-- Logs begin at Mon 2022-10-31 14:31:06 UTC, end at Mon 2022-10-31 17:01:45 UTC. -- Oct 31 15:05:44.110928 n-d-858384-17 systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 15:05:44.118307 n-d-858384-17 devstack@n-api.service[104770]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 15:05:44.120878 n-d-858384-17 devstack@n-api.service[104770]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 15:05:44 2022] *** Oct 31 15:05:44.120878 n-d-858384-17 devstack@n-api.service[104770]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 15:05:44.120878 n-d-858384-17 devstack@n-api.service[104770]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 15:05:44.120878 n-d-858384-17 devstack@n-api.service[104770]: nodename: n-d-858384-17 Oct 31 15:05:44.120878 n-d-858384-17 devstack@n-api.service[104770]: machine: x86_64 Oct 31 15:05:44.121323 n-d-858384-17 devstack@n-api.service[104770]: clock source: unix Oct 31 15:05:44.121323 n-d-858384-17 devstack@n-api.service[104770]: pcre jit disabled Oct 31 15:05:44.121323 n-d-858384-17 devstack@n-api.service[104770]: detected number of CPU cores: 4 Oct 31 15:05:44.121323 n-d-858384-17 devstack@n-api.service[104770]: current working directory: / Oct 31 15:05:44.121323 n-d-858384-17 devstack@n-api.service[104770]: detected binary path: /usr/bin/uwsgi-core Oct 31 15:05:44.121323 n-d-858384-17 devstack@n-api.service[104770]: your processes number limit is 47680 Oct 31 15:05:44.121323 n-d-858384-17 devstack@n-api.service[104770]: your memory page size is 4096 bytes Oct 31 15:05:44.121323 n-d-858384-17 devstack@n-api.service[104770]: detected max file descriptor number: 2048 Oct 31 15:05:44.121323 n-d-858384-17 devstack@n-api.service[104770]: lock engine: pthread robust mutexes Oct 31 15:05:44.123042 n-d-858384-17 devstack@n-api.service[104770]: thunder lock: enabled Oct 31 15:05:44.123042 n-d-858384-17 devstack@n-api.service[104770]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 15:05:44.123042 n-d-858384-17 devstack@n-api.service[104770]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 15:05:44.161685 n-d-858384-17 devstack@n-api.service[104770]: Python main interpreter initialized at 0x5643459b29c0 Oct 31 15:05:44.161685 n-d-858384-17 devstack@n-api.service[104770]: python threads support enabled Oct 31 15:05:44.161685 n-d-858384-17 devstack@n-api.service[104770]: your server socket listen backlog is limited to 100 connections Oct 31 15:05:44.161685 n-d-858384-17 devstack@n-api.service[104770]: your mercy for graceful operations on workers is 90 seconds Oct 31 15:05:44.162074 n-d-858384-17 devstack@n-api.service[104770]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 15:05:44.162074 n-d-858384-17 devstack@n-api.service[104770]: *** Operational MODE: preforking *** Oct 31 15:05:44.162346 n-d-858384-17 devstack@n-api.service[104770]: *** uWSGI is running in multiple interpreter mode *** Oct 31 15:05:44.162346 n-d-858384-17 devstack@n-api.service[104770]: spawned uWSGI master process (pid: 104770) Oct 31 15:05:44.162547 n-d-858384-17 systemd[1]: Started Devstack devstack@n-api.service. Oct 31 15:05:44.163094 n-d-858384-17 devstack@n-api.service[104770]: spawned uWSGI worker 1 (pid: 104771, cores: 1) Oct 31 15:05:44.163435 n-d-858384-17 devstack@n-api.service[104770]: spawned uWSGI worker 2 (pid: 104772, cores: 1) Oct 31 15:05:44.163599 n-d-858384-17 devstack@n-api.service[104770]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 15:05:44.825464 n-d-858384-17 devstack@n-api.service[104772]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 15:05:44.856737 n-d-858384-17 devstack@n-api.service[104771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 15:05:45.915008 n-d-858384-17 devstack@n-api.service[104772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:05:45.915008 n-d-858384-17 devstack@n-api.service[104772]: from cryptography.utils import int_from_bytes Oct 31 15:05:45.915589 n-d-858384-17 devstack@n-api.service[104772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:05:45.915589 n-d-858384-17 devstack@n-api.service[104772]: from cryptography.utils import int_from_bytes Oct 31 15:05:45.931945 n-d-858384-17 devstack@n-api.service[104771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:05:45.931945 n-d-858384-17 devstack@n-api.service[104771]: from cryptography.utils import int_from_bytes Oct 31 15:05:45.932381 n-d-858384-17 devstack@n-api.service[104771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:05:45.932381 n-d-858384-17 devstack@n-api.service[104771]: from cryptography.utils import int_from_bytes Oct 31 15:05:48.409255 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 15:05:48.409815 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 15:05:48.410027 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 15:05:48.410390 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 15:05:48.410644 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 15:05:48.411026 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.411350 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.411670 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.411763 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 15:05:48.412110 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 15:05:48.412190 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.412301 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.412460 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 15:05:48.412610 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.412819 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 15:05:48.412929 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.413071 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 15:05:48.413269 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.413475 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.413594 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.413798 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.413905 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.414116 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.414223 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.414427 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.414514 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-17 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.414755 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.414860 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.415057 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.415143 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.415365 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.415457 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.415675 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.415760 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.415974 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.416059 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.416251 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.416337 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.416563 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.416662 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.417001 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-17 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.417308 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.417627 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.417754 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.417956 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.418087 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.418268 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.418382 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.418589 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.418714 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.418894 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.418989 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.419215 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.419360 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.419520 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.419650 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.419850 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.420027 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.420173 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.420336 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.420481 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.420640 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.420872 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-17 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.421011 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.421208 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.421312 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.421523 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.421616 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.421834 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.421926 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.422193 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.422287 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.422500 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.422585 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.422821 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.422915 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.423127 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.423230 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.423460 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.423563 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-17 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.423771 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.423858 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.424112 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.424255 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.424400 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.424497 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.424731 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.424875 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.425037 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.425145 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.425365 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.425461 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.425674 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.425759 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.425982 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.426068 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.426300 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.426389 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.426604 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.426691 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.426907 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.427001 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.427159 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.427244 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.427457 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.427544 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.427774 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.427872 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.428095 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.428182 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.428413 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.428564 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.428655 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.428749 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.428901 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.428996 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.429246 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.429348 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.429562 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.429655 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.429867 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.429951 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.430172 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.430265 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.430478 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.430568 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.430784 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.430871 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.431030 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.431127 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.431279 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.431367 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.431596 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.431683 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.431911 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.432078 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.432216 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.432303 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.433104 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.433234 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.433570 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.433698 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.434072 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.434170 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.434383 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.434469 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.434692 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.434789 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.435001 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.435087 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.435307 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.435392 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.435626 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.435723 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.435937 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.436035 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.436250 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.436336 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.436561 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.436647 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.436878 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.436962 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.437214 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.437305 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.437526 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.437615 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.437829 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.437913 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.438151 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.438237 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.438469 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.438554 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.438774 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.438859 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.439022 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.439108 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.439322 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.439417 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.439628 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.439713 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.439945 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.440039 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.440250 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.440335 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.440555 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.440645 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.440858 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.440953 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.441178 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.441279 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.441431 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.441523 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.441730 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.441826 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.442030 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.442137 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.442345 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.442431 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.442648 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.442743 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.442952 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.443054 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.443254 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.443349 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.443550 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.443650 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.443851 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.443935 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.444149 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.444240 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.444449 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.444536 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.444751 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.444845 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.445052 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.445157 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.445379 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.445475 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.445680 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.445766 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.445982 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.446065 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.446283 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.446375 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.446588 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.446682 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.446889 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.446972 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.447203 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.447327 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.447505 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.447597 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.447806 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.447905 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.448669 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.448772 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.449203 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.449371 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.449603 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.449691 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.449930 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.450061 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.450235 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.450321 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.450544 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.450672 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.450861 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.450950 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.451169 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.451255 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.451477 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.451562 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.451781 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.451874 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.452083 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.452167 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.452387 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.452481 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.452685 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.452772 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.452984 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.453070 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.453311 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.453419 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.453611 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.453703 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.453914 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.454008 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.454214 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.454309 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.454515 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.454600 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.454813 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.454907 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.455114 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.455213 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.455414 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.455500 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.455713 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.455800 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.456008 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.456096 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.456323 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.456408 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.456647 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.456731 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.456959 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.457092 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.457281 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.457374 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.457583 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.457670 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.457897 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:05:48.457993 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.458227 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.458315 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.458557 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.458653 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.458870 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.458962 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.459181 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.459266 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.459491 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.459585 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.459810 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.459906 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.460130 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.460288 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.460422 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.460635 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.460780 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.460911 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.461054 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.461231 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.461377 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.461479 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.461687 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.461774 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.461994 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.462078 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.462309 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.462403 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.462623 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.462754 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.462930 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.463015 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.463252 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.463345 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.463565 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.463652 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.463995 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.464080 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.464455 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.464550 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.464782 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.464909 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.465102 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.465301 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.465443 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.465573 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.465758 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.465883 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.466103 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.466225 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.466419 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.466570 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.466736 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.466884 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.467055 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.467207 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.467370 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.467525 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.467695 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.467834 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.468012 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.468142 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.468324 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.468449 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.468639 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.468787 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.468951 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.469099 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.469303 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.469432 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.469639 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.469739 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.469957 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.470057 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.470280 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.470366 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.470597 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.470692 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.470913 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.471018 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.471228 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.471314 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.471534 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.471618 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.471844 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.471939 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.472153 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.472237 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.472458 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.472552 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.472761 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.472859 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.473066 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.473180 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.473401 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.473485 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.473704 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.473790 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.474013 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.474105 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.474322 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.474415 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.474630 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.474718 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.474933 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.475027 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.475233 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.475358 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.475535 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.475630 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.475842 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.475928 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.476143 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.476229 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.476448 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.476534 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.476766 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.476852 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.477071 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.477187 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.477402 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.477496 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.477716 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.477811 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.478025 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.478120 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.478331 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.478415 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.478636 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.478720 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.478937 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.479039 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.479244 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.479348 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.479623 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.479726 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.479938 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.480169 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.480257 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.480498 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.480587 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.480812 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.480982 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.481115 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.481231 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.481458 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.481544 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.481763 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.481863 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.482066 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.482152 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.482379 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.482465 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.482690 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.482785 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.483000 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.483085 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.483309 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.483402 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.483616 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.483712 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.483918 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.484003 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.484229 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.484315 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.484534 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.484621 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.484836 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.484928 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.485155 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.485256 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.485470 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.485559 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.485772 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.485858 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.486076 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.486162 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.486381 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.486469 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.486685 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.486772 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.486994 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.487091 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.487295 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.487380 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.487599 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.487686 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.487902 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.487997 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.488206 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.488291 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.488504 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.488602 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.488804 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.488899 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.489104 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.489249 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.489428 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.489515 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.489730 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.489830 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.490049 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.490135 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.490355 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.490476 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.490656 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.490744 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.490956 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.491041 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.491255 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.491339 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.491598 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.491686 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.491902 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.491988 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.492210 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.492293 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.492527 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.492613 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.492839 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.492933 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.493182 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.493273 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.493494 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.493581 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.493810 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.493895 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.494117 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.494209 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.494426 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.494511 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.494727 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.494811 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.495556 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.495754 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.495884 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.496149 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.496244 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.496475 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.496570 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.496800 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.496887 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.497122 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.497233 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.497461 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.497545 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.498038 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.498141 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.498358 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.498444 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.498667 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.498751 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.498979 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.499066 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.499300 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.499387 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.499612 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.499710 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.499931 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.500017 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.500243 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.500337 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.500553 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.500651 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.500863 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.500948 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.501192 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.501282 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.501502 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.501601 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.501810 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.501895 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.502118 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.502205 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.502435 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.502534 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.502744 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.502839 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.503054 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.503148 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.503360 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.503464 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.503670 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.503754 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.503976 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.504071 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.504286 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.504379 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.504586 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.504671 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.504890 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.504976 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.505226 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.505316 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.505596 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.505697 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.505851 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.505937 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.506159 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.506256 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.506463 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.506549 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.506774 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.506868 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.507079 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.507174 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.507383 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.507469 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.507686 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.507780 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.507988 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.508080 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.508296 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.508382 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.508610 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.508705 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.508919 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.509005 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.509259 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.509351 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.509564 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.509663 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.509868 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.509973 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.510177 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.510266 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.510482 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.510627 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.511511 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.511606 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.511833 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.512053 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.512160 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.512385 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.512472 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.512704 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.512791 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.513033 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.513147 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.513387 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.513474 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.513699 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.513784 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.514008 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.514179 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.514325 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.514412 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.514636 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.514727 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.514945 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.515040 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.515250 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.515342 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.515559 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.515672 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.515870 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.515969 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.516179 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.516269 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.516490 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.516577 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.516799 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.516894 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.517109 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.517219 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.517451 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.517536 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.517762 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.517857 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.518070 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.518155 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.518381 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.518472 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.518685 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.518773 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.518994 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.519081 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.519302 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.519396 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.519613 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.519882 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.519978 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.520210 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.520299 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.520515 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.520602 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.520838 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.520924 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.521164 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.521308 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.521480 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.521581 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.521791 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.521884 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.522094 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.522181 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.522404 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.522503 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.522720 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.522807 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.523053 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.523283 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.523377 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.523620 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.523709 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.523937 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.524023 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.524242 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.524325 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.524549 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.524637 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.524854 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.524949 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.525185 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.525274 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.525495 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.525594 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.525803 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.525904 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.526112 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.526275 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.526443 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.526679 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.526766 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.527051 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.527138 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.527366 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.527461 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.527673 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.527760 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.528000 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.528084 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.528309 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.528408 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.528614 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.528700 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.528919 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.529003 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.529250 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.529352 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.529557 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.529644 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.529862 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.529948 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.530167 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.530256 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.530481 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.530569 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.530785 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.530871 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.531097 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.531186 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.531401 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.531502 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.531720 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.531808 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.532029 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.532118 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.532332 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.532418 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.532633 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.532718 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.532936 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.533024 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.533272 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.533359 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.533579 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.533678 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.533892 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.533994 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.534196 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.534286 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.534509 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.534607 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.534819 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.534907 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.535122 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.535208 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.535434 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.535529 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.535734 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.535820 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.536038 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.536148 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.536342 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.536451 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.536640 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.536726 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.536942 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.537029 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.537275 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.537365 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.537583 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.537680 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.537886 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.537979 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.538195 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.538282 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.538498 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.538584 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.538796 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.538880 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.539104 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.539191 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.539405 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.539490 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.539706 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.539790 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.540013 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.540100 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.540315 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.540402 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.540614 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.540707 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.540918 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.541003 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.541249 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.541350 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.541552 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.541654 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.541920 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.542031 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.542191 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.542451 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.542537 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.542781 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.542869 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.543086 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.543170 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.543391 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.543477 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.543696 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.543784 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.543998 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.544082 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.544305 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.544400 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.544606 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.544691 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.544911 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.544997 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.545240 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.545349 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.545544 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.545629 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.545843 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.545927 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.546153 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.546281 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.546451 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.546554 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.546749 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.546837 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.547050 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.547145 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.547374 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.547468 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.547680 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.547764 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.547980 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.548065 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.548282 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.548365 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.548582 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.548667 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.548883 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.548970 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.549209 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.549299 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.549548 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.549658 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.549819 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.549906 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.550120 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.550218 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.550420 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.550514 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.550721 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.550814 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.551022 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.551107 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.551340 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.551434 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.551650 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.551747 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.551951 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.552037 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.552253 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.552347 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.552554 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.552640 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.552854 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.552945 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.553179 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.553283 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.553503 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.553589 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.553815 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.553900 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.554126 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.554221 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.554445 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.554529 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.554757 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.554842 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.555066 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.555160 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.555372 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.555455 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.555671 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.555755 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.555982 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.556069 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.556290 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.556397 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.556595 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.556689 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.556892 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.556978 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.557224 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.557311 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.558083 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.558178 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.558384 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.558654 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.558752 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.558976 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.559063 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.559284 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.559383 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.559595 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.559680 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.559903 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.559989 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.560208 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.560307 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.560520 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.560605 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.560832 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.560939 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.561157 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.561253 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.561465 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.561665 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.561811 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.561967 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.562124 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.562277 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.562421 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.562564 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.562714 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.562857 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.563021 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.563166 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.563309 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.563451 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.563594 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.563745 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.563898 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.564042 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.564186 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.564328 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.564471 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.564626 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.564780 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.564931 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.565075 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.565248 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.565393 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.565549 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.565694 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.565844 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.565989 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.566145 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.566236 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.566457 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.566553 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.566763 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.566933 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.567064 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.567231 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.567373 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.567545 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.567694 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.567856 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.568003 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.568168 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.568305 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.568478 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.568633 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.568794 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.568977 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.569108 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.569331 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.569422 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.569716 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.569837 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.570146 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.570241 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.570457 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.570583 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.570764 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.570885 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.571067 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.571180 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.571369 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.571481 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.571678 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.571799 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.572000 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.572115 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.572302 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.572416 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.572604 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.572718 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.572904 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.573825 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.573825 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.574041 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.574146 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.574414 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.574562 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.574746 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.574871 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.575060 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.575173 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.575376 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.575605 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.575725 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.575815 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.575986 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.576172 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.576308 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.576488 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.576622 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.576804 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.576949 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.577168 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.577386 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.577494 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.577711 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.577799 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.578027 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.578113 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.578349 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.578526 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.578673 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.578761 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.578976 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.579101 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.579280 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.579376 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.579591 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.579684 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.579898 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.579992 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.580199 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.580286 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.580520 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.580606 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.580821 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.580904 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.581156 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.581246 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.581461 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.581547 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.581770 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.581855 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.582074 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.582162 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.582375 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.582460 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.582696 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.582782 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.582999 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.583087 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.583318 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.583403 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.583630 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.583724 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.583950 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.584035 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.584253 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.584337 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.584559 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.584652 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.584878 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.584962 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.585217 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.585306 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.585513 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.585624 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.585819 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.585926 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.586120 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.586222 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.586422 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.586527 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.586723 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.586830 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.587042 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.587131 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.587347 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.587443 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.587668 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.587755 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.587982 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.588075 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.588301 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.588387 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.588932 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.589033 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.589033 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.589222 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.589313 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.589587 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.589688 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.589905 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.589991 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.590208 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.590301 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.590513 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.590599 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.590818 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.590902 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.591118 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.591204 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.591423 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.591516 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.591727 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.591821 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.592034 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.592120 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.592335 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.592420 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.592638 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.592730 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.592938 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.593026 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.593283 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.593374 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.593588 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.593689 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.593909 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.594003 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.594215 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.594301 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.594520 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.594643 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.594823 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.594911 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.595237 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.595321 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.595589 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.595683 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.595897 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.596016 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.596214 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.596339 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.596522 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.596670 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.596843 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.597029 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.597180 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.597341 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.597497 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.597664 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.597812 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.597979 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.598132 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.598314 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.598445 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.598627 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.598757 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.598960 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.599070 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.599275 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.599370 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.599586 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.599672 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.599897 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.599983 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.600206 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.600301 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.600555 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.600808 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.600991 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.601151 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.601469 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.601574 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.601782 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.601868 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.602093 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.602181 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.602406 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.602494 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.602718 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.602804 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.603027 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.603115 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.603338 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.603424 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.603647 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.603741 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.603956 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.604043 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.604426 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.604530 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.604645 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.604733 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.605042 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.605170 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.605390 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.605477 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.605709 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.605808 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.606027 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.606259 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.606348 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.606593 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.606714 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.606909 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.607015 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.607224 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.607327 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.607533 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.607620 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.607848 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.608007 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.608159 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.608255 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.608469 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.608555 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.608779 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.608874 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.609086 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.609246 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.609419 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.609512 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.609731 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.609826 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.610042 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.610200 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.610354 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.610439 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.610666 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.610754 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.610978 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.611065 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.611287 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.611372 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.611598 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.611685 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.611909 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.611994 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.612231 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.612315 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.612545 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.612632 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.612845 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.612929 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.613176 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.613394 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.613483 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.613712 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.613800 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.614045 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.614130 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.614368 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.614455 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.614675 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.614760 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.614983 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.615080 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.615294 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.615381 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.615600 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.615687 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.615907 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.616001 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.616210 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.616297 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.616521 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.616615 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.616834 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.616945 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.617209 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.617340 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.617474 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.617558 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.617782 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.617880 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.618092 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.618177 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.618408 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.618609 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.618706 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.618927 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.619239 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.619326 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.619569 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.619653 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.620423 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.620521 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.620788 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.620876 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.621117 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.621257 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.621466 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.621580 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.621773 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.621887 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.622078 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.622386 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.622961 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.623262 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.623347 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.623581 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.623674 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.623891 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.623979 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.624194 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.624280 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.624512 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.624604 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.624817 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.624912 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.625167 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.625372 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.625459 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.625734 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.625879 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.626035 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.626122 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.626358 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.626453 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.626661 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.626747 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.626981 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.627078 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.627286 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.627417 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.627591 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.627691 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.627893 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.627979 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.628194 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.628282 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.628498 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.628594 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.628802 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.628887 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.629102 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.629212 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.629425 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.629521 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.629730 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.629817 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.630034 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.630120 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.630329 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.630416 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.630634 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.630720 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.630932 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.631029 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.631254 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.631342 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.631554 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.631649 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.631853 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.631949 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.632153 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.632285 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.632459 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.632545 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.632757 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.632854 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.633055 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.633165 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.633380 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.633470 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.633677 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.633774 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.633991 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.634091 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.634281 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.634379 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.634586 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.634674 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.634883 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.634970 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.635189 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.635459 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.635609 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.636469 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.636567 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.636770 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.636858 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.637088 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.637208 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.637415 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.637508 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.637716 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.637815 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.638023 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.638120 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.638326 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.638413 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.638643 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.638731 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.638953 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.639043 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.639259 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.639353 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.639576 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.639662 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.639888 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.639978 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.640202 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.640412 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.640499 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.640740 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.640840 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.641057 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.641164 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.641413 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.641500 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.641722 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.641810 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.642028 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.642114 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.642331 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.642446 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.642631 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.642722 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.642938 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.643023 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.643241 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.643325 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.643548 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.643636 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.643852 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.643938 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.644155 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.644251 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.644460 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.644559 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.644763 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.644848 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.645066 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.645196 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.645395 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.645482 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.645698 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.645793 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.646000 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.646096 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.646306 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.646392 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.646608 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.646698 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.646910 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.647005 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.647213 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.647311 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.647524 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.647860 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.647966 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.648172 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.648260 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.648482 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.648569 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.648791 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.648887 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.649103 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.649210 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.649430 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.649519 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.649749 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.649855 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.650039 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.650134 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.650342 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.650429 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.650651 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.650739 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.650972 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.651060 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.651326 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.651483 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.651627 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.651861 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.652187 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.652305 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.652497 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.652622 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.652806 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.652942 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.653111 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.653297 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.653444 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.653607 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.653765 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.653925 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.654076 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.654245 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.654381 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.654557 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.654685 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.654874 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.654994 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.655181 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.655299 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.655505 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.655594 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.655836 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.655931 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.656159 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.656261 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.656478 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.656624 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.656777 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.656863 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.657078 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.657222 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.657404 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.657492 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.657707 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.657817 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.658010 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.658169 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.658307 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.658444 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.658580 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.658709 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.658877 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.659025 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.659180 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.659358 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.659497 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.659633 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.659775 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.659918 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.660052 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.660185 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.660317 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.660457 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.660603 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.660739 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.660896 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.661031 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.661222 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.661314 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.661520 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.661608 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.661815 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.661924 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.662110 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.662233 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.662405 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.662555 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.662707 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.662875 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.663004 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.663189 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.663302 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.663497 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.663591 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.663828 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.663915 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.664137 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.664225 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.664449 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.664537 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.664760 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.664857 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.665070 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.665185 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.665403 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.665502 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.665705 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.665789 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.666019 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.666106 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.666326 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.666411 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.666639 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.667307 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.667481 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.667619 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.667874 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.667975 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.668093 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.668266 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.668412 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.668499 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.668713 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.668799 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.669018 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.669117 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.669350 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.669449 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.669654 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.669749 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.669957 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.670046 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.670259 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.670347 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.670568 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.670653 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.670883 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.670971 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.671182 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.671267 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.671492 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.671579 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.671800 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.671896 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.672113 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.672207 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.672421 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.672516 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.672724 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.672815 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.673046 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.673161 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.673374 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.673475 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.673677 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.673764 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.673981 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.674069 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.674286 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.674384 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.674588 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.674676 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.674895 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.674982 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.675198 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.675286 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.675501 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.675589 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.675808 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.675894 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.676097 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 15:05:48.676188 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.676424 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.676746 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.677050 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.677396 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.677714 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.678052 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.678360 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.678694 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.679015 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.679345 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.679629 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.679927 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:05:48.680165 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 15:05:48.829676 n-d-858384-17 devstack@n-api.service[104772]: INFO dbcounter [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Registered counter for database nova_api Oct 31 15:05:48.833680 n-d-858384-17 devstack@n-api.service[104771]: INFO dbcounter [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Registered counter for database nova_api Oct 31 15:05:48.851408 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_db.sqlalchemy.engines [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:05:48.853154 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_db.sqlalchemy.engines [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:05:48.858588 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writer thread running {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:05:48.860213 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writer thread running {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:05:48.914706 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.context [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) {{(pid=104772) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 15:05:48.917452 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.context [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) {{(pid=104771) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 15:05:48.919128 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:48.919588 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:48.921185 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:48.921280 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_concurrency.lockutils [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:48.921733 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_concurrency.lockutils [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:48.921893 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:48.922330 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:48.923312 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_concurrency.lockutils [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:48.924016 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_concurrency.lockutils [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:05:48.924291 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:48.924453 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_concurrency.lockutils [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:05:48.926279 n-d-858384-17 devstack@n-api.service[104772]: INFO dbcounter [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Registered counter for database nova_cell0 Oct 31 15:05:48.926468 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_concurrency.lockutils [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:05:48.928534 n-d-858384-17 devstack@n-api.service[104771]: INFO dbcounter [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Registered counter for database nova_cell0 Oct 31 15:05:48.930300 n-d-858384-17 devstack@n-api.service[104772]: INFO dbcounter [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Registered counter for database nova_cell1 Oct 31 15:05:48.933505 n-d-858384-17 devstack@n-api.service[104771]: INFO dbcounter [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Registered counter for database nova_cell1 Oct 31 15:05:48.938651 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_db.sqlalchemy.engines [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:05:48.939972 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_db.sqlalchemy.engines [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:05:48.941467 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_db.sqlalchemy.engines [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:05:48.944639 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_db.sqlalchemy.engines [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:05:48.946873 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writer thread running {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:05:48.951620 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writer thread running {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:05:48.953118 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writer thread running {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:05:49.087515 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writer thread running {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:05:49.096955 n-d-858384-17 devstack@n-api.service[104772]: INFO dbcounter [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Registered counter for database nova_cell0 Oct 31 15:05:49.097087 n-d-858384-17 devstack@n-api.service[104771]: INFO dbcounter [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Registered counter for database nova_cell0 Oct 31 15:05:49.104122 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_db.sqlalchemy.engines [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:05:49.108878 n-d-858384-17 devstack@n-api.service[104771]: DEBUG oslo_db.sqlalchemy.engines [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:05:49.109594 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writer thread running {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:05:49.113226 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writer thread running {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:05:49.450633 n-d-858384-17 devstack@n-api.service[104772]: WARNING keystonemiddleware.auth_token [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:05:49.454262 n-d-858384-17 devstack@n-api.service[104771]: WARNING keystonemiddleware.auth_token [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:05:49.457919 n-d-858384-17 devstack@n-api.service[104772]: WARNING keystonemiddleware.auth_token [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:05:49.461490 n-d-858384-17 devstack@n-api.service[104771]: WARNING keystonemiddleware.auth_token [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:05:49.803458 n-d-858384-17 devstack@n-api.service[104772]: WARNING keystonemiddleware.auth_token [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:05:49.809514 n-d-858384-17 devstack@n-api.service[104772]: WARNING keystonemiddleware.auth_token [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:05:49.812390 n-d-858384-17 devstack@n-api.service[104771]: WARNING keystonemiddleware.auth_token [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:05:49.814814 n-d-858384-17 devstack@n-api.service[104772]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643459b29c0 pid: 104772 (default app) Oct 31 15:05:49.816872 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:05:49.818062 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Oct 31 15:05:49.818350 n-d-858384-17 devstack@n-api.service[104771]: WARNING keystonemiddleware.auth_token [None req-d907da4a-fffe-41b1-b502-6181393adefa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:05:49.818475 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Oct 31 15:05:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:05:49.824024 n-d-858384-17 devstack@n-api.service[104771]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643459b29c0 pid: 104771 (default app) Oct 31 15:07:11.541932 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:11.543530 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Oct 31 15:07:11.549210 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:11.561050 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writing DB stats nova_api:SELECT=3 {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:11.563002 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writing DB stats nova_cell0:SELECT=3 {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:11.564046 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writing DB stats nova_cell1:SELECT=3 {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:11.565082 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:12.448166 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-fecf5a99-f5da-4db1-bcd5-b3f204870764 admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:12.481454 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-fecf5a99-f5da-4db1-bcd5-b3f204870764 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.930252 Oct 31 15:07:12.482362 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 31 15:07:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:15.123251 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:15.124260 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-0da0fc78-b352-418c-9b1c-8a0ada3620ff None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 31 15:07:15.124816 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:15.585086 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-3f1bbbf2-09b6-47d1-a647-657e4d832310 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:15.634305 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-3f1bbbf2-09b6-47d1-a647-657e4d832310 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.503616 Oct 31 15:07:15.634858 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:07:15.649376 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats nova_api:SELECT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:15.650185 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats nova_cell1:SELECT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:15.652130 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats nova_cell0:SELECT=3 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:15.652866 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:15.859209 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-e301a627-9107-4096-90a2-6e678496f9a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:15.931169 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-e301a627-9107-4096-90a2-6e678496f9a0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287740 Oct 31 15:07:15.931762 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 31 15:07:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:18.568337 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-3f1bbbf2-09b6-47d1-a647-657e4d832310 admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:18.570516 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-3f1bbbf2-09b6-47d1-a647-657e4d832310 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002624 Oct 31 15:07:18.571104 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:19.423472 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-23943c92-fe5b-4c2d-a7cd-7d294ee30999 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M"}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:19.477978 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-23943c92-fe5b-4c2d-a7cd-7d294ee30999 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.899978 Oct 31 15:07:19.479224 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:07:19.496958 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-2e57869a-fb0a-4968-8b7d-8dd660e8922a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:19.547315 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-2e57869a-fb0a-4968-8b7d-8dd660e8922a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057257 Oct 31 15:07:19.548238 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 31 15:07:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:22.504160 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-23943c92-fe5b-4c2d-a7cd-7d294ee30999 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:22.505239 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-23943c92-fe5b-4c2d-a7cd-7d294ee30999 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 31 15:07:22.514484 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:22.992225 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-1cc3b026-13f9-4954-9cfb-cceb5e6e9a15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "disk": 10}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:23.012216 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-1cc3b026-13f9-4954-9cfb-cceb5e6e9a15 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500430 Oct 31 15:07:23.017673 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:07:23.025677 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-8c4de131-1b92-470d-ace2-577f44046862 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:23.054031 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-8c4de131-1b92-470d-ace2-577f44046862 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032878 Oct 31 15:07:23.054746 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 31 15:07:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:25.711962 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-1cc3b026-13f9-4954-9cfb-cceb5e6e9a15 admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:25.712980 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-1cc3b026-13f9-4954-9cfb-cceb5e6e9a15 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 31 15:07:25.713415 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:26.187657 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-ea42f92d-e2fd-4be0-963b-e1b8f7fa253b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:26.210933 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-ea42f92d-e2fd-4be0-963b-e1b8f7fa253b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491501 Oct 31 15:07:26.211482 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:07:26.223631 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-d3faf0dc-d3ef-4acf-abd6-be91404dee5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:26.256475 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-d3faf0dc-d3ef-4acf-abd6-be91404dee5d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035662 Oct 31 15:07:26.257475 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 31 15:07:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:29.039860 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-ea42f92d-e2fd-4be0-963b-e1b8f7fa253b admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:29.041512 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-ea42f92d-e2fd-4be0-963b-e1b8f7fa253b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 Oct 31 15:07:29.052086 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:29.504134 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-bdfa92c2-72b6-486e-be49-de51790f0c09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 4, "name": "ds4G"}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:29.525289 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-bdfa92c2-72b6-486e-be49-de51790f0c09 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477080 Oct 31 15:07:29.525984 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:07:29.538469 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-880106c5-d2d5-4fda-9413-72fd6476a50d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:29.568443 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-880106c5-d2d5-4fda-9413-72fd6476a50d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033553 Oct 31 15:07:29.569338 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Oct 31 15:07:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:32.245526 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-bdfa92c2-72b6-486e-be49-de51790f0c09 admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:32.246517 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-bdfa92c2-72b6-486e-be49-de51790f0c09 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 31 15:07:32.249304 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:32.694617 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-930d7f45-233a-4322-a821-76ef8e5558f4 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:32.731390 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-930d7f45-233a-4322-a821-76ef8e5558f4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.478079 Oct 31 15:07:32.732328 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 31 15:07:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:07:35.406462 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-bdfa92c2-72b6-486e-be49-de51790f0c09 admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:35.407534 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-bdfa92c2-72b6-486e-be49-de51790f0c09 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 31 15:07:35.407923 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:35.897647 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-a778d0b9-6c65-46be-a3df-781a686fa9f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:35.918370 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-a778d0b9-6c65-46be-a3df-781a686fa9f0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.503846 Oct 31 15:07:35.918908 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:07:35.933712 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-e183e5e0-6c89-4326-a202-317a8e9295be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:35.968026 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-e183e5e0-6c89-4326-a202-317a8e9295be admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039793 Oct 31 15:07:35.968622 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 31 15:07:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:07:38.630358 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-a778d0b9-6c65-46be-a3df-781a686fa9f0 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:38.631363 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-a778d0b9-6c65-46be-a3df-781a686fa9f0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001680 Oct 31 15:07:38.631763 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:39.049898 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-90565a80-4b42-4dd4-a278-1389a5ec777e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:39.071297 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-90565a80-4b42-4dd4-a278-1389a5ec777e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433347 Oct 31 15:07:39.071965 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:07:39.085423 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-dafe6056-cc11-453c-adbc-373b222c99bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:39.110604 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-dafe6056-cc11-453c-adbc-373b222c99bb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030236 Oct 31 15:07:39.111172 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 31 15:07:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:41.780370 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-90565a80-4b42-4dd4-a278-1389a5ec777e admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:41.781400 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-90565a80-4b42-4dd4-a278-1389a5ec777e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 31 15:07:41.781807 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:42.154438 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-86a07563-b18e-420d-8257-7204d22473a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "3", "vcpus": 2, "name": "m1.medium"}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:42.176185 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-86a07563-b18e-420d-8257-7204d22473a2 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.388026 Oct 31 15:07:42.177245 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:07:42.190457 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-408ee24a-9b5f-4d2c-9f80-163ccd02b1af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:42.197341 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:42.218015 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-408ee24a-9b5f-4d2c-9f80-163ccd02b1af admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032436 Oct 31 15:07:42.218680 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 31 15:07:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:44.922536 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-86a07563-b18e-420d-8257-7204d22473a2 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:44.924159 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-86a07563-b18e-420d-8257-7204d22473a2 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002071 Oct 31 15:07:44.924738 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:45.403775 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-1db504df-d7b8-4e46-b53f-ca5556365d82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "name": "m1.large", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:45.424230 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-1db504df-d7b8-4e46-b53f-ca5556365d82 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.491207 Oct 31 15:07:45.424230 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:07:45.436318 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-7cf4c810-ff16-474a-a578-0442ac1b36a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:45.463443 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-7cf4c810-ff16-474a-a578-0442ac1b36a4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030536 Oct 31 15:07:45.464042 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 31 15:07:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:07:48.102575 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-1db504df-d7b8-4e46-b53f-ca5556365d82 admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:07:48.103574 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-1db504df-d7b8-4e46-b53f-ca5556365d82 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 31 15:07:48.104238 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:07:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:07:48.595302 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-b052ba88-d2b0-4a23-9d11-c5c826b38f96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "vcpus": 8}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:48.605474 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:07:48.622510 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-b052ba88-d2b0-4a23-9d11-c5c826b38f96 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.507901 Oct 31 15:07:48.623068 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Oct 31 15:07:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:07:48.635638 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-5a8f25ac-ead9-4ff4-b51b-e1b5f89301a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:07:48.667481 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-5a8f25ac-ead9-4ff4-b51b-e1b5f89301a9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035473 Oct 31 15:07:48.669176 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Oct 31 15:07:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:08:09.980072 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-b052ba88-d2b0-4a23-9d11-c5c826b38f96 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:09.981285 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-b052ba88-d2b0-4a23-9d11-c5c826b38f96 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 31 15:08:09.981708 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:08:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:09.992988 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:08:10.374989 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-451cb894-27d6-41c5-8e8c-2b8c48859f31 admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:10.393657 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-451cb894-27d6-41c5-8e8c-2b8c48859f31 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405939 Oct 31 15:08:10.394197 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 31 15:08:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:08:11.689695 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-b052ba88-d2b0-4a23-9d11-c5c826b38f96 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:11.690681 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-b052ba88-d2b0-4a23-9d11-c5c826b38f96 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 31 15:08:11.691067 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:08:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:12.225783 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-58506f59-226c-494b-a0c2-1033bbc29fe2 admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:12.231053 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.wsgi [None req-58506f59-226c-494b-a0c2-1033bbc29fe2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-58506f59-226c-494b-a0c2-1033bbc29fe2 admin admin] Request method failure captured: Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: Accept: application/json Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: Accept-Encoding: gzip, deflate Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: Connection: keep-alive Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: Content-Length: 0 Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: Host: 10.222.0.20 Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: Openstack-Api-Version: compute 2.92 Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: Openstack-System-Scope: None Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: User-Agent: python-novaclient Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Auth-Token: gAAAAABjX-TbB69GPTRMVOZU4hdcqvd3BvzTNrLT3swxAUBeACqty4ssjlA1EjlyZ6IrHLxMYswxR0T5xiBkzz4r1gFMS6GSBlWJGj9TVy-3h57Ko2J5KU-ZruGKv558Vy_uggiY0f9uc4oL4AuADRz_xNPkISs-gkbkgGUo7zsRhkkenRpg0-g Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Domain-Id: None Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Domain-Name: None Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Identity-Status: Confirmed Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Is-Admin-Project: True Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Domain-Id: default Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Domain-Name: Default Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Name: admin Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Role: reader,member,admin Oct 31 15:08:12.234315 n-d-858384-17 devstack@n-api.service[104771]: X-Roles: reader,member,admin Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f64f28aba1c41899d88d3decd8274f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f64f28aba1c41899d88d3decd8274f7"}]}] Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: X-Tenant: admin Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: X-Tenant-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: X-Tenant-Name: admin Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: X-User: admin Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: X-User-Domain-Id: default Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: X-User-Domain-Name: Default Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: X-User-Id: 89c0c2b58a73448a815a33c45597abbd Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: X-User-Name: admin Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: method: > Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: exception: Flavor 42 could not be found. Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: action_args: {'id': '42'} Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:12.235974 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:12.237319 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.238714 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-58506f59-226c-494b-a0c2-1033bbc29fe2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:12.240471 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-58506f59-226c-494b-a0c2-1033bbc29fe2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398194 Oct 31 15:08:12.240471 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 31 15:08:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:12.246519 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-bb9d0012-cfef-4395-bbb7-7c8595229f43 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:12.269053 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-bb9d0012-cfef-4395-bbb7-7c8595229f43 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026654 Oct 31 15:08:12.269679 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 31 15:08:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:08:12.281297 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-da65b321-6616-4e2c-980d-aec9aa8122cb admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:12.303656 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-da65b321-6616-4e2c-980d-aec9aa8122cb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026973 Oct 31 15:08:12.304183 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 31 15:08:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:08:12.313483 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-f6e8ec66-44c3-4477-b218-69dc60d2a28a admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:12.319241 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.wsgi [None req-f6e8ec66-44c3-4477-b218-69dc60d2a28a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-f6e8ec66-44c3-4477-b218-69dc60d2a28a admin admin] Request method failure captured: Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: Accept: application/json Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: Accept-Encoding: gzip, deflate Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: Connection: keep-alive Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: Content-Length: 0 Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: Host: 10.222.0.20 Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: Openstack-Api-Version: compute 2.92 Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: Openstack-System-Scope: None Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: User-Agent: python-novaclient Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Auth-Token: gAAAAABjX-TbB69GPTRMVOZU4hdcqvd3BvzTNrLT3swxAUBeACqty4ssjlA1EjlyZ6IrHLxMYswxR0T5xiBkzz4r1gFMS6GSBlWJGj9TVy-3h57Ko2J5KU-ZruGKv558Vy_uggiY0f9uc4oL4AuADRz_xNPkISs-gkbkgGUo7zsRhkkenRpg0-g Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Domain-Id: None Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Domain-Name: None Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Identity-Status: Confirmed Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Is-Admin-Project: True Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Domain-Id: default Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Domain-Name: Default Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Name: admin Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Role: reader,member,admin Oct 31 15:08:12.322434 n-d-858384-17 devstack@n-api.service[104772]: X-Roles: reader,member,admin Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f64f28aba1c41899d88d3decd8274f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f64f28aba1c41899d88d3decd8274f7"}]}] Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: X-Tenant: admin Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: X-Tenant-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: X-Tenant-Name: admin Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: X-User: admin Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: X-User-Domain-Id: default Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: X-User-Domain-Name: Default Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: X-User-Id: 89c0c2b58a73448a815a33c45597abbd Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: X-User-Name: admin Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: method: > Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: exception: Flavor 42 could not be found. Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: action_args: {'id': '42'} Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:12.323953 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:12.325159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:12.326464 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-f6e8ec66-44c3-4477-b218-69dc60d2a28a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:12.327667 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-f6e8ec66-44c3-4477-b218-69dc60d2a28a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013870 Oct 31 15:08:12.327667 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 31 15:08:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 31 15:08:13.539413 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-da65b321-6616-4e2c-980d-aec9aa8122cb admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:13.540450 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-da65b321-6616-4e2c-980d-aec9aa8122cb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 31 15:08:13.540845 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:08:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:14.066813 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-8e96a824-8d84-441e-aefd-04a0d52a966f admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:14.071903 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.wsgi [None req-8e96a824-8d84-441e-aefd-04a0d52a966f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-8e96a824-8d84-441e-aefd-04a0d52a966f admin admin] Request method failure captured: Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: Accept: application/json Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: Accept-Encoding: gzip, deflate Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: Connection: keep-alive Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: Content-Length: 0 Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: Host: 10.222.0.20 Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: Openstack-Api-Version: compute 2.92 Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: Openstack-System-Scope: None Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: User-Agent: python-novaclient Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Auth-Token: gAAAAABjX-TduAMK7-rSwqP5422FHuJ4_PAZk9Z7KxyYKkTj_B_DBtdgLZZvZJGP56BnKLOvRhQ6JXGq5EXL4R3QnAvo5QMU2L5N_ABNQDnu5-r25v2vIuuZSEGATuU4nzUkns5GahCBLrrml1YXhob_QXMpp4q3WcTmzXDw9ErE1y8orf_aYmI Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Domain-Id: None Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Domain-Name: None Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Identity-Status: Confirmed Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Is-Admin-Project: True Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Domain-Id: default Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Domain-Name: Default Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Name: admin Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Role: reader,member,admin Oct 31 15:08:14.073431 n-d-858384-17 devstack@n-api.service[104772]: X-Roles: reader,member,admin Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f64f28aba1c41899d88d3decd8274f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f64f28aba1c41899d88d3decd8274f7"}]}] Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: X-Tenant: admin Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: X-Tenant-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: X-Tenant-Name: admin Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: X-User: admin Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: X-User-Domain-Id: default Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: X-User-Domain-Name: Default Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: X-User-Id: 89c0c2b58a73448a815a33c45597abbd Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: X-User-Name: admin Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: method: > Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: exception: Flavor 84 could not be found. Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: action_args: {'id': '84'} Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:14.074983 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:14.075995 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.077159 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-8e96a824-8d84-441e-aefd-04a0d52a966f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:14.078198 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-8e96a824-8d84-441e-aefd-04a0d52a966f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.395908 Oct 31 15:08:14.078198 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 31 15:08:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:14.084902 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-e9b3490f-3115-42ec-8500-c3b0403268ea admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:14.100645 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-e9b3490f-3115-42ec-8500-c3b0403268ea admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019903 Oct 31 15:08:14.101194 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 31 15:08:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:08:14.110500 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-acea592d-b129-42ae-b76f-32e54114c32e admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:14.126575 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-acea592d-b129-42ae-b76f-32e54114c32e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019559 Oct 31 15:08:14.127087 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 31 15:08:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:08:14.136703 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-72c22be1-02fb-41ad-9995-5cf9f7a26254 admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:14.141659 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.wsgi [None req-72c22be1-02fb-41ad-9995-5cf9f7a26254 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-72c22be1-02fb-41ad-9995-5cf9f7a26254 admin admin] Request method failure captured: Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: Accept: application/json Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: Accept-Encoding: gzip, deflate Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: Connection: keep-alive Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: Content-Length: 0 Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: Host: 10.222.0.20 Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: Openstack-Api-Version: compute 2.92 Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: Openstack-System-Scope: None Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: User-Agent: python-novaclient Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Auth-Token: gAAAAABjX-TduAMK7-rSwqP5422FHuJ4_PAZk9Z7KxyYKkTj_B_DBtdgLZZvZJGP56BnKLOvRhQ6JXGq5EXL4R3QnAvo5QMU2L5N_ABNQDnu5-r25v2vIuuZSEGATuU4nzUkns5GahCBLrrml1YXhob_QXMpp4q3WcTmzXDw9ErE1y8orf_aYmI Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Domain-Id: None Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Domain-Name: None Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Identity-Status: Confirmed Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Is-Admin-Project: True Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Domain-Id: default Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Domain-Name: Default Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Name: admin Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Role: reader,member,admin Oct 31 15:08:14.143133 n-d-858384-17 devstack@n-api.service[104771]: X-Roles: reader,member,admin Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f64f28aba1c41899d88d3decd8274f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f64f28aba1c41899d88d3decd8274f7"}]}] Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: X-Tenant: admin Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: X-Tenant-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: X-Tenant-Name: admin Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: X-User: admin Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: X-User-Domain-Id: default Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: X-User-Domain-Name: Default Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: X-User-Id: 89c0c2b58a73448a815a33c45597abbd Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: X-User-Name: admin Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: method: > Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: exception: Flavor 84 could not be found. Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: action_args: {'id': '84'} Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:14.144719 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:14.145678 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:14.147583 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-72c22be1-02fb-41ad-9995-5cf9f7a26254 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:14.148773 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-72c22be1-02fb-41ad-9995-5cf9f7a26254 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011335 Oct 31 15:08:14.148773 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 31 15:08:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:15.344611 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-acea592d-b129-42ae-b76f-32e54114c32e admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:15.345681 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-acea592d-b129-42ae-b76f-32e54114c32e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 31 15:08:15.346072 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:08:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:15.864615 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-49b84661-0dbf-4e60-b2d4-3bec1769718f admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:15.870808 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.wsgi [None req-49b84661-0dbf-4e60-b2d4-3bec1769718f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-49b84661-0dbf-4e60-b2d4-3bec1769718f admin admin] Request method failure captured: Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: Accept: application/json Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: Accept-Encoding: gzip, deflate Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: Connection: keep-alive Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: Content-Length: 0 Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: Host: 10.222.0.20 Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: Openstack-Api-Version: compute 2.92 Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: Openstack-System-Scope: None Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: User-Agent: python-novaclient Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Auth-Token: gAAAAABjX-Tfz4KUfz4Nn3hLurXMj353ZjlGGCo9q-LMvBILi5yBmX5-RC9_t0Ldq_Z9JisjwE9u0J3tfRziMQMK1ZehukF1A0UqFuUFFgS2LQDky4i_1qo5SJH_zVM-0Wl3A4smRquV8DRyZ4DB9wBVnVPvwGnDnd4EdjNKahDVuP9kjnPDHGc Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Domain-Id: None Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Domain-Name: None Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Identity-Status: Confirmed Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Is-Admin-Project: True Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Domain-Id: default Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Domain-Name: Default Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Project-Name: admin Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Role: reader,member,admin Oct 31 15:08:15.872280 n-d-858384-17 devstack@n-api.service[104771]: X-Roles: reader,member,admin Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f64f28aba1c41899d88d3decd8274f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f64f28aba1c41899d88d3decd8274f7"}]}] Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: X-Tenant: admin Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: X-Tenant-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: X-Tenant-Name: admin Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: X-User: admin Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: X-User-Domain-Id: default Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: X-User-Domain-Name: Default Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: X-User-Id: 89c0c2b58a73448a815a33c45597abbd Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: X-User-Name: admin Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: method: > Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: exception: Flavor 451 could not be found. Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: action_args: {'id': '451'} Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:15.873856 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:15.874825 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.876107 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-49b84661-0dbf-4e60-b2d4-3bec1769718f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:15.877414 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-49b84661-0dbf-4e60-b2d4-3bec1769718f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.388986 Oct 31 15:08:15.877414 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 31 15:08:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:15.883787 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-1407210f-cb59-4a87-a7b4-6702b14324b1 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:15.898884 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-1407210f-cb59-4a87-a7b4-6702b14324b1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019288 Oct 31 15:08:15.899399 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 31 15:08:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:08:15.908441 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:15.926681 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021643 Oct 31 15:08:15.927216 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Oct 31 15:08:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:08:15.936522 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-1844216c-b124-45b6-b98d-4391eb0fa34e admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:15.941426 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.wsgi [None req-1844216c-b124-45b6-b98d-4391eb0fa34e admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-1844216c-b124-45b6-b98d-4391eb0fa34e admin admin] Request method failure captured: Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: Accept: application/json Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: Accept-Encoding: gzip, deflate Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: Connection: keep-alive Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: Content-Length: 0 Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: Host: 10.222.0.20 Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: Openstack-Api-Version: compute 2.92 Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: Openstack-System-Scope: None Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: User-Agent: python-novaclient Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Auth-Token: gAAAAABjX-Tfz4KUfz4Nn3hLurXMj353ZjlGGCo9q-LMvBILi5yBmX5-RC9_t0Ldq_Z9JisjwE9u0J3tfRziMQMK1ZehukF1A0UqFuUFFgS2LQDky4i_1qo5SJH_zVM-0Wl3A4smRquV8DRyZ4DB9wBVnVPvwGnDnd4EdjNKahDVuP9kjnPDHGc Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Domain-Id: None Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Domain-Name: None Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Identity-Status: Confirmed Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Is-Admin-Project: True Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Openstack-Nova-Api-Version: 2.92 Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Domain-Id: default Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Domain-Name: Default Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Project-Name: admin Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Role: reader,member,admin Oct 31 15:08:15.944147 n-d-858384-17 devstack@n-api.service[104772]: X-Roles: reader,member,admin Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f64f28aba1c41899d88d3decd8274f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f64f28aba1c41899d88d3decd8274f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f64f28aba1c41899d88d3decd8274f7"}]}] Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: X-Tenant: admin Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: X-Tenant-Id: 5f64f28aba1c41899d88d3decd8274f7 Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: X-Tenant-Name: admin Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: X-User: admin Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: X-User-Domain-Id: default Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: X-User-Domain-Name: Default Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: X-User-Id: 89c0c2b58a73448a815a33c45597abbd Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: X-User-Name: admin Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: method: > Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: exception: Flavor 451 could not be found. Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: action_args: {'id': '451'} Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:08:15.946907 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:15.948405 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: ERROR nova.api.openstack.wsgi Oct 31 15:08:15.950719 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-1844216c-b124-45b6-b98d-4391eb0fa34e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:08:15.952495 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-1844216c-b124-45b6-b98d-4391eb0fa34e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013091 Oct 31 15:08:15.952495 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 31 15:08:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:08:17.155084 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:17.156076 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 31 15:08:17.156459 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:08:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:17.678707 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-944f4d6d-7f5b-4632-a855-429e069d8fd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:17.698099 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-944f4d6d-7f5b-4632-a855-429e069d8fd0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.403331 Oct 31 15:08:17.698635 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 31 15:08:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:08:18.907665 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:18.908735 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 31 15:08:18.909237 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:19.432828 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-b5a64b4f-422b-44ed-a8bf-498c715bb373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:19.451041 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-b5a64b4f-422b-44ed-a8bf-498c715bb373 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.401207 Oct 31 15:08:19.451583 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 31 15:08:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:08:20.673348 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:20.674358 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 31 15:08:20.674757 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:21.191686 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-5f621db3-9baa-43e5-8f11-98900ef52e34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:21.216454 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-5f621db3-9baa-43e5-8f11-98900ef52e34 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.403105 Oct 31 15:08:21.216997 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 31 15:08:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:08:22.426474 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:22.428165 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Oct 31 15:08:22.428588 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:08:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:22.953768 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-d229d865-0a3e-4966-b42e-9aa414b47e15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:08:22.972697 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-d229d865-0a3e-4966-b42e-9aa414b47e15 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405964 Oct 31 15:08:22.973264 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Oct 31 15:08:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:08:24.177678 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:24.178671 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Oct 31 15:08:24.179062 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:08:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:08:24.699501 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-03ab126b-b2ae-4fe8-be1a-b6d3a2eddd37 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:08:24.719640 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-03ab126b-b2ae-4fe8-be1a-b6d3a2eddd37 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402882 Oct 31 15:08:24.720174 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Oct 31 15:08:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:09:21.541868 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:21.542893 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-2a83305f-53bd-457e-a16a-44cdd8eaad4c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 31 15:09:21.543337 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Mon Oct 31 15:09:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:09:21.554610 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:21.934161 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-2bdacbf7-f809-4b77-96f3-4a932b16d928 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:21.954245 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-2bdacbf7-f809-4b77-96f3-4a932b16d928 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404908 Oct 31 15:09:21.954852 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 31 15:09:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:09:21.976844 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writing DB stats nova_api:SELECT=14 {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:09:21.980883 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-1a6905ee-f652-448a-a54f-d314164600fc admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:21.988132 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-1a6905ee-f652-448a-a54f-d314164600fc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012704 Oct 31 15:09:21.988653 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Oct 31 15:09:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:22.000744 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-4a08b425-bece-4eb7-8430-15dc3bda362d admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:22.008082 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-4a08b425-bece-4eb7-8430-15dc3bda362d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010934 Oct 31 15:09:22.008593 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Oct 31 15:09:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:09:22.020402 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-dbdcb0d8-2484-428c-bb30-e3c4e1e519ba admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:22.027596 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-dbdcb0d8-2484-428c-bb30-e3c4e1e519ba admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011262 Oct 31 15:09:22.028104 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Oct 31 15:09:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:09:22.039916 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-7dfde1ba-e86b-4004-8df1-f2dc0d462bbf admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:09:22.047032 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-7dfde1ba-e86b-4004-8df1-f2dc0d462bbf admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010641 Oct 31 15:09:22.047541 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Oct 31 15:09:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:14:34.094914 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-dbdcb0d8-2484-428c-bb30-e3c4e1e519ba admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.095946 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-dbdcb0d8-2484-428c-bb30-e3c4e1e519ba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 31 15:14:34.096331 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:34.236696 n-d-858384-17 devstack@n-api.service[104772]: DEBUG dbcounter [-] [104772] Writing DB stats nova_api:SELECT=6 {{(pid=104772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:14:34.376272 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-0d64a26f-ecda-4794-a270-bf3b3f241be2 admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:34.380959 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0d64a26f-ecda-4794-a270-bf3b3f241be2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.381482 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0d64a26f-ecda-4794-a270-bf3b3f241be2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.381900 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0d64a26f-ecda-4794-a270-bf3b3f241be2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.382595 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0d64a26f-ecda-4794-a270-bf3b3f241be2 admin admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:34.383029 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0d64a26f-ecda-4794-a270-bf3b3f241be2 admin admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:34.383435 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-0d64a26f-ecda-4794-a270-bf3b3f241be2 admin admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:34.421840 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-0d64a26f-ecda-4794-a270-bf3b3f241be2 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.186360 Oct 31 15:14:34.422391 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 31 15:14:34 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:14:35.487836 n-d-858384-17 devstack@n-api.service[104771]: DEBUG nova.api.openstack.wsgi [None req-dbdcb0d8-2484-428c-bb30-e3c4e1e519ba admin admin] Calling method '>' {{(pid=104771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.488864 n-d-858384-17 devstack@n-api.service[104771]: INFO nova.api.openstack.requestlog [None req-dbdcb0d8-2484-428c-bb30-e3c4e1e519ba admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 31 15:14:35.489283 n-d-858384-17 devstack@n-api.service[104771]: [pid: 104771|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:14:35.684335 n-d-858384-17 devstack@n-api.service[104772]: DEBUG nova.api.openstack.wsgi [None req-88c103ee-5da0-4279-9e07-035061bd7a3b admin admin] Calling method '>' {{(pid=104772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:14:35.687775 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-88c103ee-5da0-4279-9e07-035061bd7a3b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:35.688244 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-88c103ee-5da0-4279-9e07-035061bd7a3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:35.688666 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-88c103ee-5da0-4279-9e07-035061bd7a3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:35.689401 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-88c103ee-5da0-4279-9e07-035061bd7a3b admin admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:14:35.689845 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-88c103ee-5da0-4279-9e07-035061bd7a3b admin admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:14:35.690261 n-d-858384-17 devstack@n-api.service[104772]: DEBUG oslo_concurrency.lockutils [None req-88c103ee-5da0-4279-9e07-035061bd7a3b admin admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:14:35.713411 n-d-858384-17 devstack@n-api.service[104772]: INFO nova.api.openstack.requestlog [None req-88c103ee-5da0-4279-9e07-035061bd7a3b admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.079867 Oct 31 15:14:35.713960 n-d-858384-17 devstack@n-api.service[104772]: [pid: 104772|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 31 15:14:35 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:15:20.745576 n-d-858384-17 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 31 15:15:20.746092 n-d-858384-17 devstack@n-api.service[104770]: Mon Oct 31 15:15:20 2022 - graceful shutdown triggered... Oct 31 15:15:20.746557 n-d-858384-17 devstack@n-api.service[104771]: Gracefully killing worker 1 (pid: 104771)... Oct 31 15:15:20.746914 n-d-858384-17 devstack@n-api.service[104772]: Gracefully killing worker 2 (pid: 104772)... Oct 31 15:15:20.873117 n-d-858384-17 devstack@n-api.service[104771]: DEBUG dbcounter [-] [104771] Writing DB stats nova_api:SELECT=4 {{(pid=104771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:15:21.746822 n-d-858384-17 devstack@n-api.service[104770]: worker 1 buried after 1 seconds Oct 31 15:15:21.747314 n-d-858384-17 devstack@n-api.service[104770]: worker 2 buried after 1 seconds Oct 31 15:15:21.747314 n-d-858384-17 devstack@n-api.service[104770]: goodbye to uWSGI. Oct 31 15:15:21.748409 n-d-858384-17 systemd[1]: devstack@n-api.service: Succeeded. Oct 31 15:15:21.749010 n-d-858384-17 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 31 15:15:21.751799 n-d-858384-17 systemd[1]: Starting Devstack devstack@n-api.service... Oct 31 15:15:21.767675 n-d-858384-17 devstack@n-api.service[120572]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 31 15:15:21 2022] *** Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: nodename: n-d-858384-17 Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: machine: x86_64 Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: clock source: unix Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: pcre jit disabled Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: detected number of CPU cores: 4 Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: current working directory: / Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: detected binary path: /usr/bin/uwsgi-core Oct 31 15:15:21.784676 n-d-858384-17 devstack@n-api.service[120572]: your processes number limit is 47680 Oct 31 15:15:21.785570 n-d-858384-17 devstack@n-api.service[120572]: your memory page size is 4096 bytes Oct 31 15:15:21.785570 n-d-858384-17 devstack@n-api.service[120572]: detected max file descriptor number: 2048 Oct 31 15:15:21.785570 n-d-858384-17 devstack@n-api.service[120572]: lock engine: pthread robust mutexes Oct 31 15:15:21.785570 n-d-858384-17 devstack@n-api.service[120572]: thunder lock: enabled Oct 31 15:15:21.785570 n-d-858384-17 devstack@n-api.service[120572]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 31 15:15:21.785570 n-d-858384-17 devstack@n-api.service[120572]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 31 15:15:21.828855 n-d-858384-17 devstack@n-api.service[120572]: Python main interpreter initialized at 0x55d1548779c0 Oct 31 15:15:21.828855 n-d-858384-17 devstack@n-api.service[120572]: python threads support enabled Oct 31 15:15:21.828855 n-d-858384-17 devstack@n-api.service[120572]: your server socket listen backlog is limited to 100 connections Oct 31 15:15:21.828855 n-d-858384-17 devstack@n-api.service[120572]: your mercy for graceful operations on workers is 90 seconds Oct 31 15:15:21.829340 n-d-858384-17 devstack@n-api.service[120572]: mapped 403077 bytes (393 KB) for 2 cores Oct 31 15:15:21.829340 n-d-858384-17 devstack@n-api.service[120572]: *** Operational MODE: preforking *** Oct 31 15:15:21.829582 n-d-858384-17 devstack@n-api.service[120572]: *** uWSGI is running in multiple interpreter mode *** Oct 31 15:15:21.829582 n-d-858384-17 devstack@n-api.service[120572]: spawned uWSGI master process (pid: 120572) Oct 31 15:15:21.829788 n-d-858384-17 systemd[1]: Started Devstack devstack@n-api.service. Oct 31 15:15:21.830476 n-d-858384-17 devstack@n-api.service[120572]: spawned uWSGI worker 1 (pid: 120587, cores: 1) Oct 31 15:15:21.831191 n-d-858384-17 devstack@n-api.service[120572]: spawned uWSGI worker 2 (pid: 120588, cores: 1) Oct 31 15:15:21.831191 n-d-858384-17 devstack@n-api.service[120572]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 31 15:15:22.491807 n-d-858384-17 devstack@n-api.service[120587]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 15:15:22.495594 n-d-858384-17 devstack@n-api.service[120588]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 31 15:15:23.738738 n-d-858384-17 devstack@n-api.service[120587]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:15:23.738738 n-d-858384-17 devstack@n-api.service[120587]: from cryptography.utils import int_from_bytes Oct 31 15:15:23.739390 n-d-858384-17 devstack@n-api.service[120587]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:15:23.739390 n-d-858384-17 devstack@n-api.service[120587]: from cryptography.utils import int_from_bytes Oct 31 15:15:23.743397 n-d-858384-17 devstack@n-api.service[120588]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:15:23.743397 n-d-858384-17 devstack@n-api.service[120588]: from cryptography.utils import int_from_bytes Oct 31 15:15:23.743852 n-d-858384-17 devstack@n-api.service[120588]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 31 15:15:23.743852 n-d-858384-17 devstack@n-api.service[120588]: from cryptography.utils import int_from_bytes Oct 31 15:15:26.170221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 15:15:26.170777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 31 15:15:26.171144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 15:15:26.171247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 31 15:15:26.171337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 15:15:26.171440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 31 15:15:26.171527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 15:15:26.171634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 31 15:15:26.171729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 15:15:26.171826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 31 15:15:26.171923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.172076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.172228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.172400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.172527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.172712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.172848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.173038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.173209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.173385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.173503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.173680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.173800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.173999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.174106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.174319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.174427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.174644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.174774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.174902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.175002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.175216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.175327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-17 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.175540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-858384-17 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.175656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.175857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.175948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.176159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.176318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.176470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.176596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.176787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.176895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.177088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.177220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.177430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.177538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.177731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.177936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.178323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.178545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.178749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.178952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.179154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.179284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.179447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.179590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.179724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.179859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.179954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.180141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.180321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.180461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.180551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.180784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.180919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.181101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.181265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.181470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.181573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-17 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.181783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.181928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.182175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.182276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-858384-17 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.182492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.182588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.182807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.182914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.183121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.183214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.183504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.183596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.183830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.183946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.184136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.184227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.184450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.184548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.184773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.184910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.185081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.185209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.185440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.185532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.185763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.185875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.186061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.186152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.186369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.186473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.186676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.186812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.186980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.187072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.187289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.187382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.187595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.187687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.187848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.187971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.188159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.188264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.188427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.188525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.188734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.188824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.189057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.189194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.189373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.189471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.189627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.189765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.189949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.190043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.190196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.190286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.190515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.190613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.190834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.190934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.191141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.191234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.191447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.191548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.191751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.191850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.192055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.192158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.192357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.192477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.192659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.192759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.192961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.193058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.193288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.193393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.193607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.193749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.193968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.194166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.194342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.194532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.194702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.194796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.194889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.194980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.195169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.195271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.195502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.195592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.195819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.196024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.196186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.196384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.196495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.196732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.196847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.197037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.197176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.197371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.197480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.197679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.197780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.197984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.198115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.198292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.198448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.198595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.198746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.198896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.199076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.199223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.199378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.199517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.199663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.199818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.199973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.200125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.200262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.200410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.200548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.200715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.200855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.200997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.201181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.201274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.201370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.201517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.201617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.201813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.201905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.202118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.202263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.202424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.202516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.202725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.202827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.203030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.203135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.203331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.203422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.203634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.203724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.203939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.204066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.204242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.204347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.204543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.204637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.204845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.204957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.205172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.205268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.205486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.205590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.205787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.205888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.206089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.206195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.206390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.206484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.206708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.206891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.207064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.207216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.207360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.207507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.207652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.207804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.207944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.208082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.208229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.208368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.208514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.208655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.208795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.208944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.209085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.209206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.209395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.209488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.210255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.210433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.210593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.210704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.210853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.210943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.211143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.211245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.211448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.211548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.211754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.211854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.212059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.212160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.212358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.212471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.212657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.212748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.212956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.213054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.213275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.213383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.213576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.213679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.213872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.213970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.214188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.214292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.214499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.214589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.214799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.214890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.215101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.215203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.215402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.215498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.215718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 31 15:15:26.215820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.216048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.216151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.216381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.216498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.216718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.216818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.217027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.217121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.217374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.217467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.217692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.217797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.218006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.218104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.218315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.218415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.218626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.218732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.218938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.219030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.219249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.219345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.219557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.219954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.220160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.220273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.220475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.220569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.220790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.220881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.221107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.221244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.221441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.221540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.221753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.221854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.222067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.222166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.222374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.222518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.222687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.222786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.223013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.223113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.223328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.223426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.223636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.223727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.223972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.224073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.224317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.224415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.224626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.224731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.224936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.225027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.225925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.226102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.226276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.228835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.228992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.229961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.230953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.231958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.232935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.233101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.233269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.233425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.233531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.233727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.233833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.234029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.234142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.234335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.234511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.234635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.234751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.234950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.235090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.235279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.235402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.235584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.235716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.235917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.236030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.236222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.236328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.236531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.236622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.236837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.236931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.237167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.237308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.237466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.237558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.237774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.237874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.238081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.238187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.238382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.238482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.238704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.238795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.239009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.239146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.239317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.239409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.239634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.239734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.239943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.240036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.240239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.240331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.240553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.240661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.240909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.241068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.241224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.241466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.241646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.241824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.242019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.242116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.242349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.242442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.242662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.242764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.242970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.243074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.243304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.243396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.243632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.243735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.243937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.244039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.244257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.244355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.244569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.244670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.244875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.244974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.245200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.245307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.245505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.245597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.245803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.245902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.246104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.246204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.246404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.246504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.246709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.246799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.247006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.247096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.247307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.247412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.247608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.247700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.247907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.248013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.248206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.248298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.248508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.248597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.248814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.248914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.249112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.249262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.249436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.249536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.249735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.249840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.250075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.250177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.250377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.250474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.250721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.250867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.251058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.251157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.251374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.251500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.251689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.251789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.251998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.252097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.252322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.252411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.252629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.252762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.252941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.253043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.253278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.253383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.253605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.253699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.253921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.254013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.254249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.254341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.254564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.254660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.254871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.254961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.255180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.255285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.255493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.255585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.255812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.255907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.256116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.256217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.256480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.256633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.256791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.256960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.257221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.257339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.257536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.257630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.257850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.257956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.258158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.258263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.258470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.258560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.258775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.258872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.259083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.259183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.259395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.259491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.259703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.259794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.260015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.260106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.260322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.260419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.260638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.260736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.260947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.261038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.261277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.261380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.261592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.261690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.261909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.262002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.262210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.262301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.262521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.262621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.262845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.262982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.263166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.263256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.263472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.263645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.263784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.263874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.264096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.264195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.264403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.264501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.264708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.264805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.265013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.265111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.265348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.265460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.265651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.265752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.265959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.266050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.266267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.266373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.266569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.266667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.266875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.266966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.267178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.267277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.267483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.267629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.267786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.267883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.268086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.268186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.268387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.268491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.268693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.268792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.269013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.269105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.269349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.269493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.269654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.269744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.269977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.270068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.270279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.270370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.270579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.270671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.270883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.270984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.271188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.271280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.271487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.271591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.271788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.271879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.272689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.272859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.273064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.273286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.273447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.273540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.273761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.273854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.274078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.274233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.274390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.274491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.274702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.274806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.275015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.275151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.275323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.275414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.275630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.275721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.275942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.276040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.276250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.276347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.276555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.276647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.276861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.276954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.277191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.277323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.277502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.277603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.277810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.277912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.278119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.278218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.278423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.278513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.278732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.278822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.279035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.279125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.279333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.279611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.279711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.279941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.280031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.280259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.280509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.280619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.280839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.280939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.281171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.281286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.281491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.281584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.281828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.281966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.282145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.282239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.282475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.282568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.282786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.282885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.283094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.283188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.283396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.283502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.283705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.283797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.284004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.284102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.284306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.284407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.284610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.284701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.284907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.284997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.285236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.285347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.285540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.285641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.285845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.285943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.286148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.286322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.286452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.286549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.286752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.286856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.287053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.287147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.287354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.287498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.287738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.288434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.288614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.288790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.288945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.289048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.289182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.289290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.289496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.289589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.289846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.289946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.290156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.290255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.290466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.290558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.290809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.290910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.291115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.291220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.291448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.291552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.291756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.291857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.292090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.292192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.292391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.292489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.292691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.292782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.292994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.293094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.293328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.293430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.293629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.293721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.293932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.294104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.294239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.294333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.294546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.294641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.294845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.294945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.295153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.295244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.295458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.295685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.295787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.296060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.296376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.296692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.296851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.297002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.297187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.297356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.297515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.297665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.297814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.297970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.298135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.298318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.298468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.298624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.298774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.298939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.299112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.299377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.299548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.299716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.299867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.300027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.300178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.300340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.300499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.300650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.300807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.300978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.301148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.301307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.301457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.301607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.301774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.302959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.303060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.303333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.303516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.303798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.304038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.304183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.304277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.304408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.304549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.304721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.304822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.305030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.305143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.305365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.305504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.305674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.305767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.305983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.306084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.306288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.306380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.306593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.306686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.306900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.307003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.307205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.307304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.307508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.307608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.307809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.307911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.308114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.308215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.308414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.308505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.308717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.308816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.309015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.309105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.309341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.309444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.309643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.309750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.309963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.310062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.310274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.310367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.310576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.310668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.310874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.310967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.311172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.311264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.311516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.311620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.311819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.311908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.312131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.312221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.312450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.312549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.312761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.312852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.313073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.313205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.313405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.313549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.313709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.313883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.314051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.314136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.314304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.314425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.314616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.314717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.314924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.315027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.315234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.315326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.315535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.315628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.315835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.315929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.316151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.316251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.316456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.316548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.316763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.316862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.317076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.317198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.317416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.317520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.317731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.317834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.318046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.318141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.318360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.318462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.318671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.318772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.319010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.319163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.319323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.319502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.319673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.319806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.319928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.320109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.320236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.320408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.320565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.320713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.320876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.321010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.321208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.321373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.321558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.321680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.321864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.321989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.322184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.322312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.322492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.322619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.322962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.323181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.323288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.323500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.323637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.323817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.323901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.324124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.324261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.324516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.324816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.325013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.325237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.325522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.325689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.325842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.326000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.326159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.326310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.326472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.326631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.326802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.326962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.327112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.327262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.327423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.327575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.327775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.327896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.328089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.328200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.328402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.328554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.328733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.328869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.329043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.329203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.329379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.329514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.329688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.329818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.330018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.330120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.330329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.330422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.330657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.330788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.331021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.331127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.331326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.331418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.331628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.331721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.331951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.332087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.332252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.332387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.332572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.332699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.332985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.333095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.333355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.333491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.333689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.333942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.334094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.334211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.334332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.334454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.335156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.335525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.335686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.335847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.335963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.336052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.336151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.336239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.336409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.336549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.336714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.336864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.337042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.337449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.337592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.337707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.337818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.338024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.338156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.338339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.338457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.338690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.338821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.338995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.339147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.339319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.339413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.339692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.339784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.340002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.340097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.340313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.340405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.340628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.340720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.340936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.341038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.341280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.341377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.341612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.341715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.341920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.342015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.342240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.342369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.342554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.342658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.342862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.342945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.343167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.343262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.343471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.343577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.343793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.343886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.344095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.344188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.344404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.344511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.344712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.344815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.345018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.345110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.345344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.345491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.345646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.345747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.345966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.346066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.346269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.346372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.346575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.346666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.346886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.347017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.347196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.347308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.347510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.347611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.347812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.347914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.348133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.348227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.348441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.348535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.348743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.348836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.349043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.349165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.349375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.349468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.349717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.349810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.350021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.350138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.350908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.351151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.351324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.351550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.351653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.351748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.351841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.351926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.352136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.352244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.352447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.352531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.352756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.352857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.353366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.353478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.353676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.353770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.353989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.354083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.354295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.354402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.354596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.354687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.354901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.354992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.355203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.355304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.355504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.355598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.355806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.355899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.356110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.356212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.356410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.356510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.356711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.356821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.357015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.357121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.357362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.357456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.357664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.357756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.357985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.358079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.358289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.358382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.358592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.358699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.358893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.358995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.359194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.359288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.359526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.359632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.359826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.359917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.360150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.360267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.361149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.361308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.361308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.361495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.361594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.361681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.361773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.361773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.362013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.362261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.362565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.362659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.362898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.362993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.363215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.363317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.363532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.363633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.363846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.363939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.364156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.364257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.364468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.364573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.364781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.364880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.365093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.365300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.365433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.365672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.365792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.366093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.366296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.366456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.366617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.366880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.366975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.367248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.367349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.367567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.367674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.367884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.368005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.368204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.368333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.368524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.368667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.368838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.369225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.369409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.369588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.369750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.369912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.370064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.370215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.370365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.370518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.370677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.370838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.370990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.371141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.371292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.371452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.371625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.371779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.371937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.372088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.372240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.372400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.372570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.372723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.372882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.373035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.373250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.373428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.373581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.373740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.373899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.374057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.374216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.374420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.374577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.374837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.374936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.375023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.375108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.375205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.375292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.375427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.375600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.375778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.375886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.376089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.376182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.376456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.376592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.376791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.376894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.377118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.377336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.377477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.377621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.377770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.377927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.378068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.378208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.378361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.378594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.378738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.378906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.379052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.379236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.379391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.379561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.379712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.379859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.380017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.380166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.380335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.380503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.380666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.380806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.380983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.381322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.382291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.382545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.382806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.382948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.383088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.383238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.383378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.383529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.383679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.383816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.383965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.384104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.384250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.384455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.384639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.384826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.384971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.385118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.385297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.385512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.385659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.385869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.386155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.386310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.386477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.386626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.386789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.386930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.387096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.387226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.387408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.387553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.387719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.387936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.388164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.388307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.388463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.388709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.388949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.389096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.389304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.389304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.389576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.389724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.389863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.390001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.390147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.390296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.390462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.390601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.390748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.390886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.391024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.391180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.391320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.391458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.391594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.391731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.391867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.392023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.392162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.392301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.392448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.392585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.392721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.392869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.393008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.393176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.393331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.393480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.393631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.393788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.393926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.394073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.394219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.394364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.394563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.394750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.394941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.395084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.395221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.395369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.395516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.395664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.395812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.395959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.396144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.396287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.396437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.396587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.396758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.396902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.397783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.397938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.398110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.398418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.398611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.398882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.399102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.399253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.399354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.399527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.399632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.399852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.399948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.400164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.400266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.400478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.400617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.400794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.400897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.401112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.401228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.401453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.401677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.401779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.402017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.402121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.402342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.402435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.402668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.402767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.402989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.403101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.403296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.403396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.403603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.403705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.403910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.404004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.404221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.404312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.404531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.404673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.404842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.404977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.405177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.405317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.405479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.405583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.405787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.405881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.406095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.406234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.406402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.406504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.406708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.406809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.407015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.407116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.407318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.407422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.407625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.407719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.407930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.408031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.408237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.408341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.408540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.408634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.408850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.408942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.409210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.409307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.409532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.409624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.409845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.409938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.410157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.410252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.410472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.410566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.410780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.410872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.411138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.411232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.411447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.411541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.411772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.412087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.412424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.412615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.412836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.413093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.413408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.413776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.413776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.414118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.414273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.414430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.414430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.414750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.414910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.415110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.415265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.415416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.415580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.415741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.415892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.416050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.416203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.416352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.416352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.416656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.416806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.416972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.417180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.417329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.417452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.417651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.417786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.417974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.418094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.418404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.418515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.418610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.418697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.418909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.419033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.419222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.419346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.419535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.419655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.419848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.419992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.420159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.420324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.420472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.420585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.420783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.420878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.421097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.421236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.421431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.421539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.421743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.421846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.422052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.422153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.422360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.422453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.422665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.422772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.422964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.423055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.423263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.423356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.423563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.423666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.423863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.423966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.424164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.424256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.424463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.424565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.424767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.424868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.425066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.425212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.425391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.425544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.425689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.425865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.425991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.426181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.426293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.426520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.426624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.426835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.426956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.427152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.427259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.427469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.427570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.427782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.427883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.428097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.428200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.428552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.428709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.428888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.429044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.429195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.429286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.429505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.429599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.429811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.429914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.430141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.430247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.430451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.430544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.430760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.430862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.431077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.431179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.431384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.431486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.431694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.431845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.432001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.432099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.432315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.432415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.432632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.432734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.432934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.433026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.433282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.433384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.433600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.433708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.433914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.434023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.434223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.434324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.434532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.434627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.434863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.434956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.435171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.435273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.435482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.435577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.435789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.435891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.436096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.436216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.436404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.436532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.436716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.436810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.437021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.437142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.437368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.437462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.437681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.437774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.437993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.438098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.438320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.438413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.438585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 15:15:26.438678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.438982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.439311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.439637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.440023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.440335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.441240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.441240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.441455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.441657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.441960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 31 15:15:26.442201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120588) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 31 15:15:26.501250 n-d-858384-17 devstack@n-api.service[120587]: INFO dbcounter [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Registered counter for database nova_api Oct 31 15:15:26.504265 n-d-858384-17 devstack@n-api.service[120588]: INFO dbcounter [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Registered counter for database nova_api Oct 31 15:15:26.523243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:15:26.527791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:15:26.530363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:15:26.534842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:15:26.589349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.context [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) {{(pid=120587) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 15:15:26.593398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.593883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.594416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.context [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) {{(pid=120588) load_cells /opt/stack/nova/nova/context.py:464}} Oct 31 15:15:26.595476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.596211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.596663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.598536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.598719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.599014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.600714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.600915 n-d-858384-17 devstack@n-api.service[120587]: INFO dbcounter [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Registered counter for database nova_cell0 Oct 31 15:15:26.601544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:15:26.601988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:15:26.604256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:15:26.605519 n-d-858384-17 devstack@n-api.service[120587]: INFO dbcounter [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Registered counter for database nova_cell1 Oct 31 15:15:26.606321 n-d-858384-17 devstack@n-api.service[120588]: INFO dbcounter [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Registered counter for database nova_cell0 Oct 31 15:15:26.610934 n-d-858384-17 devstack@n-api.service[120588]: INFO dbcounter [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Registered counter for database nova_cell1 Oct 31 15:15:26.613401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:15:26.616365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:15:26.620216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:15:26.621443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:15:26.623675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:15:26.630738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:15:26.633101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:15:26.763225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:15:26.772130 n-d-858384-17 devstack@n-api.service[120587]: INFO dbcounter [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Registered counter for database nova_cell0 Oct 31 15:15:26.778877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_db.sqlalchemy.engines [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:15:26.781506 n-d-858384-17 devstack@n-api.service[120588]: INFO dbcounter [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Registered counter for database nova_cell0 Oct 31 15:15:26.783448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writer thread running {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:15:26.791239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_db.sqlalchemy.engines [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120588) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 31 15:15:26.796349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writer thread running {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 31 15:15:27.103636 n-d-858384-17 devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:15:27.110949 n-d-858384-17 devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:15:27.126318 n-d-858384-17 devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:15:27.133902 n-d-858384-17 devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:15:27.452586 n-d-858384-17 devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:15:27.458504 n-d-858384-17 devstack@n-api.service[120587]: WARNING keystonemiddleware.auth_token [None req-a44f53a3-4586-429b-b2ae-e925c85c0749 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:15:27.464341 n-d-858384-17 devstack@n-api.service[120587]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1548779c0 pid: 120587 (default app) Oct 31 15:15:27.480289 n-d-858384-17 devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 31 15:15:27.486267 n-d-858384-17 devstack@n-api.service[120588]: WARNING keystonemiddleware.auth_token [None req-12c34bdc-5c58-4b59-a9d0-99855d72a05f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 31 15:15:27.492002 n-d-858384-17 devstack@n-api.service[120588]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1548779c0 pid: 120588 (default app) Oct 31 15:16:06.793375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:06.794250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:06.795022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:06.795800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:08.210113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c4913df1-82b6-4bb1-9c1b-f045704cfedd tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1876225670", "id": 327732823, "os-flavor-access:is_public": "True"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:08.294173 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c4913df1-82b6-4bb1-9c1b-f045704cfedd tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 1.506085 Oct 31 15:16:08.306228 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:06 2022] POST /compute/v2.1/flavors => generated 427 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:08.580327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eaf8e4a2-4ebd-4204-aa0b-7aa6a96f5676 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:08.618604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:08.620097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:08.621232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:08.622440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:08.642897 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eaf8e4a2-4ebd-4204-aa0b-7aa6a96f5676 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/327732823" status: 202 len: 0 microversion: 2.1 time: 0.334573 Oct 31 15:16:08.644019 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:16:08 2022] DELETE /compute/v2.1/flavors/327732823 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:08.654546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bb1335f7-c87e-4cee-8e85-1dab42444ade tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:08.735836 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bb1335f7-c87e-4cee-8e85-1dab42444ade tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086723 Oct 31 15:16:08.741429 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:08.760520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28665229-a2e7-40fb-bcf6-d8cd6bf57e7b tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1363922824", "id": 1419258306, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:08.894819 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28665229-a2e7-40fb-bcf6-d8cd6bf57e7b tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.138560 Oct 31 15:16:08.895750 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2/4] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:08 2022] POST /compute/v2.1/flavors => generated 417 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:08.907496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1025317a-aa99-43cd-998c-1e0a7372ec3b tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:08.936074 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1025317a-aa99-43cd-998c-1e0a7372ec3b tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.031901 Oct 31 15:16:08.936834 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:08 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:08.958208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c88b4cb9-5fc5-437b-9e2f-87f8b1ce65b6 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:08.991546 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c88b4cb9-5fc5-437b-9e2f-87f8b1ce65b6 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1419258306" status: 202 len: 0 microversion: 2.1 time: 0.036390 Oct 31 15:16:08.992881 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:08 2022] DELETE /compute/v2.1/flavors/1419258306 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:09.001818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e801ab38-3429-4ad4-b79a-241cffccb04f tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.035528 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e801ab38-3429-4ad4-b79a-241cffccb04f tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037799 Oct 31 15:16:09.037371 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:09.060295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3a501ac-5ae8-4284-9536-a82686022979 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-874888622", "id": 1264378789, "os-flavor-access:is_public": "True"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:09.088493 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3a501ac-5ae8-4284-9536-a82686022979 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.032007 Oct 31 15:16:09.090309 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 4/8] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:09 2022] POST /compute/v2.1/flavors => generated 428 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:09.103915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-139891ee-a467-46a9-b11c-732752d0dbc8 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.141109 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-139891ee-a467-46a9-b11c-732752d0dbc8 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1264378789" status: 202 len: 0 microversion: 2.1 time: 0.041115 Oct 31 15:16:09.142028 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:09 2022] DELETE /compute/v2.1/flavors/1264378789 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:09.150968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-607936d5-ac21-452d-9293-0c37078b0137 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.176924 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-607936d5-ac21-452d-9293-0c37078b0137 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029749 Oct 31 15:16:09.182019 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:09.199531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21f6d1aa-755d-481c-b3c9-d2d41dd8f4b9 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-264154946", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:09.232690 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21f6d1aa-755d-481c-b3c9-d2d41dd8f4b9 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.033140 Oct 31 15:16:09.233600 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 7/11] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:09 2022] POST /compute/v2.1/flavors => generated 506 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:09.718895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '.version_select at 0x7f16e2cda8b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.732029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) {{(pid=120587) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 31 15:16:09.735609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.737866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.739010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.788726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.788726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.788726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.803172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:09.803833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:09.804415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:09.811465 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f5f8f8b-3f70-4d1a-8dee-9785d997cd3c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.576535 Oct 31 15:16:09.822259 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 8/12] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:09.827790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81a615ac-c9cb-45a4-9e6c-b43e675bb8a6 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:09.852023 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-81a615ac-c9cb-45a4-9e6c-b43e675bb8a6 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/08df4cca-8bc0-414a-b09b-4b46fda7f780" status: 202 len: 0 microversion: 2.1 time: 0.027927 Oct 31 15:16:09.853925 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 9/13] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:16:09 2022] DELETE /compute/v2.1/flavors/08df4cca-8bc0-414a-b09b-4b46fda7f780 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:09.996774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db50b861-9775-41c3-98fb-e94da60699b1 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1264516252", "ram": 512, "vcpus": 1, "disk": 10, "id": 378687752, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:10.043464 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db50b861-9775-41c3-98fb-e94da60699b1 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.910577 Oct 31 15:16:10.055841 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 5/14] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:09 2022] POST /compute/v2.1/flavors => generated 413 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:10.155090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad7a8211-7605-4dea-86d7-a7378f607d05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.164052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7a8211-7605-4dea-86d7-a7378f607d05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.167805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7a8211-7605-4dea-86d7-a7378f607d05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.168432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7a8211-7605-4dea-86d7-a7378f607d05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.171440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7a8211-7605-4dea-86d7-a7378f607d05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.172370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7a8211-7605-4dea-86d7-a7378f607d05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.172974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7a8211-7605-4dea-86d7-a7378f607d05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.258860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Calling method '.version_select at 0x7f16e36944c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.272601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) {{(pid=120588) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 31 15:16:10.273530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.274006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.274435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.277667 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad7a8211-7605-4dea-86d7-a7378f607d05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.421469 Oct 31 15:16:10.291313 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 10/15] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 31 15:16:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:10.301277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bade0de-85dc-47c1-89b9-2c32908c5bff tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-470591997", "name": "tempest-test_aggregate-1381920980"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:10.322045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.322370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.322808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.329208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-1bade0de-85dc-47c1-89b9-2c32908c5bff tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Generated uuid 60423b93-f0c0-4b5b-bab4-e964774f29b7 for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:10.339620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.340113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.344127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.366681 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-696d4481-245e-42cc-9650-b0b2345601c9 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.309075 Oct 31 15:16:10.368876 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 6/16] 10.222.0.20 () {60 vars in 1208 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:10.381785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eee678df-7800-42a5-a455-db5c9f084957 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.442047 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eee678df-7800-42a5-a455-db5c9f084957 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.068742 Oct 31 15:16:10.442919 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 7/17] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:10.458247 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bade0de-85dc-47c1-89b9-2c32908c5bff tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.163818 Oct 31 15:16:10.458981 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 11/18] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Oct 31 15:16:10 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:10.700328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-356716e1-b21b-418b-8455-27af98b6be91 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Calling method '.version_select at 0x7f16e2e58790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.705682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356716e1-b21b-418b-8455-27af98b6be91 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.706471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356716e1-b21b-418b-8455-27af98b6be91 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.706941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356716e1-b21b-418b-8455-27af98b6be91 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.707694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356716e1-b21b-418b-8455-27af98b6be91 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.708351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356716e1-b21b-418b-8455-27af98b6be91 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.708800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356716e1-b21b-418b-8455-27af98b6be91 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.821731 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-356716e1-b21b-418b-8455-27af98b6be91 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.377342 Oct 31 15:16:10.825515 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 8/19] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:10.837411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdf4516e-b11e-473c-a6ae-aee5866fb8d4 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-116272764", "id": "ec26121d-ef34-4c12-86b9-ce41c045972a", "os-flavor-access:is_public": "True"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:10.847386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad3968d1-ce6a-4879-bebe-524b4df076c1 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.875374 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdf4516e-b11e-473c-a6ae-aee5866fb8d4 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.039042 Oct 31 15:16:10.875374 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 9/20] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:10 2022] POST /compute/v2.1/flavors => generated 506 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:10.875528 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ad3968d1-ce6a-4879-bebe-524b4df076c1 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] HTTP exception thrown: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:16:10.875611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d68d4cbf-31b3-4157-967d-5ab1bcc1b5b3 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad3968d1-ce6a-4879-bebe-524b4df076c1 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Request method failure captured: Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/flavors/378687752/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a2zFAkykYmBcisAOn8ewkxk0Sm95lpOQZrGR7L4rc4var3ob-Cus4bCHmi_vJx4CY_yvjt0Na6SuphIn_kDB2kqV2DmQYRvGUwsSFqIVNDPa_sWNksdS5r5Nx01DH9SscMtb0BfZ7HPADLbAZRZCx-qY0wDdmfr2WxvXPmOr9aW10 Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 0a619d0dce95482eb7a243081dbb2ec0 Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:10.875690 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a619d0dce95482eb7a243081dbb2ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a619d0dce95482eb7a243081dbb2ec0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a619d0dce95482eb7a243081dbb2ec0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a619d0dce95482eb7a243081dbb2ec0"}]}] Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 0a619d0dce95482eb7a243081dbb2ec0 Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 090dd744d84847c4886854641be8e10d Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:10.876914 n-d-858384-17 devstack@n-api.service[120587]: exception: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'flavor_id': '378687752', 'id': 'hw:cpu_thread_policy'} Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:10.877626 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad3968d1-ce6a-4879-bebe-524b4df076c1 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Returning 404 to user: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad3968d1-ce6a-4879-bebe-524b4df076c1 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] 10.222.0.20 "GET /compute/v2.1/flavors/378687752/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.413194 Oct 31 15:16:10.879077 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 12/21] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/flavors/378687752/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:10.883161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc8a1d49-b7cb-4a55-b7d0-20a99a57d355 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Calling method '.version_select at 0x7f16e2efac10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.886812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d49-b7cb-4a55-b7d0-20a99a57d355 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.887413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d49-b7cb-4a55-b7d0-20a99a57d355 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.888024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d49-b7cb-4a55-b7d0-20a99a57d355 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.888979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d49-b7cb-4a55-b7d0-20a99a57d355 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.889673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d49-b7cb-4a55-b7d0-20a99a57d355 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.891557 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d68d4cbf-31b3-4157-967d-5ab1bcc1b5b3 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.023753 Oct 31 15:16:10.892498 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 10/22] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:10.899189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59f1bf32-96ff-434d-8b01-e829bf743655 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:10.901108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d49-b7cb-4a55-b7d0-20a99a57d355 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.921909 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59f1bf32-96ff-434d-8b01-e829bf743655 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/ec26121d-ef34-4c12-86b9-ce41c045972a" status: 202 len: 0 microversion: 2.1 time: 0.028054 Oct 31 15:16:10.923516 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:16:10 2022] DELETE /compute/v2.1/flavors/ec26121d-ef34-4c12-86b9-ce41c045972a => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:10.935278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76e15889-8c9e-4539-8589-505a4633cd7b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:10.944985 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc8a1d49-b7cb-4a55-b7d0-20a99a57d355 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.069993 Oct 31 15:16:10.946160 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 13/24] 10.222.0.20 () {58 vars in 1139 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:10.947618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-76e15889-8c9e-4539-8589-505a4633cd7b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '090dd744d84847c4886854641be8e10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a619d0dce95482eb7a243081dbb2ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:10.951160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a34875b1-2532-4aa0-ab78-8f7706f66173 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76e15889-8c9e-4539-8589-505a4633cd7b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Request method failure captured: Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/flavors/378687752/os-extra_specs HTTP/1.1 Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 66 Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a2zFAkykYmBcisAOn8ewkxk0Sm95lpOQZrGR7L4rc4var3ob-Cus4bCHmi_vJx4CY_yvjt0Na6SuphIn_kDB2kqV2DmQYRvGUwsSFqIVNDPa_sWNksdS5r5Nx01DH9SscMtb0BfZ7HPADLbAZRZCx-qY0wDdmfr2WxvXPmOr9aW10 Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 0a619d0dce95482eb7a243081dbb2ec0 Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:10.956465 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a619d0dce95482eb7a243081dbb2ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a619d0dce95482eb7a243081dbb2ec0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a619d0dce95482eb7a243081dbb2ec0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a619d0dce95482eb7a243081dbb2ec0"}]}] Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 0a619d0dce95482eb7a243081dbb2ec0 Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 090dd744d84847c4886854641be8e10d Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 31 15:16:10.958371 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'flavor_id': '378687752', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:10.959040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 31 15:16:10.960100 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:10.962996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76e15889-8c9e-4539-8589-505a4633cd7b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:10.964204 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76e15889-8c9e-4539-8589-505a4633cd7b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] 10.222.0.20 "POST /compute/v2.1/flavors/378687752/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.036870 Oct 31 15:16:10.969472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a34875b1-2532-4aa0-ab78-8f7706f66173 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:10.969472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a34875b1-2532-4aa0-ab78-8f7706f66173 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:10.969472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a34875b1-2532-4aa0-ab78-8f7706f66173 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:10.970343 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 12/25] 10.222.0.20 () {60 vars in 1221 bytes} [Mon Oct 31 15:16:10 2022] POST /compute/v2.1/flavors/378687752/os-extra_specs => generated 124 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:10.983541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f30bac46-5374-4c96-be91-2c3fbc46c27b tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.020198 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f30bac46-5374-4c96-be91-2c3fbc46c27b tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.044869 Oct 31 15:16:11.024071 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:10 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:11.046703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-850e61e9-166a-4a8b-909a-990468af89ff tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Calling method '.version_select at 0x7f16e2c2c9d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.059043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850e61e9-166a-4a8b-909a-990468af89ff tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:11.059775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850e61e9-166a-4a8b-909a-990468af89ff tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:11.060377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850e61e9-166a-4a8b-909a-990468af89ff tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:11.061184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850e61e9-166a-4a8b-909a-990468af89ff tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:11.061619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850e61e9-166a-4a8b-909a-990468af89ff tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:11.066923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850e61e9-166a-4a8b-909a-990468af89ff tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:11.129023 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-850e61e9-166a-4a8b-909a-990468af89ff tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.103002 Oct 31 15:16:11.130135 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1145 bytes} [Mon Oct 31 15:16:11 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:11.141917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c8c89a3c-73a2-4b24-8b94-c958b747df0a tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:11.223919 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c8c89a3c-73a2-4b24-8b94-c958b747df0a tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/378687752/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.090266 Oct 31 15:16:11.233395 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 15/28] 10.222.0.20 () {60 vars in 1221 bytes} [Mon Oct 31 15:16:11 2022] POST /compute/v2.1/flavors/378687752/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:11.239672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b43ed0f-68e2-4066-9fed-2098ea5493b5 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1773673612", "id": 1571558310, "os-flavor-access:is_public": "True"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:11.266687 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b43ed0f-68e2-4066-9fed-2098ea5493b5 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.032017 Oct 31 15:16:11.267648 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 16/29] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:11 2022] POST /compute/v2.1/flavors => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:11.273341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fa14b8f-582b-4522-84c4-47a255f91b51 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.275076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4fa14b8f-582b-4522-84c4-47a255f91b51 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '090dd744d84847c4886854641be8e10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a619d0dce95482eb7a243081dbb2ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fa14b8f-582b-4522-84c4-47a255f91b51 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Request method failure captured: Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a2zFAkykYmBcisAOn8ewkxk0Sm95lpOQZrGR7L4rc4var3ob-Cus4bCHmi_vJx4CY_yvjt0Na6SuphIn_kDB2kqV2DmQYRvGUwsSFqIVNDPa_sWNksdS5r5Nx01DH9SscMtb0BfZ7HPADLbAZRZCx-qY0wDdmfr2WxvXPmOr9aW10 Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 0a619d0dce95482eb7a243081dbb2ec0 Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:11.277591 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a619d0dce95482eb7a243081dbb2ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a619d0dce95482eb7a243081dbb2ec0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a619d0dce95482eb7a243081dbb2ec0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a619d0dce95482eb7a243081dbb2ec0"}]}] Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 0a619d0dce95482eb7a243081dbb2ec0 Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 090dd744d84847c4886854641be8e10d Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:11.278742 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'flavor_id': '378687752', 'id': 'hw:numa_nodes'} Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:11.279257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 31 15:16:11.280141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.289379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fa14b8f-582b-4522-84c4-47a255f91b51 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:11.290854 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4fa14b8f-582b-4522-84c4-47a255f91b51 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.021182 Oct 31 15:16:11.297459 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 17/30] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:16:11 2022] DELETE /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:11.303591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-655c028d-0238-4d7b-9d1c-b43d651e1c52 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.311734 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-655c028d-0238-4d7b-9d1c-b43d651e1c52 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1571558310" status: 200 len: 414 microversion: 2.1 time: 0.012865 Oct 31 15:16:11.312298 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 18/31] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:16:11 2022] GET /compute/v2.1/flavors/1571558310 => generated 414 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:11.320731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b431c26-c429-4df0-ace6-a23f9b3d72e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:11.375485 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b431c26-c429-4df0-ace6-a23f9b3d72e9 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/378687752/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058586 Oct 31 15:16:11.376405 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 19/32] 10.222.0.20 () {60 vars in 1221 bytes} [Mon Oct 31 15:16:11 2022] POST /compute/v2.1/flavors/378687752/os-extra_specs => generated 66 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:11.627425 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a34875b1-2532-4aa0-ab78-8f7706f66173 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 0.679778 Oct 31 15:16:11.631977 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 14/33] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 31 15:16:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:11.652929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c77e6cd2-b568-458f-b75b-a64bcb5b221b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:11.660288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c77e6cd2-b568-458f-b75b-a64bcb5b221b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '090dd744d84847c4886854641be8e10d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a619d0dce95482eb7a243081dbb2ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c77e6cd2-b568-458f-b75b-a64bcb5b221b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Request method failure captured: Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 22 Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a2zFAkykYmBcisAOn8ewkxk0Sm95lpOQZrGR7L4rc4var3ob-Cus4bCHmi_vJx4CY_yvjt0Na6SuphIn_kDB2kqV2DmQYRvGUwsSFqIVNDPa_sWNksdS5r5Nx01DH9SscMtb0BfZ7HPADLbAZRZCx-qY0wDdmfr2WxvXPmOr9aW10 Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 0a619d0dce95482eb7a243081dbb2ec0 Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:11.669965 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a619d0dce95482eb7a243081dbb2ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a619d0dce95482eb7a243081dbb2ec0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a619d0dce95482eb7a243081dbb2ec0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a619d0dce95482eb7a243081dbb2ec0"}]}] Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 0a619d0dce95482eb7a243081dbb2ec0 Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 090dd744d84847c4886854641be8e10d Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: {"hw:numa_nodes": "1"} Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:11.670917 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'flavor_id': '378687752', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:11.671510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 31 15:16:11.672347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.673351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c77e6cd2-b568-458f-b75b-a64bcb5b221b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:11.673351 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c77e6cd2-b568-458f-b75b-a64bcb5b221b tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707 tempest-FlavorsExtraSpecsNegativeTestJSON-1227998707-project] 10.222.0.20 "PUT /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035562 Oct 31 15:16:11.673351 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 15/34] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:16:11 2022] PUT /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes => generated 124 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:11.682984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b20659f-b027-4800-b164-4c2e2046f23a tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.712378 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4b20659f-b027-4800-b164-4c2e2046f23a tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] HTTP exception thrown: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b20659f-b027-4800-b164-4c2e2046f23a tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Request method failure captured: Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/flavors/378687752/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a4vnprarAK-mGieKyRFKDOz7GOYfEZMf8jqngi7hyTs3_nVJ4eLc7HS6N2hxJ-EzZLlydSz3bHGnzY0MvE32Rcx_qJvyoCZJcQ3aNhwK83DVhfz7HCnAJ4PB-cMd3pJnVYKreQs7dQgSrUIAWUC5QZZjvdARjYqtKumvjqEMcTNAE Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 1857e1a960c1400abf92e56ae66aace2 Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:16:11.716177 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1857e1a960c1400abf92e56ae66aace2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1857e1a960c1400abf92e56ae66aace2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1857e1a960c1400abf92e56ae66aace2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1857e1a960c1400abf92e56ae66aace2"}]}] Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 1857e1a960c1400abf92e56ae66aace2 Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: f06ae2c3f7204487aa5b593c2d16e3ec Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:11.717270 n-d-858384-17 devstack@n-api.service[120587]: exception: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'flavor_id': '378687752', 'id': 'hw:cpu_thread_policy'} Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:11.717843 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.718896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.718896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.718896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.718896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:11.718896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:11.718896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. Oct 31 15:16:11.718896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.721982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b20659f-b027-4800-b164-4c2e2046f23a tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Returning 404 to user: Flavor 378687752 has no extra specs with key hw:cpu_thread_policy. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:11.724691 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b20659f-b027-4800-b164-4c2e2046f23a tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/378687752/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.050323 Oct 31 15:16:11.734490 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 16/35] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:16:11 2022] DELETE /compute/v2.1/flavors/378687752/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:16:11.753703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acdaf9ee-58e9-426f-9f1e-b3559f570c62 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:11.762496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1539b135-09b2-4b22-8a72-e0007274b29c tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.765005 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-acdaf9ee-58e9-426f-9f1e-b3559f570c62 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acdaf9ee-58e9-426f-9f1e-b3559f570c62 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Request method failure captured: Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 27 Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a4vnprarAK-mGieKyRFKDOz7GOYfEZMf8jqngi7hyTs3_nVJ4eLc7HS6N2hxJ-EzZLlydSz3bHGnzY0MvE32Rcx_qJvyoCZJcQ3aNhwK83DVhfz7HCnAJ4PB-cMd3pJnVYKreQs7dQgSrUIAWUC5QZZjvdARjYqtKumvjqEMcTNAE Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 1857e1a960c1400abf92e56ae66aace2 Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:16:11.777495 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1857e1a960c1400abf92e56ae66aace2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1857e1a960c1400abf92e56ae66aace2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1857e1a960c1400abf92e56ae66aace2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1857e1a960c1400abf92e56ae66aace2"}]}] Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 1857e1a960c1400abf92e56ae66aace2 Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: f06ae2c3f7204487aa5b593c2d16e3ec Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: {"hw:cpu_policy": "shared"} Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:11.778600 n-d-858384-17 devstack@n-api.service[120587]: exception: Request body and URI mismatch Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'flavor_id': '378687752', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.779227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.780124 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:11.780124 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:11.780124 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 31 15:16:11.780124 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.780124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acdaf9ee-58e9-426f-9f1e-b3559f570c62 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:11.780374 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-acdaf9ee-58e9-426f-9f1e-b3559f570c62 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.039195 Oct 31 15:16:11.780724 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 17/36] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:16:11 2022] PUT /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes => generated 73 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:11.791634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5c54e12-110f-4cf0-bd02-03a5165afae2 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5c54e12-110f-4cf0-bd02-03a5165afae2 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Request method failure captured: Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 49 Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a4vnprarAK-mGieKyRFKDOz7GOYfEZMf8jqngi7hyTs3_nVJ4eLc7HS6N2hxJ-EzZLlydSz3bHGnzY0MvE32Rcx_qJvyoCZJcQ3aNhwK83DVhfz7HCnAJ4PB-cMd3pJnVYKreQs7dQgSrUIAWUC5QZZjvdARjYqtKumvjqEMcTNAE Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 1857e1a960c1400abf92e56ae66aace2 Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:16:11.800276 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1857e1a960c1400abf92e56ae66aace2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1857e1a960c1400abf92e56ae66aace2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1857e1a960c1400abf92e56ae66aace2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1857e1a960c1400abf92e56ae66aace2"}]}] Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 1857e1a960c1400abf92e56ae66aace2 Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: f06ae2c3f7204487aa5b593c2d16e3ec Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 31 15:16:11.801623 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'flavor_id': '378687752', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance: Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 31 15:16:11.802175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.803200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:11.804122 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:11.804122 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:11.804122 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:16:11.804122 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:16:11.804122 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 31 15:16:11.804122 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:11.805757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5c54e12-110f-4cf0-bd02-03a5165afae2 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:11.806926 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5c54e12-110f-4cf0-bd02-03a5165afae2 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.019800 Oct 31 15:16:11.807756 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:16:11 2022] PUT /compute/v2.1/flavors/378687752/os-extra_specs/hw:numa_nodes => generated 117 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:16:11.822996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f1c4e33e-59c8-45b4-9240-1c0028ccddc2 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.837582 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1539b135-09b2-4b22-8a72-e0007274b29c tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5798 microversion: 2.1 time: 0.457278 Oct 31 15:16:11.838652 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 20/38] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:11 2022] GET /compute/v2.1/flavors/detail => generated 5798 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:11.874493 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f1c4e33e-59c8-45b4-9240-1c0028ccddc2 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/378687752" status: 202 len: 0 microversion: 2.1 time: 0.057727 Oct 31 15:16:11.877808 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 19/39] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:16:11 2022] DELETE /compute/v2.1/flavors/378687752 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:11.893196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ef88807-e5e2-48c9-9dbd-a77859bb49bf tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.937146 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ef88807-e5e2-48c9-9dbd-a77859bb49bf tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1571558310" status: 202 len: 0 microversion: 2.1 time: 0.057798 Oct 31 15:16:11.942383 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 20/40] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:11 2022] DELETE /compute/v2.1/flavors/1571558310 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:11.947681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f4c1c1d-13ab-4150-bf29-41dec9171934 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:11.975490 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f4c1c1d-13ab-4150-bf29-41dec9171934 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542 tempest-FlavorsExtraSpecsNegativeTestJSON-1936098542-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031715 Oct 31 15:16:11.977071 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:11.981802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ba948d5-ab59-4a95-8b80-1ffb22dfeade tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.002256 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ba948d5-ab59-4a95-8b80-1ffb22dfeade tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023917 Oct 31 15:16:12.003075 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 22/42] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:12.023934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-56f9bdb8-12fe-490c-9402-4d40e5623354 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1736893757", "id": 1859114140, "os-flavor-access:is_public": "False"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:12.047755 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-56f9bdb8-12fe-490c-9402-4d40e5623354 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.028002 Oct 31 15:16:12.049173 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 23/43] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:12 2022] POST /compute/v2.1/flavors => generated 430 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:12.058384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-620907564", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "availability_zone": "tempest-test_az-470591997"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:12.063079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d4d50a8-1cf4-43b6-b93f-5c26e0f2af56 tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "1859114140"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:12.080357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-3d4d50a8-1cf4-43b6-b93f-5c26e0f2af56 tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] HTTP exception thrown: Flavor 1859114140 could not be found. Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d4d50a8-1cf4-43b6-b93f-5c26e0f2af56 tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] Request method failure captured: Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 107 Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a00Sdc2MlzXL_o5--lnrB3w75A6ZMqr8aP-D40mCk9tYLYvrnkoDYqXXkevY6EGMwkrVDd45xN7Ef1nT4ZB6hwasO-1tt3224B_G8FPIakxNb3MJ8d6jw6QAoLB8uHiiCGY1sQSLKUiAvKJjoJMe2_UnoNzEV0LSkPbP7U0dwrH04 Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: cbce67f5f96547da94ff74f98ddb4067 Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsAdminTestJSON-1374783661 Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:12.086554 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbce67f5f96547da94ff74f98ddb4067"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cbce67f5f96547da94ff74f98ddb4067", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cbce67f5f96547da94ff74f98ddb4067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cbce67f5f96547da94ff74f98ddb4067"}]}] Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsAdminTestJSON-1374783661 Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: cbce67f5f96547da94ff74f98ddb4067 Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1374783661 Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsAdminTestJSON-1374783661-project Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1f2f8545eb684d179d4890fc6f41d95d Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsAdminTestJSON-1374783661-project Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "test", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "1859114140"}} Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:12.087721 n-d-858384-17 devstack@n-api.service[120587]: exception: Flavor 1859114140 could not be found. Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '1859114140'}}} Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1859114140 could not be found. Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:12.088352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1859114140 could not be found. Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:12.089335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:12.090378 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:12.090378 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:12.090378 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:12.090378 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1859114140 could not be found. Oct 31 15:16:12.090378 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:12.092921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d4d50a8-1cf4-43b6-b93f-5c26e0f2af56 tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] Returning 400 to user: Flavor 1859114140 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:12.094562 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d4d50a8-1cf4-43b6-b93f-5c26e0f2af56 tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.037330 Oct 31 15:16:12.096513 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 24/44] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:12 2022] POST /compute/v2.1/servers => generated 81 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:12.116679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-569a3212-a824-4094-a796-4c520ad11f81 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.126580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.127080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.129997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.130958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:12.133419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:12.135465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:12.157017 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-569a3212-a824-4094-a796-4c520ad11f81 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1859114140" status: 202 len: 0 microversion: 2.1 time: 0.055402 Oct 31 15:16:12.157940 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 25/45] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:12 2022] DELETE /compute/v2.1/flavors/1859114140 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:12.170824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4b2247a-b240-4135-8af9-34af32703f21 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.184361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6,nova_api:DELETE=15 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:12.222348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4b2247a-b240-4135-8af9-34af32703f21 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059386 Oct 31 15:16:12.223723 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 26/46] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:12.245778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d90a9d47-78f8-4193-ae1c-74f3c1a03300 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-706081539", "id": 1531015329, "os-flavor-access:is_public": "False"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:12.274507 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d90a9d47-78f8-4193-ae1c-74f3c1a03300 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033570 Oct 31 15:16:12.284227 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 27/47] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:12 2022] POST /compute/v2.1/flavors => generated 414 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:12.296221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46f56884-37b9-4297-ab68-4507652bf8a4 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1834147118", "id": 1315994636, "os-flavor-access:is_public": "True"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:12.343063 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46f56884-37b9-4297-ab68-4507652bf8a4 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.055747 Oct 31 15:16:12.351914 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 28/48] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:12 2022] POST /compute/v2.1/flavors => generated 414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:12.357557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83c115cc-c0c1-4afd-99b6-c8a364fab57c tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.381047 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-83c115cc-c0c1-4afd-99b6-c8a364fab57c tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.027811 Oct 31 15:16:12.381670 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 29/49] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:12.396928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7626b776-4625-4e42-a744-7a5f0a0c9c6b tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.407799 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7626b776-4625-4e42-a744-7a5f0a0c9c6b tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.016296 Oct 31 15:16:12.408739 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 30/50] 10.222.0.20 () {58 vars in 1177 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:12.422011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b249b8a-a06d-430e-9ca0-09d1e95bef90 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.434041 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b249b8a-a06d-430e-9ca0-09d1e95bef90 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.015465 Oct 31 15:16:12.443930 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 31/51] 10.222.0.20 () {58 vars in 1171 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:12.448845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3fc6722a-2fcb-4d82-91fe-9abe98a1b8c0 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.459838 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3fc6722a-2fcb-4d82-91fe-9abe98a1b8c0 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.014464 Oct 31 15:16:12.469548 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 32/52] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:12.474806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-427a4840-150f-4d39-9f60-90086c16b5a7 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.503172 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-427a4840-150f-4d39-9f60-90086c16b5a7 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.032095 Oct 31 15:16:12.525054 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 33/53] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:12.538880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e2fd3be-01c1-41e6-9aa5-36eace093e63 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.598043 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e2fd3be-01c1-41e6-9aa5-36eace093e63 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.071707 Oct 31 15:16:12.602497 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 34/54] 10.222.0.20 () {58 vars in 1175 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:12.622871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65a45150-e086-464e-a51a-9bc7fb345499 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.672631 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65a45150-e086-464e-a51a-9bc7fb345499 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.051677 Oct 31 15:16:12.674178 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 35/55] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:12.693883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-025e2599-e9b9-42ba-b7b9-7cfcf355fa07 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.733696 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-025e2599-e9b9-42ba-b7b9-7cfcf355fa07 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.044110 Oct 31 15:16:12.734618 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 36/56] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:12.758295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-649aa955-b718-4158-88e3-970cca3a5eaa tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.793475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-649aa955-b718-4158-88e3-970cca3a5eaa tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1315994636" status: 202 len: 0 microversion: 2.1 time: 0.042878 Oct 31 15:16:12.794525 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 37/57] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:12 2022] DELETE /compute/v2.1/flavors/1315994636 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:16:12.809025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d7ee95bb-74e3-4548-b46b-6e988303b2ef tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:12.859323 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d7ee95bb-74e3-4548-b46b-6e988303b2ef tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057656 Oct 31 15:16:12.860477 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 38/58] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:13.054387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:13.172258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d59f39ea-5959-46d8-aa28-acc5fc2d2da6 tempest-AZAdminNegativeTestJSON-1867544242 tempest-AZAdminNegativeTestJSON-1867544242-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.176173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d59f39ea-5959-46d8-aa28-acc5fc2d2da6 tempest-AZAdminNegativeTestJSON-1867544242 tempest-AZAdminNegativeTestJSON-1867544242-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '35cceec37b3e4651bbb1b5e6260fe77a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f49ddda94fd5484e89c67531c53d5e56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d59f39ea-5959-46d8-aa28-acc5fc2d2da6 tempest-AZAdminNegativeTestJSON-1867544242 tempest-AZAdminNegativeTestJSON-1867544242-project] Request method failure captured: Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a7XLQCvnEe7sWMcmr99F1gJpBbvHJVQ2gAwLwgN6NUiN5q23re_L50I8BNu5Nt9Ux5jkQofQVUYwWoSxGgvyxyAVmfg0WJl_rGz3GUSDBBkQ7aUwHawIKfvTmvjfwViLKFUtmAGi7SSbKdpV6NGzsAMX02gDBz-v077aaMpNU2Cvk Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f49ddda94fd5484e89c67531c53d5e56 Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1867544242 Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:13.176754 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f49ddda94fd5484e89c67531c53d5e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f49ddda94fd5484e89c67531c53d5e56", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f49ddda94fd5484e89c67531c53d5e56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f49ddda94fd5484e89c67531c53d5e56"}]}] Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AZAdminNegativeTestJSON-1867544242 Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f49ddda94fd5484e89c67531c53d5e56 Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1867544242 Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AZAdminNegativeTestJSON-1867544242-project Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 35cceec37b3e4651bbb1b5e6260fe77a Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AZAdminNegativeTestJSON-1867544242-project Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 31 15:16:13.177922 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:13.178556 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:13.179552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d59f39ea-5959-46d8-aa28-acc5fc2d2da6 tempest-AZAdminNegativeTestJSON-1867544242 tempest-AZAdminNegativeTestJSON-1867544242-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:13.181319 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d59f39ea-5959-46d8-aa28-acc5fc2d2da6 tempest-AZAdminNegativeTestJSON-1867544242 tempest-AZAdminNegativeTestJSON-1867544242-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.316920 Oct 31 15:16:13.181319 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 39/59] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 31 15:16:12 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 318 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:13.190943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e9c848de-f825-43df-b33a-dd0aa33d4b82 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.232253 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e9c848de-f825-43df-b33a-dd0aa33d4b82 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1531015329" status: 202 len: 0 microversion: 2.1 time: 0.051841 Oct 31 15:16:13.241112 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 40/60] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:13 2022] DELETE /compute/v2.1/flavors/1531015329 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:13.251545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7203d54-87d9-493d-86ce-81919e4e5bc8 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.292256 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7203d54-87d9-493d-86ce-81919e4e5bc8 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049661 Oct 31 15:16:13.306910 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 41/61] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:13.316753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-15e07963-1192-417c-bb9d-2d9c73aaa5cc tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1055862261", "id": 576737838, "os-flavor-access:is_public": "False"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:13.346258 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-15e07963-1192-417c-bb9d-2d9c73aaa5cc tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.033700 Oct 31 15:16:13.355784 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 42/62] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:13 2022] POST /compute/v2.1/flavors => generated 412 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:13.370998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a78643be-4959-4956-9ed6-93278c774047 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.409105 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a78643be-4959-4956-9ed6-93278c774047 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051174 Oct 31 15:16:13.410734 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 43/63] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:13.434536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb179d72-c14f-4bc4-bdb7-098728f10bd7 tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.494831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:13.496017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:13.497266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:13.498058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:13.499029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:13.499480 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fb179d72-c14f-4bc4-bdb7-098728f10bd7 tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073115 Oct 31 15:16:13.516428 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 44/64] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:13.527389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52c04472-0e3d-4d76-8e84-ffaf0346fc23 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.585903 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52c04472-0e3d-4d76-8e84-ffaf0346fc23 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/576737838" status: 202 len: 0 microversion: 2.1 time: 0.067879 Oct 31 15:16:13.586548 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 45/65] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:16:13 2022] DELETE /compute/v2.1/flavors/576737838 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:13.599022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6433eb2a-1c3f-4731-995b-a6bfc5c4eca8 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.615134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:13.616449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:13.618296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:13.619680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:13.620938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:13.621824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:13.649593 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6433eb2a-1c3f-4731-995b-a6bfc5c4eca8 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057307 Oct 31 15:16:13.651741 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 46/66] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:13.672715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ebb0fcb9-f321-4a95-8518-1176fec20c07 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-678989208", "id": 1300144189, "os-flavor-access:is_public": "True"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:13.685190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Getting quotas for project f75067d429b8476a87f21278c15f713f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:13.714106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Getting quotas for user f11b3f04a10a448c84cc00549be53fb6 and project f75067d429b8476a87f21278c15f713f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:13.723703 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ebb0fcb9-f321-4a95-8518-1176fec20c07 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.054410 Oct 31 15:16:13.724662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=9,nova_api:INSERT=7,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:13.724865 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 47/67] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:13 2022] POST /compute/v2.1/flavors => generated 413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:13.749289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4947f48-4b28-4649-89a6-965603ed5f43 tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.749487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:13.757025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:13.783348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4947f48-4b28-4649-89a6-965603ed5f43 tempest-FlavorsAdminTestJSON-1374783661 tempest-FlavorsAdminTestJSON-1374783661-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.042078 Oct 31 15:16:13.806077 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 48/68] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:13.812306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-596ec8f5-dbfc-49a5-84e9-0b80defbec31 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.853870 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-596ec8f5-dbfc-49a5-84e9-0b80defbec31 tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1300144189" status: 202 len: 0 microversion: 2.1 time: 0.046372 Oct 31 15:16:13.861605 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 49/69] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:13 2022] DELETE /compute/v2.1/flavors/1300144189 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:13.877163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-edf0d998-7574-4bc7-8b21-0819936ae40c tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.945949 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-edf0d998-7574-4bc7-8b21-0819936ae40c tempest-FlavorsAdminTestJSON-1615105394 tempest-FlavorsAdminTestJSON-1615105394-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083132 Oct 31 15:16:13.949419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e3b5dfb-f8a7-491a-a445-499b6145ba69 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.093528 Oct 31 15:16:13.950051 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 21/70] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:16:13.955187 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 50/71] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:13.966267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db8772e1-0c70-4744-86a4-a9e28b59c41d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:13.968330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-db8772e1-0c70-4744-86a4-a9e28b59c41d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:14.268086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-db8772e1-0c70-4744-86a4-a9e28b59c41d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:14.311598 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db8772e1-0c70-4744-86a4-a9e28b59c41d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1241 microversion: 2.1 time: 0.353142 Oct 31 15:16:14.313778 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 22/72] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:13 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1241 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:15.340120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ba634c1-b1ff-4d76-a2fe-94d59d61e0ed tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:15.341181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ba634c1-b1ff-4d76-a2fe-94d59d61e0ed tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:16.592481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8ba634c1-b1ff-4d76-a2fe-94d59d61e0ed tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:16.613975 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ba634c1-b1ff-4d76-a2fe-94d59d61e0ed tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1241 microversion: 2.1 time: 1.278952 Oct 31 15:16:16.616043 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 51/73] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:15 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1241 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:17.639524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:17.640784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:17.654017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:17.656311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:17.657141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:17.661054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:17.663729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:17.664072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:18.070564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:18.100223 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab0e74d4-7302-44cd-b551-5180b2aa5117 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1295 microversion: 2.1 time: 0.464423 Oct 31 15:16:18.102781 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 23/74] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:17 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1295 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:19.129372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:19.130764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:19.160716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:19.161027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:19.161525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:19.162229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:19.162691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:19.163124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:19.887761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:19.916397 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45c128d2-ee17-456f-ba30-c0d8fc5db6c8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.791182 Oct 31 15:16:19.918532 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 52/75] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:19 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:20.955878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:20.956570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:20.966122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:20.973325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.975969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.975969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:20.975969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:20.975969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:20.976389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.409214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:21.442589 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4d23728-fd0f-4a84-8589-0fc66e84f5eb tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.487148 Oct 31 15:16:21.450255 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 53/76] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:20 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:21.691419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Calling method '.version_select at 0x7f16e2229c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:21.693262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.693777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.694215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.767493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.771593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.772063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.818216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.819995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.824257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.838086 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e23248a-f01a-4e27-8933-940b38e0808b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.991959 Oct 31 15:16:21.838697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 24/77] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 31 15:16:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:21.892536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-609b0717-b580-4447-80b5-f1fafd9314fd tempest-FlavorsV255TestJSON-1853407187 tempest-FlavorsV255TestJSON-1853407187-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-918503041", "id": 1473410035, "os-flavor-access:is_public": "True"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:21.928415 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-609b0717-b580-4447-80b5-f1fafd9314fd tempest-FlavorsV255TestJSON-1853407187 tempest-FlavorsV255TestJSON-1853407187-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.476532 Oct 31 15:16:21.929694 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 54/78] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:16:21 2022] POST /compute/v2.1/flavors => generated 448 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:21.941995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b6c3f4f-cf6a-4ada-af64-762a7524864b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Calling method '.version_select at 0x7f16e21e61f0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:21.950286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c3f4f-cf6a-4ada-af64-762a7524864b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:21.951243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c3f4f-cf6a-4ada-af64-762a7524864b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:21.951928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c3f4f-cf6a-4ada-af64-762a7524864b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:21.967163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e11b590-4652-4450-b799-3077ac152d92 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1340721545", "id": 878777425, "os-flavor-access:is_public": "False"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:22.000326 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e11b590-4652-4450-b799-3077ac152d92 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.160245 Oct 31 15:16:22.004776 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 25/79] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:21 2022] POST /compute/v2.1/flavors => generated 428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:22.006780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c3f4f-cf6a-4ada-af64-762a7524864b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.007220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c3f4f-cf6a-4ada-af64-762a7524864b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.007552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c3f4f-cf6a-4ada-af64-762a7524864b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.027762 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b6c3f4f-cf6a-4ada-af64-762a7524864b tempest-HypervisorAdminV228Test-1721213621 tempest-HypervisorAdminV228Test-1721213621-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.094044 Oct 31 15:16:22.030746 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 55/80] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 31 15:16:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:22.054840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1a0b749-b64d-4c7d-a58f-0f8f7d4f9448 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "f862dece3e5f4129ac478d923ef3f68d"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:22.315051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-38bd9109-27fd-4b93-9f96-497fd1250108 tempest-FlavorsV255TestJSON-396518784 tempest-FlavorsV255TestJSON-396518784-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:22.346429 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-38bd9109-27fd-4b93-9f96-497fd1250108 tempest-FlavorsV255TestJSON-396518784 tempest-FlavorsV255TestJSON-396518784-project] 10.222.0.20 "GET /compute/v2.1/flavors/1473410035" status: 200 len: 448 microversion: 2.55 time: 0.337823 Oct 31 15:16:22.364493 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 26/81] 10.222.0.20 () {60 vars in 1199 bytes} [Mon Oct 31 15:16:22 2022] GET /compute/v2.1/flavors/1473410035 => generated 448 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:22.381570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d059a6d-c35d-490d-9ed1-a0fbc372ac5e tempest-FlavorsV255TestJSON-1853407187 tempest-FlavorsV255TestJSON-1853407187-project-admin] Action: 'update', calling method: .version_select at 0x7f16e320ab80>, body: {"flavor": {"description": "new"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:22.565633 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d059a6d-c35d-490d-9ed1-a0fbc372ac5e tempest-FlavorsV255TestJSON-1853407187 tempest-FlavorsV255TestJSON-1853407187-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1473410035" status: 200 len: 449 microversion: 2.55 time: 0.189605 Oct 31 15:16:22.570808 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 27/82] 10.222.0.20 () {62 vars in 1219 bytes} [Mon Oct 31 15:16:22 2022] PUT /compute/v2.1/flavors/1473410035 => generated 449 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:22.574108 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1a0b749-b64d-4c7d-a58f-0f8f7d4f9448 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/878777425/action" status: 200 len: 96 microversion: 2.1 time: 0.541584 Oct 31 15:16:22.586573 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 56/83] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Oct 31 15:16:22 2022] POST /compute/v2.1/flavors/878777425/action => generated 96 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:22.609486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2dc92deb-3e31-483f-af68-5ffa6f0be0df tempest-FlavorsV255TestJSON-396518784 tempest-FlavorsV255TestJSON-396518784-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:22.611004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:22.612475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:22.635859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.642350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.642898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.644645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:22.645665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:22.646649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:22.672697 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2dc92deb-3e31-483f-af68-5ffa6f0be0df tempest-FlavorsV255TestJSON-396518784 tempest-FlavorsV255TestJSON-396518784-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.081742 Oct 31 15:16:22.676549 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 57/84] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 31 15:16:22 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:23.175575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c1c5c91-5b9a-4a67-9251-9a8ee3d4c939 tempest-FlavorsAccessTestJSON-1003516006 tempest-FlavorsAccessTestJSON-1003516006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.248242 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c1c5c91-5b9a-4a67-9251-9a8ee3d4c939 tempest-FlavorsAccessTestJSON-1003516006 tempest-FlavorsAccessTestJSON-1003516006-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5826 microversion: 2.1 time: 0.570242 Oct 31 15:16:23.261151 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 58/85] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:22 2022] GET /compute/v2.1/flavors/detail => generated 5826 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:23.262536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e6006f8-4826-4cbb-b183-b134b5ad6f0c tempest-FlavorsV255TestJSON-396518784 tempest-FlavorsV255TestJSON-396518784-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.271611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:DELETE=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:23.317928 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e6006f8-4826-4cbb-b183-b134b5ad6f0c tempest-FlavorsV255TestJSON-396518784 tempest-FlavorsV255TestJSON-396518784-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.067133 Oct 31 15:16:23.319614 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 59/86] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:23.334102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6248ec59-6bbf-406d-850e-403217fc291c tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "f862dece3e5f4129ac478d923ef3f68d"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:23.493276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:23.508479 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89102e98-4db8-4572-bb40-8796cf10efc6 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.936545 Oct 31 15:16:23.513829 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 28/87] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:22 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:23.659929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:23.671520 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6248ec59-6bbf-406d-850e-403217fc291c tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/878777425/action" status: 200 len: 21 microversion: 2.1 time: 0.348842 Oct 31 15:16:23.673459 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 60/88] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Oct 31 15:16:23 2022] POST /compute/v2.1/flavors/878777425/action => generated 21 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:23.675764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-41908a10-65ee-4bdd-9be4-70fa9978c58c req-f268fd15-3777-48f3-82ce-adeb2eda78e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee21f97a-b117-41b9-bb10-029bd6b05cd5", "tag": "54f08fde-d450-4933-b2d2-7f228ea714e6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:23.685162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da20ba6c-63c7-47a3-bfec-d002d205ff93 tempest-FlavorsV255TestJSON-1853407187 tempest-FlavorsV255TestJSON-1853407187-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.707682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41908a10-65ee-4bdd-9be4-70fa9978c58c req-f268fd15-3777-48f3-82ce-adeb2eda78e1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.708370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41908a10-65ee-4bdd-9be4-70fa9978c58c req-f268fd15-3777-48f3-82ce-adeb2eda78e1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.709346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41908a10-65ee-4bdd-9be4-70fa9978c58c req-f268fd15-3777-48f3-82ce-adeb2eda78e1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.773549 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-41908a10-65ee-4bdd-9be4-70fa9978c58c req-f268fd15-3777-48f3-82ce-adeb2eda78e1 service nova] Creating event network-changed:54f08fde-d450-4933-b2d2-7f228ea714e6 for instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 on n-h1-858384-17 Oct 31 15:16:23.774295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41908a10-65ee-4bdd-9be4-70fa9978c58c req-f268fd15-3777-48f3-82ce-adeb2eda78e1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:16:23.775337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41908a10-65ee-4bdd-9be4-70fa9978c58c req-f268fd15-3777-48f3-82ce-adeb2eda78e1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:16:23.784871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f9848a1-9538-479f-b859-01dbcff86383 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.785610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f9848a1-9538-479f-b859-01dbcff86383 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.789370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f9848a1-9538-479f-b859-01dbcff86383 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.790286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f9848a1-9538-479f-b859-01dbcff86383 None None] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:23.790764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f9848a1-9538-479f-b859-01dbcff86383 None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:23.793329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f9848a1-9538-479f-b859-01dbcff86383 None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:23.793837 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da20ba6c-63c7-47a3-bfec-d002d205ff93 tempest-FlavorsV255TestJSON-1853407187 tempest-FlavorsV255TestJSON-1853407187-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1473410035" status: 202 len: 0 microversion: 2.55 time: 0.116003 Oct 31 15:16:23.798552 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 61/89] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Oct 31 15:16:23 2022] DELETE /compute/v2.1/flavors/1473410035 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:16:23.814450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b76284f1-91c8-4b3f-8fc7-5e87febd4deb tempest-FlavorsAccessTestJSON-1003516006 tempest-FlavorsAccessTestJSON-1003516006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.826539 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.rpcapi [None req-4f9848a1-9538-479f-b859-01dbcff86383 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 31 15:16:23.830283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f9848a1-9538-479f-b859-01dbcff86383 None None] Releasing lock "compute-rpcapi-router" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:16:23.863650 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b76284f1-91c8-4b3f-8fc7-5e87febd4deb tempest-FlavorsAccessTestJSON-1003516006 tempest-FlavorsAccessTestJSON-1003516006-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057601 Oct 31 15:16:23.864596 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 62/90] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:23.871281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c312bf01-34c3-4885-b4d6-18f67a95ddf7 tempest-FlavorsV255TestJSON-1853407187 tempest-FlavorsV255TestJSON-1853407187-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.871612 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4f9848a1-9538-479f-b859-01dbcff86383 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356249 Oct 31 15:16:23.876031 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 29/91] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:23.887234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c109897-58e5-4873-beda-4fb4bf2fba46 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.911494 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c312bf01-34c3-4885-b4d6-18f67a95ddf7 tempest-FlavorsV255TestJSON-1853407187 tempest-FlavorsV255TestJSON-1853407187-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.044165 Oct 31 15:16:23.912681 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 63/92] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:16:23.952423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c109897-58e5-4873-beda-4fb4bf2fba46 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/878777425" status: 202 len: 0 microversion: 2.1 time: 0.065468 Oct 31 15:16:23.953272 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 30/93] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:16:23 2022] DELETE /compute/v2.1/flavors/878777425 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:23.965019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50a48873-d819-40a6-beee-6c1613a936fc tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:23.995775 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-50a48873-d819-40a6-beee-6c1613a936fc tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035928 Oct 31 15:16:23.997059 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 64/94] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:24.023856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2a7a01c-8382-4fac-9778-266fdb80cd74 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-57098406", "id": 349132899, "os-flavor-access:is_public": "False"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:24.075261 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c2a7a01c-8382-4fac-9778-266fdb80cd74 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.054710 Oct 31 15:16:24.083664 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 31/95] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:24 2022] POST /compute/v2.1/flavors => generated 426 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:24.092159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a573f80d-32a7-4c73-a2db-da94d0b65088 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.129604 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a573f80d-32a7-4c73-a2db-da94d0b65088 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/349132899/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.044575 Oct 31 15:16:24.143216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-595733c4-6512-449d-9e18-409793c4f79b tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.155369 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 65/96] 10.222.0.20 () {58 vars in 1206 bytes} [Mon Oct 31 15:16:24 2022] GET /compute/v2.1/flavors/349132899/os-flavor-access => generated 21 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:16:24.184725 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-595733c4-6512-449d-9e18-409793c4f79b tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/349132899" status: 202 len: 0 microversion: 2.1 time: 0.047000 Oct 31 15:16:24.198883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95cf61c1-e92a-4466-a541-652315597e78 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.203987 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 32/97] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:16:24 2022] DELETE /compute/v2.1/flavors/349132899 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:24.231990 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95cf61c1-e92a-4466-a541-652315597e78 tempest-FlavorsAccessTestJSON-928882332 tempest-FlavorsAccessTestJSON-928882332-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038654 Oct 31 15:16:24.235142 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 66/98] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:24.539743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:24.540823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:24.543391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:24.559392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.560239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.560756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:24.562429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:24.563836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:24.566403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:25.035983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:25.044846 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0a8277c-0500-403f-b0a8-a00c919bf79b tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.509454 Oct 31 15:16:25.061940 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 33/99] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:24 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:26.095047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:26.096444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:26.117445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:26.119536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:26.122459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:26.123672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:26.123976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:26.124411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:26.591609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:26.605400 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfedf85a-e445-43d1-97e1-727b36c9854f tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.512251 Oct 31 15:16:26.622561 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 67/100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:26 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:27.643959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:27.647651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:27.658103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:27.682067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.682967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.683645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.684664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:27.685612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:27.686371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:27.983947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:28.006264 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-361b032a-5e11-49a5-8d0e-c2fca564ef94 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.374521 Oct 31 15:16:28.017469 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 68/101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:27 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:28.195240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc9f2533-829f-4a09-b102-ea20077f1abb tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:28.216278 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc9f2533-829f-4a09-b102-ea20077f1abb tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.741379 Oct 31 15:16:28.218038 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 34/102] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:16:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:28.904678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c137d1de-bfba-48cd-a358-7a48580af6e8 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-770707615", "id": 2033485829, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:28.942556 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c137d1de-bfba-48cd-a358-7a48580af6e8 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.704947 Oct 31 15:16:28.943940 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 69/103] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:28 2022] POST /compute/v2.1/flavors => generated 424 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:28.959864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d7f2a69c-da7e-49c2-8fc3-5aed1b62fbe5 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:28.970409 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d7f2a69c-da7e-49c2-8fc3-5aed1b62fbe5 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017625 Oct 31 15:16:28.972609 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 35/104] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Oct 31 15:16:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:28.983618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-70a10033-a3e5-4460-b509-01a5417e565d tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1753958338", "id": 1238317695, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:29.031170 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-70a10033-a3e5-4460-b509-01a5417e565d tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.051941 Oct 31 15:16:29.037326 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 70/105] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:28 2022] POST /compute/v2.1/flavors => generated 425 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:29.045250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:29.047587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:29.050481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-978d9abb-af95-489a-b44e-9fc1dd0fb5a8 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:29.056260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.057053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.057733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.058643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:29.059790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:29.060573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:29.072400 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-978d9abb-af95-489a-b44e-9fc1dd0fb5a8 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023212 Oct 31 15:16:29.081510 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 71/106] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Oct 31 15:16:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:29.087773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7a19c8c-eb83-49c9-b272-c50a2a780ab9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Action: 'create', calling method: .version_select at 0x7f16e21d7430>, body: {"keypair": {"name": "tempest-keypair-123702585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXCced/kEjGnEhUKhqlv7W0vwWGFtddJxMghHwFxcDYedmNAJLRYHku1ywYAHjPBnf1GGLwLVCAM0yIvTDQqoxzLYVU3s9InYZbROZrzTsEWLRC4AeWc06Gq8tL/hQ6tA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:29.174820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e7a19c8c-eb83-49c9-b272-c50a2a780ab9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Getting quotas for project 726e2d465c8d41eb904f9a561363b927. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:29.192652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e7a19c8c-eb83-49c9-b272-c50a2a780ab9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Getting quotas for user fa8b2998637d46cea5484de42091b1ef and project 726e2d465c8d41eb904f9a561363b927. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:29.266938 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7a19c8c-eb83-49c9-b272-c50a2a780ab9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183077 Oct 31 15:16:29.271038 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 72/107] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:16:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:29.512212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:29.528717 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fef651d6-3adf-4971-8e5f-77669331c092 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.494535 Oct 31 15:16:29.529586 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 36/108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:29 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:30.557471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:30.558275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:30.568944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:30.570386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:30.571994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:30.574131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:30.575504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:30.577582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:30.819511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:30.828111 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16408a54-7c5c-4de4-8ae6-1a4a9ea8fc15 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.275805 Oct 31 15:16:30.845064 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 73/109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:30 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:31.780594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-695706614", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "1238317695", "adminPass": "***", "networks": [{"uuid": "f566a996-f9c7-4755-bfaa-8969fed73a21"}], "security_groups": [{"name": "tempest-securitygroup--81762354"}], "key_name": "tempest-keypair-123702585", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:31.977771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] validate_networks() for [('f566a996-f9c7-4755-bfaa-8969fed73a21', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:16:32.035494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5934a66f-d245-4900-9491-afb8fc4f19a9 tempest-InstanceUsageAuditLogTestJSON-1612924162 tempest-InstanceUsageAuditLogTestJSON-1612924162-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.069555 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5934a66f-d245-4900-9491-afb8fc4f19a9 tempest-InstanceUsageAuditLogTestJSON-1612924162 tempest-InstanceUsageAuditLogTestJSON-1612924162-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31 15:16:31" status: 200 len: 318 microversion: 2.1 time: 0.335001 Oct 31 15:16:32.075080 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 37/110] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:16:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31%2015%3A16%3A31 => generated 318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:32.094638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.095884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:32.103885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.104964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.105905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.106850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:32.107509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:32.108143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:32.285686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:32.294279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-41194162-2267-4f45-8f32-76246376969c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.217845 Oct 31 15:16:32.309171 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 38/111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:32.309171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b50935c5-0220-412b-a0df-8e9f67e902c5 tempest-InstanceUsageAuditLogTestJSON-1612924162 tempest-InstanceUsageAuditLogTestJSON-1612924162-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.324360 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b50935c5-0220-412b-a0df-8e9f67e902c5 tempest-InstanceUsageAuditLogTestJSON-1612924162 tempest-InstanceUsageAuditLogTestJSON-1612924162-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.025635 Oct 31 15:16:32.324961 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 39/112] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:32.326121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b50935c5-0220-412b-a0df-8e9f67e902c5 tempest-InstanceUsageAuditLogTestJSON-1612924162 tempest-InstanceUsageAuditLogTestJSON-1612924162-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:32.327268 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b50935c5-0220-412b-a0df-8e9f67e902c5 tempest-InstanceUsageAuditLogTestJSON-1612924162 tempest-InstanceUsageAuditLogTestJSON-1612924162-project-admin] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001209 Oct 31 15:16:32.328276 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 40/113] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 31 15:16:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 15:16:33.309989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:16:33.310485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:16:33.310958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:16:33.311704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:16:33.312373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:16:33.323450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.324129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.324863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.325623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.326080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.326498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.368351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Getting quotas for project 726e2d465c8d41eb904f9a561363b927. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:33.374332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Getting quotas for user fa8b2998637d46cea5484de42091b1ef and project 726e2d465c8d41eb904f9a561363b927. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:33.394197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-641543ef-98bd-4283-ade1-2efc7f1bed40 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1305443590", "id": 1694439127, "os-flavor-access:is_public": "False"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:33.399389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:16:33.402604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:16:33.421085 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-641543ef-98bd-4283-ade1-2efc7f1bed40 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.250154 Oct 31 15:16:33.421906 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 41/114] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:33 2022] POST /compute/v2.1/flavors => generated 439 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:33.435726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.436585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.444092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.444470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.445011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.445768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:33.446217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:33.446632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:33.465450 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-655e501c-445d-4b19-bf78-b8d6953de96c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.689735 Oct 31 15:16:33.466617 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 74/115] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:31 2022] POST /compute/v2.1/servers => generated 400 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:16:33.473987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5b16d65-6ec3-4a5c-96b8-e1562748439b tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:33.579911 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5b16d65-6ec3-4a5c-96b8-e1562748439b tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1694439127/action" status: 200 len: 97 microversion: 2.1 time: 0.111553 Oct 31 15:16:33.583468 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 75/116] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 31 15:16:33 2022] POST /compute/v2.1/flavors/1694439127/action => generated 97 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:33.590460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-998e884b-aa21-4493-b12a-6230a0fec840 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:33.591333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-998e884b-aa21-4493-b12a-6230a0fec840 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:33.685511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:33.702223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-998e884b-aa21-4493-b12a-6230a0fec840 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:33.704171 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d7f6c23-74e6-4b60-a0c6-5a662f87e0ba tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.272095 Oct 31 15:16:33.709529 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 42/117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:33 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:33.710546 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-998e884b-aa21-4493-b12a-6230a0fec840 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1263 microversion: 2.1 time: 0.125618 Oct 31 15:16:33.713154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 76/118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:33 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1263 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:33.726721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32c56418-a04b-46d9-9d9f-e09445c581d6 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:33.814714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:34.231864 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-32c56418-a04b-46d9-9d9f-e09445c581d6 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project 88821e97dee346fa96829560407330ee combination. Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32c56418-a04b-46d9-9d9f-e09445c581d6 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Request method failure captured: Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/flavors/1694439127/action HTTP/1.1 Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 67 Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bQCatq22mtyFtY6s2dMnz7QyDqbYvTkmCGeinTtG47y_sOFEinTmYtZOAsjfScpf58hpMb_9aJE0ArOoc5CTswlrRIA5GeFPnhYLHmQedVqtPLf_4QkLPNEv_Cy0E7aAq7wLE_okhOUZkEU0Y0ynrBQnO3IPbYH0yD19qL_Ufpk_c Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5b3f914266534998bc6b70e4aa2e47b3 Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1712504238 Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:34.257461 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b3f914266534998bc6b70e4aa2e47b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b3f914266534998bc6b70e4aa2e47b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b3f914266534998bc6b70e4aa2e47b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b3f914266534998bc6b70e4aa2e47b3"}]}] Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1712504238 Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5b3f914266534998bc6b70e4aa2e47b3 Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1712504238 Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c4bd8b429d2e4e6fb124d9131e0ec185 Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: {"addTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} Oct 31 15:16:34.258989 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: exception: Flavor access already exists for flavor 32 and project 88821e97dee346fa96829560407330ee combination. Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '1694439127', 'body': {'addTenantAccess': {'tenant': '88821e97dee346fa96829560407330ee'}}} Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:16:34.259778 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-88821e97dee346fa96829560407330ee' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi session.flush() Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 15:16:34.260888 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 15:16:34.262096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:16:34.263691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-88821e97dee346fa96829560407330ee' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 31, 15, 16, 34, 225631), 'updated_at': None, 'flavor_id': 32, 'project_id': '88821e97dee346fa96829560407330ee'}] Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:34.265201 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project 88821e97dee346fa96829560407330ee combination. Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:34.266568 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project 88821e97dee346fa96829560407330ee combination. Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:34.268671 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:34.269919 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project 88821e97dee346fa96829560407330ee combination. Oct 31 15:16:34.269919 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:34.272876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32c56418-a04b-46d9-9d9f-e09445c581d6 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project 88821e97dee346fa96829560407330ee combination. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:34.273799 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32c56418-a04b-46d9-9d9f-e09445c581d6 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1694439127/action" status: 409 len: 152 microversion: 2.1 time: 0.563226 Oct 31 15:16:34.274557 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 43/119] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 31 15:16:33 2022] POST /compute/v2.1/flavors/1694439127/action => generated 152 bytes in 565 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:34.283176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e53135ef-1ffc-4361-8e32-d408ac047cf2 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:34.730330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:34.730949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:34.735783 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e53135ef-1ffc-4361-8e32-d408ac047cf2 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1694439127/action" status: 200 len: 21 microversion: 2.1 time: 0.456783 Oct 31 15:16:34.736442 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 77/120] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 31 15:16:34 2022] POST /compute/v2.1/flavors/1694439127/action => generated 21 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:16:34.739225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.745261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.745741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.746470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.747039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.747224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:34.747460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.747858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:34.765486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.766425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.770167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.772143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:34.773150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:34.773795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:34.850674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:34.859917 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce059935-15f1-482e-9120-4adff5ed44c6 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1259 microversion: 2.1 time: 0.117646 Oct 31 15:16:34.860757 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 78/121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:34 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1259 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:34.868984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8225e70f-eb72-4326-8ec4-2fc031d9c5a6 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:34.899763 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8225e70f-eb72-4326-8ec4-2fc031d9c5a6 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1694439127" status: 202 len: 0 microversion: 2.1 time: 0.037700 Oct 31 15:16:34.900368 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 79/122] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:34 2022] DELETE /compute/v2.1/flavors/1694439127 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:34.907955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87aa25b8-5779-4db9-9df2-d0fabe089670 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:34.930511 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87aa25b8-5779-4db9-9df2-d0fabe089670 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.025892 Oct 31 15:16:34.931122 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 80/123] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:34 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:34.952546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a58f4c55-5402-455f-9e41-cc8f1a4531a7 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1056012361", "id": 753570141, "os-flavor-access:is_public": "True"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:34.960071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=8,nova_api:INSERT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:34.977194 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a58f4c55-5402-455f-9e41-cc8f1a4531a7 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.028472 Oct 31 15:16:34.978070 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 81/124] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:34 2022] POST /compute/v2.1/flavors => generated 435 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:34.995405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25755296-aa78-4376-8de1-95682a5adceb tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.005998 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-25755296-aa78-4376-8de1-95682a5adceb tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25755296-aa78-4376-8de1-95682a5adceb tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Request method failure captured: Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/flavors/753570141/os-flavor-access HTTP/1.1 Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bQCatq22mtyFtY6s2dMnz7QyDqbYvTkmCGeinTtG47y_sOFEinTmYtZOAsjfScpf58hpMb_9aJE0ArOoc5CTswlrRIA5GeFPnhYLHmQedVqtPLf_4QkLPNEv_Cy0E7aAq7wLE_okhOUZkEU0Y0ynrBQnO3IPbYH0yD19qL_Ufpk_c Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5b3f914266534998bc6b70e4aa2e47b3 Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1712504238 Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:16:35.008022 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b3f914266534998bc6b70e4aa2e47b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b3f914266534998bc6b70e4aa2e47b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b3f914266534998bc6b70e4aa2e47b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b3f914266534998bc6b70e4aa2e47b3"}]}] Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1712504238 Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5b3f914266534998bc6b70e4aa2e47b3 Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1712504238 Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c4bd8b429d2e4e6fb124d9131e0ec185 Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: exception: Access list not available for public flavors. Oct 31 15:16:35.009426 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'flavor_id': '753570141'} Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 31 15:16:35.010046 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:35.011081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25755296-aa78-4376-8de1-95682a5adceb tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:35.011081 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25755296-aa78-4376-8de1-95682a5adceb tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/753570141/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.022206 Oct 31 15:16:35.011726 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 82/125] 10.222.0.20 () {58 vars in 1206 bytes} [Mon Oct 31 15:16:34 2022] GET /compute/v2.1/flavors/753570141/os-flavor-access => generated 91 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:16:35.018913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7930ad5-742c-4f12-a50f-bed9b5d0694c tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.039818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:35.051730 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7930ad5-742c-4f12-a50f-bed9b5d0694c tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/753570141" status: 202 len: 0 microversion: 2.1 time: 0.036179 Oct 31 15:16:35.052386 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 83/126] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:16:35 2022] DELETE /compute/v2.1/flavors/753570141 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:16:35.053785 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85cdb92e-4a42-4d45-bc14-ef1e68ec3ffd tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.321829 Oct 31 15:16:35.056707 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 44/127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:34 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:35.061155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ce5d417-5ba2-4318-8280-969a62f4e229 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.086262 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ce5d417-5ba2-4318-8280-969a62f4e229 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.028581 Oct 31 15:16:35.087057 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 84/128] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:35 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:35.108348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d642186-11c3-4957-a900-73a57d413e24 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1687347946", "id": 1809299769, "os-flavor-access:is_public": "False"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:35.129196 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d642186-11c3-4957-a900-73a57d413e24 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.024558 Oct 31 15:16:35.134164 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 45/129] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:35 2022] POST /compute/v2.1/flavors => generated 439 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:35.410111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-636720ce-4c4c-49ff-aff3-b8e503d4ad9f tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:35.414635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-636720ce-4c4c-49ff-aff3-b8e503d4ad9f tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '7b8e28c3b0e7457b8ae3823fa757666b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88821e97dee346fa96829560407330ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-636720ce-4c4c-49ff-aff3-b8e503d4ad9f tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] Request method failure captured: Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/flavors/1809299769/action HTTP/1.1 Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 67 Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bOD-Lqc0NGXYlmDDq828l-ObSqpa-BKfBLYLXuQHNkIZAStLySy1ecaQKiFQl6jH6rG1hqGbUZwmFg3ziCePFL07dwHHvvr5bmHFNthuFAlbIUiedjYDzgeVneMXUlUYTN7ocLJW_LYbTZTWGEd6176c7TdJdPAHHV2D1layCDppk Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 88821e97dee346fa96829560407330ee Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1809463137 Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:35.423806 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88821e97dee346fa96829560407330ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88821e97dee346fa96829560407330ee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88821e97dee346fa96829560407330ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88821e97dee346fa96829560407330ee"}]}] Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1809463137 Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 88821e97dee346fa96829560407330ee Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1809463137 Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsAccessNegativeTestJSON-1809463137-project Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 7b8e28c3b0e7457b8ae3823fa757666b Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1809463137-project Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: {"addTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} Oct 31 15:16:35.426738 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '1809299769', 'body': {'addTenantAccess': {'tenant': '88821e97dee346fa96829560407330ee'}}} Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:35.427451 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 31 15:16:35.428403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:35.431088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-636720ce-4c4c-49ff-aff3-b8e503d4ad9f tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:35.432244 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-636720ce-4c4c-49ff-aff3-b8e503d4ad9f tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] 10.222.0.20 "POST /compute/v2.1/flavors/1809299769/action" status: 403 len: 130 microversion: 2.1 time: 0.293245 Oct 31 15:16:35.433174 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 85/130] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 31 15:16:35 2022] POST /compute/v2.1/flavors/1809299769/action => generated 130 bytes in 295 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:35.442433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7706d89e-064c-4504-9257-2c7a201329ce tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.466139 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7706d89e-064c-4504-9257-2c7a201329ce tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1809299769" status: 202 len: 0 microversion: 2.1 time: 0.028883 Oct 31 15:16:35.467657 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 46/131] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:35 2022] DELETE /compute/v2.1/flavors/1809299769 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:35.476347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-97746765-d645-4586-a33c-a00f4ca2fc63 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.504213 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-97746765-d645-4586-a33c-a00f4ca2fc63 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.032223 Oct 31 15:16:35.505494 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 86/132] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:35 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:35.528699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73e383b6-1cbe-4ce3-a1b7-b2bf5f363df5 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1250914113", "id": 1944895735, "os-flavor-access:is_public": "False"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:35.554101 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73e383b6-1cbe-4ce3-a1b7-b2bf5f363df5 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.029653 Oct 31 15:16:35.555099 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 47/133] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:35 2022] POST /compute/v2.1/flavors => generated 439 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:35.567604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a17d7e04-c130-4e5d-9596-e8ff0ea8480b tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:35.853942 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a17d7e04-c130-4e5d-9596-e8ff0ea8480b tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1944895735/action" status: 200 len: 97 microversion: 2.1 time: 0.290250 Oct 31 15:16:35.855775 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 87/134] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 31 15:16:35 2022] POST /compute/v2.1/flavors/1944895735/action => generated 97 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:35.866225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1deeeda2-8f7b-4bed-9683-402a93c73a7e tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:35.869607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1deeeda2-8f7b-4bed-9683-402a93c73a7e tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '7b8e28c3b0e7457b8ae3823fa757666b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88821e97dee346fa96829560407330ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1deeeda2-8f7b-4bed-9683-402a93c73a7e tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] Request method failure captured: Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/flavors/1944895735/action HTTP/1.1 Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 70 Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bOD-Lqc0NGXYlmDDq828l-ObSqpa-BKfBLYLXuQHNkIZAStLySy1ecaQKiFQl6jH6rG1hqGbUZwmFg3ziCePFL07dwHHvvr5bmHFNthuFAlbIUiedjYDzgeVneMXUlUYTN7ocLJW_LYbTZTWGEd6176c7TdJdPAHHV2D1layCDppk Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 88821e97dee346fa96829560407330ee Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1809463137 Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:35.873470 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88821e97dee346fa96829560407330ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_88821e97dee346fa96829560407330ee", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/88821e97dee346fa96829560407330ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/88821e97dee346fa96829560407330ee"}]}] Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1809463137 Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 88821e97dee346fa96829560407330ee Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1809463137 Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FlavorsAccessNegativeTestJSON-1809463137-project Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 7b8e28c3b0e7457b8ae3823fa757666b Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1809463137-project Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: {"removeTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} Oct 31 15:16:35.874830 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '1944895735', 'body': {'removeTenantAccess': {'tenant': '88821e97dee346fa96829560407330ee'}}} Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can( Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:35.875525 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 31 15:16:35.876769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:35.878263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1deeeda2-8f7b-4bed-9683-402a93c73a7e tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:35.878263 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1deeeda2-8f7b-4bed-9683-402a93c73a7e tempest-FlavorsAccessNegativeTestJSON-1809463137 tempest-FlavorsAccessNegativeTestJSON-1809463137-project] 10.222.0.20 "POST /compute/v2.1/flavors/1944895735/action" status: 403 len: 133 microversion: 2.1 time: 0.013483 Oct 31 15:16:35.878263 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 48/135] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 31 15:16:35 2022] POST /compute/v2.1/flavors/1944895735/action => generated 133 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:35.886268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-139714aa-be20-40f4-9acf-c49cb2133b17 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "88821e97dee346fa96829560407330ee"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:35.896287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:35.903771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:35.918293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.918920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.919314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:35.920066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:35.925822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:35.926669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.016012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:36.028500 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04971e92-bd17-4c16-ba57-2266bc570209 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1321 microversion: 2.1 time: 0.140542 Oct 31 15:16:36.041226 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 49/136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:35 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1321 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:36.081302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:36.082210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:36.090438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:36.091548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:36.092158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.093076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:36.093779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:36.094573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.329096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:36.355207 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1afbd950-65c0-4c21-a5a9-0f72994f83f1 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.279250 Oct 31 15:16:36.357708 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 50/137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:36 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:36.386895 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-139714aa-be20-40f4-9acf-c49cb2133b17 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1944895735/action" status: 200 len: 21 microversion: 2.1 time: 0.505877 Oct 31 15:16:36.387506 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 88/138] 10.222.0.20 () {60 vars in 1200 bytes} [Mon Oct 31 15:16:35 2022] POST /compute/v2.1/flavors/1944895735/action => generated 21 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:36.400690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-125f9f6e-5b67-4f5e-87d0-7c3c4d8aae72 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:36.413973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9,nova_api:UPDATE=1,nova_api:DELETE=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:36.426143 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-125f9f6e-5b67-4f5e-87d0-7c3c4d8aae72 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1944895735" status: 202 len: 0 microversion: 2.1 time: 0.029909 Oct 31 15:16:36.430600 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 51/139] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:16:36 2022] DELETE /compute/v2.1/flavors/1944895735 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:16:36.435718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a711f59d-731b-4cf9-8d7a-1f6dc1ffe7ee tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:36.477080 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a711f59d-731b-4cf9-8d7a-1f6dc1ffe7ee tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.045578 Oct 31 15:16:36.477824 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 89/140] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:36 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:36.505121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed3cf15a-5678-45c1-9fd7-33bfd09a9afd tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1812116632", "id": 894545415, "os-flavor-access:is_public": "False"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:36.530740 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed3cf15a-5678-45c1-9fd7-33bfd09a9afd tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.029700 Oct 31 15:16:36.531660 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 90/141] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:36 2022] POST /compute/v2.1/flavors => generated 436 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:36.548345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbba2719-3102-40e6-9b21-4b87146c8431 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "af0f4920a402404ab38bb24e242f43b6"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:36.555579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-08c46353-4eec-467b-a4db-b40be500063a req-8106bb5c-2184-4fd5-8563-a9f6d2f4bdad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee21f97a-b117-41b9-bb10-029bd6b05cd5", "name": "network-vif-plugged", "status": "completed", "tag": "54f08fde-d450-4933-b2d2-7f228ea714e6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:36.578222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08c46353-4eec-467b-a4db-b40be500063a req-8106bb5c-2184-4fd5-8563-a9f6d2f4bdad service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:36.579064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08c46353-4eec-467b-a4db-b40be500063a req-8106bb5c-2184-4fd5-8563-a9f6d2f4bdad service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:36.579722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08c46353-4eec-467b-a4db-b40be500063a req-8106bb5c-2184-4fd5-8563-a9f6d2f4bdad service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:36.597570 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-08c46353-4eec-467b-a4db-b40be500063a req-8106bb5c-2184-4fd5-8563-a9f6d2f4bdad service nova] Creating event network-vif-plugged:54f08fde-d450-4933-b2d2-7f228ea714e6 for instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 on n-h1-858384-17 Oct 31 15:16:36.603151 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-08c46353-4eec-467b-a4db-b40be500063a req-8106bb5c-2184-4fd5-8563-a9f6d2f4bdad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155094 Oct 31 15:16:36.608088 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 52/142] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:37.001392 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-bbba2719-3102-40e6-9b21-4b87146c8431 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] HTTP exception thrown: Flavor access not found for 36 / af0f4920a402404ab38bb24e242f43b6 combination. Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbba2719-3102-40e6-9b21-4b87146c8431 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Request method failure captured: Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/flavors/894545415/action HTTP/1.1 Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 70 Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bQCatq22mtyFtY6s2dMnz7QyDqbYvTkmCGeinTtG47y_sOFEinTmYtZOAsjfScpf58hpMb_9aJE0ArOoc5CTswlrRIA5GeFPnhYLHmQedVqtPLf_4QkLPNEv_Cy0E7aAq7wLE_okhOUZkEU0Y0ynrBQnO3IPbYH0yD19qL_Ufpk_c Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5b3f914266534998bc6b70e4aa2e47b3 Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1712504238 Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:16:37.009280 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b3f914266534998bc6b70e4aa2e47b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b3f914266534998bc6b70e4aa2e47b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b3f914266534998bc6b70e4aa2e47b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b3f914266534998bc6b70e4aa2e47b3"}]}] Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1712504238 Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5b3f914266534998bc6b70e4aa2e47b3 Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1712504238 Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c4bd8b429d2e4e6fb124d9131e0ec185 Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: {"removeTenantAccess": {"tenant": "af0f4920a402404ab38bb24e242f43b6"}} Oct 31 15:16:37.010469 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: exception: Flavor access not found for 36 / af0f4920a402404ab38bb24e242f43b6 combination. Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '894545415', 'body': {'removeTenantAccess': {'tenant': 'af0f4920a402404ab38bb24e242f43b6'}}} Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 31 15:16:37.011459 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / af0f4920a402404ab38bb24e242f43b6 combination. Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / af0f4920a402404ab38bb24e242f43b6 combination. Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.012375 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.014737 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:37.014737 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:37.014737 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:37.014737 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:37.014737 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / af0f4920a402404ab38bb24e242f43b6 combination. Oct 31 15:16:37.014737 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.021301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbba2719-3102-40e6-9b21-4b87146c8431 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Returning 404 to user: Flavor access not found for 36 / af0f4920a402404ab38bb24e242f43b6 combination. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:37.023300 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bbba2719-3102-40e6-9b21-4b87146c8431 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/894545415/action" status: 404 len: 124 microversion: 2.1 time: 0.479023 Oct 31 15:16:37.024811 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 91/143] 10.222.0.20 () {60 vars in 1197 bytes} [Mon Oct 31 15:16:36 2022] POST /compute/v2.1/flavors/894545415/action => generated 124 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:37.035676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9105b623-03f7-46fd-9a9b-4024192e8d4b tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.057824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.058651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:37.061857 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9105b623-03f7-46fd-9a9b-4024192e8d4b tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/894545415" status: 202 len: 0 microversion: 2.1 time: 0.031136 Oct 31 15:16:37.063377 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 53/144] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:16:37 2022] DELETE /compute/v2.1/flavors/894545415 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:37.074688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43ecb0e3-e549-4842-ad87-db5689a75b09 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.082655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.083206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.084836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.085654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.086168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.090667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.101097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=57 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:37.108760 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43ecb0e3-e549-4842-ad87-db5689a75b09 tempest-FlavorsAccessNegativeTestJSON-1712504238 tempest-FlavorsAccessNegativeTestJSON-1712504238-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.039950 Oct 31 15:16:37.110094 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 54/145] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:37.193874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.207659 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dda94d91-3e13-4400-9188-3a43cb837edc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1321 microversion: 2.1 time: 0.154000 Oct 31 15:16:37.208869 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 92/146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:37.383060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.384000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:37.397600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.398341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.399291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.401011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:37.401764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:37.402332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:37.574713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-199124f7-a6d4-4d18-8299-6a87e9d1e6e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.576724 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-199124f7-a6d4-4d18-8299-6a87e9d1e6e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-199124f7-a6d4-4d18-8299-6a87e9d1e6e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422-project-admin] Request method failure captured: Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bVxuhIAKyRNlaaESjJXRZmWKaZmT736sBLqy485eF8bFT3kSAZZdhaIHIHI83DK28J3GwCG5me6-QBNhHUUEfYkefjMmFXPGV6VbUHXTbCb_0LB5K5xj5OZfzeOfS-EPNsxYBPjW0l1CE-WluUSkZ4XZ9uVMrFcfZ4XdPH2e3Py5A Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d722f2f7b625468183f0cc5bca47068b Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422 Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:37.591102 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d722f2f7b625468183f0cc5bca47068b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d722f2f7b625468183f0cc5bca47068b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d722f2f7b625468183f0cc5bca47068b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d722f2f7b625468183f0cc5bca47068b"}]}] Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422 Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d722f2f7b625468183f0cc5bca47068b Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422 Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422-project-admin Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 48bcf119658843e88f3420bb615f3260 Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422-project-admin Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:37.592582 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid timestamp for date invalid_time Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'invalid_time'} Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:37.593386 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-199124f7-a6d4-4d18-8299-6a87e9d1e6e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:37.594450 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-199124f7-a6d4-4d18-8299-6a87e9d1e6e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422 tempest-InstanceUsageAuditLogNegativeTestJSON-1228007422-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.413910 Oct 31 15:16:37.595240 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 55/147] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 416 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:16:37.605224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.612678 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f7d88fc-3ff7-4ae0-952e-4f33e135ff91 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.236781 Oct 31 15:16:37.613735 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 93/148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:37.929835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98da481f-8935-4fd8-9e20-4d25a4006414 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.932040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98da481f-8935-4fd8-9e20-4d25a4006414 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '23d49988a3af4b2491fcd33b843d477c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c9f149845449cea0ea114b5d83c6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98da481f-8935-4fd8-9e20-4d25a4006414 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] Request method failure captured: Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bTmzDKjKERCdKQ9pbdGkL0htGXuiqThvW-C4T-EKqCKlItNM-yLtU4QYUUYJ_B4brvPrrguwLBVMsIjqdIHhslGUo-DviOlJl86nt1uY-sr3b4BB6nTHmLruz6NtHF3WdyXr_vM0lEcyKkXQUnvQV9xdQtOMaCPhYRvs7dL1Lr0M8 Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 09c9f149845449cea0ea114b5d83c6a3 Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:37.933883 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09c9f149845449cea0ea114b5d83c6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09c9f149845449cea0ea114b5d83c6a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09c9f149845449cea0ea114b5d83c6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09c9f149845449cea0ea114b5d83c6a3"}]}] Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 09c9f149845449cea0ea114b5d83c6a3 Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 23d49988a3af4b2491fcd33b843d477c Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project Oct 31 15:16:37.934982 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: action_args: {} Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:37.935501 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 31 15:16:37.936960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.937845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98da481f-8935-4fd8-9e20-4d25a4006414 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:37.937845 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98da481f-8935-4fd8-9e20-4d25a4006414 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.332241 Oct 31 15:16:37.937845 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 56/149] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 333 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:16:37.946950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-612a4676-483e-4ed6-ac35-1b6104436ab1 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:37.952046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-612a4676-483e-4ed6-ac35-1b6104436ab1 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '23d49988a3af4b2491fcd33b843d477c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09c9f149845449cea0ea114b5d83c6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-612a4676-483e-4ed6-ac35-1b6104436ab1 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] Request method failure captured: Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31%2015:16:37 HTTP/1.1 Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bTmzDKjKERCdKQ9pbdGkL0htGXuiqThvW-C4T-EKqCKlItNM-yLtU4QYUUYJ_B4brvPrrguwLBVMsIjqdIHhslGUo-DviOlJl86nt1uY-sr3b4BB6nTHmLruz6NtHF3WdyXr_vM0lEcyKkXQUnvQV9xdQtOMaCPhYRvs7dL1Lr0M8 Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 09c9f149845449cea0ea114b5d83c6a3 Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:37.954104 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09c9f149845449cea0ea114b5d83c6a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09c9f149845449cea0ea114b5d83c6a3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09c9f149845449cea0ea114b5d83c6a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09c9f149845449cea0ea114b5d83c6a3"}]}] Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 09c9f149845449cea0ea114b5d83c6a3 Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 23d49988a3af4b2491fcd33b843d477c Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project Oct 31 15:16:37.956210 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '2022-10-31 15:16:37'} Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:37.957038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 31 15:16:37.961621 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:37.964047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-612a4676-483e-4ed6-ac35-1b6104436ab1 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:37.964047 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-612a4676-483e-4ed6-ac35-1b6104436ab1 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126 tempest-InstanceUsageAuditLogNegativeTestJSON-115609126-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31 15:16:37" status: 403 len: 128 microversion: 2.1 time: 0.016934 Oct 31 15:16:37.964047 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 94/150] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:16:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-31%2015%3A16%3A37 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:38.232509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:38.233364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:38.240923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.242441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.244649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.246039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.246877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.247864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.468190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:38.479341 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0cb417f8-ae19-4bac-920f-b32719e18148 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.250611 Oct 31 15:16:38.481740 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 57/151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:38 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:38.520906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a85692c-73e2-46bd-8b0c-0199124858da tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Action: 'update', calling method: .version_select at 0x7f16e2033b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:38.648865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:38.649889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:38.664460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.667367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.668214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.669892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.670705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.671442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.821055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a85692c-73e2-46bd-8b0c-0199124858da tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.821762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a85692c-73e2-46bd-8b0c-0199124858da tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.822192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a85692c-73e2-46bd-8b0c-0199124858da tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.823232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a85692c-73e2-46bd-8b0c-0199124858da tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:38.823685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a85692c-73e2-46bd-8b0c-0199124858da tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:38.824680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a85692c-73e2-46bd-8b0c-0199124858da tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:38.894478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:38.914160 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-118abd54-f48e-49a9-bf71-7bd3bb260f3a tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1337 microversion: 2.1 time: 0.281500 Oct 31 15:16:38.915786 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 58/152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:38 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1337 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:38.934344 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a85692c-73e2-46bd-8b0c-0199124858da tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/3bcbdf8ceae343819db6f8f4dd71f6d4" status: 200 len: 240 microversion: 2.36 time: 0.618621 Oct 31 15:16:38.935044 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 95/153] 10.222.0.20 () {62 vars in 1303 bytes} [Mon Oct 31 15:16:38 2022] PUT /compute/v2.1/os-quota-sets/3bcbdf8ceae343819db6f8f4dd71f6d4 => generated 240 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:16:38.953237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67c473bf-23f4-450b-9b2c-12d514e8588d tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Calling method '.version_select at 0x7f16e1f63af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:39.273436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c473bf-23f4-450b-9b2c-12d514e8588d tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.274619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c473bf-23f4-450b-9b2c-12d514e8588d tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.275052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c473bf-23f4-450b-9b2c-12d514e8588d tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.275961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c473bf-23f4-450b-9b2c-12d514e8588d tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.276410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c473bf-23f4-450b-9b2c-12d514e8588d tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.276818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67c473bf-23f4-450b-9b2c-12d514e8588d tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.285946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:39.308440 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67c473bf-23f4-450b-9b2c-12d514e8588d tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/3bcbdf8ceae343819db6f8f4dd71f6d4/detail" status: 200 len: 672 microversion: 2.36 time: 0.365146 Oct 31 15:16:39.309618 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 59/154] 10.222.0.20 () {60 vars in 1304 bytes} [Mon Oct 31 15:16:38 2022] GET /compute/v2.1/os-quota-sets/3bcbdf8ceae343819db6f8f4dd71f6d4/detail => generated 672 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:39.508585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:39.509465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:39.521396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.522958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.523612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.525329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.525967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.526552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.677966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Action: 'update', calling method: .version_select at 0x7f16e1eef4c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:39.786309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:39.802849 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da317044-882c-4746-874d-daa60fd0eec4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.302064 Oct 31 15:16:39.804813 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 96/155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:39 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:39.943774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:39.944878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:39.951985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.952470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.958057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.959180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.960126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.960858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.993088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.993784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.994273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:39.995003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:39.995628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:39.996219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.072099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.072600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.073230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.074155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.074709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.075135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.154882 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7f10281-f6b5-4b7f-8a1c-20dbb22082ee tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/3bcbdf8ceae343819db6f8f4dd71f6d4?user_id=ca75d763a7e34c9f8075dab6fe6dda89" status: 200 len: 240 microversion: 2.36 time: 0.481602 Oct 31 15:16:40.155833 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 60/156] 10.222.0.20 () {62 vars in 1384 bytes} [Mon Oct 31 15:16:39 2022] PUT /compute/v2.1/os-quota-sets/3bcbdf8ceae343819db6f8f4dd71f6d4?user_id=ca75d763a7e34c9f8075dab6fe6dda89 => generated 240 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:16:40.170755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be8e91c1-9539-473f-8214-c408fd449dbf tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] Calling method '.version_select at 0x7f16e1eef790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:40.214252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:40.224420 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eed8c573-d867-48e3-9939-122f9c20950d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1485 microversion: 2.1 time: 0.288425 Oct 31 15:16:40.225806 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 97/157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:39 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1485 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:40.247758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10b069d6-814a-4606-b60f-3203ead4ec12 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:40.248516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10b069d6-814a-4606-b60f-3203ead4ec12 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:40.255160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b069d6-814a-4606-b60f-3203ead4ec12 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.255956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b069d6-814a-4606-b60f-3203ead4ec12 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.256599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b069d6-814a-4606-b60f-3203ead4ec12 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.257532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b069d6-814a-4606-b60f-3203ead4ec12 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.258194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b069d6-814a-4606-b60f-3203ead4ec12 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.258818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b069d6-814a-4606-b60f-3203ead4ec12 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.507476 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be8e91c1-9539-473f-8214-c408fd449dbf tempest-QuotasAdminTestV236-944446318 tempest-QuotasAdminTestV236-944446318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/3bcbdf8ceae343819db6f8f4dd71f6d4?user_id=ca75d763a7e34c9f8075dab6fe6dda89" status: 200 len: 282 microversion: 2.36 time: 0.340914 Oct 31 15:16:40.508768 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 61/158] 10.222.0.20 () {60 vars in 1364 bytes} [Mon Oct 31 15:16:40 2022] GET /compute/v2.1/os-quota-sets/3bcbdf8ceae343819db6f8f4dd71f6d4?user_id=ca75d763a7e34c9f8075dab6fe6dda89 => generated 282 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:16:40.808199 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10b069d6-814a-4606-b60f-3203ead4ec12 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1638 microversion: 2.1 time: 0.564034 Oct 31 15:16:40.833322 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 98/159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:40 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1638 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:40.834141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:40.836107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:40.840149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:40.840637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:40.843157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.843842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.844281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.847138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.847797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.848387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.850359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.852428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.853004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.854158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:40.854836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:40.855953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:40.888503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:16:41.015289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.016678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "compute-rpcapi-router" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:16:41.017471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7079f06e-5fd9-4a01-83f2-3a063d679376 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquired lock "compute-rpcapi-router" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:16:41.020621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e483a11d-2213-416c-a646-fc9c4ca2f017 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.021764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e483a11d-2213-416c-a646-fc9c4ca2f017 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.022723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e483a11d-2213-416c-a646-fc9c4ca2f017 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.024108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e483a11d-2213-416c-a646-fc9c4ca2f017 None None] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.025442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e483a11d-2213-416c-a646-fc9c4ca2f017 None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.025880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e483a11d-2213-416c-a646-fc9c4ca2f017 None None] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.026795 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da328d9e-a0dc-48ca-90fc-1899205ede19 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.198423 Oct 31 15:16:41.029046 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 62/160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:40 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:41.037326 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.compute.rpcapi [None req-e483a11d-2213-416c-a646-fc9c4ca2f017 None None] Automatically selected compute RPC version 6.2 from minimum service version 65 Oct 31 15:16:41.038211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e483a11d-2213-416c-a646-fc9c4ca2f017 None None] Releasing lock "compute-rpcapi-router" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:16:41.086579 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e483a11d-2213-416c-a646-fc9c4ca2f017 None None] 10.222.0.20 "DELETE /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 204 len: 0 microversion: 2.1 time: 0.249733 Oct 31 15:16:41.087741 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 99/161] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:16:40 2022] DELETE /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:16:41.095407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:41.097094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:41.105252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.106636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.107227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.108068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.108692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.109291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:41.414357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:41.423418 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da4aa769-746c-4aff-b43f-35f8e393aeca tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1491 microversion: 2.1 time: 0.331705 Oct 31 15:16:41.433434 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 63/162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:41 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1491 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:41.905240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8619ddd7-9dcc-435d-b6e2-7310b45697a9 req-be04fc4a-cd96-4bae-8bfe-f48b6ecff91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dacf152-1913-4810-84fa-113047bf0e73", "tag": "562118eb-55c8-4072-bb71-2cf744930f3a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:41.920842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8619ddd7-9dcc-435d-b6e2-7310b45697a9 req-be04fc4a-cd96-4bae-8bfe-f48b6ecff91d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:41.921587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8619ddd7-9dcc-435d-b6e2-7310b45697a9 req-be04fc4a-cd96-4bae-8bfe-f48b6ecff91d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:41.922158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8619ddd7-9dcc-435d-b6e2-7310b45697a9 req-be04fc4a-cd96-4bae-8bfe-f48b6ecff91d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.053211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:42.055503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:42.068946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.073156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.074993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.076959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.080768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.081967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.108892 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8619ddd7-9dcc-435d-b6e2-7310b45697a9 req-be04fc4a-cd96-4bae-8bfe-f48b6ecff91d service nova] Creating event network-changed:562118eb-55c8-4072-bb71-2cf744930f3a for instance 4dacf152-1913-4810-84fa-113047bf0e73 on n-h2-858384-17 Oct 31 15:16:42.115896 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8619ddd7-9dcc-435d-b6e2-7310b45697a9 req-be04fc4a-cd96-4bae-8bfe-f48b6ecff91d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214780 Oct 31 15:16:42.117091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 100/163] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:42.443305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:42.448563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:42.450168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:42.459619 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b913fd0-32b4-4dc9-8559-20d58ffafb27 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.408373 Oct 31 15:16:42.460803 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 64/164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:42 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:42.460979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.461603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.463292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.464081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:42.465169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:42.465903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:42.777255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:42.790584 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1a6e243-6788-47ed-9c65-55271b58f2ec tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1491 microversion: 2.1 time: 0.346328 Oct 31 15:16:42.805211 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 101/165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:42 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1491 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:42.945048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-161510de-937f-4860-b215-8dc9360505fc tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1275875891", "ram": 512, "vcpus": 1, "disk": 10, "id": 23887004, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:42.976019 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-161510de-937f-4860-b215-8dc9360505fc tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.215284 Oct 31 15:16:42.976654 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 65/166] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:16:42 2022] POST /compute/v2.1/flavors => generated 410 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:42.991072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea53d98a-e80a-4089-b562-effafd9cb971 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:43.075013 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea53d98a-e80a-4089-b562-effafd9cb971 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/23887004/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.087200 Oct 31 15:16:43.076048 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 102/167] 10.222.0.20 () {60 vars in 1218 bytes} [Mon Oct 31 15:16:42 2022] POST /compute/v2.1/flavors/23887004/os-extra_specs => generated 66 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:43.329441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7651bd3f-ff5d-4f41-b501-32fdef3b8c43 tempest-FlavorsExtraSpecsTestJSON-50943643 tempest-FlavorsExtraSpecsTestJSON-50943643-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.350299 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7651bd3f-ff5d-4f41-b501-32fdef3b8c43 tempest-FlavorsExtraSpecsTestJSON-50943643 tempest-FlavorsExtraSpecsTestJSON-50943643-project] 10.222.0.20 "GET /compute/v2.1/flavors/23887004/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.267023 Oct 31 15:16:43.356325 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 66/168] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/flavors/23887004/os-extra_specs => generated 66 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:43.362878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-58d9dbfe-2f28-4faa-b8b8-303d8da1a8e0 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:43.417692 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-58d9dbfe-2f28-4faa-b8b8-303d8da1a8e0 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/23887004/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055621 Oct 31 15:16:43.418904 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 103/169] 10.222.0.20 () {60 vars in 1218 bytes} [Mon Oct 31 15:16:43 2022] POST /compute/v2.1/flavors/23887004/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:43.430710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-22e31dd2-1d01-4177-928c-43cae15cbb8d tempest-FlavorsExtraSpecsTestJSON-50943643 tempest-FlavorsExtraSpecsTestJSON-50943643-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.471311 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-22e31dd2-1d01-4177-928c-43cae15cbb8d tempest-FlavorsExtraSpecsTestJSON-50943643 tempest-FlavorsExtraSpecsTestJSON-50943643-project] 10.222.0.20 "GET /compute/v2.1/flavors/23887004/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.043770 Oct 31 15:16:43.478718 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 67/170] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/flavors/23887004/os-extra_specs/hw:numa_nodes => generated 22 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:43.483376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.483982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:43.487237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6a2da53-6947-4f86-b6e2-7b9cde5ef950 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:43.497744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.498529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.500227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.501445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.505225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.508147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.585106 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6a2da53-6947-4f86-b6e2-7b9cde5ef950 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/23887004/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.104831 Oct 31 15:16:43.597421 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 68/171] 10.222.0.20 () {60 vars in 1218 bytes} [Mon Oct 31 15:16:43 2022] POST /compute/v2.1/flavors/23887004/os-extra_specs => generated 66 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:43.603095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a63e00a2-e237-4bd3-90a0-8d96e964ca53 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.633529 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a63e00a2-e237-4bd3-90a0-8d96e964ca53 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/23887004/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029935 Oct 31 15:16:43.633529 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 69/172] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/flavors/23887004/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:43.656157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26788bd8-fcf3-47e7-8a57-68358e03b566 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:43.754455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26788bd8-fcf3-47e7-8a57-68358e03b566 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/23887004/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.111669 Oct 31 15:16:43.762672 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 70/173] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 31 15:16:43 2022] PUT /compute/v2.1/flavors/23887004/os-extra_specs/hw:numa_nodes => generated 22 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:43.784257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef4e460a-bb36-4416-8c89-a59a55f6ef8c tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.803896 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef4e460a-bb36-4416-8c89-a59a55f6ef8c tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/23887004/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034169 Oct 31 15:16:43.806820 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 71/174] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/flavors/23887004/os-extra_specs => generated 66 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:43.825643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-12e9ded7-9218-4f08-a005-ed3c3fc1d75c tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.908912 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-12e9ded7-9218-4f08-a005-ed3c3fc1d75c tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/23887004/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.092728 Oct 31 15:16:43.912980 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 72/175] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:16:43 2022] DELETE /compute/v2.1/flavors/23887004/os-extra_specs/hw:numa_nodes => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:43.919173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:43.919935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:43.926347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=4,nova_api:INSERT=2,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:43.928313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.929049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.930197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.931117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.931753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.932354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.992099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:43.992928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:43.994449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:43.995948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lazy-loading 'fault' on Instance uuid ee21f97a-b117-41b9-bb10-029bd6b05cd5 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:16:44.056487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f11b3f04a10a448c84cc00549be53fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75067d429b8476a87f21278c15f713f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:44.066647 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a26cb8cb-143b-477b-ae59-5456a6e604a8 tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 200 len: 1327 microversion: 2.1 time: 0.152468 Oct 31 15:16:44.070953 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 73/176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 1327 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:44.071872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:44.076532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8cee5af4-8aa4-4472-af47-852e34c8b3eb tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:44.089440 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc54721f-89d4-4d5a-8f1f-1db592e86ba0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.610341 Oct 31 15:16:44.090394 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 104/177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:43 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:44.101747 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8cee5af4-8aa4-4472-af47-852e34c8b3eb tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/23887004/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.029400 Oct 31 15:16:44.102600 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 74/178] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:16:44 2022] DELETE /compute/v2.1/flavors/23887004/os-extra_specs/hw:cpu_policy => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:44.110465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7dc3e6c-50d9-4b02-af58-51ad8da21e0b tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:44.120130 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7dc3e6c-50d9-4b02-af58-51ad8da21e0b tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/23887004/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013257 Oct 31 15:16:44.120952 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 105/179] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 31 15:16:44 2022] GET /compute/v2.1/flavors/23887004/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:16:44.140510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5405ce8d-fb5d-42ed-a2b4-e261477d8943 req-e9fdb00f-97f6-40d0-9419-4945e0a82b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee21f97a-b117-41b9-bb10-029bd6b05cd5", "name": "network-vif-deleted", "tag": "54f08fde-d450-4933-b2d2-7f228ea714e6"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:44.140741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-542b6e63-a8cd-4c64-8287-548c1d2e3897 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:44.148485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=5,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:44.158324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5405ce8d-fb5d-42ed-a2b4-e261477d8943 req-e9fdb00f-97f6-40d0-9419-4945e0a82b9d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:44.159666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5405ce8d-fb5d-42ed-a2b4-e261477d8943 req-e9fdb00f-97f6-40d0-9419-4945e0a82b9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:44.160491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5405ce8d-fb5d-42ed-a2b4-e261477d8943 req-e9fdb00f-97f6-40d0-9419-4945e0a82b9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:44.171756 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-542b6e63-a8cd-4c64-8287-548c1d2e3897 tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/23887004" status: 202 len: 0 microversion: 2.1 time: 0.036284 Oct 31 15:16:44.177783 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 75/180] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:44 2022] DELETE /compute/v2.1/flavors/23887004 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:16:44.181531 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5405ce8d-fb5d-42ed-a2b4-e261477d8943 req-e9fdb00f-97f6-40d0-9419-4945e0a82b9d service nova] Creating event network-vif-deleted:54f08fde-d450-4933-b2d2-7f228ea714e6 for instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 on n-h1-858384-17 Oct 31 15:16:44.184562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-62082807-de76-46dd-ba32-6486c213abdd tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:44.191047 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5405ce8d-fb5d-42ed-a2b4-e261477d8943 req-e9fdb00f-97f6-40d0-9419-4945e0a82b9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053889 Oct 31 15:16:44.191864 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 106/181] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:44.213594 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-62082807-de76-46dd-ba32-6486c213abdd tempest-FlavorsExtraSpecsTestJSON-764788456 tempest-FlavorsExtraSpecsTestJSON-764788456-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.033611 Oct 31 15:16:44.214652 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 76/182] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:16:44 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:45.091150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:45.092505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:45.114233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:45.115552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:45.124105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.124895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.125775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.127521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.128560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.129236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.130749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.132939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.134278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.135433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.136822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.139953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.171729 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] HTTP exception thrown: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Request method failure captured: Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 HTTP/1.1 Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a2BAFZRlnlhxY0TLMXt-o-u2VGFsCToMy8KlxqwZ_4hSuoeUP92zBG6Mwq5iaRpWYfzDViDgx0lWlHTZgLh5MhyAvvSxWNzdzYMcXgGXCtDU_clo3S_mhZPuWDV6yuTGrSnDT5yuFqc6_UqL-EaUcwZbkIbrkCUqmGJ-8Qtg3qhm8 Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f75067d429b8476a87f21278c15f713f Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AggregatesAdminTestJSON-2059945343 Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:45.187197 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f75067d429b8476a87f21278c15f713f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f75067d429b8476a87f21278c15f713f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f75067d429b8476a87f21278c15f713f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f75067d429b8476a87f21278c15f713f"}]}] Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AggregatesAdminTestJSON-2059945343 Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f75067d429b8476a87f21278c15f713f Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2059945343 Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AggregatesAdminTestJSON-2059945343-project Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: f11b3f04a10a448c84cc00549be53fb6 Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AggregatesAdminTestJSON-2059945343-project Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:45.188438 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ee21f97a-b117-41b9-bb10-029bd6b05cd5'} Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:45.189108 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:45.190988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:45.196887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Returning 404 to user: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:45.198253 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ed56eda-61ae-46ab-a9c4-316c74f8d07c tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 404 len: 111 microversion: 2.1 time: 0.111736 Oct 31 15:16:45.199033 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 107/183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:45 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:45.213221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-31e2fc4a-2cb3-477c-9e4e-dc2198df6fcb tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-17"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:45.240980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31e2fc4a-2cb3-477c-9e4e-dc2198df6fcb tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.241434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31e2fc4a-2cb3-477c-9e4e-dc2198df6fcb tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.241866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31e2fc4a-2cb3-477c-9e4e-dc2198df6fcb tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:45.464361 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-31e2fc4a-2cb3-477c-9e4e-dc2198df6fcb tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.254828 Oct 31 15:16:45.469485 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 108/184] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 31 15:16:45 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:45.498707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c4de8563-fe39-4eed-8445-0ecce308970e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:45.550380 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c4de8563-fe39-4eed-8445-0ecce308970e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.069944 Oct 31 15:16:45.551523 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 109/185] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:45 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:45.589632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-336bb5b7-d91e-47a6-8f32-09a7a5a9338e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-348808419"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:45.591245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:45.595337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-336bb5b7-d91e-47a6-8f32-09a7a5a9338e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Generated uuid 31875db3-14f5-4571-9ba7-9787160e0c18 for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:45.607901 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c9de2077-3556-4553-8119-5c209e625651 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.497533 Oct 31 15:16:45.610659 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 77/186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:45 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:45.641463 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-336bb5b7-d91e-47a6-8f32-09a7a5a9338e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057539 Oct 31 15:16:45.652949 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 110/187] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:45.659747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f473cbc-1912-47bf-9f05-e3be03cac0a7 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:45.718534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f473cbc-1912-47bf-9f05-e3be03cac0a7 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:45.720290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f473cbc-1912-47bf-9f05-e3be03cac0a7 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:45.722118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f473cbc-1912-47bf-9f05-e3be03cac0a7 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.633823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52d6c852-f529-4935-9495-b95c2d0f4f01 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Calling method '.version_select at 0x7f16e1e3d5e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:46.675209 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-52d6c852-f529-4935-9495-b95c2d0f4f01 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] HTTP exception thrown: Image not found. Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52d6c852-f529-4935-9495-b95c2d0f4f01 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Request method failure captured: Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/images/1e00c02c-be7b-403e-9560-8a64d7fd5114/metadata/os_distro HTTP/1.1 Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bd7CB6rPB250grHI33vaCVp2HsTI9c9NQYOkSoV3OsljTXXdu8f6QRa7iE_qRjPNHJIurUS0tGXA-uR2flrNj60MrGg5OvnxA_IoS5gKEmERmAHAc9NnCpHVExvYFAUGQYiqmuXH87IrHveghO8LDamUtDS3K6cIRARqQXFz5VhPU Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:46.687965 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcf218a907e343efa26cedd0a4046298", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcf218a907e343efa26cedd0a4046298"}]}] Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 90c7ace14ca942b28db0e199a89bc005 Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: exception: Image not found. Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'image_id': '1e00c02c-be7b-403e-9560-8a64d7fd5114', 'id': 'os_distro'} Oct 31 15:16:46.689887 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:46.690862 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1e00c02c-be7b-403e-9560-8a64d7fd5114 Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:46.692000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e00c02c-be7b-403e-9560-8a64d7fd5114 could not be found. Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:46.694372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:16:46.696039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:46.699788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52d6c852-f529-4935-9495-b95c2d0f4f01 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Returning 404 to user: Image not found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:46.702283 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52d6c852-f529-4935-9495-b95c2d0f4f01 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] 10.222.0.20 "DELETE /compute/v2.1/images/1e00c02c-be7b-403e-9560-8a64d7fd5114/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.557871 Oct 31 15:16:46.713114 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 111/188] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 31 15:16:46 2022] DELETE /compute/v2.1/images/1e00c02c-be7b-403e-9560-8a64d7fd5114/metadata/os_distro => generated 62 bytes in 570 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:46.721022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:46.722128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:46.730698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.732006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.732661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:46.733642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:46.734327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:46.735444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.161404 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f473cbc-1912-47bf-9f05-e3be03cac0a7 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 1.507910 Oct 31 15:16:47.162022 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 78/189] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 31 15:16:45 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:47.167666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67e8b7f2-58b1-4410-bf52-b701e29bec1c tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Calling method '.version_select at 0x7f16e1ed3a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:47.211015 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-67e8b7f2-58b1-4410-bf52-b701e29bec1c tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] HTTP exception thrown: Image not found. Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67e8b7f2-58b1-4410-bf52-b701e29bec1c tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Request method failure captured: Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/images/5f913f45-abb9-4b35-94b4-182f38da58ed/metadata/os_version HTTP/1.1 Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bd7CB6rPB250grHI33vaCVp2HsTI9c9NQYOkSoV3OsljTXXdu8f6QRa7iE_qRjPNHJIurUS0tGXA-uR2flrNj60MrGg5OvnxA_IoS5gKEmERmAHAc9NnCpHVExvYFAUGQYiqmuXH87IrHveghO8LDamUtDS3K6cIRARqQXFz5VhPU Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:47.215510 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcf218a907e343efa26cedd0a4046298", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcf218a907e343efa26cedd0a4046298"}]}] Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 90c7ace14ca942b28db0e199a89bc005 Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'image_id': '5f913f45-abb9-4b35-94b4-182f38da58ed', 'id': 'os_version'} Oct 31 15:16:47.216651 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.217374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5f913f45-abb9-4b35-94b4-182f38da58ed Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.218276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5f913f45-abb9-4b35-94b4-182f38da58ed could not be found. Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:47.219312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.220265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67e8b7f2-58b1-4410-bf52-b701e29bec1c tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:47.222658 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67e8b7f2-58b1-4410-bf52-b701e29bec1c tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] 10.222.0.20 "GET /compute/v2.1/images/5f913f45-abb9-4b35-94b4-182f38da58ed/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.053574 Oct 31 15:16:47.222658 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 79/190] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 31 15:16:47 2022] GET /compute/v2.1/images/5f913f45-abb9-4b35-94b4-182f38da58ed/metadata/os_version => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:47.228129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86a7c644-ea9b-44f8-bf3b-c07f08bf7510 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:47.244691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:47.247690 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86a7c644-ea9b-44f8-bf3b-c07f08bf7510 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.027478 Oct 31 15:16:47.248648 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 80/191] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:16:47 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:47.262502 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f65bc92a-3de3-4653-97a4-35b7f56028c0 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.547984 Oct 31 15:16:47.263573 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 112/192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:46 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:47.265757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-235f7bd2-12b3-47d4-867c-611dcbcc8d40 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Calling method '.version_select at 0x7f16e1ec0a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:47.285788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ac28a48-b4eb-4950-baa7-dd03e881effd tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-17"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:47.304453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac28a48-b4eb-4950-baa7-dd03e881effd tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.307113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac28a48-b4eb-4950-baa7-dd03e881effd tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.307704 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-235f7bd2-12b3-47d4-867c-611dcbcc8d40 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] HTTP exception thrown: Image not found. Oct 31 15:16:47.309262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac28a48-b4eb-4950-baa7-dd03e881effd tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-235f7bd2-12b3-47d4-867c-611dcbcc8d40 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Request method failure captured: Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/images/f449c9fc-9446-4433-9bdd-3e98c57e74a1/metadata HTTP/1.1 Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bd7CB6rPB250grHI33vaCVp2HsTI9c9NQYOkSoV3OsljTXXdu8f6QRa7iE_qRjPNHJIurUS0tGXA-uR2flrNj60MrGg5OvnxA_IoS5gKEmERmAHAc9NnCpHVExvYFAUGQYiqmuXH87IrHveghO8LDamUtDS3K6cIRARqQXFz5VhPU Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:47.309739 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcf218a907e343efa26cedd0a4046298", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcf218a907e343efa26cedd0a4046298"}]}] Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 90c7ace14ca942b28db0e199a89bc005 Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'image_id': 'f449c9fc-9446-4433-9bdd-3e98c57e74a1'} Oct 31 15:16:47.310857 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.311514 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f449c9fc-9446-4433-9bdd-3e98c57e74a1 Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.312616 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f449c9fc-9446-4433-9bdd-3e98c57e74a1 could not be found. Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:47.313663 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.314776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-235f7bd2-12b3-47d4-867c-611dcbcc8d40 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:47.315828 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-235f7bd2-12b3-47d4-867c-611dcbcc8d40 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] 10.222.0.20 "GET /compute/v2.1/images/f449c9fc-9446-4433-9bdd-3e98c57e74a1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.057183 Oct 31 15:16:47.315828 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 81/193] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:16:47 2022] GET /compute/v2.1/images/f449c9fc-9446-4433-9bdd-3e98c57e74a1/metadata => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:47.322826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9ef99f2-a60c-46e8-8076-4b803f52b7dc tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Action: 'update_all', calling method: .version_select at 0x7f16e1ec0dc0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:47.352057 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-e9ef99f2-a60c-46e8-8076-4b803f52b7dc tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] HTTP exception thrown: Image not found. Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9ef99f2-a60c-46e8-8076-4b803f52b7dc tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Request method failure captured: Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: request: PUT /compute/v2.1/images/49157d52-a95d-4f58-9d80-c44b1698c028/metadata HTTP/1.1 Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 57 Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bd7CB6rPB250grHI33vaCVp2HsTI9c9NQYOkSoV3OsljTXXdu8f6QRa7iE_qRjPNHJIurUS0tGXA-uR2flrNj60MrGg5OvnxA_IoS5gKEmERmAHAc9NnCpHVExvYFAUGQYiqmuXH87IrHveghO8LDamUtDS3K6cIRARqQXFz5VhPU Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:47.354395 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcf218a907e343efa26cedd0a4046298", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcf218a907e343efa26cedd0a4046298"}]}] Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 90c7ace14ca942b28db0e199a89bc005 Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:16:47.355502 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'image_id': '49157d52-a95d-4f58-9d80-c44b1698c028', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.356238 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 49157d52-a95d-4f58-9d80-c44b1698c028 Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.357256 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 49157d52-a95d-4f58-9d80-c44b1698c028 could not be found. Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:47.358204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:16:47.359142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.362477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9ef99f2-a60c-46e8-8076-4b803f52b7dc tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:47.363572 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9ef99f2-a60c-46e8-8076-4b803f52b7dc tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] 10.222.0.20 "PUT /compute/v2.1/images/49157d52-a95d-4f58-9d80-c44b1698c028/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044774 Oct 31 15:16:47.365277 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 82/194] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:16:47 2022] PUT /compute/v2.1/images/49157d52-a95d-4f58-9d80-c44b1698c028/metadata => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:47.380265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-359a0929-5838-4485-934b-2b5fb5a5c2b7 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Action: 'update', calling method: .version_select at 0x7f16e1e8e430>, body: {"meta": {"os_distro": "alt"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:47.432221 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-359a0929-5838-4485-934b-2b5fb5a5c2b7 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] HTTP exception thrown: Image not found. Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-359a0929-5838-4485-934b-2b5fb5a5c2b7 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Request method failure captured: Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: request: PUT /compute/v2.1/images/245ab365-c418-468d-84de-3c92762037d1/metadata/os_distro HTTP/1.1 Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 30 Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bd7CB6rPB250grHI33vaCVp2HsTI9c9NQYOkSoV3OsljTXXdu8f6QRa7iE_qRjPNHJIurUS0tGXA-uR2flrNj60MrGg5OvnxA_IoS5gKEmERmAHAc9NnCpHVExvYFAUGQYiqmuXH87IrHveghO8LDamUtDS3K6cIRARqQXFz5VhPU Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:47.436334 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcf218a907e343efa26cedd0a4046298", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcf218a907e343efa26cedd0a4046298"}]}] Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 90c7ace14ca942b28db0e199a89bc005 Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: {"meta": {"os_distro": "alt"}} Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:16:47.437495 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'image_id': '245ab365-c418-468d-84de-3c92762037d1', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.438306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 245ab365-c418-468d-84de-3c92762037d1 Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.439798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 245ab365-c418-468d-84de-3c92762037d1 could not be found. Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:47.442330 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:16:47.445456 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.448019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-359a0929-5838-4485-934b-2b5fb5a5c2b7 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:47.448019 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-359a0929-5838-4485-934b-2b5fb5a5c2b7 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] 10.222.0.20 "PUT /compute/v2.1/images/245ab365-c418-468d-84de-3c92762037d1/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.064997 Oct 31 15:16:47.448019 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 83/195] 10.222.0.20 () {60 vars in 1310 bytes} [Mon Oct 31 15:16:47 2022] PUT /compute/v2.1/images/245ab365-c418-468d-84de-3c92762037d1/metadata/os_distro => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:47.474962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b3f1b4b-8862-4a21-a6a4-c9097a2ab698 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Action: 'create', calling method: .version_select at 0x7f16e21daaf0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:47.528378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-5b3f1b4b-8862-4a21-a6a4-c9097a2ab698 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] HTTP exception thrown: Image not found. Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b3f1b4b-8862-4a21-a6a4-c9097a2ab698 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Request method failure captured: Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/images/0c9ac696-27de-49fe-8386-b9d5b8c739ea/metadata HTTP/1.1 Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 57 Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bd7CB6rPB250grHI33vaCVp2HsTI9c9NQYOkSoV3OsljTXXdu8f6QRa7iE_qRjPNHJIurUS0tGXA-uR2flrNj60MrGg5OvnxA_IoS5gKEmERmAHAc9NnCpHVExvYFAUGQYiqmuXH87IrHveghO8LDamUtDS3K6cIRARqQXFz5VhPU Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:47.531290 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_dcf218a907e343efa26cedd0a4046298", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/dcf218a907e343efa26cedd0a4046298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/dcf218a907e343efa26cedd0a4046298"}]}] Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: dcf218a907e343efa26cedd0a4046298 Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-830255986 Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 90c7ace14ca942b28db0e199a89bc005 Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-830255986-project Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:16:47.532448 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'image_id': '0c9ac696-27de-49fe-8386-b9d5b8c739ea', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.533816 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0c9ac696-27de-49fe-8386-b9d5b8c739ea Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:16:47.535030 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c9ac696-27de-49fe-8386-b9d5b8c739ea could not be found. Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:47.536286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:16:47.538665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:47.541223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b3f1b4b-8862-4a21-a6a4-c9097a2ab698 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:47.541223 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b3f1b4b-8862-4a21-a6a4-c9097a2ab698 tempest-ImagesMetadataNegativeTestJSON-830255986 tempest-ImagesMetadataNegativeTestJSON-830255986-project] 10.222.0.20 "POST /compute/v2.1/images/0c9ac696-27de-49fe-8386-b9d5b8c739ea/metadata" status: 404 len: 62 microversion: 2.1 time: 0.081878 Oct 31 15:16:47.541223 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 84/196] 10.222.0.20 () {60 vars in 1281 bytes} [Mon Oct 31 15:16:47 2022] POST /compute/v2.1/images/0c9ac696-27de-49fe-8386-b9d5b8c739ea/metadata => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:16:47.559567 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ac28a48-b4eb-4950-baa7-dd03e881effd tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.294720 Oct 31 15:16:47.570639 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 113/197] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 31 15:16:47 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:47.596549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7de83468-6b17-4b17-a3a0-2b66df352436 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:47.647042 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7de83468-6b17-4b17-a3a0-2b66df352436 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.057369 Oct 31 15:16:47.653143 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 85/198] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:47 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:47.660584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-868343d2-5ee6-4ca6-a05f-83839d517078 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1997816967"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:47.664719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-868343d2-5ee6-4ca6-a05f-83839d517078 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Generated uuid add63abc-9e62-4152-b2ed-809051dd8845 for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:47.728595 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-868343d2-5ee6-4ca6-a05f-83839d517078 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071049 Oct 31 15:16:47.729465 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 114/199] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:47.742920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ff82035a-13e2-42f8-9be8-a2ff5097128c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:47.760479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff82035a-13e2-42f8-9be8-a2ff5097128c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:47.760972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff82035a-13e2-42f8-9be8-a2ff5097128c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:47.763791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff82035a-13e2-42f8-9be8-a2ff5097128c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.009952 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ff82035a-13e2-42f8-9be8-a2ff5097128c tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.270781 Oct 31 15:16:48.010565 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 86/200] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 31 15:16:47 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:48.024503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f660db00-ff81-4918-8250-932494c85f3f tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:48.060137 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f660db00-ff81-4918-8250-932494c85f3f tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.038712 Oct 31 15:16:48.068319 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 115/201] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:16:48 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:48.076653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf3a6e35-7d98-46e8-b59e-d089ab4db230 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:48.102067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf3a6e35-7d98-46e8-b59e-d089ab4db230 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.104674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf3a6e35-7d98-46e8-b59e-d089ab4db230 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.105310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf3a6e35-7d98-46e8-b59e-d089ab4db230 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.293005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:48.294009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:48.318314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.318892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.319339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.323888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.324908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.327163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.368911 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf3a6e35-7d98-46e8-b59e-d089ab4db230 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.295657 Oct 31 15:16:48.371290 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 87/202] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 31 15:16:48 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:48.387017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91c75342-a60e-473d-93d5-e1383b7526c4 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:48.425813 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91c75342-a60e-473d-93d5-e1383b7526c4 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.043830 Oct 31 15:16:48.428635 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 88/203] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:48 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 31 15:16:48.437423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b969c61-b4c0-4b2e-975e-514808c25c6e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-550532361"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:48.441797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.aggregate [None req-5b969c61-b4c0-4b2e-975e-514808c25c6e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Generated uuid 92e958fe-ed8e-4f36-acb5-001d8658c69b for aggregate {{(pid=120588) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:48.488876 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b969c61-b4c0-4b2e-975e-514808c25c6e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.052911 Oct 31 15:16:48.491036 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 89/204] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:48.507780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5f4caf76-c6eb-471c-a3df-1ab0593d28c5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:48.539156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f4caf76-c6eb-471c-a3df-1ab0593d28c5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.539671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f4caf76-c6eb-471c-a3df-1ab0593d28c5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.543128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f4caf76-c6eb-471c-a3df-1ab0593d28c5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.844628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:48.852008 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5f4caf76-c6eb-471c-a3df-1ab0593d28c5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.352771 Oct 31 15:16:48.854725 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 90/205] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 31 15:16:48 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:48.861937 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eca03edf-7175-447e-9869-574da835ae97 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.575282 Oct 31 15:16:48.862538 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 116/206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:48 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:48.870149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f3dbe442-3c17-4916-bd9b-8829a40c90f0 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-17"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:48.874984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-22e63b50-f024-4ef5-ba41-44004b2d56f9 req-148c2e86-3dc0-4c16-b5ed-5127f183d58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dacf152-1913-4810-84fa-113047bf0e73", "name": "network-vif-plugged", "status": "completed", "tag": "562118eb-55c8-4072-bb71-2cf744930f3a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:48.904579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3dbe442-3c17-4916-bd9b-8829a40c90f0 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.905118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22e63b50-f024-4ef5-ba41-44004b2d56f9 req-148c2e86-3dc0-4c16-b5ed-5127f183d58b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:48.905277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3dbe442-3c17-4916-bd9b-8829a40c90f0 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.905705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3dbe442-3c17-4916-bd9b-8829a40c90f0 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.907949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22e63b50-f024-4ef5-ba41-44004b2d56f9 req-148c2e86-3dc0-4c16-b5ed-5127f183d58b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:48.908387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22e63b50-f024-4ef5-ba41-44004b2d56f9 req-148c2e86-3dc0-4c16-b5ed-5127f183d58b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:48.924649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=20 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:48.926828 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-22e63b50-f024-4ef5-ba41-44004b2d56f9 req-148c2e86-3dc0-4c16-b5ed-5127f183d58b service nova] Creating event network-vif-plugged:562118eb-55c8-4072-bb71-2cf744930f3a for instance 4dacf152-1913-4810-84fa-113047bf0e73 on n-h2-858384-17 Oct 31 15:16:48.948099 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-22e63b50-f024-4ef5-ba41-44004b2d56f9 req-148c2e86-3dc0-4c16-b5ed-5127f183d58b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092099 Oct 31 15:16:48.950921 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 91/207] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:49.134497 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f3dbe442-3c17-4916-bd9b-8829a40c90f0 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.270901 Oct 31 15:16:49.135139 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 117/208] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 31 15:16:48 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:49.149234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e8e1156-20cb-4463-9013-6908b6e43e80 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.180023 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e8e1156-20cb-4463-9013-6908b6e43e80 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.035779 Oct 31 15:16:49.181321 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 92/209] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:49 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:49.192044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29cd5998-7d70-4233-9c3d-609c7e207acb tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1718126894"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:49.196306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-29cd5998-7d70-4233-9c3d-609c7e207acb tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Generated uuid 0a09ac95-aeda-49da-bfb6-6270d6e20fc6 for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:49.229882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3cfa26f6-6605-4e53-af51-3d3bdd451d67 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1008585980"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:49.236983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.aggregate [None req-3cfa26f6-6605-4e53-af51-3d3bdd451d67 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Generated uuid 63a48b3c-f1b1-4b29-a7e3-d0f721d50367 for aggregate {{(pid=120588) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:49.244076 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29cd5998-7d70-4233-9c3d-609c7e207acb tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056216 Oct 31 15:16:49.253487 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 118/210] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:49.264262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c095b653-53d4-4478-85fa-837e0e4f09b5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.295116 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3cfa26f6-6605-4e53-af51-3d3bdd451d67 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.068252 Oct 31 15:16:49.297185 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 93/211] 10.222.0.20 () {62 vars in 1205 bytes} [Mon Oct 31 15:16:49 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:49.313393 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c095b653-53d4-4478-85fa-837e0e4f09b5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.058637 Oct 31 15:16:49.314222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27145f65-6bea-4e7f-b546-15659aac079b tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1203441898"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:49.318575 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 119/212] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:49 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:49.324050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-538108de-3bfc-4ffe-9703-854e22b9419a tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.341010 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-538108de-3bfc-4ffe-9703-854e22b9419a tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-538108de-3bfc-4ffe-9703-854e22b9419a tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Request method failure captured: Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a5DVDArW0h976Yh9YprwYOTIxVBgYh4MAnIaZQJmfmrDNE5yV1tq7KKPTSsVmc54vBqqac7XXXuzkk314pV_CAnYn5gdkF6C9exMcE5y8r01BbFGbrv3kRYFAY0KhzGf_dK4R3pXFGQj72a9agjNjygpNwUMrTkCUhrtCVfYi71NU Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 338b4411b7c04cb7a41c4ade9683d064 Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:16:49.343824 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/338b4411b7c04cb7a41c4ade9683d064"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_338b4411b7c04cb7a41c4ade9683d064", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/338b4411b7c04cb7a41c4ade9683d064"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/338b4411b7c04cb7a41c4ade9683d064"}]}] Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 338b4411b7c04cb7a41c4ade9683d064 Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AggregatesAdminTestJSON-1393789529-project-admin Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ab1abd88d80450f99cbb4f8af4d21a6 Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AggregatesAdminTestJSON-1393789529-project-admin Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: exception: Aggregate 5 could not be found. Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '5'} Oct 31 15:16:49.345159 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.346638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 31 15:16:49.348364 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.355122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-538108de-3bfc-4ffe-9703-854e22b9419a tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:49.356233 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-538108de-3bfc-4ffe-9703-854e22b9419a tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.036736 Oct 31 15:16:49.357391 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 120/213] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:49.370289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe75fa9e-2dc9-4022-a5eb-c8fa662e2d46 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.443584 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-fe75fa9e-2dc9-4022-a5eb-c8fa662e2d46 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe75fa9e-2dc9-4022-a5eb-c8fa662e2d46 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Request method failure captured: Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a5DVDArW0h976Yh9YprwYOTIxVBgYh4MAnIaZQJmfmrDNE5yV1tq7KKPTSsVmc54vBqqac7XXXuzkk314pV_CAnYn5gdkF6C9exMcE5y8r01BbFGbrv3kRYFAY0KhzGf_dK4R3pXFGQj72a9agjNjygpNwUMrTkCUhrtCVfYi71NU Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 338b4411b7c04cb7a41c4ade9683d064 Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:16:49.446283 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/338b4411b7c04cb7a41c4ade9683d064"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_338b4411b7c04cb7a41c4ade9683d064", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/338b4411b7c04cb7a41c4ade9683d064"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/338b4411b7c04cb7a41c4ade9683d064"}]}] Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 338b4411b7c04cb7a41c4ade9683d064 Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AggregatesAdminTestJSON-1393789529-project-admin Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ab1abd88d80450f99cbb4f8af4d21a6 Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AggregatesAdminTestJSON-1393789529-project-admin Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: exception: Aggregate 5 could not be found. Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '5'} Oct 31 15:16:49.447654 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:49.448389 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.449630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:49.450763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:49.450763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:49.450763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:49.450763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 31 15:16:49.450763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.454327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe75fa9e-2dc9-4022-a5eb-c8fa662e2d46 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:49.456552 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe75fa9e-2dc9-4022-a5eb-c8fa662e2d46 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.090644 Oct 31 15:16:49.457436 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 121/214] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:49 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:16:49.493683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f3c8b8e-d798-4875-94a3-d9ee40e9f7c8 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-852928893", "name": "tempest-test_aggregate-193985183"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:49.497537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-8f3c8b8e-d798-4875-94a3-d9ee40e9f7c8 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Generated uuid c2ab03c2-49c0-4c23-9acd-1812c89e80ad for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:49.544761 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f3c8b8e-d798-4875-94a3-d9ee40e9f7c8 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.081792 Oct 31 15:16:49.551890 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 122/215] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Oct 31 15:16:49 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:49.556762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91755f3a-7be0-4dc6-ac3f-369ac6789b8e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.602167 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-91755f3a-7be0-4dc6-ac3f-369ac6789b8e tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.048509 Oct 31 15:16:49.614410 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 123/216] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:49 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 31 15:16:49.622661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d357e0d4-77cb-48d9-910a-f3928a878c27 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.632538 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d357e0d4-77cb-48d9-910a-f3928a878c27 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d357e0d4-77cb-48d9-910a-f3928a878c27 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Request method failure captured: Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a5DVDArW0h976Yh9YprwYOTIxVBgYh4MAnIaZQJmfmrDNE5yV1tq7KKPTSsVmc54vBqqac7XXXuzkk314pV_CAnYn5gdkF6C9exMcE5y8r01BbFGbrv3kRYFAY0KhzGf_dK4R3pXFGQj72a9agjNjygpNwUMrTkCUhrtCVfYi71NU Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 338b4411b7c04cb7a41c4ade9683d064 Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:16:49.634761 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/338b4411b7c04cb7a41c4ade9683d064"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_338b4411b7c04cb7a41c4ade9683d064", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/338b4411b7c04cb7a41c4ade9683d064"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/338b4411b7c04cb7a41c4ade9683d064"}]}] Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 338b4411b7c04cb7a41c4ade9683d064 Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AggregatesAdminTestJSON-1393789529-project-admin Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ab1abd88d80450f99cbb4f8af4d21a6 Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AggregatesAdminTestJSON-1393789529-project-admin Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: exception: Aggregate 7 could not be found. Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '7'} Oct 31 15:16:49.636211 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.637043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 31 15:16:49.638266 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.641043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d357e0d4-77cb-48d9-910a-f3928a878c27 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:49.642529 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d357e0d4-77cb-48d9-910a-f3928a878c27 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.024682 Oct 31 15:16:49.645495 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 124/217] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:49.651443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5dc930e9-3a95-4a2e-a7b7-b6cfd95783b5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.671532 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-5dc930e9-3a95-4a2e-a7b7-b6cfd95783b5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5dc930e9-3a95-4a2e-a7b7-b6cfd95783b5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Request method failure captured: Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a5DVDArW0h976Yh9YprwYOTIxVBgYh4MAnIaZQJmfmrDNE5yV1tq7KKPTSsVmc54vBqqac7XXXuzkk314pV_CAnYn5gdkF6C9exMcE5y8r01BbFGbrv3kRYFAY0KhzGf_dK4R3pXFGQj72a9agjNjygpNwUMrTkCUhrtCVfYi71NU Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 338b4411b7c04cb7a41c4ade9683d064 Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:16:49.676816 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/338b4411b7c04cb7a41c4ade9683d064"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_338b4411b7c04cb7a41c4ade9683d064", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/338b4411b7c04cb7a41c4ade9683d064"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/338b4411b7c04cb7a41c4ade9683d064"}]}] Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 338b4411b7c04cb7a41c4ade9683d064 Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1393789529 Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AggregatesAdminTestJSON-1393789529-project-admin Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ab1abd88d80450f99cbb4f8af4d21a6 Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AggregatesAdminTestJSON-1393789529-project-admin Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: exception: Aggregate 7 could not be found. Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '7'} Oct 31 15:16:49.678140 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:49.679123 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:49.680338 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:49.683361 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:49.683361 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:49.683361 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:49.683361 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 31 15:16:49.683361 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:49.685459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5dc930e9-3a95-4a2e-a7b7-b6cfd95783b5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:49.686553 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5dc930e9-3a95-4a2e-a7b7-b6cfd95783b5 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.039025 Oct 31 15:16:49.688829 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 125/218] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:49 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:49.698423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27145f65-6bea-4e7f-b546-15659aac079b tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.392898 Oct 31 15:16:49.699050 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 94/219] 10.222.0.20 () {62 vars in 1210 bytes} [Mon Oct 31 15:16:49 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:49.700942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78ebbf7f-08eb-444c-ac5f-066b86abf374 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-434678061"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:49.706956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-78ebbf7f-08eb-444c-ac5f-066b86abf374 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Generated uuid e7f3d36d-91d1-44a9-8284-afbd79fbef39 for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:49.712604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-efdb5b7d-974f-4c77-bd6c-0d4b7fbd9bac tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.728509 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-efdb5b7d-974f-4c77-bd6c-0d4b7fbd9bac tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.021470 Oct 31 15:16:49.729634 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 95/220] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:16:49.743182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-377bdc2d-ecd1-4722-a0b8-9ed9e862299b tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:49.752972 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78ebbf7f-08eb-444c-ac5f-066b86abf374 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.058223 Oct 31 15:16:49.754093 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 126/221] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:49 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:49.765009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-377bdc2d-ecd1-4722-a0b8-9ed9e862299b tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.765535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-377bdc2d-ecd1-4722-a0b8-9ed9e862299b tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.765645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cff4299d-ae07-4f67-af7d-52f8471d97d4 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.765967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-377bdc2d-ecd1-4722-a0b8-9ed9e862299b tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.781591 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cff4299d-ae07-4f67-af7d-52f8471d97d4 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.019995 Oct 31 15:16:49.785166 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 127/222] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:49.795823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d60dbe9-6559-4b39-8b83-e2c8d85610d3 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:49.834435 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d60dbe9-6559-4b39-8b83-e2c8d85610d3 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.042516 Oct 31 15:16:49.835528 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 128/223] 10.222.0.20 () {60 vars in 1191 bytes} [Mon Oct 31 15:16:49 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:49.850307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95d3ec2f-317d-48ac-af53-f032768dbe25 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.858640 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95d3ec2f-317d-48ac-af53-f032768dbe25 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.014847 Oct 31 15:16:49.859126 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 129/224] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:49.873083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c65acfd-8d26-4021-9e95-d59432f41a29 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.903023 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c65acfd-8d26-4021-9e95-d59432f41a29 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.034591 Oct 31 15:16:49.911558 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 130/225] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:49 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:49.914984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:49.917085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:49.931876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.932375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.932807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.933653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:49.934020 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-377bdc2d-ecd1-4722-a0b8-9ed9e862299b tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 315 microversion: 2.41 time: 0.195717 Oct 31 15:16:49.934657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:49.935375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:49.936020 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 96/226] 10.222.0.20 () {62 vars in 1232 bytes} [Mon Oct 31 15:16:49 2022] POST /compute/v2.1/os-aggregates/6/action => generated 315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:49.941801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ff0a37d-73a5-4f76-abb7-2941ae20f11b tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2044098484", "availability_zone": "tempest-test_az-1476558434"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:49.966834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.aggregate [None req-2ff0a37d-73a5-4f76-abb7-2941ae20f11b tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Generated uuid 6f83fe93-e525-4cf6-a550-46575b4f86c4 for aggregate {{(pid=120588) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:49.993312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=11,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:50.025786 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ff0a37d-73a5-4f76-abb7-2941ae20f11b tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.088717 Oct 31 15:16:50.026405 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 97/227] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Oct 31 15:16:49 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.036598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3902558f-79e3-41e6-98a1-f682c74f6147 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:50.062769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3902558f-79e3-41e6-98a1-f682c74f6147 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.063274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3902558f-79e3-41e6-98a1-f682c74f6147 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.064195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3902558f-79e3-41e6-98a1-f682c74f6147 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.092013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:50.162382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:50.173448 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6bd8d477-eb44-46f2-a0c1-5556b2543787 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.266236 Oct 31 15:16:50.174330 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 131/228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:49 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:50.179742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d6437dd9-1f5f-481d-a263-961efcac16c1 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2044098484_new", "availability_zone": "tempest-test_az-1476558434_new"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:50.282825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=11,nova_api:INSERT=7 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:50.292488 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3902558f-79e3-41e6-98a1-f682c74f6147 tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.264366 Oct 31 15:16:50.295497 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 98/229] 10.222.0.20 () {62 vars in 1232 bytes} [Mon Oct 31 15:16:50 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:50.308765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5118027d-763b-4457-8a14-18112c99736a tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.339258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6437dd9-1f5f-481d-a263-961efcac16c1 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.339979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6437dd9-1f5f-481d-a263-961efcac16c1 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.340623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6437dd9-1f5f-481d-a263-961efcac16c1 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.342144 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5118027d-763b-4457-8a14-18112c99736a tempest-AggregatesAdminTestV241-1640104763 tempest-AggregatesAdminTestV241-1640104763-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.037903 Oct 31 15:16:50.348953 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 99/230] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 31 15:16:50 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.388024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e048ad1a-2b91-4a09-8b2f-add48f6ef1f9 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Calling method '.version_select at 0x7f16e1f0a0d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.393151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048ad1a-2b91-4a09-8b2f-add48f6ef1f9 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.393797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048ad1a-2b91-4a09-8b2f-add48f6ef1f9 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.394228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048ad1a-2b91-4a09-8b2f-add48f6ef1f9 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.394956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048ad1a-2b91-4a09-8b2f-add48f6ef1f9 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.399627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048ad1a-2b91-4a09-8b2f-add48f6ef1f9 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.400372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048ad1a-2b91-4a09-8b2f-add48f6ef1f9 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.401774 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d6437dd9-1f5f-481d-a263-961efcac16c1 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.224771 Oct 31 15:16:50.402798 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 132/231] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:16:50 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.415576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2804b96e-bbc4-4d53-b5b1-3d7d1a6f3e45 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.433392 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2804b96e-bbc4-4d53-b5b1-3d7d1a6f3e45 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.021566 Oct 31 15:16:50.434873 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 133/232] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:50.451069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d16378a5-c608-4d37-8c62-b133531ce5ef tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.473979 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e048ad1a-2b91-4a09-8b2f-add48f6ef1f9 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.090923 Oct 31 15:16:50.474863 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 100/233] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.487658 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d16378a5-c608-4d37-8c62-b133531ce5ef tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.044049 Oct 31 15:16:50.493178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd00248d-4921-4a8b-a983-ac0738287c02 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Calling method '.version_select at 0x7f16e1ed3dc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.497066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd00248d-4921-4a8b-a983-ac0738287c02 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.497326 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 134/234] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:50 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:50.499941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd00248d-4921-4a8b-a983-ac0738287c02 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.500388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd00248d-4921-4a8b-a983-ac0738287c02 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.501157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd00248d-4921-4a8b-a983-ac0738287c02 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.505021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd00248d-4921-4a8b-a983-ac0738287c02 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.505507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd00248d-4921-4a8b-a983-ac0738287c02 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.505992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=26 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:50.506104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a69259e2-2109-4bf3-b510-b55090249bcd tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1525935743"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:50.511283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-a69259e2-2109-4bf3-b510-b55090249bcd tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Generated uuid 1e06f815-12fd-4bda-aaf6-a955abb883e6 for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:50.537503 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd00248d-4921-4a8b-a983-ac0738287c02 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.054965 Oct 31 15:16:50.538107 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 101/235] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.553034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ba0889c-7bb9-4c98-ab97-e0846439d6c5 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Calling method '.version_select at 0x7f16e1f4e8b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.554413 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a69259e2-2109-4bf3-b510-b55090249bcd tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053531 Oct 31 15:16:50.558706 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 135/236] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.561625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba0889c-7bb9-4c98-ab97-e0846439d6c5 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.562539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba0889c-7bb9-4c98-ab97-e0846439d6c5 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.563145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba0889c-7bb9-4c98-ab97-e0846439d6c5 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.564622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba0889c-7bb9-4c98-ab97-e0846439d6c5 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.565948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba0889c-7bb9-4c98-ab97-e0846439d6c5 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.566547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba0889c-7bb9-4c98-ab97-e0846439d6c5 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.572549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba5f332a-2d1a-4740-9142-3a336a3dc76a tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.586248 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba5f332a-2d1a-4740-9142-3a336a3dc76a tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.019006 Oct 31 15:16:50.587366 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 136/237] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:16:50.601519 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ba0889c-7bb9-4c98-ab97-e0846439d6c5 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.052387 Oct 31 15:16:50.602146 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 102/238] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.612175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21eb12f8-d885-4b41-8fd9-145998a78089 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.622438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-94437803-0859-461a-99de-ab6152681e03 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Calling method '.version_select at 0x7f16e1ed30d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.638768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94437803-0859-461a-99de-ab6152681e03 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.639277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94437803-0859-461a-99de-ab6152681e03 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.639709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94437803-0859-461a-99de-ab6152681e03 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.652839 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21eb12f8-d885-4b41-8fd9-145998a78089 tempest-AggregatesAdminTestJSON-1393789529 tempest-AggregatesAdminTestJSON-1393789529-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.044334 Oct 31 15:16:50.654721 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 137/239] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:50 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 31 15:16:50.654854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94437803-0859-461a-99de-ab6152681e03 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.655328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94437803-0859-461a-99de-ab6152681e03 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.655938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94437803-0859-461a-99de-ab6152681e03 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.664073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e5d4ae6-a924-487f-93b7-1f0137cb2133 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1051063690"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:50.667727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-7e5d4ae6-a924-487f-93b7-1f0137cb2133 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Generated uuid bf24c52c-4f67-4919-883a-969a803fd809 for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:50.676873 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-94437803-0859-461a-99de-ab6152681e03 tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h1-858384-17" status: 200 len: 335 microversion: 2.1 time: 0.061310 Oct 31 15:16:50.683070 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 103/240] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/os-hosts/n-h1-858384-17 => generated 335 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.688345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.689506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:50.696783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.697535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.698140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.698759 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e5d4ae6-a924-487f-93b7-1f0137cb2133 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038122 Oct 31 15:16:50.699159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.699667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.700158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.708050 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 138/241] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.712608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0cef0143-5642-4e52-8f6c-ec899164ecaa tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Calling method '.version_select at 0x7f16e1e9db80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.721728 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] HTTP exception thrown: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Request method failure captured: Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 HTTP/1.1 Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a2BAFZRlnlhxY0TLMXt-o-u2VGFsCToMy8KlxqwZ_4hSuoeUP92zBG6Mwq5iaRpWYfzDViDgx0lWlHTZgLh5MhyAvvSxWNzdzYMcXgGXCtDU_clo3S_mhZPuWDV6yuTGrSnDT5yuFqc6_UqL-EaUcwZbkIbrkCUqmGJ-8Qtg3qhm8 Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f75067d429b8476a87f21278c15f713f Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminTestJSON-2059945343 Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:50.726495 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f75067d429b8476a87f21278c15f713f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f75067d429b8476a87f21278c15f713f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f75067d429b8476a87f21278c15f713f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f75067d429b8476a87f21278c15f713f"}]}] Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminTestJSON-2059945343 Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f75067d429b8476a87f21278c15f713f Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2059945343 Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminTestJSON-2059945343-project Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: f11b3f04a10a448c84cc00549be53fb6 Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminTestJSON-2059945343-project Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.727667 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'ee21f97a-b117-41b9-bb10-029bd6b05cd5'} Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:50.728313 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.729989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.731275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cef0143-5642-4e52-8f6c-ec899164ecaa tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.731275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cef0143-5642-4e52-8f6c-ec899164ecaa tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.731415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Returning 404 to user: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:50.732033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cef0143-5642-4e52-8f6c-ec899164ecaa tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.732129 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2b162aee-9739-45e1-af2d-e0036e6e3a5d tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 404 len: 111 microversion: 2.1 time: 0.043913 Oct 31 15:16:50.732129 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 104/242] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:16:50 2022] DELETE /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:50.734734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64ec13ba-5ae8-4c6c-8b7a-6681f1d45ea8 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:50.737664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:50.753507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64ec13ba-5ae8-4c6c-8b7a-6681f1d45ea8 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.754253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64ec13ba-5ae8-4c6c-8b7a-6681f1d45ea8 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.755082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64ec13ba-5ae8-4c6c-8b7a-6681f1d45ea8 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.766456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cef0143-5642-4e52-8f6c-ec899164ecaa tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.767500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cef0143-5642-4e52-8f6c-ec899164ecaa tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.768159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cef0143-5642-4e52-8f6c-ec899164ecaa tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.803569 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0cef0143-5642-4e52-8f6c-ec899164ecaa tempest-HostsAdminTestJSON-1629846640 tempest-HostsAdminTestJSON-1629846640-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-h2-858384-17" status: 200 len: 471 microversion: 2.1 time: 0.100291 Oct 31 15:16:50.804292 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 139/243] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/os-hosts/n-h2-858384-17 => generated 471 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.819099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:50.819839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] [instance: ee21f97a-b117-41b9-bb10-029bd6b05cd5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:50.827138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.827757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.828285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.829075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.829818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.830351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.849596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] HTTP exception thrown: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Request method failure captured: Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 HTTP/1.1 Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a2BAFZRlnlhxY0TLMXt-o-u2VGFsCToMy8KlxqwZ_4hSuoeUP92zBG6Mwq5iaRpWYfzDViDgx0lWlHTZgLh5MhyAvvSxWNzdzYMcXgGXCtDU_clo3S_mhZPuWDV6yuTGrSnDT5yuFqc6_UqL-EaUcwZbkIbrkCUqmGJ-8Qtg3qhm8 Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f75067d429b8476a87f21278c15f713f Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AggregatesAdminTestJSON-2059945343 Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:50.851230 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f75067d429b8476a87f21278c15f713f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f75067d429b8476a87f21278c15f713f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f75067d429b8476a87f21278c15f713f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f75067d429b8476a87f21278c15f713f"}]}] Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AggregatesAdminTestJSON-2059945343 Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f75067d429b8476a87f21278c15f713f Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2059945343 Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AggregatesAdminTestJSON-2059945343-project Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: f11b3f04a10a448c84cc00549be53fb6 Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AggregatesAdminTestJSON-2059945343-project Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.853065 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ee21f97a-b117-41b9-bb10-029bd6b05cd5'} Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:50.853849 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. Oct 31 15:16:50.854914 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:50.855863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] Returning 404 to user: Instance ee21f97a-b117-41b9-bb10-029bd6b05cd5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:50.855863 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c42b252d-c527-49e5-9337-69e897199cda tempest-AggregatesAdminTestJSON-2059945343 tempest-AggregatesAdminTestJSON-2059945343-project] 10.222.0.20 "GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5" status: 404 len: 111 microversion: 2.1 time: 0.048815 Oct 31 15:16:50.855863 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 140/244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:50 2022] GET /compute/v2.1/servers/ee21f97a-b117-41b9-bb10-029bd6b05cd5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:50.941741 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64ec13ba-5ae8-4c6c-8b7a-6681f1d45ea8 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 244 microversion: 2.1 time: 0.211246 Oct 31 15:16:50.942341 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 105/245] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:16:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 244 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:50.954536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e0c500e-481f-470b-a3e4-c11ff74648cc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:50.967351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e0c500e-481f-470b-a3e4-c11ff74648cc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:50.968581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e0c500e-481f-470b-a3e4-c11ff74648cc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:50.969248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e0c500e-481f-470b-a3e4-c11ff74648cc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:50.999963 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-1e0c500e-481f-470b-a3e4-c11ff74648cc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-858384-17. Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e0c500e-481f-470b-a3e4-c11ff74648cc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Request method failure captured: Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 40 Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a53vxth1q7tlrG7I_Uzd0UmWm_a7Hd6nlseWx2_mz5zxVOwZlFw1-LK-xaga5c2U9nKr5MR6ALucTMnTEAslFC9gmCLl1fogmXJYpUXXm9Zo8O3QwIx7nbB0pyKUbQdiZ1CUQalFKnM8XZU3mLJfyvmBwSCpadDH4YZZJSEyZ5XNU Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:51.004957 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7eb7fab5399a434ca3845cfdc0508bdd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7eb7fab5399a434ca3845cfdc0508bdd"}]}] Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4cc1a64bf9f34f0e81e148866aeb6b8b Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: {"add_host": {"host": "n-h1-858384-17"}} Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:51.006186 n-d-858384-17 devstack@n-api.service[120588]: exception: Aggregate 11 already has host n-h1-858384-17. Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-858384-17'}}} Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:16:51.006910 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-858384-17-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi session.flush() Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 15:16:51.008182 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 15:16:51.009210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:16:51.015222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-858384-17-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 31, 15, 16, 50, 989800), 'updated_at': None, 'host': 'n-h1-858384-17', 'aggregate_id': 11}] Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:51.017405 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6643, in add_host_to_aggregate Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-858384-17. Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:51.019267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-858384-17. Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:51.022802 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:51.026018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-858384-17. Oct 31 15:16:51.026018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:51.026018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e0c500e-481f-470b-a3e4-c11ff74648cc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-858384-17. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:51.026018 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e0c500e-481f-470b-a3e4-c11ff74648cc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.055617 Oct 31 15:16:51.026018 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 106/246] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:16:50 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 31 15:16:51.026018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1b535d7f-d0d4-40f8-91db-22f8316d5241 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:51.031441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b535d7f-d0d4-40f8-91db-22f8316d5241 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.031877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b535d7f-d0d4-40f8-91db-22f8316d5241 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.032417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b535d7f-d0d4-40f8-91db-22f8316d5241 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.037283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:51.183012 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1b535d7f-d0d4-40f8-91db-22f8316d5241 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.167711 Oct 31 15:16:51.184421 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 107/247] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:16:51 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:51.199017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:51.199678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:51.218261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.218832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.219188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.220111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:51.220582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:51.221016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:51.381114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:51.390424 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0afcc5df-8d1c-4d2b-b34e-04c9e98889ff tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1387 microversion: 2.1 time: 0.196965 Oct 31 15:16:51.392031 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 108/248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:51 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1387 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:51.404348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a41e0522-6f39-460c-a119-4b2bbf1f402c tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:51.465642 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a41e0522-6f39-460c-a119-4b2bbf1f402c tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.071777 Oct 31 15:16:51.474733 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 109/249] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:51 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:51.481613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a33ad63b-9390-4919-aa0b-549d17772ff9 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-862578856"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:51.489331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.aggregate [None req-a33ad63b-9390-4919-aa0b-549d17772ff9 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Generated uuid d422fbb1-21ed-40b7-a413-b86483dc1213 for aggregate {{(pid=120588) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:51.520248 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a33ad63b-9390-4919-aa0b-549d17772ff9 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044175 Oct 31 15:16:51.521772 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 110/250] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:51.536742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-38887f24-2e2f-440f-a53e-9bbbf1cf0a8f tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Action: 'create', calling method: .version_select at 0x7f16e2cda8b0>, body: {"keypair": {"name": "tempest-keypair-1564103262", "type": "ssh", "user_id": "3abbee9ef4bf41988325a15d935af594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7Urky+Ze9yiKlaEZV9VceEZAUOJbFkOYB5fOaVnDbeRMid0+Z50Diq43cexQCmQzi9fCExMDolZSmKKSvTPpRsIoLTJtXid1s6z2ZUQ3RTM1GH0j9z/Y9I1lNRHaH0Pg=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:51.567136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-38887f24-2e2f-440f-a53e-9bbbf1cf0a8f tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Getting quotas for project e785fdd201d44b2f843f67e31ce810b6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:51.572197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-38887f24-2e2f-440f-a53e-9bbbf1cf0a8f tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Getting quotas for user a34dbc06453a45189d297b9887a8c65b and project e785fdd201d44b2f843f67e31ce810b6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:51.612512 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-38887f24-2e2f-440f-a53e-9bbbf1cf0a8f tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.672550 Oct 31 15:16:51.613519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 141/251] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 31 15:16:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 676 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:16:51.639295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28659a92-5e77-4bf1-8ea4-6940a9030e4a tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Action: 'create', calling method: .version_select at 0x7f16e1e3d5e0>, body: {"keypair": {"name": "tempest-keypair-2067049637", "type": "ssh", "user_id": "3abbee9ef4bf41988325a15d935af594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqs6/+itQ2xW3pyZG5Tf0FgxbkJ5iSC9yjR6piYZZmu8RXSTgX1ikf3BReXnpE30A15enCSjob8JBg59xzL5M0KMSKc+F7+SjPO8ZUtGR5dKMnJR+nQzFaBihrFdRIsXQ=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:51.679305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-28659a92-5e77-4bf1-8ea4-6940a9030e4a tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Getting quotas for project e785fdd201d44b2f843f67e31ce810b6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:51.693016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-28659a92-5e77-4bf1-8ea4-6940a9030e4a tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Getting quotas for user a34dbc06453a45189d297b9887a8c65b and project e785fdd201d44b2f843f67e31ce810b6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:51.745423 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-28659a92-5e77-4bf1-8ea4-6940a9030e4a tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.117656 Oct 31 15:16:51.746209 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 142/252] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 31 15:16:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:16:51.761271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5db8f8bf-8c4d-42d6-8cd8-66a97495bbce tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Calling method '.version_select at 0x7f16e1e3c040>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:51.801034 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5db8f8bf-8c4d-42d6-8cd8-66a97495bbce tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1564103262?user_id=3abbee9ef4bf41988325a15d935af594" status: 200 len: 512 microversion: 2.10 time: 0.044725 Oct 31 15:16:51.814205 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 143/253] 10.222.0.20 () {60 vars in 1340 bytes} [Mon Oct 31 15:16:51 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1564103262?user_id=3abbee9ef4bf41988325a15d935af594 => generated 512 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:51.840851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3263984-3c23-4285-8618-e32f2915d909 tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Action: 'create', calling method: .version_select at 0x7f16e1e3cca0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-540778709", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsYkQTRqR06U+tOvC4JEMy9Si4oti8xA0KTTuLiCORxDlbBrEx7zyv86Nm0DztQlReo1edkb0fE7QugOZpiZ7O4eL9vnNKSRlxu+i4mZbRqKskrrFKtxGm3P3IMMr2zTg=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:51.878335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a3263984-3c23-4285-8618-e32f2915d909 tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Getting quotas for project e785fdd201d44b2f843f67e31ce810b6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:16:51.887572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a3263984-3c23-4285-8618-e32f2915d909 tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Getting quotas for user a34dbc06453a45189d297b9887a8c65b and project e785fdd201d44b2f843f67e31ce810b6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:16:51.941551 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3263984-3c23-4285-8618-e32f2915d909 tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.110106 Oct 31 15:16:51.942443 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 144/254] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 31 15:16:51 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:16:51.953437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7370f9c-9bd3-4b17-bca1-506bbb433569 tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Calling method '.version_select at 0x7f16e1e3c820>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:51.962470 n-d-858384-17 devstack@n-api.service[120587]: WARNING oslo_db.sqlalchemy.utils [None req-c7370f9c-9bd3-4b17-bca1-506bbb433569 tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:16:51.973512 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7370f9c-9bd3-4b17-bca1-506bbb433569 tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=3abbee9ef4bf41988325a15d935af594" status: 200 len: 726 microversion: 2.10 time: 0.024160 Oct 31 15:16:51.974871 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 145/255] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 31 15:16:51 2022] GET /compute/v2.1/os-keypairs?user_id=3abbee9ef4bf41988325a15d935af594 => generated 726 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:16:52.006259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af94fcd8-97e3-4564-bdeb-96fd61068e0f tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Calling method '.version_select at 0x7f16e1e3d5e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.052590 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af94fcd8-97e3-4564-bdeb-96fd61068e0f tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-540778709" status: 204 len: 0 microversion: 2.10 time: 0.056645 Oct 31 15:16:52.054639 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 146/256] 10.222.0.20 () {60 vars in 1322 bytes} [Mon Oct 31 15:16:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-540778709 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:16:52.072819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c9a34e8-0563-4754-88ee-ab7ed32e8af4 tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Calling method '.version_select at 0x7f16e1d834c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.145960 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c9a34e8-0563-4754-88ee-ab7ed32e8af4 tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067049637?user_id=3abbee9ef4bf41988325a15d935af594" status: 204 len: 0 microversion: 2.10 time: 0.085777 Oct 31 15:16:52.156176 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 147/257] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067049637?user_id=3abbee9ef4bf41988325a15d935af594 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:16:52.165704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8244bb7-95e6-4e1c-bd9f-16994b026ecc tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] Calling method '.version_select at 0x7f16e1d83c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.187245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e73f73d9-7df6-40ca-b4de-129db82a4628 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:52.191422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e73f73d9-7df6-40ca-b4de-129db82a4628 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '8b51a7fa46bb482292c4ab0ac88a7b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0a167ec46644819c657c937959d6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e73f73d9-7df6-40ca-b4de-129db82a4628 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Request method failure captured: Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 40 Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a2-bAjxIPS-6cDIYNLqPSls61ftmSCl-Fb0vq1qPsc5HtSk4siT-2-i8DMvAkn0cSDGCsjHmKo9KyKs7Ry7LSQj-FHD5c1-e5yfkczq5Nc5bsprOFQjIce6KRj_latddltJTexWLbCicr6N33FjJu8tDmTKQjsfhIUwyhJuHx7eZg Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:52.196626 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0a167ec46644819c657c937959d6b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0a167ec46644819c657c937959d6b3"}]}] Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 8b51a7fa46bb482292c4ab0ac88a7b6b Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: {"add_host": {"host": "n-h1-858384-17"}} Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:52.197848 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-858384-17'}}} Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:52.198555 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 31 15:16:52.199532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.200610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e73f73d9-7df6-40ca-b4de-129db82a4628 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:52.205523 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e73f73d9-7df6-40ca-b4de-129db82a4628 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.664295 Oct 31 15:16:52.206323 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 111/258] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:16:51 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 671 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:16:52.214344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f73ceffa-ab85-4f8c-937e-1e9f52d6b01a tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.223102 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8244bb7-95e6-4e1c-bd9f-16994b026ecc tempest-KeyPairsV210TestJSON-1593015043 tempest-KeyPairsV210TestJSON-1593015043-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564103262?user_id=3abbee9ef4bf41988325a15d935af594" status: 204 len: 0 microversion: 2.10 time: 0.065416 Oct 31 15:16:52.225918 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 148/259] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564103262?user_id=3abbee9ef4bf41988325a15d935af594 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:16:52.302105 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f73ceffa-ab85-4f8c-937e-1e9f52d6b01a tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.091376 Oct 31 15:16:52.308820 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 112/260] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:52 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:52.314421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1db5792-486c-464b-a295-bf432e0a2e23 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-753566388"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:52.318783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-e1db5792-486c-464b-a295-bf432e0a2e23 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Generated uuid b9d3f164-0f0f-45dc-a1d1-293cb165720d for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:52.374143 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1db5792-486c-464b-a295-bf432e0a2e23 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064403 Oct 31 15:16:52.375701 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 149/261] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:52.394637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1700541366"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:52.416581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.418406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:52.431591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.431794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.433419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.433544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.434281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.435900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.436753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.438578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.441103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.457671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.463598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.464068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.486122 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1700541366 could not be found. Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Request method failure captured: Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 58 Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a53vxth1q7tlrG7I_Uzd0UmWm_a7Hd6nlseWx2_mz5zxVOwZlFw1-LK-xaga5c2U9nKr5MR6ALucTMnTEAslFC9gmCLl1fogmXJYpUXXm9Zo8O3QwIx7nbB0pyKUbQdiZ1CUQalFKnM8XZU3mLJfyvmBwSCpadDH4YZZJSEyZ5XNU Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:52.493812 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7eb7fab5399a434ca3845cfdc0508bdd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7eb7fab5399a434ca3845cfdc0508bdd"}]}] Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4cc1a64bf9f34f0e81e148866aeb6b8b Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: {"add_host": {"host": "tempest-nonexist_host-1700541366"}} Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:52.494988 n-d-858384-17 devstack@n-api.service[120588]: exception: Compute host tempest-nonexist_host-1700541366 could not be found. Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1700541366'}}} Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1700541366' is not mapped to any cell Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.495678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6623, in add_host_to_aggregate Oct 31 15:16:52.496673 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1700541366 could not be found. Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1700541366 could not be found. Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.498642 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.500734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.500734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.500734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.500734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:52.500734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:52.500734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1700541366 could not be found. Oct 31 15:16:52.500734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.500734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1700541366 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:52.500734 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07240fa6-f22a-473e-81ef-139623ebb3f0 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.113548 Oct 31 15:16:52.502580 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 113/262] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:16:52 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:52.515028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e804f15-eda9-4431-914e-a4a43107ed17 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.572433 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e804f15-eda9-4431-914e-a4a43107ed17 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.068698 Oct 31 15:16:52.582935 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 114/263] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:52 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:52.588892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8408c551-86cb-4c4e-a6ac-b60167cc6498 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8408c551-86cb-4c4e-a6ac-b60167cc6498 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Request method failure captured: Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 283 Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a53vxth1q7tlrG7I_Uzd0UmWm_a7Hd6nlseWx2_mz5zxVOwZlFw1-LK-xaga5c2U9nKr5MR6ALucTMnTEAslFC9gmCLl1fogmXJYpUXXm9Zo8O3QwIx7nbB0pyKUbQdiZ1CUQalFKnM8XZU3mLJfyvmBwSCpadDH4YZZJSEyZ5XNU Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:52.604825 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7eb7fab5399a434ca3845cfdc0508bdd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7eb7fab5399a434ca3845cfdc0508bdd"}]}] Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4cc1a64bf9f34f0e81e148866aeb6b8b Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:52.606091 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:16:52.606629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:52.607190 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.609210 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.610047 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:16:52.610047 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:16:52.610047 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:16:52.610047 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.612160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8408c551-86cb-4c4e-a6ac-b60167cc6498 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:52.614284 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8408c551-86cb-4c4e-a6ac-b60167cc6498 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.029200 Oct 31 15:16:52.622423 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 115/264] 10.222.0.20 () {60 vars in 1165 bytes} [Mon Oct 31 15:16:52 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:16:52.633974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5aa97017-c22e-464d-86e6-314d81e999d4 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5aa97017-c22e-464d-86e6-314d81e999d4 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Request method failure captured: Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 27 Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a53vxth1q7tlrG7I_Uzd0UmWm_a7Hd6nlseWx2_mz5zxVOwZlFw1-LK-xaga5c2U9nKr5MR6ALucTMnTEAslFC9gmCLl1fogmXJYpUXXm9Zo8O3QwIx7nbB0pyKUbQdiZ1CUQalFKnM8XZU3mLJfyvmBwSCpadDH4YZZJSEyZ5XNU Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:52.639495 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7eb7fab5399a434ca3845cfdc0508bdd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7eb7fab5399a434ca3845cfdc0508bdd"}]}] Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4cc1a64bf9f34f0e81e148866aeb6b8b Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: {"aggregate": {"name": ""}} Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:52.640693 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '' Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:52.641447 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:16:52.643586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.647700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5aa97017-c22e-464d-86e6-314d81e999d4 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:52.648881 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5aa97017-c22e-464d-86e6-314d81e999d4 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.024870 Oct 31 15:16:52.654996 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 116/265] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:52 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:16:52.661203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b2cb2f1-26bf-41d5-abb0-71db00819015 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-371995403"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:52.665673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0b2cb2f1-26bf-41d5-abb0-71db00819015 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '8b51a7fa46bb482292c4ab0ac88a7b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0a167ec46644819c657c937959d6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b2cb2f1-26bf-41d5-abb0-71db00819015 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Request method failure captured: Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 59 Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a2-bAjxIPS-6cDIYNLqPSls61ftmSCl-Fb0vq1qPsc5HtSk4siT-2-i8DMvAkn0cSDGCsjHmKo9KyKs7Ry7LSQj-FHD5c1-e5yfkczq5Nc5bsprOFQjIce6KRj_latddltJTexWLbCicr6N33FjJu8tDmTKQjsfhIUwyhJuHx7eZg Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:52.668324 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0a167ec46644819c657c937959d6b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0a167ec46644819c657c937959d6b3"}]}] Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 8b51a7fa46bb482292c4ab0ac88a7b6b Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: {"aggregate": {"name": "tempest-test_aggregate-371995403"}} Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:52.669784 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-371995403'}}} Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:52.670571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:52.671546 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 31 15:16:52.672575 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.674326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b2cb2f1-26bf-41d5-abb0-71db00819015 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:52.675080 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b2cb2f1-26bf-41d5-abb0-71db00819015 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018305 Oct 31 15:16:52.680912 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 117/266] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:52 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:52.691861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-996b205e-feed-4756-a085-9bff6d442d92 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1153552773"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:52.697534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.aggregate [None req-996b205e-feed-4756-a085-9bff6d442d92 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Generated uuid 60964359-6c3d-444a-994c-78d6b41c1b98 for aggregate {{(pid=120588) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:52.747998 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-996b205e-feed-4756-a085-9bff6d442d92 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060643 Oct 31 15:16:52.749997 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 118/267] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:52.757169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:52.762798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f490c22a-a94c-4cea-98c9-d48197374d3f tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1153552773"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:52.766697 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-168a9b78-d437-4081-a8f9-80cda9cfe92e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1586 microversion: 2.1 time: 0.354766 Oct 31 15:16:52.768957 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 150/268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:52 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1586 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:16:52.776768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.aggregate [None req-f490c22a-a94c-4cea-98c9-d48197374d3f tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Generated uuid ba5b75c2-1150-4f39-8549-3da3cf3adeef for aggregate {{(pid=120588) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:52.804858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c110330-6633-44d6-848e-28c843d63646 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.808012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6c110330-6633-44d6-848e-28c843d63646 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:52.827430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=7,nova_api:INSERT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:52.831412 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f490c22a-a94c-4cea-98c9-d48197374d3f tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1153552773 already exists. Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f490c22a-a94c-4cea-98c9-d48197374d3f tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Request method failure captured: Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 60 Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a53vxth1q7tlrG7I_Uzd0UmWm_a7Hd6nlseWx2_mz5zxVOwZlFw1-LK-xaga5c2U9nKr5MR6ALucTMnTEAslFC9gmCLl1fogmXJYpUXXm9Zo8O3QwIx7nbB0pyKUbQdiZ1CUQalFKnM8XZU3mLJfyvmBwSCpadDH4YZZJSEyZ5XNU Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:52.834156 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7eb7fab5399a434ca3845cfdc0508bdd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7eb7fab5399a434ca3845cfdc0508bdd"}]}] Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4cc1a64bf9f34f0e81e148866aeb6b8b Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: {"aggregate": {"name": "tempest-test_aggregate-1153552773"}} Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:52.835324 n-d-858384-17 devstack@n-api.service[120588]: exception: Aggregate tempest-test_aggregate-1153552773 already exists. Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1153552773'}}} Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6460, in create_aggregate Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 31 15:16:52.836017 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1153552773 already exists. Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:52.836998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1153552773 already exists. Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1153552773 already exists. Oct 31 15:16:52.838113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:52.838743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c110330-6633-44d6-848e-28c843d63646 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.838743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c110330-6633-44d6-848e-28c843d63646 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.838743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c110330-6633-44d6-848e-28c843d63646 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.838743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c110330-6633-44d6-848e-28c843d63646 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:52.839864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c110330-6633-44d6-848e-28c843d63646 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:52.839864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c110330-6633-44d6-848e-28c843d63646 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:52.840522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f490c22a-a94c-4cea-98c9-d48197374d3f tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1153552773 already exists. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:52.841532 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f490c22a-a94c-4cea-98c9-d48197374d3f tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.083323 Oct 31 15:16:52.842201 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 119/269] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:52 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:52.858663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16835283-7b44-482a-9dbd-26539bfe5069 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.916235 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16835283-7b44-482a-9dbd-26539bfe5069 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.067484 Oct 31 15:16:52.919009 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 120/270] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:52 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:52.928010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-93d5dd07-070d-4547-bec7-45e8682b5a37 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1721265533"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:52.933023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.aggregate [None req-93d5dd07-070d-4547-bec7-45e8682b5a37 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Generated uuid 323d39c7-7009-48bc-9836-31af7c4e6d15 for aggregate {{(pid=120588) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:52.977017 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-93d5dd07-070d-4547-bec7-45e8682b5a37 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.053107 Oct 31 15:16:52.978093 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 121/271] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:52.993806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ac45b7bf-d38b-440e-a102-ae4ace36fdad tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:52.993893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ac45b7bf-d38b-440e-a102-ae4ace36fdad tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '8b51a7fa46bb482292c4ab0ac88a7b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0a167ec46644819c657c937959d6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ac45b7bf-d38b-440e-a102-ae4ace36fdad tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Request method failure captured: Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a2-bAjxIPS-6cDIYNLqPSls61ftmSCl-Fb0vq1qPsc5HtSk4siT-2-i8DMvAkn0cSDGCsjHmKo9KyKs7Ry7LSQj-FHD5c1-e5yfkczq5Nc5bsprOFQjIce6KRj_latddltJTexWLbCicr6N33FjJu8tDmTKQjsfhIUwyhJuHx7eZg Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:52.997954 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0a167ec46644819c657c937959d6b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0a167ec46644819c657c937959d6b3"}]}] Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 8b51a7fa46bb482292c4ab0ac88a7b6b Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 31 15:16:52.999170 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '15'} Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:52.999931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.000920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ac45b7bf-d38b-440e-a102-ae4ace36fdad tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:53.002662 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ac45b7bf-d38b-440e-a102-ae4ace36fdad tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.015502 Oct 31 15:16:53.005044 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 122/272] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:52 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:53.017750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71a29a0e-bc7e-4a23-8f31-3bfef1d43cd3 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.059890 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71a29a0e-bc7e-4a23-8f31-3bfef1d43cd3 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.050189 Oct 31 15:16:53.060883 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 123/273] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:53 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:53.070949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e356544-3de0-4035-934e-16210137f0bc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.094360 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7e356544-3de0-4035-934e-16210137f0bc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e356544-3de0-4035-934e-16210137f0bc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Request method failure captured: Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a53vxth1q7tlrG7I_Uzd0UmWm_a7Hd6nlseWx2_mz5zxVOwZlFw1-LK-xaga5c2U9nKr5MR6ALucTMnTEAslFC9gmCLl1fogmXJYpUXXm9Zo8O3QwIx7nbB0pyKUbQdiZ1CUQalFKnM8XZU3mLJfyvmBwSCpadDH4YZZJSEyZ5XNU Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:53.096139 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7eb7fab5399a434ca3845cfdc0508bdd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7eb7fab5399a434ca3845cfdc0508bdd"}]}] Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4cc1a64bf9f34f0e81e148866aeb6b8b Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: exception: Aggregate -1 could not be found. Oct 31 15:16:53.097476 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '-1'} Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6519, in delete_aggregate Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:16:53.098230 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.099479 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.100792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.100792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.100792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:53.100792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:53.100792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 31 15:16:53.100792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.102216 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c110330-6633-44d6-848e-28c843d63646 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.307110 Oct 31 15:16:53.102741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e356544-3de0-4035-934e-16210137f0bc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:53.103304 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 151/274] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:16:52 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73/os-interface => generated 284 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:53.103462 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e356544-3de0-4035-934e-16210137f0bc tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.036557 Oct 31 15:16:53.105321 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 124/275] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:53 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:53.116822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b43ae51b-496d-43e5-a318-b46f28d7a19c tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1623420265"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:53.121941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-b43ae51b-496d-43e5-a318-b46f28d7a19c tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Generated uuid 6c22e90d-43b6-411e-bd63-bb54544c29d3 for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:53.191239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b43ae51b-496d-43e5-a318-b46f28d7a19c tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.077791 Oct 31 15:16:53.198009 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 152/276] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:53.209915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92cff7b6-f5ba-4606-abec-022b42398f58 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.211409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-92cff7b6-f5ba-4606-abec-022b42398f58 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '8b51a7fa46bb482292c4ab0ac88a7b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0a167ec46644819c657c937959d6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92cff7b6-f5ba-4606-abec-022b42398f58 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Request method failure captured: Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a2-bAjxIPS-6cDIYNLqPSls61ftmSCl-Fb0vq1qPsc5HtSk4siT-2-i8DMvAkn0cSDGCsjHmKo9KyKs7Ry7LSQj-FHD5c1-e5yfkczq5Nc5bsprOFQjIce6KRj_latddltJTexWLbCicr6N33FjJu8tDmTKQjsfhIUwyhJuHx7eZg Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:53.212932 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0a167ec46644819c657c937959d6b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0a167ec46644819c657c937959d6b3"}]}] Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 8b51a7fa46bb482292c4ab0ac88a7b6b Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 31 15:16:53.214259 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '16'} Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:53.214936 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.216353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92cff7b6-f5ba-4606-abec-022b42398f58 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:53.217300 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92cff7b6-f5ba-4606-abec-022b42398f58 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.008252 Oct 31 15:16:53.217300 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 125/277] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:53 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:16:53.223773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5562eba4-4841-45d0-98ad-23a5f20f4603 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.275678 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5562eba4-4841-45d0-98ad-23a5f20f4603 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.056200 Oct 31 15:16:53.276552 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 153/278] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:53 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:53.287597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33bafff4-99ba-4b93-b7d7-263750e08fdd tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.290444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=14,nova_api:INSERT=5 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:53.303693 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-33bafff4-99ba-4b93-b7d7-263750e08fdd tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33bafff4-99ba-4b93-b7d7-263750e08fdd tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Request method failure captured: Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a53vxth1q7tlrG7I_Uzd0UmWm_a7Hd6nlseWx2_mz5zxVOwZlFw1-LK-xaga5c2U9nKr5MR6ALucTMnTEAslFC9gmCLl1fogmXJYpUXXm9Zo8O3QwIx7nbB0pyKUbQdiZ1CUQalFKnM8XZU3mLJfyvmBwSCpadDH4YZZJSEyZ5XNU Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:53.305350 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7eb7fab5399a434ca3845cfdc0508bdd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7eb7fab5399a434ca3845cfdc0508bdd"}]}] Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4cc1a64bf9f34f0e81e148866aeb6b8b Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: exception: Aggregate -1 could not be found. Oct 31 15:16:53.306784 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '-1'} Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6466, in get_aggregate Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.307787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 31 15:16:53.308853 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.311139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33bafff4-99ba-4b93-b7d7-263750e08fdd tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:53.311139 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33bafff4-99ba-4b93-b7d7-263750e08fdd tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024037 Oct 31 15:16:53.311139 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 126/279] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:16:53 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:53.320483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b1b717e-ad3d-4e68-b36c-8893a117ba4d tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:53.322126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9b1b717e-ad3d-4e68-b36c-8893a117ba4d tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '8b51a7fa46bb482292c4ab0ac88a7b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0a167ec46644819c657c937959d6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b1b717e-ad3d-4e68-b36c-8893a117ba4d tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Request method failure captured: Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a2-bAjxIPS-6cDIYNLqPSls61ftmSCl-Fb0vq1qPsc5HtSk4siT-2-i8DMvAkn0cSDGCsjHmKo9KyKs7Ry7LSQj-FHD5c1-e5yfkczq5Nc5bsprOFQjIce6KRj_latddltJTexWLbCicr6N33FjJu8tDmTKQjsfhIUwyhJuHx7eZg Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:16:53.323989 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0a167ec46644819c657c937959d6b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0a167ec46644819c657c937959d6b3"}]}] Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 8b51a7fa46bb482292c4ab0ac88a7b6b Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 31 15:16:53.325728 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:53.326436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.327573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b1b717e-ad3d-4e68-b36c-8893a117ba4d tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:53.330327 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9b1b717e-ad3d-4e68-b36c-8893a117ba4d tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.010792 Oct 31 15:16:53.330914 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 154/280] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:16:53 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:53.343280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-68fa9efe-0c85-4e58-b031-625a1672fafa tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1933439101"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:53.347666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.aggregate [None req-68fa9efe-0c85-4e58-b031-625a1672fafa tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Generated uuid a9a4955e-0206-4bef-9c6d-853efa90812d for aggregate {{(pid=120588) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:53.391742 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-68fa9efe-0c85-4e58-b031-625a1672fafa tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.052560 Oct 31 15:16:53.393778 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 127/281] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:53.409682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e89a47b-552f-4892-a8b4-cc434fae2d13 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:53.435647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e89a47b-552f-4892-a8b4-cc434fae2d13 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.436238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e89a47b-552f-4892-a8b4-cc434fae2d13 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.436746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e89a47b-552f-4892-a8b4-cc434fae2d13 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:53.725937 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e89a47b-552f-4892-a8b4-cc434fae2d13 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.324631 Oct 31 15:16:53.726927 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 155/282] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:16:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:53.740441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-676103bf-1ccf-49f1-8cdb-819005fbe1f5 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:53.744221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-676103bf-1ccf-49f1-8cdb-819005fbe1f5 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '8b51a7fa46bb482292c4ab0ac88a7b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f0a167ec46644819c657c937959d6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-676103bf-1ccf-49f1-8cdb-819005fbe1f5 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Request method failure captured: Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 43 Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a2-bAjxIPS-6cDIYNLqPSls61ftmSCl-Fb0vq1qPsc5HtSk4siT-2-i8DMvAkn0cSDGCsjHmKo9KyKs7Ry7LSQj-FHD5c1-e5yfkczq5Nc5bsprOFQjIce6KRj_latddltJTexWLbCicr6N33FjJu8tDmTKQjsfhIUwyhJuHx7eZg Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:16:53.748945 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3f0a167ec46644819c657c937959d6b3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3f0a167ec46644819c657c937959d6b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3f0a167ec46644819c657c937959d6b3"}]}] Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3f0a167ec46644819c657c937959d6b3 Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-142406761 Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 8b51a7fa46bb482292c4ab0ac88a7b6b Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-142406761-project Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: {"remove_host": {"host": "n-h1-858384-17"}} Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:53.750173 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-858384-17'}}} Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:53.750874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 31 15:16:53.752470 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:53.754981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-676103bf-1ccf-49f1-8cdb-819005fbe1f5 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:53.756367 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-676103bf-1ccf-49f1-8cdb-819005fbe1f5 tempest-AggregatesAdminNegativeTestJSON-142406761 tempest-AggregatesAdminNegativeTestJSON-142406761-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.017188 Oct 31 15:16:53.759034 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 128/283] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:16:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:16:53.765060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5b10ee2-7751-4221-a72f-2523d3f41050 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-17"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:53.788753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5b10ee2-7751-4221-a72f-2523d3f41050 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:53.789283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5b10ee2-7751-4221-a72f-2523d3f41050 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:53.793153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5b10ee2-7751-4221-a72f-2523d3f41050 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:54.064436 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5b10ee2-7751-4221-a72f-2523d3f41050 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.302539 Oct 31 15:16:54.065251 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 156/284] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:16:53 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:54.077372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3c99926-3825-4bc3-acd0-377d7a6f2a13 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:54.140053 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3c99926-3825-4bc3-acd0-377d7a6f2a13 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.066983 Oct 31 15:16:54.141354 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 129/285] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:54 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:54.155629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f46da44-2bb9-4941-81b7-4aa60425e071 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2129104641"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:54.159226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.aggregate [None req-2f46da44-2bb9-4941-81b7-4aa60425e071 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Generated uuid dfa502fe-f850-481e-b94d-fd3e14d5f012 for aggregate {{(pid=120587) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:16:54.215484 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f46da44-2bb9-4941-81b7-4aa60425e071 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065097 Oct 31 15:16:54.216636 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 157/286] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:16:54 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:16:54.229328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:54.247530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:54.248198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:54.248794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:54.267567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:54.268066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:54.268500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:54.293080 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.compute.aggregates [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 31 15:16:54.293646 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Request method failure captured: Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 42 Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a53vxth1q7tlrG7I_Uzd0UmWm_a7Hd6nlseWx2_mz5zxVOwZlFw1-LK-xaga5c2U9nKr5MR6ALucTMnTEAslFC9gmCLl1fogmXJYpUXXm9Zo8O3QwIx7nbB0pyKUbQdiZ1CUQalFKnM8XZU3mLJfyvmBwSCpadDH4YZZJSEyZ5XNU Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:16:54.295547 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7eb7fab5399a434ca3845cfdc0508bdd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7eb7fab5399a434ca3845cfdc0508bdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7eb7fab5399a434ca3845cfdc0508bdd"}]}] Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7eb7fab5399a434ca3845cfdc0508bdd Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-512993776 Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4cc1a64bf9f34f0e81e148866aeb6b8b Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: {"remove_host": {"host": "nonexist_host"}} Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:16:54.296669 n-d-858384-17 devstack@n-api.service[120588]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 31 15:16:54.297468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6685, in remove_host_from_aggregate Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 31 15:16:54.299176 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6009, in _get_service_in_cell_by_host Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:54.300269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:16:54.302657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:16:54.302657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:16:54.302657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:16:54.302657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:16:54.302657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 31 15:16:54.302657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:16:54.305775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:16:54.307095 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26b2f03d-cda5-427c-892e-4c9b04685ee7 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.081603 Oct 31 15:16:54.308174 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 130/287] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:16:54 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:16:54.316413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60e2d630-b106-434c-98dc-c514a7f06e05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:54.361649 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60e2d630-b106-434c-98dc-c514a7f06e05 tempest-AggregatesAdminNegativeTestJSON-512993776 tempest-AggregatesAdminNegativeTestJSON-512993776-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.048512 Oct 31 15:16:54.362525 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 158/288] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:16:54 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:16:57.242740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:16:57.243430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:16:57.274360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.274910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.277072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.280572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:57.282084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:57.287068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:57.364386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:16:57.950081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:16:57.963107 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-163b09f6-6893-41a4-aebd-b6168f178578 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 200 len: 1586 microversion: 2.1 time: 0.725565 Oct 31 15:16:57.965937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 131/289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:16:57 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 1586 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:16:59.828550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a5a29ec6-fd7c-429d-86c6-7d94bb161b1a req-87cb68ac-41b9-4086-9fc4-a347791ad667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dacf152-1913-4810-84fa-113047bf0e73", "tag": "562118eb-55c8-4072-bb71-2cf744930f3a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:16:59.860581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a5a29ec6-fd7c-429d-86c6-7d94bb161b1a req-87cb68ac-41b9-4086-9fc4-a347791ad667 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:16:59.861121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a5a29ec6-fd7c-429d-86c6-7d94bb161b1a req-87cb68ac-41b9-4086-9fc4-a347791ad667 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:16:59.861545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a5a29ec6-fd7c-429d-86c6-7d94bb161b1a req-87cb68ac-41b9-4086-9fc4-a347791ad667 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:16:59.899866 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a5a29ec6-fd7c-429d-86c6-7d94bb161b1a req-87cb68ac-41b9-4086-9fc4-a347791ad667 service nova] Creating event network-changed:562118eb-55c8-4072-bb71-2cf744930f3a for instance 4dacf152-1913-4810-84fa-113047bf0e73 on n-h2-858384-17 Oct 31 15:16:59.912768 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a5a29ec6-fd7c-429d-86c6-7d94bb161b1a req-87cb68ac-41b9-4086-9fc4-a347791ad667 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.030594 Oct 31 15:16:59.918015 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 159/290] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:02.985466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:03.171010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Calling method '.version_select at 0x7f16e1cc4c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.178489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.179553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.180186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.221933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.222830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.224104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.256616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.257275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.257795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.277631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.278409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.279070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.351103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.353652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.355838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.375245 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e8c7d45-4754-4bea-8aad-7bc15ccf5489 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1668 microversion: 2.53 time: 0.876891 Oct 31 15:17:03.392950 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 132/291] 10.222.0.20 () {60 vars in 1243 bytes} [Mon Oct 31 15:17:02 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1668 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:03.403175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Calling method '.version_select at 0x7f16e1cc4700>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.412299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.413989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.414724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.436796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.438976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.439520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.473513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.474255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.474697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.499381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.499870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.500296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.553379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.554646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.556253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.590078 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf846d6f-2009-41ed-b0c5-0b727c31d185 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 359 microversion: 2.53 time: 0.194117 Oct 31 15:17:03.592289 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 133/292] 10.222.0.20 () {60 vars in 1222 bytes} [Mon Oct 31 15:17:03 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:17:03.611670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-010ced88-8d9b-42d8-b8a7-132cff79cdd8 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Calling method '.version_select at 0x7f16e1cc05e0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.617061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-010ced88-8d9b-42d8-b8a7-132cff79cdd8 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.618087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-010ced88-8d9b-42d8-b8a7-132cff79cdd8 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.620248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-010ced88-8d9b-42d8-b8a7-132cff79cdd8 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.694166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-010ced88-8d9b-42d8-b8a7-132cff79cdd8 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.695234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-010ced88-8d9b-42d8-b8a7-132cff79cdd8 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.695939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-010ced88-8d9b-42d8-b8a7-132cff79cdd8 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.717536 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-010ced88-8d9b-42d8-b8a7-132cff79cdd8 tempest-HypervisorAdminV253TestBase-1185470834 tempest-HypervisorAdminV253TestBase-1185470834-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/80c34049-9a6e-44b2-96d0-d5d64643d51c" status: 200 len: 793 microversion: 2.53 time: 0.112121 Oct 31 15:17:03.721362 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 134/293] 10.222.0.20 () {60 vars in 1298 bytes} [Mon Oct 31 15:17:03 2022] GET /compute/v2.1/os-hypervisors/80c34049-9a6e-44b2-96d0-d5d64643d51c => generated 793 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:17:03.758401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Calling method '.version_select at 0x7f16e1d3fb80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.761635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.762933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.763595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.801504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.803111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.804436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.846890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.848968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.849466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.865343 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1492acc5-6ea6-47d6-83b0-ca20a573a58c tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.885191 Oct 31 15:17:03.869830 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 160/294] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:03.889286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Calling method '.version_select at 0x7f16e1d3f430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:03.893613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.895540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.897512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.949909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.950415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.950854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.980161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:03.980910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:03.981611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:03.991421 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-109cac4c-3978-49f4-a0f3-d62dfe276d51 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-858384-17/servers" status: 200 len: 105 microversion: 2.1 time: 0.113193 Oct 31 15:17:04.007181 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 161/295] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Oct 31 15:17:03 2022] GET /compute/v2.1/os-hypervisors/n-h1-858384-17/servers => generated 105 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:04.026754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Calling method '.version_select at 0x7f16e1d3faf0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:04.034621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.036820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.038537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.083341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.084060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.086489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.115875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.122206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.122906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.135183 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e7c31aa-6252-4605-a565-09afc04575c1 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.121751 Oct 31 15:17:04.136410 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 162/296] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:04 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:04.151214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b59da5a9-7e23-4af4-ba07-337711e2f8e6 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Calling method '.version_select at 0x7f16e1d3f8b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:04.153390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b59da5a9-7e23-4af4-ba07-337711e2f8e6 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.154238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b59da5a9-7e23-4af4-ba07-337711e2f8e6 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.154852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b59da5a9-7e23-4af4-ba07-337711e2f8e6 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.170464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b59da5a9-7e23-4af4-ba07-337711e2f8e6 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.171338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b59da5a9-7e23-4af4-ba07-337711e2f8e6 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.171932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b59da5a9-7e23-4af4-ba07-337711e2f8e6 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.180547 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b59da5a9-7e23-4af4-ba07-337711e2f8e6 tempest-HypervisorAdminUnderV252Test-1800258140 tempest-HypervisorAdminUnderV252Test-1800258140-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-858384-17/search" status: 200 len: 105 microversion: 2.1 time: 0.036268 Oct 31 15:17:04.181489 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 163/297] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Oct 31 15:17:04 2022] GET /compute/v2.1/os-hypervisors/n-h1-858384-17/search => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:04.266839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:04.530997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf84920a-2370-4f4d-b589-24f19285cdf1 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:04.532648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf84920a-2370-4f4d-b589-24f19285cdf1 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.533158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf84920a-2370-4f4d-b589-24f19285cdf1 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.533612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf84920a-2370-4f4d-b589-24f19285cdf1 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.534675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf84920a-2370-4f4d-b589-24f19285cdf1 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.538397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf84920a-2370-4f4d-b589-24f19285cdf1 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.538921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf84920a-2370-4f4d-b589-24f19285cdf1 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.621296 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf84920a-2370-4f4d-b589-24f19285cdf1 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.780142 Oct 31 15:17:04.628071 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 135/298] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Oct 31 15:17:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:17:04.644330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0992e417-521f-43d6-a332-084a65e9cdf8 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:04.646990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0992e417-521f-43d6-a332-084a65e9cdf8 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.647906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0992e417-521f-43d6-a332-084a65e9cdf8 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.648737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0992e417-521f-43d6-a332-084a65e9cdf8 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.650325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0992e417-521f-43d6-a332-084a65e9cdf8 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:04.651601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0992e417-521f-43d6-a332-084a65e9cdf8 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:04.653000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0992e417-521f-43d6-a332-084a65e9cdf8 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:04.692982 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0992e417-521f-43d6-a332-084a65e9cdf8 tempest-AZAdminV2TestJSON-192086178 tempest-AZAdminV2TestJSON-192086178-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.053595 Oct 31 15:17:04.704807 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 164/299] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 31 15:17:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:07.899492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1685569188", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": "none"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:07.999840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:08.000258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:08.001399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:08.001803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:08.002204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:08.043138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.045780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.047074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.048836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:08.056856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:08.057330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:08.131583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Getting quotas for project 552160083f6047d18b497a42bff6e99e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:08.145281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Getting quotas for user 4495e06014354a6f990613dc87af1644 and project 552160083f6047d18b497a42bff6e99e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:08.187147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:08.192379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:08.324978 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32687504-da05-4cab-a74b-e7c5d6f433c4 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.392916 Oct 31 15:17:08.342852 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 136/300] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:17:08.373591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5cc5925-44ed-41ec-bbf9-ba9d3f7b55ed tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:08.386541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a5cc5925-44ed-41ec-bbf9-ba9d3f7b55ed tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:08.492893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1678974072", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fae45c93-5c66-4e3d-908c-bfaf50cd6c4a"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:08.621070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] validate_networks() for [('fae45c93-5c66-4e3d-908c-bfaf50cd6c4a', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:08.674683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5cc5925-44ed-41ec-bbf9-ba9d3f7b55ed tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.686047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5cc5925-44ed-41ec-bbf9-ba9d3f7b55ed tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.696841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5cc5925-44ed-41ec-bbf9-ba9d3f7b55ed tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.727112 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5cc5925-44ed-41ec-bbf9-ba9d3f7b55ed tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "PUT /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1359 microversion: 2.75 time: 0.382851 Oct 31 15:17:08.727721 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 137/301] 10.222.0.20 () {62 vars in 1297 bytes} [Mon Oct 31 15:17:08 2022] PUT /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1359 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:08.788487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c767398-9284-4a33-8880-40fbf726346d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:08.790480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c767398-9284-4a33-8880-40fbf726346d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:08.917106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c767398-9284-4a33-8880-40fbf726346d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.926441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c767398-9284-4a33-8880-40fbf726346d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.929312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c767398-9284-4a33-8880-40fbf726346d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:08.946782 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c767398-9284-4a33-8880-40fbf726346d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1359 microversion: 2.75 time: 0.176695 Oct 31 15:17:08.961293 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 138/302] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:08 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:09.482035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1315917428", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:09.565900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:10.272334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:10.274855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:10.275822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:10.276442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:10.278203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:10.317449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.318237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.319076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.319854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.320642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.321075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.404634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Getting quotas for project d2f519c3aab447979a24d6e1c99b478c. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:10.426403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Getting quotas for user 32e5168a75474617a359aaa6fde1055c and project d2f519c3aab447979a24d6e1c99b478c. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:10.482257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:10.504288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:10.681352 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0182765-cb6a-4d32-a483-f61c56adf7c0 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504834 Oct 31 15:17:10.682715 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 139/303] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:10.694317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:10.695212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:10.738028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.738534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.739003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:10.751999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:10.752580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:10.756523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.053207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:11.074930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:11.076763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:11.100328 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a04dd228-398b-4821-aa34-29bce623a362 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1417 microversion: 2.75 time: 0.414071 Oct 31 15:17:11.100937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 140/304] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:10 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1417 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:11.123509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-02dac488-a6f9-4dd5-922d-4bf6ebf8e682 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:11.149627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:11.150125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:11.150506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:11.150915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:11.151323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:11.155702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-02dac488-a6f9-4dd5-922d-4bf6ebf8e682 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:11.166711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.167073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.167513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.168237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:11.194795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:11.195416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:11.237934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:11.251385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for user cd661f82522f4d5ab5f54d9fcdb81232 and project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:11.275554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:11.278026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:11.407605 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4ab4968-d961-4bdc-b0cc-e22665a90972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.212067 Oct 31 15:17:11.409653 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 165/305] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:11.441775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d4375c4-3b49-4229-8aac-481ccea8ebb1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:11.444112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d4375c4-3b49-4229-8aac-481ccea8ebb1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:11.493251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-02dac488-a6f9-4dd5-922d-4bf6ebf8e682 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:11.524978 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-02dac488-a6f9-4dd5-922d-4bf6ebf8e682 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1220 microversion: 2.1 time: 0.415902 Oct 31 15:17:11.546712 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 141/306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:11 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1220 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:11.644936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d4375c4-3b49-4229-8aac-481ccea8ebb1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:11.664863 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d4375c4-3b49-4229-8aac-481ccea8ebb1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1208 microversion: 2.1 time: 0.245279 Oct 31 15:17:11.678717 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 166/307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:11 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1208 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:12.136830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:12.137909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:12.150681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.154265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.155413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.156848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.157939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.159186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.328910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.342772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.347352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.362002 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cb63ea01-d1a9-4ede-8c1d-395cbd9fe032 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1417 microversion: 2.75 time: 0.229908 Oct 31 15:17:12.365112 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 142/308] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:12 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1417 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:12.569283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:12.583316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:12.609041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.612604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.614464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.615416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:12.618749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:12.619957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:12.698943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-427a9223-3db8-48f0-a462-62b47b8edcbc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:12.699909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-427a9223-3db8-48f0-a462-62b47b8edcbc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:12.714444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:12.841482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.852930 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4659947c-6aa8-4e22-8dd4-40070d062081 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1272 microversion: 2.1 time: 0.297061 Oct 31 15:17:12.862553 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 167/309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:12 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1272 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:12.939604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-427a9223-3db8-48f0-a462-62b47b8edcbc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:12.959359 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-427a9223-3db8-48f0-a462-62b47b8edcbc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1208 microversion: 2.1 time: 0.264517 Oct 31 15:17:12.964323 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 143/310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:12 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1208 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:13.396939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:13.398305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:13.436456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.436456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.436456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.436901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.438944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.439415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.795026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:13.806068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:13.808422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:13.824549 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e769c2a6-810b-45e0-a465-2995897bed76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1438 microversion: 2.75 time: 0.431694 Oct 31 15:17:13.837469 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 168/311] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:13 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1438 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:13.861424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:13.866114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:13.888888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:13.889515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:13.896535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.898112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.900999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.902547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.904589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.906480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.908011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.909269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.911115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:13.912017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:13.916324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:13.917106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.062310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:14.065818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:14.066541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:14.070933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:14.071626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:14.134665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.160412 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-28385c7b-0652-4feb-8e96-a285102ebb95 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1278 microversion: 2.1 time: 0.273312 Oct 31 15:17:14.164245 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 169/312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:13 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:14.178061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:14.178716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:14.190514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.193483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.194163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.195254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.196002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.196610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.375795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:14.433458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.434162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.435170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.436089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.437122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.438253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.504060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.524264 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-559478b1-5447-4b71-a893-2a005756e06d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1268 microversion: 2.1 time: 0.357759 Oct 31 15:17:14.530262 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 170/313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:14 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1268 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:14.638802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.659150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.662785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:14.692853 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a36c66d0-8b4c-4283-8e79-6fb4478d4abb tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "POST /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f/action" status: 202 len: 1495 microversion: 2.75 time: 0.836449 Oct 31 15:17:14.692853 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 144/314] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:17:13 2022] POST /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f/action => generated 1495 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 15:17:14.722465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:14.723511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:14.740751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.746161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.746757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.747840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:14.749400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:14.750811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:14.985042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:15.000750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:15.004638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:15.022087 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e3b39e1-0bd4-45a2-aeb6-bab0d32725f3 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.304533 Oct 31 15:17:15.024588 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 171/315] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:14 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:15.192620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:15.193806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:15.207272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.207832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.208348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.210142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.213746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.214301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.623462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:15.634801 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d56aa1a-3e71-498f-a9c8-876eb07ecbcc tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1320 microversion: 2.1 time: 0.446857 Oct 31 15:17:15.637835 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 145/316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:15 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:15.644011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:15.644612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:15.666429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.666932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.667369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.668079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:15.668661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:15.668956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:15.746549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ba0386d-d2d1-45f3-a083-0ac7578e50fd tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Calling method '.version_select at 0x7f16e1d133a0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:15.748541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3ba0386d-d2d1-45f3-a083-0ac7578e50fd tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b1734c5c5679472c835f0b174701d5d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d73c1075a646109ef8eec62d6ecf54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ba0386d-d2d1-45f3-a083-0ac7578e50fd tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Request method failure captured: Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-b4-SX8JdZ3NA2OVBEra5dC46We1jGHpBnRbF0dh7NPgEZ-SKhH2zPIvS-9WXLhHXtpcOrekaJwWE1Yx7PDYnGPmrmv7_B290VR71EYJQM05DgyAUPEF2iJLN7ALm8uzgdxrYlszonNzyevHxQT6P13z4M32ja3qnqLXP1bdh0Bwco Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:17:15.753245 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d73c1075a646109ef8eec62d6ecf54", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d73c1075a646109ef8eec62d6ecf54"}]}] Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b1734c5c5679472c835f0b174701d5d0 Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:17:15.754707 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:17:15.755592 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 31 15:17:15.756909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:15.762877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ba0386d-d2d1-45f3-a083-0ac7578e50fd tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:15.764780 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3ba0386d-d2d1-45f3-a083-0ac7578e50fd tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.557892 Oct 31 15:17:15.766800 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 172/317] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 31 15:17:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 560 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:15.777184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b274afbd-5419-4b8b-abf0-5efd786e0e94 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Calling method '.version_select at 0x7f16e1e3c4c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:15.778986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b274afbd-5419-4b8b-abf0-5efd786e0e94 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b1734c5c5679472c835f0b174701d5d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d73c1075a646109ef8eec62d6ecf54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b274afbd-5419-4b8b-abf0-5efd786e0e94 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Request method failure captured: Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-b4-SX8JdZ3NA2OVBEra5dC46We1jGHpBnRbF0dh7NPgEZ-SKhH2zPIvS-9WXLhHXtpcOrekaJwWE1Yx7PDYnGPmrmv7_B290VR71EYJQM05DgyAUPEF2iJLN7ALm8uzgdxrYlszonNzyevHxQT6P13z4M32ja3qnqLXP1bdh0Bwco Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:17:15.780547 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d73c1075a646109ef8eec62d6ecf54", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d73c1075a646109ef8eec62d6ecf54"}]}] Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b1734c5c5679472c835f0b174701d5d0 Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:17:15.782398 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:17:15.783276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 31 15:17:15.784309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:15.785382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b274afbd-5419-4b8b-abf0-5efd786e0e94 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:15.795608 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b274afbd-5419-4b8b-abf0-5efd786e0e94 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.022096 Oct 31 15:17:15.803432 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 173/318] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:15 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:15.820040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6045dc02-e2c2-4778-9fb6-2f4c5ed7ab0c tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Calling method '.version_select at 0x7f16e2c38ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:15.821833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6045dc02-e2c2-4778-9fb6-2f4c5ed7ab0c tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b1734c5c5679472c835f0b174701d5d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d73c1075a646109ef8eec62d6ecf54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6045dc02-e2c2-4778-9fb6-2f4c5ed7ab0c tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Request method failure captured: Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-b4-SX8JdZ3NA2OVBEra5dC46We1jGHpBnRbF0dh7NPgEZ-SKhH2zPIvS-9WXLhHXtpcOrekaJwWE1Yx7PDYnGPmrmv7_B290VR71EYJQM05DgyAUPEF2iJLN7ALm8uzgdxrYlszonNzyevHxQT6P13z4M32ja3qnqLXP1bdh0Bwco Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:17:15.827689 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d73c1075a646109ef8eec62d6ecf54", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d73c1075a646109ef8eec62d6ecf54"}]}] Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b1734c5c5679472c835f0b174701d5d0 Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:17:15.830081 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:17:15.830948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 31 15:17:15.832135 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:15.833289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6045dc02-e2c2-4778-9fb6-2f4c5ed7ab0c tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:15.833289 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6045dc02-e2c2-4778-9fb6-2f4c5ed7ab0c tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.019131 Oct 31 15:17:15.833289 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 174/319] 10.222.0.20 () {58 vars in 1179 bytes} [Mon Oct 31 15:17:15 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:15.928640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:15.939063 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a634dfb-841b-47ac-b2fa-92fecfbd6389 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1266 microversion: 2.1 time: 0.299961 Oct 31 15:17:15.939656 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 146/320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:15 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:16.143849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0aee770-6a07-4255-be1c-b18b32efe9a1 tempest-FlavorMetadataValidation-2034509490 tempest-FlavorMetadataValidation-2034509490-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1181365011", "id": 2097653692, "os-flavor-access:is_public": "True"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:16.181840 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b0aee770-6a07-4255-be1c-b18b32efe9a1 tempest-FlavorMetadataValidation-2034509490 tempest-FlavorMetadataValidation-2034509490-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.238752 Oct 31 15:17:16.182989 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 147/321] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:17:15 2022] POST /compute/v2.1/flavors => generated 471 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:17:16.230011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Calling method '.version_select at 0x7f16e1d3fca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.232690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.233422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.234845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.257347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.258313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.258956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.260991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f7f2c80-0ec9-4b02-ad3e-9cc9c679a2b3 tempest-NetworksTest-556159737 tempest-NetworksTest-556159737-project-admin] Calling method '.version_select at 0x7f16e1c91a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.275320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.275933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.276592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.284151 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61b3b458-8470-4360-a4fd-2a54b76b7c76 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.447018 Oct 31 15:17:16.285108 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 175/322] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:16.289758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.290869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:16.297534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.298381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.299044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.299955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.300612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.301271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.538353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:16.550217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:16.551668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:16.565537 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78276fff-187e-4aa2-9b02-074b9f6f6e5f tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.274506 Oct 31 15:17:16.582948 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 176/323] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:16.588466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3471577-03b9-4afa-8510-48fea84c4911 tempest-FlavorMetadataValidation-2034509490 tempest-FlavorMetadataValidation-2034509490-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:16.765275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:16.788508 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f7f2c80-0ec9-4b02-ad3e-9cc9c679a2b3 tempest-NetworksTest-556159737 tempest-NetworksTest-556159737-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 4699 microversion: 2.1 time: 0.604090 Oct 31 15:17:16.792858 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 148/324] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/os-networks => generated 4699 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:16.800910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3471577-03b9-4afa-8510-48fea84c4911 tempest-FlavorMetadataValidation-2034509490 tempest-FlavorMetadataValidation-2034509490-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/2097653692/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.218837 Oct 31 15:17:16.802175 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 177/325] 10.222.0.20 () {62 vars in 1265 bytes} [Mon Oct 31 15:17:16 2022] POST /compute/v2.1/flavors/2097653692/os-extra_specs => generated 62 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:16.807086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83985a48-f16e-401b-8da9-101932a7f8df tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Calling method '.version_select at 0x7f16e1be6430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.814304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83985a48-f16e-401b-8da9-101932a7f8df tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b1734c5c5679472c835f0b174701d5d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d73c1075a646109ef8eec62d6ecf54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:16.814851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:16.815826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:16.823892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83985a48-f16e-401b-8da9-101932a7f8df tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Request method failure captured: Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-b4-SX8JdZ3NA2OVBEra5dC46We1jGHpBnRbF0dh7NPgEZ-SKhH2zPIvS-9WXLhHXtpcOrekaJwWE1Yx7PDYnGPmrmv7_B290VR71EYJQM05DgyAUPEF2iJLN7ALm8uzgdxrYlszonNzyevHxQT6P13z4M32ja3qnqLXP1bdh0Bwco Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:17:16.824265 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d73c1075a646109ef8eec62d6ecf54", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d73c1075a646109ef8eec62d6ecf54"}]}] Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b1734c5c5679472c835f0b174701d5d0 Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '1'} Oct 31 15:17:16.825987 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:17:16.826826 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 31 15:17:16.828539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:16.830772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83985a48-f16e-401b-8da9-101932a7f8df tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:16.831572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.832248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.833245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:16.833353 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83985a48-f16e-401b-8da9-101932a7f8df tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.037026 Oct 31 15:17:16.834086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:16.834722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:16.835617 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 149/326] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:16.857718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-18488259-2f01-4f11-be90-1f5ff9f54cfe tempest-NetworksTest-556159737 tempest-NetworksTest-556159737-project-admin] Calling method '.version_select at 0x7f16e1d0adc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.029614 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-18488259-2f01-4f11-be90-1f5ff9f54cfe tempest-NetworksTest-556159737 tempest-NetworksTest-556159737-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed" status: 200 len: 652 microversion: 2.1 time: 0.192133 Oct 31 15:17:17.030620 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 150/327] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/os-networks/14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed => generated 652 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:17.051693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-838972c2-a732-4008-ba03-124152a87fbd tempest-FlavorMetadataValidation-2034509490 tempest-FlavorMetadataValidation-2034509490-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.117300 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-838972c2-a732-4008-ba03-124152a87fbd tempest-FlavorMetadataValidation-2034509490 tempest-FlavorMetadataValidation-2034509490-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2097653692" status: 202 len: 0 microversion: 2.86 time: 0.083011 Oct 31 15:17:17.118423 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 151/328] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Oct 31 15:17:17 2022] DELETE /compute/v2.1/flavors/2097653692 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:17:17.127091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bcba4513-d728-4e78-b126-e3e05c134a37 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Calling method '.version_select at 0x7f16e1c91670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.129102 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-bcba4513-d728-4e78-b126-e3e05c134a37 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] HTTP exception thrown: Hypervisor with ID 'c43a3d33-9608-4898-9bb4-71835068f7ee' could not be found. Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bcba4513-d728-4e78-b126-e3e05c134a37 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Request method failure captured: Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-hypervisors/c43a3d33-9608-4898-9bb4-71835068f7ee/uptime HTTP/1.1 Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-b71Hj3RJbw4obKCjE8bLv_voZvQOlkwyDirxA31LAAQdDNvInhGFNHBuUmGxJHQvoq1mAVa33-wYjsdXQwfsBEpOdUsKsWzz3U_qNUny4OeiRJwkd8gkLP43Oo7Ov0X0HW8JIdryVL2LOO_zjUnWXHBd9SZHM1r2CLtmNxsprfUgo Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: e4c1f6a9b0cf4b7b91ab898a164d7edf Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1318360977 Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:17:17.138694 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4c1f6a9b0cf4b7b91ab898a164d7edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4c1f6a9b0cf4b7b91ab898a164d7edf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4c1f6a9b0cf4b7b91ab898a164d7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4c1f6a9b0cf4b7b91ab898a164d7edf"}]}] Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1318360977 Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: e4c1f6a9b0cf4b7b91ab898a164d7edf Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1318360977 Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 9531956cd4e74b2db3273edfac4ca1bf Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: exception: Hypervisor with ID 'c43a3d33-9608-4898-9bb4-71835068f7ee' could not be found. Oct 31 15:17:17.140206 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'c43a3d33-9608-4898-9bb4-71835068f7ee'} Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c43a3d33-9608-4898-9bb4-71835068f7ee' Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 31 15:17:17.141011 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c43a3d33-9608-4898-9bb4-71835068f7ee' could not be found. Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.144160 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.146939 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.146939 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:17.146939 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:17.146939 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:17.146939 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:17.146939 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c43a3d33-9608-4898-9bb4-71835068f7ee' could not be found. Oct 31 15:17:17.146939 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.146939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bcba4513-d728-4e78-b126-e3e05c134a37 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Returning 404 to user: Hypervisor with ID 'c43a3d33-9608-4898-9bb4-71835068f7ee' could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:17.146939 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bcba4513-d728-4e78-b126-e3e05c134a37 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/c43a3d33-9608-4898-9bb4-71835068f7ee/uptime" status: 404 len: 123 microversion: 2.1 time: 0.022750 Oct 31 15:17:17.148343 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 152/329] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/os-hypervisors/c43a3d33-9608-4898-9bb4-71835068f7ee/uptime => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:17.152235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.152819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.161209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.162108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.162738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.163640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.164610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.165484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.307348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.310128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:17.320105 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f85584f1-ebc4-426e-86b8-a351fe080493 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1320 microversion: 2.1 time: 0.516263 Oct 31 15:17:17.320766 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 178/330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:16 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1320 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:17.340192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89c1daec-e72d-4dfc-be0b-7498bd0c04a8 tempest-NetworksTest-556159737 tempest-NetworksTest-556159737-project-admin] Calling method '.version_select at 0x7f16e1d83c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.447515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.458202 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64a2abc7-e3fc-41ea-8951-a88325fc3dc6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1308 microversion: 2.1 time: 0.309594 Oct 31 15:17:17.458779 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 153/331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:17.464865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-cc385d89-f5ad-45a7-9c50-39f1ce6b23d7 req-8316a467-9458-4d9b-98a3-6ecdf9daa6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d822e8-8a06-4792-841b-39288b697b2f", "tag": "06a1a9ef-b9b6-413c-b32a-32fbebed8d04"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:17.479590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cc385d89-f5ad-45a7-9c50-39f1ce6b23d7 req-8316a467-9458-4d9b-98a3-6ecdf9daa6a7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.480937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cc385d89-f5ad-45a7-9c50-39f1ce6b23d7 req-8316a467-9458-4d9b-98a3-6ecdf9daa6a7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.481573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cc385d89-f5ad-45a7-9c50-39f1ce6b23d7 req-8316a467-9458-4d9b-98a3-6ecdf9daa6a7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.500280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-cc385d89-f5ad-45a7-9c50-39f1ce6b23d7 req-8316a467-9458-4d9b-98a3-6ecdf9daa6a7 service nova] Creating event network-changed:06a1a9ef-b9b6-413c-b32a-32fbebed8d04 for instance c6d822e8-8a06-4792-841b-39288b697b2f on n-h2-858384-17 Oct 31 15:17:17.507627 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-cc385d89-f5ad-45a7-9c50-39f1ce6b23d7 req-8316a467-9458-4d9b-98a3-6ecdf9daa6a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047377 Oct 31 15:17:17.509090 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 154/332] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:17.514209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-921fdd7f-4c6e-4f86-af2a-6e5732b39115 tempest-FlavorMetadataValidation-2034509490 tempest-FlavorMetadataValidation-2034509490-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.550171 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-921fdd7f-4c6e-4f86-af2a-6e5732b39115 tempest-FlavorMetadataValidation-2034509490 tempest-FlavorMetadataValidation-2034509490-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.039613 Oct 31 15:17:17.551142 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 155/333] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:17.555614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Calling method '.version_select at 0x7f16e1c070d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.557608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.558294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.558911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.594922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.595385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.595815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.607972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.608461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.608893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.617371 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b1167cde-da88-46f9-b692-54fefedbc169 tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.064807 Oct 31 15:17:17.619029 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 156/334] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:17.624596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.626169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:17.633219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.634025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.634949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.635861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:17.636543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:17.637425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:17.700084 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89c1daec-e72d-4dfc-be0b-7498bd0c04a8 tempest-NetworksTest-556159737 tempest-NetworksTest-556159737-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 4699 microversion: 2.1 time: 0.378297 Oct 31 15:17:17.701363 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 179/335] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/os-networks => generated 4699 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:17.713169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da34a87d-10de-43d2-8683-82ee2fd6e638 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Calling method '.version_select at 0x7f16e1d135e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.715024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da34a87d-10de-43d2-8683-82ee2fd6e638 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b1734c5c5679472c835f0b174701d5d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d73c1075a646109ef8eec62d6ecf54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da34a87d-10de-43d2-8683-82ee2fd6e638 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Request method failure captured: Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-b4-SX8JdZ3NA2OVBEra5dC46We1jGHpBnRbF0dh7NPgEZ-SKhH2zPIvS-9WXLhHXtpcOrekaJwWE1Yx7PDYnGPmrmv7_B290VR71EYJQM05DgyAUPEF2iJLN7ALm8uzgdxrYlszonNzyevHxQT6P13z4M32ja3qnqLXP1bdh0Bwco Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:17:17.720910 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_48d73c1075a646109ef8eec62d6ecf54", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/48d73c1075a646109ef8eec62d6ecf54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/48d73c1075a646109ef8eec62d6ecf54"}]}] Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 48d73c1075a646109ef8eec62d6ecf54 Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-864499876 Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b1734c5c5679472c835f0b174701d5d0 Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-864499876-project Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '1'} Oct 31 15:17:17.722244 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:17:17.722961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 31 15:17:17.724230 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.725285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da34a87d-10de-43d2-8683-82ee2fd6e638 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:17.725285 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da34a87d-10de-43d2-8683-82ee2fd6e638 tempest-HypervisorAdminNegativeTestJSON-864499876 tempest-HypervisorAdminNegativeTestJSON-864499876-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.022244 Oct 31 15:17:17.726116 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 180/336] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:17.738120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-530ff2d6-33bd-4bd3-b4d2-b2fcf84df55d tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Calling method '.version_select at 0x7f16e1d32ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:17.739746 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-530ff2d6-33bd-4bd3-b4d2-b2fcf84df55d tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] HTTP exception thrown: Hypervisor with ID '0ef453a9-1863-439f-9601-d4d1360f5d20' could not be found. Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-530ff2d6-33bd-4bd3-b4d2-b2fcf84df55d tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Request method failure captured: Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hypervisors/0ef453a9-1863-439f-9601-d4d1360f5d20 HTTP/1.1 Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-b71Hj3RJbw4obKCjE8bLv_voZvQOlkwyDirxA31LAAQdDNvInhGFNHBuUmGxJHQvoq1mAVa33-wYjsdXQwfsBEpOdUsKsWzz3U_qNUny4OeiRJwkd8gkLP43Oo7Ov0X0HW8JIdryVL2LOO_zjUnWXHBd9SZHM1r2CLtmNxsprfUgo Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: e4c1f6a9b0cf4b7b91ab898a164d7edf Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1318360977 Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:17:17.747273 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4c1f6a9b0cf4b7b91ab898a164d7edf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e4c1f6a9b0cf4b7b91ab898a164d7edf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e4c1f6a9b0cf4b7b91ab898a164d7edf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e4c1f6a9b0cf4b7b91ab898a164d7edf"}]}] Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1318360977 Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: e4c1f6a9b0cf4b7b91ab898a164d7edf Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1318360977 Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 9531956cd4e74b2db3273edfac4ca1bf Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: exception: Hypervisor with ID '0ef453a9-1863-439f-9601-d4d1360f5d20' could not be found. Oct 31 15:17:17.748481 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '0ef453a9-1863-439f-9601-d4d1360f5d20'} Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0ef453a9-1863-439f-9601-d4d1360f5d20' Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 31 15:17:17.749294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:17:17.751042 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0ef453a9-1863-439f-9601-d4d1360f5d20' could not be found. Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0ef453a9-1863-439f-9601-d4d1360f5d20' could not be found. Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-530ff2d6-33bd-4bd3-b4d2-b2fcf84df55d tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] Returning 404 to user: Hypervisor with ID '0ef453a9-1863-439f-9601-d4d1360f5d20' could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:17.752074 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-530ff2d6-33bd-4bd3-b4d2-b2fcf84df55d tempest-HypervisorAdminNegativeTestJSON-1318360977 tempest-HypervisorAdminNegativeTestJSON-1318360977-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/0ef453a9-1863-439f-9601-d4d1360f5d20" status: 404 len: 123 microversion: 2.1 time: 0.020253 Oct 31 15:17:17.754126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.760806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:17.766047 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 181/337] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/os-hypervisors/0ef453a9-1863-439f-9601-d4d1360f5d20 => generated 123 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:17:17.773713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.777773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:17.787151 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1b92c058-eae9-4fc4-9b94-844a262c2e76 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.166717 Oct 31 15:17:17.802797 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 157/338] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:17 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:18.345956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:18.351762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:18.363375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.366399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.370595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.371755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.372411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.374363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.484090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:18.485283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:18.499756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.504709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.505348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.506297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.506765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.507192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.715415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:18.730578 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d74377c-6b98-40f3-a431-2835cd17f6fa tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1320 microversion: 2.1 time: 0.389736 Oct 31 15:17:18.749681 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 182/339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:18 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:18.852947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-66208152-4491-43dc-865e-8beef8e94202 req-ec38138e-7db8-4222-8691-4f1ccde0707a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d28f347d-fe10-4885-bbf4-1d8591ca6340", "tag": "fc85af9d-8ed8-4328-9088-8c61c61d17c1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:18.885787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-66208152-4491-43dc-865e-8beef8e94202 req-ec38138e-7db8-4222-8691-4f1ccde0707a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.891853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-66208152-4491-43dc-865e-8beef8e94202 req-ec38138e-7db8-4222-8691-4f1ccde0707a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.892650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-66208152-4491-43dc-865e-8beef8e94202 req-ec38138e-7db8-4222-8691-4f1ccde0707a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.913250 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-66208152-4491-43dc-865e-8beef8e94202 req-ec38138e-7db8-4222-8691-4f1ccde0707a service nova] Creating event network-changed:fc85af9d-8ed8-4328-9088-8c61c61d17c1 for instance d28f347d-fe10-4885-bbf4-1d8591ca6340 on n-h2-858384-17 Oct 31 15:17:18.921725 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-66208152-4491-43dc-865e-8beef8e94202 req-ec38138e-7db8-4222-8691-4f1ccde0707a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120211 Oct 31 15:17:18.929316 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 183/340] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:17:18.940105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:18.940990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:18.949013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.949954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.950532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:18.952128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:18.952754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:18.955027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.032187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.042741 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2d45e46b-6e5b-4d62-aea4-f472a117606c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1308 microversion: 2.1 time: 0.562496 Oct 31 15:17:19.044111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 158/341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:18 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:19.072685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.087193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.088956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:19.097652 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2cf791e6-c479-4303-8928-62aede7b349b tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.166673 Oct 31 15:17:19.099286 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 184/342] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:18 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:19.756467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:19.757079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:19.763753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.764256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.764688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:19.766075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:19.766533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:19.767060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.071147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:20.071506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:20.077706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.078510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.079108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.079924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.080389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.080973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.254258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:20.271768 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e137bb8-dd65-430c-8a06-163365ce6485 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1320 microversion: 2.1 time: 0.518715 Oct 31 15:17:20.308097 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 159/343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:19 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1320 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:20.321040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:20.322067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:20.350426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.352143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.352958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.354510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:20.355703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:20.356980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:20.361372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:20.378875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:20.394299 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5af8c51a-09d2-4c35-8a32-39f212d12893 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1308 microversion: 2.1 time: 0.326954 Oct 31 15:17:20.395824 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 185/344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:20 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1308 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:20.678034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:20.692795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:20.695701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:20.705070 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8493e97d-dc5e-4b3b-ae12-de7634d3fb78 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.393172 Oct 31 15:17:20.707339 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 160/345] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:20 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:21.317190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:21.318483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:21.327438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:21.331520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.332423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.333750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.334714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.335360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.335984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.417590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:21.418822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:21.427183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.428616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.443213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.444970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.445677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.446441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.661547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:21.676578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:21.690396 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3641b2f-e1c6-434e-879a-61119a6c8110 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1320 microversion: 2.1 time: 0.376967 Oct 31 15:17:21.715049 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 186/346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:21 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1320 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:21.739420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:21.740264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:21.754947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.756780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.757967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.759417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:21.761068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:21.762150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:21.889322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:21.898357 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6511e00e-827c-4ee5-b0cb-55dfe5d2a2db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1308 microversion: 2.1 time: 0.484452 Oct 31 15:17:21.899460 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 161/347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:21 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:21.998025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.022489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.024020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.044840 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1497cac-d0c0-41f9-b080-ceb396dbcb4d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.305939 Oct 31 15:17:22.045760 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 187/348] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:21 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:17:22.451381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6d63b1c7-b484-4e84-affa-95a3179a4813 req-70c3dc67-83b7-4ead-bdbb-e10e1f886db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d822e8-8a06-4792-841b-39288b697b2f", "name": "network-vif-plugged", "status": "completed", "tag": "06a1a9ef-b9b6-413c-b32a-32fbebed8d04"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:22.464548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6d63b1c7-b484-4e84-affa-95a3179a4813 req-70c3dc67-83b7-4ead-bdbb-e10e1f886db5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.465861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6d63b1c7-b484-4e84-affa-95a3179a4813 req-70c3dc67-83b7-4ead-bdbb-e10e1f886db5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.466538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6d63b1c7-b484-4e84-affa-95a3179a4813 req-70c3dc67-83b7-4ead-bdbb-e10e1f886db5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.490455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6d63b1c7-b484-4e84-affa-95a3179a4813 req-70c3dc67-83b7-4ead-bdbb-e10e1f886db5 service nova] Creating event network-vif-plugged:06a1a9ef-b9b6-413c-b32a-32fbebed8d04 for instance c6d822e8-8a06-4792-841b-39288b697b2f on n-h2-858384-17 Oct 31 15:17:22.507857 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6d63b1c7-b484-4e84-affa-95a3179a4813 req-70c3dc67-83b7-4ead-bdbb-e10e1f886db5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058024 Oct 31 15:17:22.511023 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 162/349] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:22.722482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:22.724076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:22.737615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.738115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.738549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.739391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.739929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.740355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.904134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:22.914980 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b2932505-4134-46cc-9352-d1b5fa44224a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1320 microversion: 2.1 time: 0.199124 Oct 31 15:17:22.923727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:22.924387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:22.926245 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 188/350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:22 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1320 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:22.932567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.933688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.934754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.935470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:22.935924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:22.936520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:22.955862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=20 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:23.074975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:23.075582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:23.082380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.083410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.084012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.084951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.085655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.086576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.088804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.100104 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f737d400-c267-4eeb-a164-011c190bc120 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1308 microversion: 2.1 time: 0.180638 Oct 31 15:17:23.101465 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 163/351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:22 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:23.178947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.195952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.198013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:23.207034 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fcb0984d-81e1-4382-8c2a-866c9205ea05 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.135951 Oct 31 15:17:23.208394 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 189/352] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:23 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:17:23.941372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:23.943112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:23.950450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.950968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.951394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:23.952320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:23.953871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:23.954816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.126510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:24.127787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:24.140636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.141421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.142341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.143823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.146591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.147235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.184453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:24.194662 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f5f33fd-e969-424c-8e9a-dd4eb40a6e1d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1470 microversion: 2.1 time: 0.258833 Oct 31 15:17:24.201851 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 164/353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:23 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:24.431317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:24.442747 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bbe58d63-f751-4624-896b-a06fe192436c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1308 microversion: 2.1 time: 0.320160 Oct 31 15:17:24.444449 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 190/354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:24 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:24.453292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:24.453955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:24.484720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.486315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.488021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.490265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.492389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.494069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.617548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:24.644379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:24.650055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:24.662583 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46b88e7a-2571-429a-a3d4-a11f3743387d tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.215309 Oct 31 15:17:24.663183 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 191/355] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:24 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:24.753064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:24.753598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:24.764094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.764595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.765727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.766495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:24.766950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:24.771347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:24.938355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:17:25.166170 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f245c924-7122-4330-b51f-aa3410a4ba25 tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 204 len: 0 microversion: 2.1 time: 0.941873 Oct 31 15:17:25.169047 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 165/356] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:24 2022] DELETE /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 0 bytes in 946 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:17:25.181006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:25.181877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:25.192040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.192535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.192967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.193704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.197561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.198029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.469851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:25.470549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:25.484789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.485445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.485888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.486604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.487063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.487488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.612405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.630376 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dfbf0153-8f66-4e12-b91a-3370ad6f100e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1476 microversion: 2.1 time: 0.456118 Oct 31 15:17:25.645199 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 192/357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:25 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1476 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:25.699247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:25.700102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:25.706262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.716244 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-12d85f1b-15dc-4fd5-9548-8b0ae2968496 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1308 microversion: 2.1 time: 0.251226 Oct 31 15:17:25.716844 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 166/358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:25 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:25.717059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.717688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.718179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.718911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:25.719379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:25.719964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:25.853470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.871344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.873407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:25.885442 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-42a1c791-49ba-429c-a459-d13e5aedf7fd tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.189678 Oct 31 15:17:25.886556 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 193/359] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:25 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:25.967537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dac9d4d5-64e7-4cd5-8825-45de52f93909 tempest-QuotaClassesAdminTestJSON-1904998362 tempest-QuotaClassesAdminTestJSON-1904998362-project-admin] Calling method '.version_select at 0x7f16e1be90d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:25.986649 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dac9d4d5-64e7-4cd5-8825-45de52f93909 tempest-QuotaClassesAdminTestJSON-1904998362 tempest-QuotaClassesAdminTestJSON-1904998362-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.243373 Oct 31 15:17:25.987555 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 167/360] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 31 15:17:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:26.001044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-616cf7e0-6d4a-422a-9d6f-ac137986548c tempest-QuotaClassesAdminTestJSON-1904998362 tempest-QuotaClassesAdminTestJSON-1904998362-project-admin] Action: 'update', calling method: .version_select at 0x7f16e1c5a5e0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:26.022747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-667713240", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:26.104972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:26.250519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:26.452008 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-616cf7e0-6d4a-422a-9d6f-ac137986548c tempest-QuotaClassesAdminTestJSON-1904998362 tempest-QuotaClassesAdminTestJSON-1904998362-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.456519 Oct 31 15:17:26.454582 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 168/361] 10.222.0.20 () {60 vars in 1206 bytes} [Mon Oct 31 15:17:25 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:26.460974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4027c1b9-42a1-403a-9b4c-80e82d60c1ed req-f334d51d-20a6-401f-a9ec-355afcf570ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28f347d-fe10-4885-bbf4-1d8591ca6340", "name": "network-vif-plugged", "status": "completed", "tag": "fc85af9d-8ed8-4328-9088-8c61c61d17c1"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:26.475290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4027c1b9-42a1-403a-9b4c-80e82d60c1ed req-f334d51d-20a6-401f-a9ec-355afcf570ae service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.476640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4027c1b9-42a1-403a-9b4c-80e82d60c1ed req-f334d51d-20a6-401f-a9ec-355afcf570ae service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.477071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4027c1b9-42a1-403a-9b4c-80e82d60c1ed req-f334d51d-20a6-401f-a9ec-355afcf570ae service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.495677 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4027c1b9-42a1-403a-9b4c-80e82d60c1ed req-f334d51d-20a6-401f-a9ec-355afcf570ae service nova] Creating event network-vif-plugged:fc85af9d-8ed8-4328-9088-8c61c61d17c1 for instance d28f347d-fe10-4885-bbf4-1d8591ca6340 on n-h2-858384-17 Oct 31 15:17:26.502188 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4027c1b9-42a1-403a-9b4c-80e82d60c1ed req-f334d51d-20a6-401f-a9ec-355afcf570ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045797 Oct 31 15:17:26.503140 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 169/362] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:26.510330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd0189ac-16a5-4970-bf80-aced54ff4e4a tempest-QuotaClassesAdminTestJSON-1904998362 tempest-QuotaClassesAdminTestJSON-1904998362-project-admin] Calling method '.version_select at 0x7f16e1c91c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:26.540769 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd0189ac-16a5-4970-bf80-aced54ff4e4a tempest-QuotaClassesAdminTestJSON-1904998362 tempest-QuotaClassesAdminTestJSON-1904998362-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.036004 Oct 31 15:17:26.549518 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 170/363] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 31 15:17:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:26.567957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0b09dfe-397b-4dee-be12-3c9314990d8b tempest-QuotaClassesAdminTestJSON-1904998362 tempest-QuotaClassesAdminTestJSON-1904998362-project-admin] Action: 'update', calling method: .version_select at 0x7f16e1aa1ca0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:26.743057 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0b09dfe-397b-4dee-be12-3c9314990d8b tempest-QuotaClassesAdminTestJSON-1904998362 tempest-QuotaClassesAdminTestJSON-1904998362-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.190721 Oct 31 15:17:26.743967 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 171/364] 10.222.0.20 () {60 vars in 1206 bytes} [Mon Oct 31 15:17:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:17:26.751369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:26.752186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:26.767842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.768347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.768910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.769735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.770412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.770894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.967553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:26.969465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:26.970391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:26.971312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:26.973471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:26.991178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.992248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.992942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:26.995409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:26.996122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:26.997415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.017724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:27.028404 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a11977ff-33b0-478c-8f48-01e9420eaf69 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1476 microversion: 2.1 time: 0.282878 Oct 31 15:17:27.028994 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 172/365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:26 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1476 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:27.039469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:27.040614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:27.057462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.058301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.058932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.059868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.060519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.061158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.082245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:27.115136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:27.154242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:27.162928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:27.270792 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c1579ce-f3d4-494c-ae31-b2f65fb12bf2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382445 Oct 31 15:17:27.271990 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 194/366] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:27.284857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:27.287083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:27.302237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.306200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.307229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.308839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.312361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.313177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.448709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:27.461167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:27.462715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:27.484975 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a964f77d-60c3-40fc-98b6-3f89934df5ce tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.211653 Oct 31 15:17:27.491093 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 195/367] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:27 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:27.504243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24f3a787-4bdd-4683-95ee-5c1216d2cc92 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:27.504864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24f3a787-4bdd-4683-95ee-5c1216d2cc92 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:27.636560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-24f3a787-4bdd-4683-95ee-5c1216d2cc92 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:27.665892 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24f3a787-4bdd-4683-95ee-5c1216d2cc92 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1216 microversion: 2.1 time: 0.167612 Oct 31 15:17:27.687500 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 196/368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:27 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1216 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:27.854691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:27.866602 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dfcb43ac-1d20-4c3c-a5ee-99710fa0eff0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1308 microversion: 2.1 time: 0.834651 Oct 31 15:17:27.870220 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 173/369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:27 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1308 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:27.937272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-136adb19-f872-4fad-8a37-7e9633e47ace req-df8892c8-373a-447c-b004-97f7f4628066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d822e8-8a06-4792-841b-39288b697b2f", "name": "network-vif-deleted", "tag": "06a1a9ef-b9b6-413c-b32a-32fbebed8d04"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:27.953314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-136adb19-f872-4fad-8a37-7e9633e47ace req-df8892c8-373a-447c-b004-97f7f4628066 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:27.957714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-136adb19-f872-4fad-8a37-7e9633e47ace req-df8892c8-373a-447c-b004-97f7f4628066 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:27.959138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-136adb19-f872-4fad-8a37-7e9633e47ace req-df8892c8-373a-447c-b004-97f7f4628066 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:27.977835 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-136adb19-f872-4fad-8a37-7e9633e47ace req-df8892c8-373a-447c-b004-97f7f4628066 service nova] Creating event network-vif-deleted:06a1a9ef-b9b6-413c-b32a-32fbebed8d04 for instance c6d822e8-8a06-4792-841b-39288b697b2f on n-h2-858384-17 Oct 31 15:17:27.995631 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-136adb19-f872-4fad-8a37-7e9633e47ace req-df8892c8-373a-447c-b004-97f7f4628066 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062339 Oct 31 15:17:28.006058 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 197/370] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:28.053826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:28.057295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:28.067191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.068172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.070897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.071347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.072947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.074331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.208663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:28.217686 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d0c75ba-9a3c-4caf-9af7-6ad539f3fc2e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 200 len: 1434 microversion: 2.1 time: 0.168257 Oct 31 15:17:28.229251 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 174/371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:28 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 1434 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:28.433335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d7bc7f3-3fc9-413a-8600-b474f98a156d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Action: 'update', calling method: .version_select at 0x7f16e1d32790>, body: {"quota_set": {"ram": "5120"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:28.511978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7bc7f3-3fc9-413a-8600-b474f98a156d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.513831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7bc7f3-3fc9-413a-8600-b474f98a156d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.518438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7bc7f3-3fc9-413a-8600-b474f98a156d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.519545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7bc7f3-3fc9-413a-8600-b474f98a156d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.520206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7bc7f3-3fc9-413a-8600-b474f98a156d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.520702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7bc7f3-3fc9-413a-8600-b474f98a156d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.523009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:28.523617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:28.537144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.537946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.538667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.539654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.540323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.540935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.638742 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d7bc7f3-3fc9-413a-8600-b474f98a156d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/c5ddadae8ba64524b2d5826138940a6c" status: 200 len: 148 microversion: 2.57 time: 0.493794 Oct 31 15:17:28.641388 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 198/372] 10.222.0.20 () {62 vars in 1303 bytes} [Mon Oct 31 15:17:28 2022] PUT /compute/v2.1/os-quota-sets/c5ddadae8ba64524b2d5826138940a6c => generated 148 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:17:28.662440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-646ea064-4833-40da-b906-cba8e8286f2d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Calling method '.version_select at 0x7f16e1e66d30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:28.688343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:28.700805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:28.705888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:28.723332 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25d8e104-990b-41c0-b391-ccfabb017d19 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.202588 Oct 31 15:17:28.726901 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 175/373] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:28 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:28.744015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:28.745192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:28.753531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.754056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.754496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.755195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.755644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.756062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.756262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646ea064-4833-40da-b906-cba8e8286f2d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.756763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646ea064-4833-40da-b906-cba8e8286f2d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.761424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646ea064-4833-40da-b906-cba8e8286f2d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.761424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646ea064-4833-40da-b906-cba8e8286f2d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.761654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646ea064-4833-40da-b906-cba8e8286f2d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.762092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646ea064-4833-40da-b906-cba8e8286f2d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.809052 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-646ea064-4833-40da-b906-cba8e8286f2d tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/c5ddadae8ba64524b2d5826138940a6c/detail" status: 200 len: 463 microversion: 2.57 time: 0.154721 Oct 31 15:17:28.813194 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 199/374] 10.222.0.20 () {60 vars in 1304 bytes} [Mon Oct 31 15:17:28 2022] GET /compute/v2.1/os-quota-sets/c5ddadae8ba64524b2d5826138940a6c/detail => generated 463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:17:28.897753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:28.898547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:28.912492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:28.920721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.921304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.921755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.923355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:28.923829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:28.925053 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d2ec0fa-c646-4ae5-af40-ede2d7af3372 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1220 microversion: 2.1 time: 0.197027 Oct 31 15:17:28.925619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:28.928514 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 176/375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:28 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1220 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:29.122119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Action: 'update', calling method: .version_select at 0x7f16e1be9e50>, body: {"quota_set": {"ram": "2048"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:29.337770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:29.352239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49e99558-cba4-4fbb-bb3f-25edef9cc972 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1488 microversion: 2.1 time: 0.459301 Oct 31 15:17:29.352890 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 200/376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:28 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1488 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:29.368712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.368712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:29.382053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.384615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.385223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.387399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.390609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.391091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.426337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.430465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.430958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.431744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.432215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.432633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.436029 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] HTTP exception thrown: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Request method failure captured: Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f HTTP/1.1 Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bwe0o6ogVFeBZi2ClxyBeMuI7C8_JcG2cqFFLhTHYU7NX4ADDtSl_MMY0jXv_JS9GC-u1zUvpUH8zLZC0wIa91ZidtT-3NhTmfBWx3D6g9-Zpceh2HU4cJYmYWNXQWvUnkJa39oBrBsEWFGCT7cDsx9FsvObY79FbiaTWkBkio7v4 Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:17:29.441708 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2f519c3aab447979a24d6e1c99b478c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2f519c3aab447979a24d6e1c99b478c"}]}] Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 32e5168a75474617a359aaa6fde1055c Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:17:29.443043 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'c6d822e8-8a06-4792-841b-39288b697b2f'} Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:29.443744 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:17:29.444847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:17:29.445878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Returning 404 to user: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:29.446181 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89bac06a-3161-44b8-a1fa-d2350124a85b tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 404 len: 111 microversion: 2.1 time: 0.092348 Oct 31 15:17:29.463029 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 201/377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:29 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:17:29.474055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81806112-aeff-4db7-a2a6-6ddd87c37da8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:29.476462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-81806112-aeff-4db7-a2a6-6ddd87c37da8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:29.487187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81806112-aeff-4db7-a2a6-6ddd87c37da8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.491721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81806112-aeff-4db7-a2a6-6ddd87c37da8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.493285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81806112-aeff-4db7-a2a6-6ddd87c37da8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.495861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81806112-aeff-4db7-a2a6-6ddd87c37da8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.496525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81806112-aeff-4db7-a2a6-6ddd87c37da8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.499647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81806112-aeff-4db7-a2a6-6ddd87c37da8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.527921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.528340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.528751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.529494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:29.529944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:29.535128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:29.676943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:29.696250 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a0a30a4-6354-450d-a3ad-f07d365e1b07 tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/c5ddadae8ba64524b2d5826138940a6c?user_id=4c1e4bbf27194024ad1a0d4e6030d17c" status: 200 len: 148 microversion: 2.57 time: 0.578607 Oct 31 15:17:29.696715 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 177/378] 10.222.0.20 () {62 vars in 1384 bytes} [Mon Oct 31 15:17:29 2022] PUT /compute/v2.1/os-quota-sets/c5ddadae8ba64524b2d5826138940a6c?user_id=4c1e4bbf27194024ad1a0d4e6030d17c => generated 148 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:17:29.718584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ebb43832-5b15-412c-9697-c16b39d6d9ad tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] Calling method '.version_select at 0x7f16e1aa1430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:29.776885 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-81806112-aeff-4db7-a2a6-6ddd87c37da8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340/action" status: 202 len: 0 microversion: 2.1 time: 0.312282 Oct 31 15:17:29.791377 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 202/379] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:29 2022] POST /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:29.808443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1574920684", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:29.937994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:30.182830 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ebb43832-5b15-412c-9697-c16b39d6d9ad tempest-QuotasAdminTestV257-1803177672 tempest-QuotasAdminTestV257-1803177672-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/c5ddadae8ba64524b2d5826138940a6c?user_id=4c1e4bbf27194024ad1a0d4e6030d17c" status: 200 len: 190 microversion: 2.57 time: 0.478336 Oct 31 15:17:30.185032 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 178/380] 10.222.0.20 () {60 vars in 1364 bytes} [Mon Oct 31 15:17:29 2022] GET /compute/v2.1/os-quota-sets/c5ddadae8ba64524b2d5826138940a6c?user_id=4c1e4bbf27194024ad1a0d4e6030d17c => generated 190 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:17:30.192329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.193963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.196917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=76,nova_api:UPDATE=17 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:30.203875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.204951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.208834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.209882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.210575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.212151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.239274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:30.326644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:30.338517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:30.341849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:30.348935 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6286efc-eebe-48e7-b2fd-de2a3830b28c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.162398 Oct 31 15:17:30.350166 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 179/381] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:30.355978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.356653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.379766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.381550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.382489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.383706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.384474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.385872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.522247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:30.522827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:30.523561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:30.524730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:30.525373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:30.529442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=90,nova_api:SAVEPOINT=2,nova_api:INSERT=6,nova_api:RELEASE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:30.552070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.552486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.552916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.553719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.554521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.554662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.595367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Getting quotas for project d2f519c3aab447979a24d6e1c99b478c. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:30.603705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Getting quotas for user 32e5168a75474617a359aaa6fde1055c and project d2f519c3aab447979a24d6e1c99b478c. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:30.623394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:30.629231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:30.705232 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6456dc05-c3a8-44a6-9be0-b3cbfecce97e tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912419 Oct 31 15:17:30.707183 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 203/382] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:30.712222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.713568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.720208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.720619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.721046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.721853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.722667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.723103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.857787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:30.868335 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8754c0a-09d5-4c9b-a572-aeb61f032004 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1274 microversion: 2.1 time: 0.160818 Oct 31 15:17:30.873525 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 204/383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1274 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:30.900827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc41b6e8-538f-44d5-82ec-68385d3a6475 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:30.903636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc41b6e8-538f-44d5-82ec-68385d3a6475 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.907583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:30.918356 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-703cd439-46c6-4f32-8396-6a335abb1bed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 200 len: 1473 microversion: 2.1 time: 0.566377 Oct 31 15:17:30.932380 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 180/384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 1473 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:30.950228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9884895a-9c63-444a-bf7c-ef065ba3b8a0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1176472993"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:30.954950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9884895a-9c63-444a-bf7c-ef065ba3b8a0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:30.971915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9884895a-9c63-444a-bf7c-ef065ba3b8a0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.972657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9884895a-9c63-444a-bf7c-ef065ba3b8a0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.974761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9884895a-9c63-444a-bf7c-ef065ba3b8a0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:30.975479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9884895a-9c63-444a-bf7c-ef065ba3b8a0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:30.975935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9884895a-9c63-444a-bf7c-ef065ba3b8a0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:30.976356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9884895a-9c63-444a-bf7c-ef065ba3b8a0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.116647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc41b6e8-538f-44d5-82ec-68385d3a6475 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:31.123768 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc41b6e8-538f-44d5-82ec-68385d3a6475 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1220 microversion: 2.1 time: 0.236367 Oct 31 15:17:31.124394 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 205/385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:30 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1220 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:31.383153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.386041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.408690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.409616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.410591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.413584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.414652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.415867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.539439 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9884895a-9c63-444a-bf7c-ef065ba3b8a0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340/action" status: 202 len: 0 microversion: 2.1 time: 0.594727 Oct 31 15:17:31.551278 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 181/386] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:30 2022] POST /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:17:31.575399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f508c0b-8766-408e-be93-e4a5c54669b4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1a5e310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.667175 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f508c0b-8766-408e-be93-e4a5c54669b4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.111915 Oct 31 15:17:31.668118 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 182/387] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:31.669859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:31.693226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:31.705835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:31.713788 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bcd0557e-6e44-4bfd-9554-241f48b0b99e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.335435 Oct 31 15:17:31.714152 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 206/388] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:31.901580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.901860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.923368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.927863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.929047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.930993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.931476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.931906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.939264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:31.939876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:31.957732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.966166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.968557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:31.973189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:31.974530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:31.975184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.065880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:17:32.283055 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89f98365-cb4c-4d44-83ec-3d33e41d7ffc tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 204 len: 0 microversion: 2.1 time: 0.348325 Oct 31 15:17:32.284062 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 207/389] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:31 2022] DELETE /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:17:32.290198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:32.291428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:32.337778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.339247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.340231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.341202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.343774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.344437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.379342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:32.391378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8777f277-5aef-402b-9f82-6a0d6ebca38a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1316 microversion: 2.1 time: 0.493904 Oct 31 15:17:32.393681 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 183/390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:31 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:32.441408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1228011501", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "2033485829", "adminPass": "***", "networks": [{"uuid": "f566a996-f9c7-4755-bfaa-8969fed73a21"}], "security_groups": [{"name": "tempest-securitygroup--81762354"}], "key_name": "tempest-keypair-123702585", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:32.477782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:32.493506 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f923b445-3671-479e-8073-920f32ca5371 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1272 microversion: 2.1 time: 0.203296 Oct 31 15:17:32.494628 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 208/391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:32 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:32.692538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e15fefa-457c-47a9-a5eb-ac33124f50c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1e3c280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:32.693959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] validate_networks() for [('f566a996-f9c7-4755-bfaa-8969fed73a21', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:32.768575 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e15fefa-457c-47a9-a5eb-ac33124f50c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.088968 Oct 31 15:17:32.770319 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 209/392] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:32 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:32.775646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:32.779700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:32.787364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.788263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.789083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.789963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:32.790582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:32.791141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:32.879744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:32.893394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:32.895185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:32.902331 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0bcfc38-067e-42b7-a8ac-a0aa06c9e220 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.130821 Oct 31 15:17:32.907446 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 210/393] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:32 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:33.417503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:33.419573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:33.429072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.430073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.431856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.432957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.433942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.434732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.711328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:33.727685 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f1454263-91ac-47dd-9bd7-6369b6de48eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1316 microversion: 2.1 time: 0.315147 Oct 31 15:17:33.729599 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 211/394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:33 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:17:33.745511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:33.749620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:33.759938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.760423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.760933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.762680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.764335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.767661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.887602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:33.901371 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e52a6010-0357-42c5-9dc2-0cf4b034cdfb tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1272 microversion: 2.1 time: 0.170446 Oct 31 15:17:33.918181 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 212/395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:33 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:33.935208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1f9e19e7-99b9-40e7-b2b6-42a51e32667d req-96652483-e3dd-41ea-9600-9f84c6f073f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6d49c8-10cb-4bbd-a978-69db51f46d2b", "tag": "5237a460-78b7-40d3-82f0-828b6401c0e0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:33.961213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f9e19e7-99b9-40e7-b2b6-42a51e32667d req-96652483-e3dd-41ea-9600-9f84c6f073f1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:33.964149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f9e19e7-99b9-40e7-b2b6-42a51e32667d req-96652483-e3dd-41ea-9600-9f84c6f073f1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:33.964579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f9e19e7-99b9-40e7-b2b6-42a51e32667d req-96652483-e3dd-41ea-9600-9f84c6f073f1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:33.997493 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1f9e19e7-99b9-40e7-b2b6-42a51e32667d req-96652483-e3dd-41ea-9600-9f84c6f073f1 service nova] Creating event network-changed:5237a460-78b7-40d3-82f0-828b6401c0e0 for instance 6f6d49c8-10cb-4bbd-a978-69db51f46d2b on n-h1-858384-17 Oct 31 15:17:34.011449 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1f9e19e7-99b9-40e7-b2b6-42a51e32667d req-96652483-e3dd-41ea-9600-9f84c6f073f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088134 Oct 31 15:17:34.014043 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 213/396] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:34.026043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73a03060-9267-4aef-825e-ad2ca18fa1c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1c1a4c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:34.115477 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73a03060-9267-4aef-825e-ad2ca18fa1c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.098057 Oct 31 15:17:34.116464 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 214/397] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:34 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:34.128584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:34.129557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:34.145473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.146335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.149914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.155520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.159102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.160321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.359577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:34.415664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:34.419148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:34.436764 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d5b23bf-5150-4ca5-bd49-f92aacfc27f5 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.315534 Oct 31 15:17:34.439177 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 215/398] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:34 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:34.760321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:34.765250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:34.801899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.802579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.805591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.807177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.808944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.809837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.863554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:34.864097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:34.865167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:34.865616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:34.865996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:34.894992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.895510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.896024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.896799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:34.897333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:34.897945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:34.946925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Getting quotas for project 726e2d465c8d41eb904f9a561363b927. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:34.953853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Getting quotas for user fa8b2998637d46cea5484de42091b1ef and project 726e2d465c8d41eb904f9a561363b927. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:34.979904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:34.990307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:35.136111 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0c2f2a3a-aa4f-4d97-9fdc-c23351e8d533 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.701675 Oct 31 15:17:35.137090 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 184/399] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:17:35.147487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:35.148251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:35.163536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:35.164331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:35.164927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:35.165821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:35.166431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:35.179275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:35.466678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:35.478044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd049a71-1c1b-403c-b335-5214715fb96c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1316 microversion: 2.1 time: 0.726268 Oct 31 15:17:35.483907 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 216/400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:34 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1316 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:35.503420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:35.512927 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-396cf4d4-753c-42c6-8c64-06a8751ee93f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1278 microversion: 2.1 time: 0.374572 Oct 31 15:17:35.518029 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 185/401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:35 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1278 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:35.522772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61c97691-9be5-41e8-aa0f-a6d1dd9396f4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1a5e0d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:35.598902 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61c97691-9be5-41e8-aa0f-a6d1dd9396f4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.079601 Oct 31 15:17:35.601045 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 186/402] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:35 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:35.607499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50f9a1d8-2a97-426d-b2ce-e51658259da8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:35.610474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50f9a1d8-2a97-426d-b2ce-e51658259da8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:35.803852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-50f9a1d8-2a97-426d-b2ce-e51658259da8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:35.822074 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50f9a1d8-2a97-426d-b2ce-e51658259da8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1264 microversion: 2.1 time: 0.217672 Oct 31 15:17:35.832312 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 187/403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:35 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:35.904032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:35.908539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:35.930160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:35.931008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:35.931699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:35.932592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:35.933235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:35.934803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:36.029240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc363f78-1372-4193-9d46-a2cab5cee7d2 tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] Action: 'create', calling method: .version_select at 0x7f16e1d32550>, body: {"security_group": {"name": "tempest-securitygroup-2066294119", "description": "tempest-description-1750210349"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:36.121638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:36.135693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:36.137729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:36.152280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e64651a-b178-4eb7-8261-847ceba05fca tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.313848 Oct 31 15:17:36.152990 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 188/404] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:35 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:36.464485 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc363f78-1372-4193-9d46-a2cab5cee7d2 tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.979671 Oct 31 15:17:36.465326 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 217/405] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:17:35 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:36.488818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b980b94-7eee-4448-bd54-d655a0c5d68c tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] Action: 'create', calling method: .version_select at 0x7f16e1e3c040>, body: {"security_group": {"name": "tempest-securitygroup-1167362286", "description": "tempest-description-1666404066"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:36.638838 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e830df1-1a0e-43be-bdbf-90e12b902a58 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.227882 Oct 31 15:17:36.640052 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 189/406] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 31 15:17:36 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:17:36.652221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:36.653378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:36.677906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:36.679471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:36.680143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:36.682157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:36.682822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:36.683959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.207745 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b980b94-7eee-4448-bd54-d655a0c5d68c tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.732819 Oct 31 15:17:37.216995 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 218/407] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:17:36 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:37.216995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:37.216995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:37.231898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.232835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.234025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.236146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.236807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.237947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.653014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:37.673598 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f373e93e-e14a-4a40-9b1d-728a93ada0a5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1316 microversion: 2.1 time: 1.018836 Oct 31 15:17:37.674624 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 190/408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:36 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1316 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:37.693203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16f18f23-ffde-44da-90b7-722c5bfb0c17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1a00310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:37.793306 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16f18f23-ffde-44da-90b7-722c5bfb0c17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.117422 Oct 31 15:17:37.793843 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 191/409] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:37 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:37.805364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:37.813566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3aff0ba3-b977-4b13-bfec-f37e83d43fc8 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Calling method '.version_select at 0x7f16e1a5e310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:37.817893 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-883d022c-5100-42bb-a6f5-2d343700c67a tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1320 microversion: 2.1 time: 0.608476 Oct 31 15:17:37.818497 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 219/410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:37 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1320 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:37.850478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:37.851818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:37.874595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.875257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.875702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.876427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.885040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.886066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.918072 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-3aff0ba3-b977-4b13-bfec-f37e83d43fc8 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] HTTP exception thrown: Image not found. Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3aff0ba3-b977-4b13-bfec-f37e83d43fc8 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Request method failure captured: Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cQo8AYBlJkecrIo0aYBbDvcD1RwQDTyrP7Oh8GYRDo10Q2Gt4hg7qX0mt9uAf93f4Dx7LTtLMltDeybOY97LKBghbLmK6o-xZUm4EUyWiiPIyx5yIjHkpFN4f9c6ot2lrxactvkSaEMiiNzU1EaqU94Mxq3GqT_fkO_F6vNS8vsZA Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:17:37.920204 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8af80c03a3b249a3bb523d4e4b4496fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8af80c03a3b249a3bb523d4e4b4496fe"}]}] Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 99129dda5af341c2a35976dc7c146f97 Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '-1'} Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:37.922297 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.923318 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:37.924687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3aff0ba3-b977-4b13-bfec-f37e83d43fc8 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:37.926102 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3aff0ba3-b977-4b13-bfec-f37e83d43fc8 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.115756 Oct 31 15:17:37.932891 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 192/411] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 31 15:17:37 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:17:37.939142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:37.961578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:37.981430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.982204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.982656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:37.983418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:37.983877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:37.984311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.167693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:38.173375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:38.176446 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9436871c-d6ae-4876-aa54-b4317c7f29a5 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1316 microversion: 2.1 time: 0.335021 Oct 31 15:17:38.184901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:38.192944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:38.200040 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 220/412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:37 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1316 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:38.205405 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27b2dfa1-45ff-4e28-81bd-e4ca31e9e24c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.271263 Oct 31 15:17:38.213261 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 193/413] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:37 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:38.224844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d1e14b9d-8e03-4b66-8b74-bcdc6ad05a2d req-275c59d3-d712-4a56-94da-1cc1fbe8a52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28f347d-fe10-4885-bbf4-1d8591ca6340", "name": "network-vif-plugged", "status": "completed", "tag": "fc85af9d-8ed8-4328-9088-8c61c61d17c1"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:38.255103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d1e14b9d-8e03-4b66-8b74-bcdc6ad05a2d req-275c59d3-d712-4a56-94da-1cc1fbe8a52c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.256110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d1e14b9d-8e03-4b66-8b74-bcdc6ad05a2d req-275c59d3-d712-4a56-94da-1cc1fbe8a52c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.257662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d1e14b9d-8e03-4b66-8b74-bcdc6ad05a2d req-275c59d3-d712-4a56-94da-1cc1fbe8a52c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.278960 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d1e14b9d-8e03-4b66-8b74-bcdc6ad05a2d req-275c59d3-d712-4a56-94da-1cc1fbe8a52c service nova] Creating event network-vif-plugged:fc85af9d-8ed8-4328-9088-8c61c61d17c1 for instance d28f347d-fe10-4885-bbf4-1d8591ca6340 on n-h2-858384-17 Oct 31 15:17:38.297949 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d1e14b9d-8e03-4b66-8b74-bcdc6ad05a2d req-275c59d3-d712-4a56-94da-1cc1fbe8a52c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083100 Oct 31 15:17:38.299780 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 194/414] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:38.313977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc02ac00-779c-4f04-ab28-b484ae1140f2 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Calling method '.version_select at 0x7f16e1a2c550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.376757 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-fc02ac00-779c-4f04-ab28-b484ae1140f2 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] HTTP exception thrown: Image not found. Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc02ac00-779c-4f04-ab28-b484ae1140f2 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Request method failure captured: Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/images/c076f61c-1951-4d51-89f7-5cb3397d70bj HTTP/1.1 Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cQo8AYBlJkecrIo0aYBbDvcD1RwQDTyrP7Oh8GYRDo10Q2Gt4hg7qX0mt9uAf93f4Dx7LTtLMltDeybOY97LKBghbLmK6o-xZUm4EUyWiiPIyx5yIjHkpFN4f9c6ot2lrxactvkSaEMiiNzU1EaqU94Mxq3GqT_fkO_F6vNS8vsZA Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:17:38.379968 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8af80c03a3b249a3bb523d4e4b4496fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8af80c03a3b249a3bb523d4e4b4496fe"}]}] Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 99129dda5af341c2a35976dc7c146f97 Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'c076f61c-1951-4d51-89f7-5cb3397d70bj'} Oct 31 15:17:38.381833 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c076f61c-1951-4d51-89f7-5cb3397d70bj to delete Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.382756 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c076f61c-1951-4d51-89f7-5cb3397d70bj could not be found. Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:38.383918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:17:38.385141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.388336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc02ac00-779c-4f04-ab28-b484ae1140f2 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:38.390318 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc02ac00-779c-4f04-ab28-b484ae1140f2 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] 10.222.0.20 "DELETE /compute/v2.1/images/c076f61c-1951-4d51-89f7-5cb3397d70bj" status: 404 len: 62 microversion: 2.1 time: 0.087315 Oct 31 15:17:38.395408 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 195/415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:38 2022] DELETE /compute/v2.1/images/c076f61c-1951-4d51-89f7-5cb3397d70bj => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:17:38.412369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92b85681-7636-41e7-ab02-64ebcd696cd3 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Calling method '.version_select at 0x7f16e1a00430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.447523 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-92b85681-7636-41e7-ab02-64ebcd696cd3 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] HTTP exception thrown: Image not found. Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92b85681-7636-41e7-ab02-64ebcd696cd3 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Request method failure captured: Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/images/7eff4688-02ff-4add-9a70-f9d2d8c0392f1 HTTP/1.1 Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cQo8AYBlJkecrIo0aYBbDvcD1RwQDTyrP7Oh8GYRDo10Q2Gt4hg7qX0mt9uAf93f4Dx7LTtLMltDeybOY97LKBghbLmK6o-xZUm4EUyWiiPIyx5yIjHkpFN4f9c6ot2lrxactvkSaEMiiNzU1EaqU94Mxq3GqT_fkO_F6vNS8vsZA Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:17:38.450210 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8af80c03a3b249a3bb523d4e4b4496fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8af80c03a3b249a3bb523d4e4b4496fe"}]}] Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 99129dda5af341c2a35976dc7c146f97 Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '7eff4688-02ff-4add-9a70-f9d2d8c0392f1'} Oct 31 15:17:38.451724 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7eff4688-02ff-4add-9a70-f9d2d8c0392f1 to delete Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.452948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7eff4688-02ff-4add-9a70-f9d2d8c0392f1 could not be found. Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:38.454245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:17:38.455617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.457783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92b85681-7636-41e7-ab02-64ebcd696cd3 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:38.460017 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92b85681-7636-41e7-ab02-64ebcd696cd3 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] 10.222.0.20 "DELETE /compute/v2.1/images/7eff4688-02ff-4add-9a70-f9d2d8c0392f1" status: 404 len: 62 microversion: 2.1 time: 0.062770 Oct 31 15:17:38.465467 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 196/416] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:38 2022] DELETE /compute/v2.1/images/7eff4688-02ff-4add-9a70-f9d2d8c0392f1 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:17:38.472859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7c69be7-ef89-408a-a67f-bef9ef22bf01 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Calling method '.version_select at 0x7f16e1a2c3a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.504399 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c7c69be7-ef89-408a-a67f-bef9ef22bf01 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] HTTP exception thrown: Image not found. Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7c69be7-ef89-408a-a67f-bef9ef22bf01 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Request method failure captured: Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/images/tempest-invalid-2086614580 HTTP/1.1 Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cQo8AYBlJkecrIo0aYBbDvcD1RwQDTyrP7Oh8GYRDo10Q2Gt4hg7qX0mt9uAf93f4Dx7LTtLMltDeybOY97LKBghbLmK6o-xZUm4EUyWiiPIyx5yIjHkpFN4f9c6ot2lrxactvkSaEMiiNzU1EaqU94Mxq3GqT_fkO_F6vNS8vsZA Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:17:38.507573 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8af80c03a3b249a3bb523d4e4b4496fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8af80c03a3b249a3bb523d4e4b4496fe"}]}] Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 99129dda5af341c2a35976dc7c146f97 Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'tempest-invalid-2086614580'} Oct 31 15:17:38.509480 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2086614580 to delete Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.510530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2086614580 could not be found. Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:38.511932 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:17:38.513320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.516885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7c69be7-ef89-408a-a67f-bef9ef22bf01 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:38.518177 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7c69be7-ef89-408a-a67f-bef9ef22bf01 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-2086614580" status: 404 len: 62 microversion: 2.1 time: 0.051334 Oct 31 15:17:38.521553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7db113be-f54f-4671-ad13-275a92b3d773 tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] Action: 'create', calling method: .version_select at 0x7f16e1d13b80>, body: {"security_group": {"name": "tempest-securitygroup-139508802", "description": "tempest-description-906805209"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:38.523344 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 197/417] 10.222.0.20 () {58 vars in 1206 bytes} [Mon Oct 31 15:17:38 2022] DELETE /compute/v2.1/images/tempest-invalid-2086614580 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:17:38.529561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e2d5719-d827-4025-8345-331fc16d9401 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Calling method '.version_select at 0x7f16e1a00280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.561936 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9e2d5719-d827-4025-8345-331fc16d9401 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] HTTP exception thrown: Image not found. Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e2d5719-d827-4025-8345-331fc16d9401 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Request method failure captured: Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/images/48a96507-a0ae-4ef0-a689-48ff28fd43a8 HTTP/1.1 Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cQo8AYBlJkecrIo0aYBbDvcD1RwQDTyrP7Oh8GYRDo10Q2Gt4hg7qX0mt9uAf93f4Dx7LTtLMltDeybOY97LKBghbLmK6o-xZUm4EUyWiiPIyx5yIjHkpFN4f9c6ot2lrxactvkSaEMiiNzU1EaqU94Mxq3GqT_fkO_F6vNS8vsZA Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:17:38.565015 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8af80c03a3b249a3bb523d4e4b4496fe", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8af80c03a3b249a3bb523d4e4b4496fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8af80c03a3b249a3bb523d4e4b4496fe"}]}] Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 8af80c03a3b249a3bb523d4e4b4496fe Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-188677749 Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 99129dda5af341c2a35976dc7c146f97 Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-188677749-project Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '48a96507-a0ae-4ef0-a689-48ff28fd43a8'} Oct 31 15:17:38.566529 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 48a96507-a0ae-4ef0-a689-48ff28fd43a8 to delete Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.567495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48a96507-a0ae-4ef0-a689-48ff28fd43a8 could not be found. Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:17:38.568791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:17:38.570209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:17:38.573354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e2d5719-d827-4025-8345-331fc16d9401 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:17:38.574426 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9e2d5719-d827-4025-8345-331fc16d9401 tempest-ImagesDeleteNegativeTestJSON-188677749 tempest-ImagesDeleteNegativeTestJSON-188677749-project] 10.222.0.20 "DELETE /compute/v2.1/images/48a96507-a0ae-4ef0-a689-48ff28fd43a8" status: 404 len: 62 microversion: 2.1 time: 0.049746 Oct 31 15:17:38.575163 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 198/418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:38 2022] DELETE /compute/v2.1/images/48a96507-a0ae-4ef0-a689-48ff28fd43a8 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:17:38.708567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:38.709536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:38.726857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.727756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.728599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:38.729579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:38.730312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:38.730969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.693633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:39.711635 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab374222-7093-4d88-adb4-65f5e4be71cc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1316 microversion: 2.1 time: 1.011040 Oct 31 15:17:39.726333 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 199/419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:38 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1316 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:39.747876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67b52d25-2822-47ab-9c3f-dc34270e9ff4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1a2cc10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:39.749486 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7db113be-f54f-4671-ad13-275a92b3d773 tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.547677 Oct 31 15:17:39.750633 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 221/420] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:17:38 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:39.755485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:39.756296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:39.768948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.770783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.773743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.774722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.775347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.775943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.852401 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67b52d25-2822-47ab-9c3f-dc34270e9ff4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.124819 Oct 31 15:17:39.853001 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 200/421] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:39 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:39.870027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:39.870668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:39.894985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.895486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.895925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:39.903109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:39.904877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:39.905236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:40.305798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:40.322424 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4748d039-757f-4a48-b080-fdd88dc6386b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1322 microversion: 2.1 time: 0.467279 Oct 31 15:17:40.323038 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 201/422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:39 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:40.340973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:40.350894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:40.362842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:40.363382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:40.363856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:40.364612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:40.377575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:40.378178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:40.538502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:40.547027 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5e4a3444-99b4-4f5e-9007-4be808cf6ae9 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1320 microversion: 2.1 time: 0.795208 Oct 31 15:17:40.591562 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 222/423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:39 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1320 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:40.596773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25b022bc-4e28-4429-967f-f6b35a37682e tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] Action: 'create', calling method: .version_select at 0x7f16e1d83790>, body: {"security_group": {"name": "tempest-securitygroup-1678286431", "description": "tempest-description-661260000"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:40.602885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:41.032495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:41.042310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:41.047107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:41.069968 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7237fa88-24ef-401b-80ee-c10d614b331c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1447 microversion: 2.75 time: 0.740257 Oct 31 15:17:41.073320 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 202/424] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:40 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1447 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:41.084877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9bb7218e-249e-4186-b0c9-3ea20c59881b req-e00877f3-c136-42fd-afc0-3083b5679d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "155e282c-3e39-48f4-a2b7-82b89e05727c", "tag": "6621ada2-18e9-4859-9e72-d4bf20aec6a9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:41.124102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=26 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:41.135360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9bb7218e-249e-4186-b0c9-3ea20c59881b req-e00877f3-c136-42fd-afc0-3083b5679d64 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.138012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9bb7218e-249e-4186-b0c9-3ea20c59881b req-e00877f3-c136-42fd-afc0-3083b5679d64 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.138661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9bb7218e-249e-4186-b0c9-3ea20c59881b req-e00877f3-c136-42fd-afc0-3083b5679d64 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.197458 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9bb7218e-249e-4186-b0c9-3ea20c59881b req-e00877f3-c136-42fd-afc0-3083b5679d64 service nova] Creating event network-changed:6621ada2-18e9-4859-9e72-d4bf20aec6a9 for instance 155e282c-3e39-48f4-a2b7-82b89e05727c on n-h2-858384-17 Oct 31 15:17:41.213008 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9bb7218e-249e-4186-b0c9-3ea20c59881b req-e00877f3-c136-42fd-afc0-3083b5679d64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138190 Oct 31 15:17:41.218095 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 203/425] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:41.241025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:41.243223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:41.271580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.277303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.277874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.280665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.284202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.285929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.675783 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25b022bc-4e28-4429-967f-f6b35a37682e tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.082951 Oct 31 15:17:41.676917 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 223/426] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:17:40 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:41.682121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-68c6f4c6-fa59-42b6-a6c0-b1c5f91a1500 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1e3cee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:41.785197 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-68c6f4c6-fa59-42b6-a6c0-b1c5f91a1500 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.106682 Oct 31 15:17:41.795482 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 224/427] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:41 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:41.801970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:41.802579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:41.840728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.841275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.841686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.843310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:41.843924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:41.844353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:41.998711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:42.022333 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4cedb57-d6ba-4777-9065-b3dc50a6ddde tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1322 microversion: 2.1 time: 0.224082 Oct 31 15:17:42.025488 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 225/428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:41 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:42.036098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:42.065545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:42.082244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:42.090411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:42.091729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:42.102197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:42.102933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:42.103676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:42.478177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:42.481009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:42.495792 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11a047f3-89be-42e9-9666-51dd3b1667a5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1320 microversion: 2.1 time: 0.462000 Oct 31 15:17:42.496980 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 226/429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:42 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1320 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:42.514967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0c3f384-7b34-451d-a78c-78f2ba59af1f tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] Calling method '.version_select at 0x7f16e1cb6940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:43.199903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:43.213750 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da044e10-18b9-43fa-aeec-2ecaa908947b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1316 microversion: 2.1 time: 1.993796 Oct 31 15:17:43.222384 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 204/430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:41 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1316 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:43.228966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:43.232484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:43.248763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.258421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.259452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.262292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.265156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.266057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.755344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:43.768247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:43.775433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:43.782845 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6020f84-fb81-4120-82d2-b04803f559b2 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1453 microversion: 2.75 time: 0.556944 Oct 31 15:17:43.797689 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 205/431] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:43 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1453 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:43.810900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-55d456a7-edbc-444c-bee3-369a26eaaebe req-f8b51470-df22-47d3-8429-09ab5128b152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dacf152-1913-4810-84fa-113047bf0e73", "name": "network-vif-deleted", "tag": "562118eb-55c8-4072-bb71-2cf744930f3a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:43.836608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-55d456a7-edbc-444c-bee3-369a26eaaebe req-f8b51470-df22-47d3-8429-09ab5128b152 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:43.837430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-55d456a7-edbc-444c-bee3-369a26eaaebe req-f8b51470-df22-47d3-8429-09ab5128b152 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:43.838059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-55d456a7-edbc-444c-bee3-369a26eaaebe req-f8b51470-df22-47d3-8429-09ab5128b152 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:43.867362 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-55d456a7-edbc-444c-bee3-369a26eaaebe req-f8b51470-df22-47d3-8429-09ab5128b152 service nova] Creating event network-vif-deleted:562118eb-55c8-4072-bb71-2cf744930f3a for instance 4dacf152-1913-4810-84fa-113047bf0e73 on n-h2-858384-17 Oct 31 15:17:43.895372 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-55d456a7-edbc-444c-bee3-369a26eaaebe req-f8b51470-df22-47d3-8429-09ab5128b152 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096329 Oct 31 15:17:43.902185 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 206/432] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:43.931496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9482892b-f197-415e-bd9b-f4c5a3f89a0f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1a00af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:44.052673 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9482892b-f197-415e-bd9b-f4c5a3f89a0f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.148830 Oct 31 15:17:44.054317 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 207/433] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:43 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:44.064173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:44.067939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:44.081986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.088120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.088908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.090073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.090757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.091427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.486009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:44.497641 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c7897ec-d83e-433d-9ba7-51ec18cebb41 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1322 microversion: 2.1 time: 0.441860 Oct 31 15:17:44.507435 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 208/434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:44 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:44.512689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-65de2539-4fd8-4d13-a74e-8f718c706688 req-376b492f-232b-409e-bf49-4a13b94a3d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6d49c8-10cb-4bbd-a978-69db51f46d2b", "name": "network-vif-plugged", "status": "completed", "tag": "5237a460-78b7-40d3-82f0-828b6401c0e0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:44.556305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-65de2539-4fd8-4d13-a74e-8f718c706688 req-376b492f-232b-409e-bf49-4a13b94a3d23 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.557320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-65de2539-4fd8-4d13-a74e-8f718c706688 req-376b492f-232b-409e-bf49-4a13b94a3d23 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.558009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-65de2539-4fd8-4d13-a74e-8f718c706688 req-376b492f-232b-409e-bf49-4a13b94a3d23 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.575451 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-65de2539-4fd8-4d13-a74e-8f718c706688 req-376b492f-232b-409e-bf49-4a13b94a3d23 service nova] Creating event network-vif-plugged:5237a460-78b7-40d3-82f0-828b6401c0e0 for instance 6f6d49c8-10cb-4bbd-a978-69db51f46d2b on n-h1-858384-17 Oct 31 15:17:44.590943 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-65de2539-4fd8-4d13-a74e-8f718c706688 req-376b492f-232b-409e-bf49-4a13b94a3d23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081660 Oct 31 15:17:44.592431 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 209/435] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:44.609419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:44.610490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:44.629919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.630676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.631324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.632423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:44.633736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:44.634384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:44.639482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:44.917766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:45.494925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:45.512428 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71f0ea98-1a48-4673-9b97-f3824755ae86 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1320 microversion: 2.1 time: 0.916233 Oct 31 15:17:45.515006 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 210/436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:44 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1320 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:45.544652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:45.548268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:45.585465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:45.587586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:45.588354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:45.591582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:45.593168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:45.595553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:45.809771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=68,nova_cell0:UPDATE=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:46.318958 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0c3f384-7b34-451d-a78c-78f2ba59af1f tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9681 microversion: 2.1 time: 3.817988 Oct 31 15:17:46.320325 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 227/437] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Oct 31 15:17:42 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9681 bytes in 3822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:46.325546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:46.326882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:46.362593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.363483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.364129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.365051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.365707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.368615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.550018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:46.583305 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-195b49cc-feba-4189-b448-26ba0fcc15dc tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1316 microversion: 2.1 time: 1.064928 Oct 31 15:17:46.584706 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 211/438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:45 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1316 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:46.594829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0a1e5c3-3958-4ac7-b14c-d5bf3bb8ee73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1a2c8b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:46.687189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:46.728089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:46.729645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b0a1e5c3-3958-4ac7-b14c-d5bf3bb8ee73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.143154 Oct 31 15:17:46.735325 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 212/439] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:46 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:46.740116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:46.754224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:46.757067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:46.766811 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cf4ab0c1-b301-4cee-85d3-c964a2576b17 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1438 microversion: 2.75 time: 0.444842 Oct 31 15:17:46.770408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 228/440] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:46 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1438 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:46.783393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acc936f9-0c01-405d-a886-b0f20ab8dccb tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] Calling method '.version_select at 0x7f16e1e3cd30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:46.784582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.788050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.788864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:46.794444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:46.796859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:46.799820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.723417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:47.736079 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2edcb99-b7b3-4a91-9b51-4449319886de tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1388 microversion: 2.1 time: 0.994846 Oct 31 15:17:47.736721 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 213/441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:46 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1388 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:47.752712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:47.755013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:47.768766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:47.769437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:47.770018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.770826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:47.771383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:47.771903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:47.909657 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-acc936f9-0c01-405d-a886-b0f20ab8dccb tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1113 microversion: 2.1 time: 1.132113 Oct 31 15:17:47.913209 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 229/442] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Oct 31 15:17:46 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1113 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:48.462304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:48.470966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:48.514591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.517800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.522801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.528091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.532010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.533736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.714877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:48.724597 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1fec76b7-7495-43a9-976d-132043dbc514 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1320 microversion: 2.1 time: 0.986760 Oct 31 15:17:48.728234 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 214/443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:47 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1320 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:48.749962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4f35f422-a0b1-4030-b904-a1b34c9196b5 req-16a9221b-7e24-41b8-b795-0b28133c535d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155e282c-3e39-48f4-a2b7-82b89e05727c", "name": "network-vif-plugged", "status": "completed", "tag": "6621ada2-18e9-4859-9e72-d4bf20aec6a9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:48.750835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:48.751722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:48.753472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:48.754165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:48.754803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:48.775778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4f35f422-a0b1-4030-b904-a1b34c9196b5 req-16a9221b-7e24-41b8-b795-0b28133c535d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.776273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4f35f422-a0b1-4030-b904-a1b34c9196b5 req-16a9221b-7e24-41b8-b795-0b28133c535d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.778976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4f35f422-a0b1-4030-b904-a1b34c9196b5 req-16a9221b-7e24-41b8-b795-0b28133c535d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.816183 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4f35f422-a0b1-4030-b904-a1b34c9196b5 req-16a9221b-7e24-41b8-b795-0b28133c535d service nova] Creating event network-vif-plugged:6621ada2-18e9-4859-9e72-d4bf20aec6a9 for instance 155e282c-3e39-48f4-a2b7-82b89e05727c on n-h2-858384-17 Oct 31 15:17:48.830695 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4f35f422-a0b1-4030-b904-a1b34c9196b5 req-16a9221b-7e24-41b8-b795-0b28133c535d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100846 Oct 31 15:17:48.833206 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 215/444] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:48.849333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:48.867185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:48.876391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.876897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.877405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.878517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.878846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.879971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.972533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:48.986936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.987702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.988265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:48.989100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:48.989770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:48.990967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.339057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:49.549225 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a4f2f2b-2de3-47c6-83f1-0ed6094afc3c tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f/action" status: 202 len: 1944 microversion: 2.75 time: 1.623358 Oct 31 15:17:49.549746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:49.561162 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 230/445] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:17:47 2022] POST /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f/action => generated 1944 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 15:17:49.561162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-281a864e-87e0-46ed-a937-076c0596bc82 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1cb6940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:49.590624 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b585de09-4725-486c-94e2-7878215235ff tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1466 microversion: 2.1 time: 0.755034 Oct 31 15:17:49.611491 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 216/446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:48 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1466 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:49.616279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b4d4628-6ebd-4fd3-9e0a-12190f309626 tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] Calling method '.version_select at 0x7f16e1a00160>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:49.637983 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-281a864e-87e0-46ed-a937-076c0596bc82 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.086699 Oct 31 15:17:49.645187 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 231/447] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:49 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:49.648205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:49.648897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:49.656151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.656971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.657267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:49.658042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:49.658851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:49.659755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.218091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:50.238671 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ac6a6cf-52b2-4a44-9687-82d2cd7066f8 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1388 microversion: 2.1 time: 0.592580 Oct 31 15:17:50.239735 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 232/448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:49 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1388 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:50.250627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:50.250627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:50.273904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.274394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.279140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.281062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.284939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.285440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.293586 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b4d4628-6ebd-4fd3-9e0a-12190f309626 tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/891b729b-cf48-4b38-b8ce-773131a4be90" status: 202 len: 0 microversion: 2.1 time: 0.680638 Oct 31 15:17:50.295250 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 217/449] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:17:49 2022] DELETE /compute/v2.1/os-security-groups/891b729b-cf48-4b38-b8ce-773131a4be90 => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:50.530369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:50.590385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2dcf152-ce4b-4d5c-b65b-c02a678154c8 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:50.593520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2dcf152-ce4b-4d5c-b65b-c02a678154c8 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:50.650025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2dcf152-ce4b-4d5c-b65b-c02a678154c8 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.654249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2dcf152-ce4b-4d5c-b65b-c02a678154c8 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.658467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2dcf152-ce4b-4d5c-b65b-c02a678154c8 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.663023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2dcf152-ce4b-4d5c-b65b-c02a678154c8 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.673899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2dcf152-ce4b-4d5c-b65b-c02a678154c8 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.673899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2dcf152-ce4b-4d5c-b65b-c02a678154c8 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.677405 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1761f819-d861-4525-aee4-3de2ab04a615 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1931 microversion: 2.75 time: 0.418667 Oct 31 15:17:50.679073 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 233/450] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:50 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1931 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:50.739481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:50.750107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:50.805912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.807348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.811553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:50.816666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:50.822823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:50.828581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:51.146809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:51.171316 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-56b76e30-acd8-4e22-bc4e-f5b30ac32e0d tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1320 microversion: 2.1 time: 0.462803 Oct 31 15:17:51.174443 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 234/451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:50 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1320 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:51.195688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a8594a8d-1e98-40db-a2bc-4f7dfacea79d req-c7a641ca-1e2f-4374-8bf9-09e16acaf93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6", "tag": "bc618eb3-b5b3-4e3c-b9ac-96906d79a8f0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:51.221055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a8594a8d-1e98-40db-a2bc-4f7dfacea79d req-c7a641ca-1e2f-4374-8bf9-09e16acaf93e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:51.222680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a8594a8d-1e98-40db-a2bc-4f7dfacea79d req-c7a641ca-1e2f-4374-8bf9-09e16acaf93e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:51.224380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a8594a8d-1e98-40db-a2bc-4f7dfacea79d req-c7a641ca-1e2f-4374-8bf9-09e16acaf93e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:51.257266 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a8594a8d-1e98-40db-a2bc-4f7dfacea79d req-c7a641ca-1e2f-4374-8bf9-09e16acaf93e service nova] Creating event network-changed:bc618eb3-b5b3-4e3c-b9ac-96906d79a8f0 for instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 on n-h1-858384-17 Oct 31 15:17:51.272877 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a8594a8d-1e98-40db-a2bc-4f7dfacea79d req-c7a641ca-1e2f-4374-8bf9-09e16acaf93e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096862 Oct 31 15:17:51.276694 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 235/452] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:51.290078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-901783ce-47d0-4c14-82be-c663e2cca54a tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] Calling method '.version_select at 0x7f16e1cb6940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:51.532788 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2dcf152-ce4b-4d5c-b65b-c02a678154c8 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1619 microversion: 2.1 time: 1.236033 Oct 31 15:17:51.533422 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 218/453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:50 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1619 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:51.565310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49214e30-8d7f-46d2-a139-c768eff088c8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1a5e550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:51.639801 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49214e30-8d7f-46d2-a139-c768eff088c8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.105021 Oct 31 15:17:51.648894 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 219/454] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:51 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:51.759717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1308664217", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "21925cce-417c-497a-868e-676a18905b25"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:51.885243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] validate_networks() for [('21925cce-417c-497a-868e-676a18905b25', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:52.244982 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-901783ce-47d0-4c14-82be-c663e2cca54a tempest-SecurityGroupsTestAdminJSON-351292194 tempest-SecurityGroupsTestAdminJSON-351292194-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/3b482e01-81c8-4115-a000-26563e212b6e" status: 202 len: 0 microversion: 2.1 time: 0.966773 Oct 31 15:17:52.245753 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 236/455] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:17:51 2022] DELETE /compute/v2.1/os-security-groups/3b482e01-81c8-4115-a000-26563e212b6e => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:52.252507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:52.254443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:52.276790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.277743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.280298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.281904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.285939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.286615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.535945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:52.539514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:52.540381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:52.541438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:52.542646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:52.556399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.557150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.557869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.558910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.559841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.561736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.589914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for project 330c65ee73534d8080c0ec2441c55f16. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:52.597893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for user 02e166a77a2c45ccab7a1f343e53542e and project 330c65ee73534d8080c0ec2441c55f16. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:52.618594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:52.621741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:52.640846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:52.653044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-39105b47-1146-4787-802b-9ce68a70d056 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1388 microversion: 2.1 time: 0.405872 Oct 31 15:17:52.671494 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 237/456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:52 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1388 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:52.687346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ad2a470-6be9-412f-9af8-619df083e447 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Action: 'create', calling method: .version_select at 0x7f16e1cd5940>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-327166790", "policies": ["affinity"]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:52.726358 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c732fce-0239-4959-9a3b-cb7d66318c99 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078513 Oct 31 15:17:52.735114 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 220/457] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:17:52.745479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:52.746430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:52.757523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.759386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.759992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.760868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:52.761519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:52.763033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:52.780814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5ad2a470-6be9-412f-9af8-619df083e447 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:52.804180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5ad2a470-6be9-412f-9af8-619df083e447 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:52.892619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:52.925632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5ad2a470-6be9-412f-9af8-619df083e447 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:52.936658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5ad2a470-6be9-412f-9af8-619df083e447 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:52.975300 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5ad2a470-6be9-412f-9af8-619df083e447 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.299893 Oct 31 15:17:52.988203 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 238/458] 10.222.0.20 () {60 vars in 1174 bytes} [Mon Oct 31 15:17:52 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:17:52.988203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:52.988203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:53.004518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:53.005008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:53.005494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.006202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:53.006657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:53.007086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:53.386997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:53.597426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:53.601443 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8abb4eeb-5507-4771-8908-99258fa2bab5 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1931 microversion: 2.75 time: 0.864800 Oct 31 15:17:53.619799 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 221/459] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:52 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1931 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:53.643170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d9d2d2b-3e88-4ab6-971b-207370f5293f tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] Calling method '.version_select at 0x7f16e1c91430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.111012 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d9d2d2b-3e88-4ab6-971b-207370f5293f tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f94d1240-1958-46f9-916a-e0e0717fa001" status: 202 len: 0 microversion: 2.1 time: 0.489641 Oct 31 15:17:54.112320 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 222/460] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:17:53 2022] DELETE /compute/v2.1/os-security-groups/f94d1240-1958-46f9-916a-e0e0717fa001 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:54.117469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70aee92d-50e9-45a7-80af-fd5f77a0c3e4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1a005e0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.179836 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70aee92d-50e9-45a7-80af-fd5f77a0c3e4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.066132 Oct 31 15:17:54.188552 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 223/461] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:54 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:54.188552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.188552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:54.219896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.221805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.225454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.226326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.226873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.228009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.308800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:54.322211 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00cd4043-f359-4435-a2aa-468246c16770 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1207 microversion: 2.1 time: 0.140096 Oct 31 15:17:54.323285 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 224/462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:54 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1207 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:54.328780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1092170985", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "54d02968-5863-4b5c-bfec-7539ced58c00"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:54.403641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:54.417542 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f9ea8339-1827-4af9-b52f-a0715e1d65b1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1470 microversion: 2.1 time: 1.440290 Oct 31 15:17:54.426288 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 239/463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:52 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1470 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:54.449821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:54.450432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:54.460885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.472820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:17:54.498147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.498702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.499607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:54.509724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:54.510470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:54.928200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:17:54.932146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:17:54.933491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:17:54.938161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:17:54.939499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:17:55.068430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.069115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.069778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.070524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.070988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.071406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.107394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:55.113371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:55.133605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Going to run 2 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:17:55.135898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:55.192522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120588) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 31 15:17:55.202010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:55.244983 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87340cb8-aed3-472a-8ae2-0fce56ad7c5c tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1388 microversion: 2.1 time: 0.816573 Oct 31 15:17:55.248218 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 240/464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:54 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1388 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:55.269213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-43b7adff-9afb-4fa5-b5cb-866c54831ec9 tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] Calling method '.version_select at 0x7f16e1d13a60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:55.272026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:55.285972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:55.426231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:55.441121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:55.461684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=aa830667-cb8a-4f7c-a15a-5f191694da32,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:17:55.547871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:55.554470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:55.631261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:17:55.636985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:17:55.684264 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61609a40-97b0-44b2-859e-563e96ec0d46 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.359551 Oct 31 15:17:55.685831 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 225/465] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:17:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1362 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:17:55.695142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f75b3a89-c1de-4ae6-bba8-a9e8fc3077ae tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:17:55.697490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f75b3a89-c1de-4ae6-bba8-a9e8fc3077ae tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:55.705512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f75b3a89-c1de-4ae6-bba8-a9e8fc3077ae tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.706009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f75b3a89-c1de-4ae6-bba8-a9e8fc3077ae tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.706440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f75b3a89-c1de-4ae6-bba8-a9e8fc3077ae tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.707149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f75b3a89-c1de-4ae6-bba8-a9e8fc3077ae tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.707602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f75b3a89-c1de-4ae6-bba8-a9e8fc3077ae tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.708022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f75b3a89-c1de-4ae6-bba8-a9e8fc3077ae tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.842932 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f75b3a89-c1de-4ae6-bba8-a9e8fc3077ae tempest-DeleteServersAdminTestJSON-1476802942 tempest-DeleteServersAdminTestJSON-1476802942-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c/action" status: 202 len: 0 microversion: 2.1 time: 0.151970 Oct 31 15:17:55.850555 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 226/466] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:17:55 2022] POST /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:55.857329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:55.858330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:55.879411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.883593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.883593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:55.890775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:55.891682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:55.893629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.182532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:56.247191 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc1b4298-45fe-47fa-aa44-138a9269ab4a tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1931 microversion: 2.75 time: 0.393909 Oct 31 15:17:56.252531 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 227/467] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:55 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1931 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:56.267515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-62caed8c-112c-40ce-93ef-4830853966b5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e19c8d30>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.385515 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-62caed8c-112c-40ce-93ef-4830853966b5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.131257 Oct 31 15:17:56.385727 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 228/468] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:56.410705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.412146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:56.422956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.423815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.424554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.425675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.427579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.428535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.590897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:56.604783 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0b7280d-04fb-48a9-b54b-d725913e4f22 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1269 microversion: 2.1 time: 0.208108 Oct 31 15:17:56.632397 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 229/469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1269 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:56.655375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:56.681594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:56.682586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Searching by: {'deleted': False, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:17:56.752358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.755248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.755699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:56.756518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:56.756979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:56.757431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.124234 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-43b7adff-9afb-4fa5-b5cb-866c54831ec9 tempest-SecurityGroupsTestAdminJSON-168263126 tempest-SecurityGroupsTestAdminJSON-168263126-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/90f79bd1-6316-4ced-8fad-8cd9d4a752f1" status: 202 len: 0 microversion: 2.1 time: 1.874305 Oct 31 15:17:57.125165 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 241/470] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:17:55 2022] DELETE /compute/v2.1/os-security-groups/90f79bd1-6316-4ced-8fad-8cd9d4a752f1 => generated 0 bytes in 1876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:17:57.130292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:57.136795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:57.166670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.167626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.169631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.174056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.174972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.181214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.197050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:17:57.348512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.353343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.353923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.354392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lazy-loading 'fault' on Instance uuid 155e282c-3e39-48f4-a2b7-82b89e05727c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:57.590783 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25f5e2d1-444c-404e-aad0-1943687c79d9 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.957155 Oct 31 15:17:57.592262 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 230/471] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:17:56 2022] GET /compute/v2.1/servers => generated 1003 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:57.597814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:57.599566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:57.617561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.618396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.619221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:57.620994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:57.621608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:57.623033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.324508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:58.345026 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b23d6e9-106a-49ae-8b21-385e7e1e4ea5 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1453 microversion: 2.1 time: 1.218725 Oct 31 15:17:58.350626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 242/472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:57 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1453 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:58.373611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.374342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:58.401585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.402216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.405089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.409624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.410367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.410814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.605525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:58.677229 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed0ebcf9-a9d4-49f1-9d4e-b0b36000a385 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1931 microversion: 2.75 time: 0.321944 Oct 31 15:17:58.685641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:58.693317 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 243/473] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:58 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1931 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:17:58.708183 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cfa444f0-6267-4acc-94ee-e3b66ff463f9 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1388 microversion: 2.1 time: 1.114735 Oct 31 15:17:58.708780 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 231/474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:57 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1388 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:58.713591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.714373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:58.720125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-560178d2-7687-474b-b839-c2b27d3ca626 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1d135e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.738435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.741500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.741500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.741500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.741500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.741792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.745438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:17:58.835522 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-560178d2-7687-474b-b839-c2b27d3ca626 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.139208 Oct 31 15:17:58.839277 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 244/475] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:17:58 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:58.849799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.850681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:58.860900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.862793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.863816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.864816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.865593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.866288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.922553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:58.930596 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d67de40c-9841-4f7b-830f-60e630224996 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1215 microversion: 2.1 time: 0.220541 Oct 31 15:17:58.931192 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 232/476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:58 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1215 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:58.952002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:58.952540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:58.961742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:17:58.975199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.975724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.975967 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-264c2980-765b-4452-863a-5be2722e8f09 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1269 microversion: 2.1 time: 0.134288 Oct 31 15:17:58.976104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.977081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:58.977305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:58.977731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:58.980544 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 245/477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:58 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1269 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:17:59.127265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:17:59.395074 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f75094f-7f24-4fec-80dc-45f9d6590214 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "DELETE /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 204 len: 0 microversion: 2.1 time: 0.462558 Oct 31 15:17:59.395850 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 233/478] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:17:58 2022] DELETE /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:17:59.406324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:59.407760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:59.422425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.424567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.425399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.430338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.431972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.442482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.557800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.559297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.563291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.564174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lazy-loading 'fault' on Instance uuid 155e282c-3e39-48f4-a2b7-82b89e05727c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:17:59.715053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:17:59.717084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:17:59.735978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.736498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.736947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.762420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:17:59.763869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:17:59.770030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:17:59.986391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:00.040942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:00.050059 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f14ee417-3054-4307-b02d-32dc2ba1cdca tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1931 microversion: 2.75 time: 0.335334 Oct 31 15:18:00.059471 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 234/479] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:17:59 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1931 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:18:00.080341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:00.085009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:00.118034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:00.128802 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea7a06ef-382a-4c4d-a666-e013eb4da6f2 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1459 microversion: 2.1 time: 0.728415 Oct 31 15:18:00.132529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.135202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.135401 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 246/480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:17:59 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1459 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:00.137341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:00.140764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.141289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.141723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:00.164035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-044a3144-2c7a-4d8f-b45f-bc05dc441f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1a951f0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:00.296768 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-044a3144-2c7a-4d8f-b45f-bc05dc441f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.156693 Oct 31 15:18:00.300359 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 247/481] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:00 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:00.317244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:00.324223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:00.347403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.348556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.350616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:00.351819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.354585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.355273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:00.363029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:00.530228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:00.550104 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2bd6c3d0-3403-4d32-9835-e4eaaa6b0ee6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1279 microversion: 2.1 time: 0.247425 Oct 31 15:18:00.551659 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 248/482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:00 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:00.558461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:00.559300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:00.572545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.573478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.574127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:00.575794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:00.577162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:00.577841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:01.187763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:01.211716 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4473d530-01ec-481e-a283-eab6f75136f3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1311 microversion: 2.1 time: 0.658702 Oct 31 15:18:01.213009 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 249/483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:00 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1311 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:01.519357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:01.536291 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d80f89b-6399-4cd0-881d-3955f10b7f18 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1388 microversion: 2.1 time: 1.472400 Oct 31 15:18:01.538437 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 235/484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:00 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1388 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:01.552391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:01.555980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:01.595863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:01.597829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:01.599992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:01.602530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:01.603217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:01.604356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:01.836365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1790669631", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "b9ce60b0-eb78-46d2-9cec-4aebad5fe7ad"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:01.928131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] validate_networks() for [('b9ce60b0-eb78-46d2-9cec-4aebad5fe7ad', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:02.249831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:02.305467 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-78caf6f3-634e-4376-93ec-0645015dc04f tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1931 microversion: 2.75 time: 0.763339 Oct 31 15:18:02.306272 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 236/485] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:01 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1931 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:02.324963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4f157f9f-02a5-40db-881f-2b668a8bb270 req-0626a2ae-1531-40fa-b325-8e0bdb658e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6", "name": "network-vif-plugged", "status": "completed", "tag": "bc618eb3-b5b3-4e3c-b9ac-96906d79a8f0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:02.352842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4f157f9f-02a5-40db-881f-2b668a8bb270 req-0626a2ae-1531-40fa-b325-8e0bdb658e17 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.354385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4f157f9f-02a5-40db-881f-2b668a8bb270 req-0626a2ae-1531-40fa-b325-8e0bdb658e17 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.355041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4f157f9f-02a5-40db-881f-2b668a8bb270 req-0626a2ae-1531-40fa-b325-8e0bdb658e17 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.397614 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4f157f9f-02a5-40db-881f-2b668a8bb270 req-0626a2ae-1531-40fa-b325-8e0bdb658e17 service nova] Creating event network-vif-plugged:bc618eb3-b5b3-4e3c-b9ac-96906d79a8f0 for instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 on n-h1-858384-17 Oct 31 15:18:02.412676 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4f157f9f-02a5-40db-881f-2b668a8bb270 req-0626a2ae-1531-40fa-b325-8e0bdb658e17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104682 Oct 31 15:18:02.413998 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 237/486] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:02.421068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:02.428249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:02.446248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.447082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.447908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.448873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.449579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.450878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.533617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:02.537640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:02.542335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:02.543091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lazy-loading 'fault' on Instance uuid 155e282c-3e39-48f4-a2b7-82b89e05727c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:02.955404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:03.104155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:03.123963 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-983d81a4-be83-4aec-80bf-17603a869552 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1459 microversion: 2.1 time: 0.704177 Oct 31 15:18:03.128784 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 238/487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:02 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1459 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:03.139931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26585a7c-e162-40f3-b92d-264243a36481 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e19750d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:03.234018 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26585a7c-e162-40f3-b92d-264243a36481 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.103373 Oct 31 15:18:03.236916 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 239/488] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:03 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:03.246285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:03.247035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:03.261551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.262293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.263024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.264072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.265499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.266153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.702016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:03.712568 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a6c070c9-10b3-4a94-9294-dd2a15a032e4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1277 microversion: 2.1 time: 0.474483 Oct 31 15:18:03.713190 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 240/489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:03 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1277 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:03.723775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:03.727336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:03.742564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.743069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.743769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.745792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.746260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.746687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.883993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:03.884650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:03.885220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:03.886402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:03.886930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:03.905970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.906480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.906937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.907655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:03.908111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:03.908529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:03.963062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Getting quotas for project 786fdf71bdb44504b15ae68b83e9dd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:03.977091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Getting quotas for user 748f45dc720144a49ca38e9e3b185410 and project 786fdf71bdb44504b15ae68b83e9dd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:04.008972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:04.016194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:04.127039 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fedbd9f3-dcc8-4389-8f84-7af74601d84b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.907153 Oct 31 15:18:04.128003 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 250/490] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:04.132923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:04.137363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:04.160617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.161427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.162086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.163009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.163677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.164988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.502080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:04.525339 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b525db7-2eb1-4185-83f6-dd76480e622e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1311 microversion: 2.1 time: 0.801828 Oct 31 15:18:04.569950 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 241/491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:03 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1311 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:04.591874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:04.592950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:04.604090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.604976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.605631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.606884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.607744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.608519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.610508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:04.623753 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ede95f0-368f-4044-b221-837c769c284a tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1388 microversion: 2.1 time: 0.494331 Oct 31 15:18:04.644969 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 251/492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:04 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1388 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:04.666868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-651fedc2-9a88-40c2-b121-f3c07aa50334 req-2328ea5c-5d83-41b0-9e53-05887a414ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155e282c-3e39-48f4-a2b7-82b89e05727c", "name": "network-vif-deleted", "tag": "6621ada2-18e9-4859-9e72-d4bf20aec6a9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:04.687240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-651fedc2-9a88-40c2-b121-f3c07aa50334 req-2328ea5c-5d83-41b0-9e53-05887a414ca2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.687908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-651fedc2-9a88-40c2-b121-f3c07aa50334 req-2328ea5c-5d83-41b0-9e53-05887a414ca2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.688567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-651fedc2-9a88-40c2-b121-f3c07aa50334 req-2328ea5c-5d83-41b0-9e53-05887a414ca2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.704331 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-651fedc2-9a88-40c2-b121-f3c07aa50334 req-2328ea5c-5d83-41b0-9e53-05887a414ca2 service nova] Creating event network-vif-deleted:6621ada2-18e9-4859-9e72-d4bf20aec6a9 for instance 155e282c-3e39-48f4-a2b7-82b89e05727c on n-h2-858384-17 Oct 31 15:18:04.713438 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-651fedc2-9a88-40c2-b121-f3c07aa50334 req-2328ea5c-5d83-41b0-9e53-05887a414ca2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066681 Oct 31 15:18:04.719460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 252/493] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:04.728482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-128ba2fb-affa-4cf9-bc2a-62eeb2999fd7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:04.729724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-128ba2fb-affa-4cf9-bc2a-62eeb2999fd7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:04.840566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-128ba2fb-affa-4cf9-bc2a-62eeb2999fd7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:04.849084 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-128ba2fb-affa-4cf9-bc2a-62eeb2999fd7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1225 microversion: 2.1 time: 0.127822 Oct 31 15:18:04.850942 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 253/494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:04 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:04.870316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:04.871309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:04.884565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.885586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.886297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.888469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.889278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.892134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.949564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:04.950923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:04.951629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:04.952464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lazy-loading 'fault' on Instance uuid 155e282c-3e39-48f4-a2b7-82b89e05727c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:05.059020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:05.090831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32e5168a75474617a359aaa6fde1055c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f519c3aab447979a24d6e1c99b478c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:05.096166 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d3dd5bd-11fe-4d60-b3f4-4619397425eb tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1931 microversion: 2.75 time: 0.524588 Oct 31 15:18:05.100420 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 242/495] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:04 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1931 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:05.108419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-187a5431-38ac-4645-b497-12bb8847e9ad tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e17de940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:05.138541 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-838f058a-6661-423a-841b-c5cf9b96d66f tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 200 len: 1310 microversion: 2.1 time: 0.286021 Oct 31 15:18:05.159707 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 254/496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:04 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:05.174536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:05.176357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:05.192779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:05.193312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:05.193771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:05.210722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:05.211228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:05.211677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:05.213102 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-187a5431-38ac-4645-b497-12bb8847e9ad tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1414 microversion: 2.1 time: 0.109625 Oct 31 15:18:05.215120 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 243/497] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:05 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:05.489169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-805791462", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:05.583444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:05.647786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:05.647978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=28 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:05.658393 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-afe80ae0-d9ac-4818-bc5e-7149b1b5fad3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1319 microversion: 2.1 time: 0.496615 Oct 31 15:18:05.660116 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 255/498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:05 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:05.677441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:05.678366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:05.692337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:05.693457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:05.694958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:05.696026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:05.697539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:05.698185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.010127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:06.029746 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-47b7d025-f1ea-4089-b42c-c293a21d9858 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1311 microversion: 2.1 time: 0.364872 Oct 31 15:18:06.030494 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 256/499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:05 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1311 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:06.045100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.046612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:06.065052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.065582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.066024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.078473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.080203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.080650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.365377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:06.377052 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-492e8073-198f-44a3-bbb3-14244c7e1ce3 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1587 microversion: 2.1 time: 0.344755 Oct 31 15:18:06.378095 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 257/500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1587 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:06.389002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.389970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:06.396616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.398575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.399289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.400826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.401689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.402268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.530680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:06.546636 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f79cdfe-04f9-4460-a1cc-783874cb689b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1277 microversion: 2.1 time: 0.167023 Oct 31 15:18:06.547986 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 258/501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:06.576600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.577386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:06.586850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.587924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.588629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.589538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.590515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.591277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.838144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:06.863545 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ecb7a209-b07f-432b-b0e0-709973f42991 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1937 microversion: 2.75 time: 0.291866 Oct 31 15:18:06.875798 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 259/502] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1937 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:06.884352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:06.896817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:06.897462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:06.904301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.904799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.905467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.906616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:06.907085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:06.907512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:06.922074 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] HTTP exception thrown: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Request method failure captured: Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c HTTP/1.1 Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bwe0o6ogVFeBZi2ClxyBeMuI7C8_JcG2cqFFLhTHYU7NX4ADDtSl_MMY0jXv_JS9GC-u1zUvpUH8zLZC0wIa91ZidtT-3NhTmfBWx3D6g9-Zpceh2HU4cJYmYWNXQWvUnkJa39oBrBsEWFGCT7cDsx9FsvObY79FbiaTWkBkio7v4 Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:06.923783 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2f519c3aab447979a24d6e1c99b478c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2f519c3aab447979a24d6e1c99b478c"}]}] Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 32e5168a75474617a359aaa6fde1055c Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:06.925201 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '155e282c-3e39-48f4-a2b7-82b89e05727c'} Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:06.926130 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:06.927445 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:06.928534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Returning 404 to user: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:06.930299 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b852443f-59c0-4c12-a74e-9e2a65db5573 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 404 len: 111 microversion: 2.1 time: 0.044115 Oct 31 15:18:06.930876 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 260/503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:06.936510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7549f55f-f840-4921-92cd-ceb8ebe3c949 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1abdaf0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:07.003611 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7549f55f-f840-4921-92cd-ceb8ebe3c949 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1423 microversion: 2.1 time: 0.071618 Oct 31 15:18:07.004451 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 261/504] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:06 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1423 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:07.008835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f8ba87d-c379-415b-8058-da5f0817ad24 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:07.009349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f8ba87d-c379-415b-8058-da5f0817ad24 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:07.024724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8ba87d-c379-415b-8058-da5f0817ad24 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.025563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8ba87d-c379-415b-8058-da5f0817ad24 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.026016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8ba87d-c379-415b-8058-da5f0817ad24 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.027276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8ba87d-c379-415b-8058-da5f0817ad24 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.027800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8ba87d-c379-415b-8058-da5f0817ad24 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.028352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8ba87d-c379-415b-8058-da5f0817ad24 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.092361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:07.093021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:07.094327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:07.094991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:07.095555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:07.111780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.112553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.113170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.114155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.114783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.115375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.136069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Getting quotas for project ac787024261942edb9505c9d989aeff2. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:07.142112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Getting quotas for user bd109e04ce664c468fd5a2a19d840c7c and project ac787024261942edb9505c9d989aeff2. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:07.156342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:07.157033 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f8ba87d-c379-415b-8058-da5f0817ad24 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151690 Oct 31 15:18:07.157667 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 262/505] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:18:07 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:07.159272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:07.173685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-87cc218f-238f-489c-b868-59c394e67495 req-7161d5d1-2758-4a9c-9673-1e0f4d290435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c28632-29a8-4fd6-aef3-d4d5a0f22b72", "tag": "af2dcd80-0441-41c3-887e-cb8c0720e186"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:07.186245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-87cc218f-238f-489c-b868-59c394e67495 req-7161d5d1-2758-4a9c-9673-1e0f4d290435 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.187164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-87cc218f-238f-489c-b868-59c394e67495 req-7161d5d1-2758-4a9c-9673-1e0f4d290435 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.188175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-87cc218f-238f-489c-b868-59c394e67495 req-7161d5d1-2758-4a9c-9673-1e0f4d290435 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.207161 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-87cc218f-238f-489c-b868-59c394e67495 req-7161d5d1-2758-4a9c-9673-1e0f4d290435 service nova] Creating event network-changed:af2dcd80-0441-41c3-887e-cb8c0720e186 for instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 on n-h2-858384-17 Oct 31 15:18:07.219042 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-efad8127-3bf0-42d1-bc5c-bd659a8a8392 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.951613 Oct 31 15:18:07.220531 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 244/506] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:07.229814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:07.230768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:07.240417 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-87cc218f-238f-489c-b868-59c394e67495 req-7161d5d1-2758-4a9c-9673-1e0f4d290435 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050541 Oct 31 15:18:07.255815 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 263/507] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:07.257062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.259600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.260062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.261661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.270753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:07.271605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:07.285988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.286481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.286913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.287720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.288053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.293885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.300329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.301283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.339115 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] HTTP exception thrown: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Request method failure captured: Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c HTTP/1.1 Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bwe0o6ogVFeBZi2ClxyBeMuI7C8_JcG2cqFFLhTHYU7NX4ADDtSl_MMY0jXv_JS9GC-u1zUvpUH8zLZC0wIa91ZidtT-3NhTmfBWx3D6g9-Zpceh2HU4cJYmYWNXQWvUnkJa39oBrBsEWFGCT7cDsx9FsvObY79FbiaTWkBkio7v4 Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:07.342500 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2f519c3aab447979a24d6e1c99b478c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2f519c3aab447979a24d6e1c99b478c"}]}] Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 32e5168a75474617a359aaa6fde1055c Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.344239 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '155e282c-3e39-48f4-a2b7-82b89e05727c'} Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:07.345069 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.350968 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.352206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Returning 404 to user: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:07.352206 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9fbc0e8e-40a3-447d-b3e0-3c0d79c510c1 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "DELETE /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 404 len: 111 microversion: 2.1 time: 0.087238 Oct 31 15:18:07.352206 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 264/508] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:07 2022] DELETE /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:07.352425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-82a67b26-ab86-4eef-83e2-f73e4a2a8bc0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1d13a60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:07.414238 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-82a67b26-ab86-4eef-83e2-f73e4a2a8bc0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 200 len: 1423 microversion: 2.1 time: 0.066554 Oct 31 15:18:07.415886 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 265/509] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:18:07 2022] GET /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 1423 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:07.431816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:07.432662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:07.442637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.443132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.443660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.444271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.444731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.445202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.828069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:07.859809 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bc8bf9d-d6c9-4c53-813c-677782c3e27f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1311 microversion: 2.1 time: 0.440320 Oct 31 15:18:07.866488 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 266/510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:07 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1311 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:07.871434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1782542632", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:07.882432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:07.892952 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7174a2c7-505e-45ac-9010-d38efc8d3d26 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1319 microversion: 2.1 time: 0.668282 Oct 31 15:18:07.909970 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 245/511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:07 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1319 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:07.923076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:07.925180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: 155e282c-3e39-48f4-a2b7-82b89e05727c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:07.938363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.941421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.943297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.944230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:07.949010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:07.949787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:07.985299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:07.986747 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] HTTP exception thrown: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Request method failure captured: Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c HTTP/1.1 Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bwe0o6ogVFeBZi2ClxyBeMuI7C8_JcG2cqFFLhTHYU7NX4ADDtSl_MMY0jXv_JS9GC-u1zUvpUH8zLZC0wIa91ZidtT-3NhTmfBWx3D6g9-Zpceh2HU4cJYmYWNXQWvUnkJa39oBrBsEWFGCT7cDsx9FsvObY79FbiaTWkBkio7v4 Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:18:07.988576 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2f519c3aab447979a24d6e1c99b478c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2f519c3aab447979a24d6e1c99b478c"}]}] Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 32e5168a75474617a359aaa6fde1055c Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.990010 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '155e282c-3e39-48f4-a2b7-82b89e05727c'} Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:07.990771 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. Oct 31 15:18:07.992016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:07.993031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Returning 404 to user: Instance 155e282c-3e39-48f4-a2b7-82b89e05727c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:07.993031 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5fadb93e-fbd3-4032-ab6a-28252930f839 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c" status: 404 len: 111 microversion: 2.1 time: 0.080935 Oct 31 15:18:07.997851 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 246/512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:07 2022] GET /compute/v2.1/servers/155e282c-3e39-48f4-a2b7-82b89e05727c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:08.003903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7b76257-d705-4c14-80bd-fbfb91164bdf tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e17de8b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:08.640233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:08.640796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:08.641112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:08.641542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:08.641947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:08.666926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.667426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.673416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.676299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.676812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.677349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.718292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Getting quotas for project ac787024261942edb9505c9d989aeff2. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:08.731795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Getting quotas for user bd109e04ce664c468fd5a2a19d840c7c and project ac787024261942edb9505c9d989aeff2. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:08.760725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:08.763530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:08.826145 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af04d309-635c-417a-86d7-e121a3ceef80 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958258 Oct 31 15:18:08.828004 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 267/513] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:08.839672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:08.840307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:08.847918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:08.858260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.859327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.859671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.861321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.861678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.862114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.977101 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7b76257-d705-4c14-80bd-fbfb91164bdf tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 204 len: 0 microversion: 2.1 time: 0.977595 Oct 31 15:18:08.977713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 247/514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:07 2022] DELETE /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 0 bytes in 979 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:08.983407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:08.986529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:08.992698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.993214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.993649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:08.994351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:08.994982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:08.995406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.081224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] Lazy-loading 'services' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:09.106431 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-787b5266-360b-46c2-9cba-0d35fbcbee07 tempest-ServersAdmin275Test-481195655 tempest-ServersAdmin275Test-481195655-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1922 microversion: 2.75 time: 0.127505 Oct 31 15:18:09.107526 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 248/515] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:08 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1922 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:09.113452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:09.114360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:09.126959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.127866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.128765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.130219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.131382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.131945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.149601 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] HTTP exception thrown: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Request method failure captured: Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f HTTP/1.1 Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bwe0o6ogVFeBZi2ClxyBeMuI7C8_JcG2cqFFLhTHYU7NX4ADDtSl_MMY0jXv_JS9GC-u1zUvpUH8zLZC0wIa91ZidtT-3NhTmfBWx3D6g9-Zpceh2HU4cJYmYWNXQWvUnkJa39oBrBsEWFGCT7cDsx9FsvObY79FbiaTWkBkio7v4 Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:18:09.151272 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2f519c3aab447979a24d6e1c99b478c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2f519c3aab447979a24d6e1c99b478c"}]}] Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 32e5168a75474617a359aaa6fde1055c Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.152978 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'c6d822e8-8a06-4792-841b-39288b697b2f'} Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:09.153953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.155714 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.158182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Returning 404 to user: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:09.160204 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3afa423e-49f5-4b13-a2bb-a368812861cd tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 404 len: 111 microversion: 2.1 time: 0.050965 Oct 31 15:18:09.165556 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 249/516] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:09 2022] DELETE /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:09.171612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d44f28c1-ce24-4267-9ae5-25ccc5948571 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:09.172228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d44f28c1-ce24-4267-9ae5-25ccc5948571 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:09.243164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d44f28c1-ce24-4267-9ae5-25ccc5948571 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:09.255314 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d44f28c1-ce24-4267-9ae5-25ccc5948571 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1214 microversion: 2.1 time: 0.087239 Oct 31 15:18:09.261312 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 250/517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:09 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:09.267210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:09.267999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:09.290920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.291568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.292132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.294408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.295434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.296096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.440823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:09.448434 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49503b35-a9be-4f56-abc4-9abea8b93c5c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1325 microversion: 2.1 time: 0.619416 Oct 31 15:18:09.449019 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 268/518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:08 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1325 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:09.460346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:09.463002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:09.480803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.481919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.482757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.483641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.484114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.484694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.539697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:09.548444 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-636c6917-44f0-4e2f-91ef-5a883d7a52bd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1311 microversion: 2.1 time: 0.285921 Oct 31 15:18:09.549373 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 251/519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:09 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1311 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:09.557380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:09.558181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:09.567026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.567862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.568515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.569555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.570518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.571735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.579683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:09.620894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:09.765426 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-39c1c336-a3c8-496e-8a75-90173e24f345 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 204 len: 0 microversion: 2.1 time: 0.214303 Oct 31 15:18:09.766128 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 252/520] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:09 2022] DELETE /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:09.772958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:09.774030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:09.781914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.782742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.787244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.788266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.789759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.790279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.834227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:09.876724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:09.889680 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d3ee5ab-e8ea-4ecd-9377-114c314a7c03 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1319 microversion: 2.1 time: 0.432803 Oct 31 15:18:09.897161 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 269/521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:09 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:09.899299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:09.899911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] [instance: c6d822e8-8a06-4792-841b-39288b697b2f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:09.914390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.915145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.918053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.922882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:09.923629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:09.926434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:09.951162 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] HTTP exception thrown: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Request method failure captured: Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f HTTP/1.1 Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bwe0o6ogVFeBZi2ClxyBeMuI7C8_JcG2cqFFLhTHYU7NX4ADDtSl_MMY0jXv_JS9GC-u1zUvpUH8zLZC0wIa91ZidtT-3NhTmfBWx3D6g9-Zpceh2HU4cJYmYWNXQWvUnkJa39oBrBsEWFGCT7cDsx9FsvObY79FbiaTWkBkio7v4 Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:09.953049 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2f519c3aab447979a24d6e1c99b478c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2f519c3aab447979a24d6e1c99b478c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2f519c3aab447979a24d6e1c99b478c"}]}] Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d2f519c3aab447979a24d6e1c99b478c Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1472309271 Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 32e5168a75474617a359aaa6fde1055c Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersAdminTestJSON-1472309271-project Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.954405 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'c6d822e8-8a06-4792-841b-39288b697b2f'} Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:09.955094 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. Oct 31 15:18:09.962467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:09.968228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] Returning 404 to user: Instance c6d822e8-8a06-4792-841b-39288b697b2f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:09.968228 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e09adba1-caaf-4014-b758-4d8e08467056 tempest-DeleteServersAdminTestJSON-1472309271 tempest-DeleteServersAdminTestJSON-1472309271-project] 10.222.0.20 "GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f" status: 404 len: 111 microversion: 2.1 time: 0.063357 Oct 31 15:18:09.968228 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 270/522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:09 2022] GET /compute/v2.1/servers/c6d822e8-8a06-4792-841b-39288b697b2f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:09.976039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2389ce23-c75c-4e8d-a9f3-558259c13889 req-34e54931-9f13-4109-ad08-c6f7f2b7eb2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa830667-cb8a-4f7c-a15a-5f191694da32", "tag": "6ffa79ad-bfce-4f75-aeaa-0bd193bac0cf"}, {"name": "network-changed", "server_uuid": "60d6d090-f0e9-4b70-a5e0-473827cc478e", "tag": "496315b9-ac9a-4aba-93e6-98d916bc927e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:10.004214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2389ce23-c75c-4e8d-a9f3-558259c13889 req-34e54931-9f13-4109-ad08-c6f7f2b7eb2b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.005795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2389ce23-c75c-4e8d-a9f3-558259c13889 req-34e54931-9f13-4109-ad08-c6f7f2b7eb2b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.006308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2389ce23-c75c-4e8d-a9f3-558259c13889 req-34e54931-9f13-4109-ad08-c6f7f2b7eb2b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.019147 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a80bd35-d74b-42e8-8c76-2fe6d4d039df tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 204 len: 0 microversion: 2.75 time: 0.250167 Oct 31 15:18:10.020215 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 253/523] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:18:09 2022] DELETE /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:18:10.029508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:10.030720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:10.036345 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2389ce23-c75c-4e8d-a9f3-558259c13889 req-34e54931-9f13-4109-ad08-c6f7f2b7eb2b service nova] Creating event network-changed:6ffa79ad-bfce-4f75-aeaa-0bd193bac0cf for instance aa830667-cb8a-4f7c-a15a-5f191694da32 on n-h1-858384-17 Oct 31 15:18:10.036977 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2389ce23-c75c-4e8d-a9f3-558259c13889 req-34e54931-9f13-4109-ad08-c6f7f2b7eb2b service nova] Creating event network-changed:496315b9-ac9a-4aba-93e6-98d916bc927e for instance 60d6d090-f0e9-4b70-a5e0-473827cc478e on n-h1-858384-17 Oct 31 15:18:10.041252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.041815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.042248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.042998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.043613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.045012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.056705 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2389ce23-c75c-4e8d-a9f3-558259c13889 req-34e54931-9f13-4109-ad08-c6f7f2b7eb2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099933 Oct 31 15:18:10.058739 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 271/524] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:10.066128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-330f13da-e765-42e3-9315-6a9e8883d8ea req-692abcb0-975e-425d-be51-b4819e030661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6", "tag": "bc618eb3-b5b3-4e3c-b9ac-96906d79a8f0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:10.093334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-330f13da-e765-42e3-9315-6a9e8883d8ea req-692abcb0-975e-425d-be51-b4819e030661 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.096244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-330f13da-e765-42e3-9315-6a9e8883d8ea req-692abcb0-975e-425d-be51-b4819e030661 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.099309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-330f13da-e765-42e3-9315-6a9e8883d8ea req-692abcb0-975e-425d-be51-b4819e030661 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.122319 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-330f13da-e765-42e3-9315-6a9e8883d8ea req-692abcb0-975e-425d-be51-b4819e030661 service nova] Creating event network-changed:bc618eb3-b5b3-4e3c-b9ac-96906d79a8f0 for instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 on n-h1-858384-17 Oct 31 15:18:10.139149 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-330f13da-e765-42e3-9315-6a9e8883d8ea req-692abcb0-975e-425d-be51-b4819e030661 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076938 Oct 31 15:18:10.141664 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 272/525] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:10.153248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-543039609", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fae45c93-5c66-4e3d-908c-bfaf50cd6c4a"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:10.252210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] validate_networks() for [('fae45c93-5c66-4e3d-908c-bfaf50cd6c4a', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:10.705548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:10.721411 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e03b0326-08f9-4a22-84b1-1b61d5b4bf33 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1587 microversion: 2.1 time: 0.699270 Oct 31 15:18:10.733157 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 254/526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:10 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1587 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:10.738093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:10.739364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:10.772886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.778930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.779772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.780530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:10.787249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:10.787707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:10.967617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:10.984257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:10.985776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:11.003632 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d936bb8d-5401-4c12-ae54-2f9cbed3329e tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1444 microversion: 2.75 time: 0.279881 Oct 31 15:18:11.005770 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 255/527] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:10 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1444 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:11.027455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:11.029774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:11.053972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.054626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.055171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.056010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.056576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.059959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.179162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:11.221932 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b4edbb93-5802-4152-a62d-bb54d4a24595 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1266 microversion: 2.1 time: 0.214990 Oct 31 15:18:11.222728 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 256/528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:11 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:11.230191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:11.232226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:11.239372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.239868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.240305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.241005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.241495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.241914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.413599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:11.414079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:11.414610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:11.415090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:11.415579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:11.426293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:11.434758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.437622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.438158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.439239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.441346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.442633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.458874 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-191c95a5-a1ba-4339-bff9-01e3920160b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1325 microversion: 2.1 time: 0.233692 Oct 31 15:18:11.459940 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 257/529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:11 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:11.477917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:11.480646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:11.492203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:11.495253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.496304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.498423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.499681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.500159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.500576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.500695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for user cd661f82522f4d5ab5f54d9fcdb81232 and project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:11.535197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:11.537910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:11.627785 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d4eb271-79fb-48cd-ae5d-8bb57c2999d9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.483851 Oct 31 15:18:11.634480 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 273/530] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:11.658124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-872a3688-9920-4a8c-87f4-725df0e1c2c6 req-1aaef898-1138-4f08-8553-836b48d0edbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28f347d-fe10-4885-bbf4-1d8591ca6340", "name": "network-vif-unplugged", "status": "completed", "tag": "fc85af9d-8ed8-4328-9088-8c61c61d17c1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:11.678434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-872a3688-9920-4a8c-87f4-725df0e1c2c6 req-1aaef898-1138-4f08-8553-836b48d0edbf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.679203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-872a3688-9920-4a8c-87f4-725df0e1c2c6 req-1aaef898-1138-4f08-8553-836b48d0edbf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.679783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-872a3688-9920-4a8c-87f4-725df0e1c2c6 req-1aaef898-1138-4f08-8553-836b48d0edbf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.686723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:11.697790 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-872a3688-9920-4a8c-87f4-725df0e1c2c6 req-1aaef898-1138-4f08-8553-836b48d0edbf service nova] Creating event network-vif-unplugged:fc85af9d-8ed8-4328-9088-8c61c61d17c1 for instance d28f347d-fe10-4885-bbf4-1d8591ca6340 on n-h2-858384-17 Oct 31 15:18:11.705906 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-872a3688-9920-4a8c-87f4-725df0e1c2c6 req-1aaef898-1138-4f08-8553-836b48d0edbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070064 Oct 31 15:18:11.707060 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 274/531] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:11.713964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:11.714944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:11.722770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.724179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.724825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.725939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:11.726603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:11.727365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:11.882958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:11.894197 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4b55a7d-8181-47ac-86f3-1b23a68e6e7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1311 microversion: 2.1 time: 0.433193 Oct 31 15:18:11.895141 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 258/532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:11 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1311 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:11.916333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8834b46f-3a96-4345-bbba-ad8c25176ce5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:11.916946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8834b46f-3a96-4345-bbba-ad8c25176ce5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:11.950367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:11.958158 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0e8a8eba-556c-4476-9cd7-ce1fbc310524 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1319 microversion: 2.1 time: 0.249781 Oct 31 15:18:11.968208 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 275/533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:11 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:12.033812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.034516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.041185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.041681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.042117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.042822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.043302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.043424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8834b46f-3a96-4345-bbba-ad8c25176ce5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.043873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.056918 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8834b46f-3a96-4345-bbba-ad8c25176ce5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1207 microversion: 2.1 time: 0.160447 Oct 31 15:18:12.061284 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 259/534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:11 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1207 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:12.250498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.251473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.267384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.268410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.269051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.272444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.275075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.276406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.372755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.383671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.389456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.405081 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48fcf908-e338-4b2c-9ada-c72c4b0fce35 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1444 microversion: 2.75 time: 0.370292 Oct 31 15:18:12.406104 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 276/535] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1444 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:18:12.412557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8b20c342-53d5-4132-80e0-1ca39037497a req-11d16b4c-10df-46b1-a47b-e4abbb53b763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98382f3-c2cd-4289-964b-8ddab6df3f83", "tag": "ed16b407-002a-4cdb-977d-bbd06aa0a782"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:12.440169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b20c342-53d5-4132-80e0-1ca39037497a req-11d16b4c-10df-46b1-a47b-e4abbb53b763 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.440658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b20c342-53d5-4132-80e0-1ca39037497a req-11d16b4c-10df-46b1-a47b-e4abbb53b763 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.440801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b20c342-53d5-4132-80e0-1ca39037497a req-11d16b4c-10df-46b1-a47b-e4abbb53b763 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.460049 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8b20c342-53d5-4132-80e0-1ca39037497a req-11d16b4c-10df-46b1-a47b-e4abbb53b763 service nova] Creating event network-changed:ed16b407-002a-4cdb-977d-bbd06aa0a782 for instance e98382f3-c2cd-4289-964b-8ddab6df3f83 on n-h2-858384-17 Oct 31 15:18:12.467639 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8b20c342-53d5-4132-80e0-1ca39037497a req-11d16b4c-10df-46b1-a47b-e4abbb53b763 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060009 Oct 31 15:18:12.469606 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 277/536] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:12.489197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.492500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.510957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.514915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.515672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.517669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.519285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.522176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.734633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.752822 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-959c82db-bf56-4de7-9cb9-52735d63cf52 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1266 microversion: 2.1 time: 0.509372 Oct 31 15:18:12.754177 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 260/537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1266 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:12.910620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:12.924561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.926053 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ecadda4a-d4d3-4061-8b40-5a9364fb7308 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1325 microversion: 2.1 time: 0.442027 Oct 31 15:18:12.926908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.927119 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 278/538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1325 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:12.940757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.943459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.944164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.945793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.946375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:12.948097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:12.984825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:12.985524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:12.998323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:12.999035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.000593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.002839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.003727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.004290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.408550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.421718 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3080928f-9cc1-464e-a31d-0745a093ba04 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1319 microversion: 2.1 time: 0.441365 Oct 31 15:18:13.432989 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 279/539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:13.444533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:13.445208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.466280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.466833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.467297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.473504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.474083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.474744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.529661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.543934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2582a34b-547b-4c4b-8a54-979edce42264 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1311 microversion: 2.1 time: 0.627984 Oct 31 15:18:13.544878 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 261/540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:12 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1311 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:13.555389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-cb165549-0b0c-4af3-8c59-aac2b6f0b267 req-52cc855a-82ab-4e05-9884-f8cd114cfaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d28f347d-fe10-4885-bbf4-1d8591ca6340", "name": "network-vif-deleted", "tag": "fc85af9d-8ed8-4328-9088-8c61c61d17c1"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:13.572090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cb165549-0b0c-4af3-8c59-aac2b6f0b267 req-52cc855a-82ab-4e05-9884-f8cd114cfaf6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.572853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cb165549-0b0c-4af3-8c59-aac2b6f0b267 req-52cc855a-82ab-4e05-9884-f8cd114cfaf6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.575056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cb165549-0b0c-4af3-8c59-aac2b6f0b267 req-52cc855a-82ab-4e05-9884-f8cd114cfaf6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.628935 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-cb165549-0b0c-4af3-8c59-aac2b6f0b267 req-52cc855a-82ab-4e05-9884-f8cd114cfaf6 service nova] Creating event network-vif-deleted:fc85af9d-8ed8-4328-9088-8c61c61d17c1 for instance d28f347d-fe10-4885-bbf4-1d8591ca6340 on n-h2-858384-17 Oct 31 15:18:13.642785 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-cb165549-0b0c-4af3-8c59-aac2b6f0b267 req-52cc855a-82ab-4e05-9884-f8cd114cfaf6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091933 Oct 31 15:18:13.645601 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 262/541] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:13.657057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:13.660704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.675355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.676713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.678302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.681115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.682351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.682845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.774268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.779896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.780347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.780805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lazy-loading 'fault' on Instance uuid b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:13.847327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.859011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.860996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4495e06014354a6f990613dc87af1644', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552160083f6047d18b497a42bff6e99e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:13.870651 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c964eb2a-099f-4904-a291-803d2ccfd045 tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 200 len: 1449 microversion: 2.75 time: 0.222399 Oct 31 15:18:13.872060 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 263/542] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:13 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 1449 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:18:13.890475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5d8af9cf-5f19-4362-876a-63faaae72a75 req-c8f77c8a-4ac2-4cef-843e-f5aeaf096e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c28632-29a8-4fd6-aef3-d4d5a0f22b72", "name": "network-vif-plugged", "status": "completed", "tag": "af2dcd80-0441-41c3-887e-cb8c0720e186"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:13.905676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5d8af9cf-5f19-4362-876a-63faaae72a75 req-c8f77c8a-4ac2-4cef-843e-f5aeaf096e34 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.906187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5d8af9cf-5f19-4362-876a-63faaae72a75 req-c8f77c8a-4ac2-4cef-843e-f5aeaf096e34 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.906612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5d8af9cf-5f19-4362-876a-63faaae72a75 req-c8f77c8a-4ac2-4cef-843e-f5aeaf096e34 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.921986 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5d8af9cf-5f19-4362-876a-63faaae72a75 req-c8f77c8a-4ac2-4cef-843e-f5aeaf096e34 service nova] Creating event network-vif-plugged:af2dcd80-0441-41c3-887e-cb8c0720e186 for instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 on n-h2-858384-17 Oct 31 15:18:13.928308 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5d8af9cf-5f19-4362-876a-63faaae72a75 req-c8f77c8a-4ac2-4cef-843e-f5aeaf096e34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054459 Oct 31 15:18:13.934988 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 264/543] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:13.941803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:13.942585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:13.952585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:13.954656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.955323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.956516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:13.957491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:13.958114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:13.958694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.067208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:14.078749 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fb386ab4-a827-4288-b377-b7fe9a604b83 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1259 microversion: 2.1 time: 0.637939 Oct 31 15:18:14.081675 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 280/544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:13 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1259 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:14.123065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:14.124066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:14.125259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:14.131827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.132597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.133275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.134209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.135014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.135685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.138122 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-48f6a542-c580-4096-8094-81b572a0534e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1272 microversion: 2.1 time: 0.204219 Oct 31 15:18:14.143402 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 265/545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:13 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:14.447450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:14.447826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:14.457900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.462872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.463501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.464267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.464748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.471244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.677390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:14.694654 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5a1f00ca-e238-4280-aa55-f765b80cf381 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1325 microversion: 2.1 time: 0.590200 Oct 31 15:18:14.709238 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 281/546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:14 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1325 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:14.709238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:14.710207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:14.718137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.723043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.726913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.727744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:14.728660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:14.729101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:14.985069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:14.993596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd8b980f-4304-4648-9b41-a29f9bc095ce tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1311 microversion: 2.1 time: 0.293940 Oct 31 15:18:14.995439 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 282/547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:14 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1311 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:15.000444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:15.001344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] [instance: b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:15.020629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.023978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.025911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.026769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.027616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.031831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.060647 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] HTTP exception thrown: Instance b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f could not be found. Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Request method failure captured: Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f HTTP/1.1 Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bvpLMPgAPW98pWUtUQ8ENrwA_TuJyNu4a-x6T7u198-x9eCGvRWFyEmgXxSCgYBStv_Tf7eLDqu_q-XqIGIMX7wjS20ahH3oA2R8suOu-xjHZKUqHp21MpDLucAghNSF5QvULdfF2xrgaCoGoG0isNlSUoVljPZda0yKCqRf8JwdI Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.75 Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 552160083f6047d18b497a42bff6e99e Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersAdmin275Test-1892835962 Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:15.064257 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552160083f6047d18b497a42bff6e99e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_552160083f6047d18b497a42bff6e99e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/552160083f6047d18b497a42bff6e99e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/552160083f6047d18b497a42bff6e99e"}]}] Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersAdmin275Test-1892835962 Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 552160083f6047d18b497a42bff6e99e Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersAdmin275Test-1892835962 Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersAdmin275Test-1892835962-project Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4495e06014354a6f990613dc87af1644 Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersAdmin275Test-1892835962-project Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f could not be found. Oct 31 15:18:15.066105 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f'} Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f could not be found. Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:15.067025 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f could not be found. Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f could not be found. Oct 31 15:18:15.068430 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:15.072347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] Returning 404 to user: Instance b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:15.077653 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b0631c3d-128f-460c-b620-06ad4c4f777c tempest-ServersAdmin275Test-1892835962 tempest-ServersAdmin275Test-1892835962-project] 10.222.0.20 "GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f" status: 404 len: 111 microversion: 2.75 time: 0.080797 Oct 31 15:18:15.079851 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 283/548] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:18:14 2022] GET /compute/v2.1/servers/b7e2a503-b9ce-4db0-8c52-ec4fe15e4e7f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:18:15.107329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:15.108516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:15.109116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:15.114929 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-503102f6-3720-494b-91f2-44f71c9eafba tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1319 microversion: 2.1 time: 0.672365 Oct 31 15:18:15.115554 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 266/549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:14 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1319 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:15.150337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.150636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.151103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.166087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.167497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:15.168292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:15.168532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.173785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.180625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.181116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.181574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.182281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.182802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.183221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.238998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:15.323069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:15.334771 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dff612f2-10bb-4d6c-a80f-4ede0cad5b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1265 microversion: 2.1 time: 0.230634 Oct 31 15:18:15.338870 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 284/550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:15 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:15.726248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:15.728174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:15.738862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.742892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.743538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.748209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:15.748926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:15.750088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:15.898644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:15.914721 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da017151-95bd-431c-95a8-85885795c679 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1314 microversion: 2.1 time: 0.750772 Oct 31 15:18:15.929592 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 267/551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:15 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:16.193151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:16.211088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Calling method '.version_select at 0x7f16e16ee8b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.212979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.213605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.214149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.229886 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7baae61-dd5d-4aa4-a0c8-7f8b77021546 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1325 microversion: 2.1 time: 0.505508 Oct 31 15:18:16.234047 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 285/552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:15 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1325 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:16.256106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-81ee8dde-d3f6-43cb-82bd-c4315ad94fb6 req-22b2d21d-54da-4373-a08d-97201d15d033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa830667-cb8a-4f7c-a15a-5f191694da32", "name": "network-vif-plugged", "status": "completed", "tag": "6ffa79ad-bfce-4f75-aeaa-0bd193bac0cf"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:16.271675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.272173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.272654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.285946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-81ee8dde-d3f6-43cb-82bd-c4315ad94fb6 req-22b2d21d-54da-4373-a08d-97201d15d033 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.287441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-81ee8dde-d3f6-43cb-82bd-c4315ad94fb6 req-22b2d21d-54da-4373-a08d-97201d15d033 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.292106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-81ee8dde-d3f6-43cb-82bd-c4315ad94fb6 req-22b2d21d-54da-4373-a08d-97201d15d033 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.297707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.298553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.299226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.315821 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1611b62a-22cc-4a6f-a3a4-fed6a5fa34bd tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.369159 Oct 31 15:18:16.324143 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 268/553] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:18:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:18:16.331596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-81ee8dde-d3f6-43cb-82bd-c4315ad94fb6 req-22b2d21d-54da-4373-a08d-97201d15d033 service nova] Creating event network-vif-plugged:6ffa79ad-bfce-4f75-aeaa-0bd193bac0cf for instance aa830667-cb8a-4f7c-a15a-5f191694da32 on n-h1-858384-17 Oct 31 15:18:16.333009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.334293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:16.341827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.342716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.343429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.344365 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-81ee8dde-d3f6-43cb-82bd-c4315ad94fb6 req-22b2d21d-54da-4373-a08d-97201d15d033 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106584 Oct 31 15:18:16.344902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.345867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.346559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.347317 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 286/554] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:16.356112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.357548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:16.370747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.373884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.375804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.377623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.378683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.379521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.748917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:16.763510 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67362557-c7bb-4086-a04b-5b6a5304c9ac tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1319 microversion: 2.1 time: 0.414115 Oct 31 15:18:16.773208 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 287/555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:16 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:16.784674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Calling method '.version_select at 0x7f16e1a955e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.788581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.789719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.791596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.826427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.828376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.830847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.856907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.857385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.857823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.875377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-debd92eb-3e90-4b5b-8f78-48c635f06eef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.100100 Oct 31 15:18:16.878234 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 288/556] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 31 15:18:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:16.884457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:16.887614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:16.900773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.901305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.901743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:16.903078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:16.903858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:16.904404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.013790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:17.020666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:17.029514 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f0fdf61-bba0-4ad2-9b59-f5ca5e84c287 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1265 microversion: 2.1 time: 0.149497 Oct 31 15:18:17.037991 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-020b808a-6458-45b2-bb78-1bf999d41117 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1494 microversion: 2.1 time: 0.711016 Oct 31 15:18:17.042316 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 289/557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:16 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:17.052107 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 269/558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:16 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1494 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:17.064547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:17.065322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Calling method '.version_select at 0x7f16e1d13b80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:17.067495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.068145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:17.068790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.071946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.080529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.081200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.081916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.083335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.085439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.086114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.094013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.094507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.094991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.107553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.108169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.108592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.116707 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a6e4075d-de07-49df-9033-a97f694898d4 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.072912 Oct 31 15:18:17.124448 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 290/559] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:18:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:17.132660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:17.309475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c3c491da-07b9-4ef3-9eaa-597cccb4e0dd tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:17.310421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c3c491da-07b9-4ef3-9eaa-597cccb4e0dd tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:17.322831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3c491da-07b9-4ef3-9eaa-597cccb4e0dd tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.323799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3c491da-07b9-4ef3-9eaa-597cccb4e0dd tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.324645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3c491da-07b9-4ef3-9eaa-597cccb4e0dd tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.327181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3c491da-07b9-4ef3-9eaa-597cccb4e0dd tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.328087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3c491da-07b9-4ef3-9eaa-597cccb4e0dd tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.328496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3c491da-07b9-4ef3-9eaa-597cccb4e0dd tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.675077 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c3c491da-07b9-4ef3-9eaa-597cccb4e0dd tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1647 microversion: 2.1 time: 0.548755 Oct 31 15:18:17.692285 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 291/560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:17 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1647 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:17.704485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2270e3df-d998-462b-869b-d356edfaafef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Calling method '.version_select at 0x7f16e1cd5430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:17.707770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2270e3df-d998-462b-869b-d356edfaafef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.708727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2270e3df-d998-462b-869b-d356edfaafef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.709681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2270e3df-d998-462b-869b-d356edfaafef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.729487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2270e3df-d998-462b-869b-d356edfaafef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.731237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2270e3df-d998-462b-869b-d356edfaafef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.731416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:17.732202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2270e3df-d998-462b-869b-d356edfaafef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.738858 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-534c4f84-d665-407a-ad0e-7e20cbad99df tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1314 microversion: 2.1 time: 0.685320 Oct 31 15:18:17.739443 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 270/561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:17 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:17.739664 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2270e3df-d998-462b-869b-d356edfaafef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.045652 Oct 31 15:18:17.740867 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 292/562] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:18:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:17.748154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:17.748905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:17.751557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-064f6648-fe43-4d76-a5d7-3b218258995e req-832bb117-9b75-4feb-826a-ee064c81888b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec22d439-86fc-48bc-a238-b9e3074d51fa", "tag": "af932539-7d08-4e92-83b1-db17d6e894a3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:17.763406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.765118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.765689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.768665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.769994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.770437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.787560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-064f6648-fe43-4d76-a5d7-3b218258995e req-832bb117-9b75-4feb-826a-ee064c81888b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.788052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-064f6648-fe43-4d76-a5d7-3b218258995e req-832bb117-9b75-4feb-826a-ee064c81888b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.788547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-064f6648-fe43-4d76-a5d7-3b218258995e req-832bb117-9b75-4feb-826a-ee064c81888b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.805468 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-064f6648-fe43-4d76-a5d7-3b218258995e req-832bb117-9b75-4feb-826a-ee064c81888b service nova] Creating event network-changed:af932539-7d08-4e92-83b1-db17d6e894a3 for instance ec22d439-86fc-48bc-a238-b9e3074d51fa on n-h2-858384-17 Oct 31 15:18:17.819132 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-064f6648-fe43-4d76-a5d7-3b218258995e req-832bb117-9b75-4feb-826a-ee064c81888b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072460 Oct 31 15:18:17.819756 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 271/563] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:17.824781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-becd01b4-27a3-49ae-94ab-247f49fb2e87 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:17.825440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-becd01b4-27a3-49ae-94ab-247f49fb2e87 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:17.831641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-becd01b4-27a3-49ae-94ab-247f49fb2e87 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.832726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-becd01b4-27a3-49ae-94ab-247f49fb2e87 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.832726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-becd01b4-27a3-49ae-94ab-247f49fb2e87 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:17.833269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-becd01b4-27a3-49ae-94ab-247f49fb2e87 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:17.833713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-becd01b4-27a3-49ae-94ab-247f49fb2e87 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:17.834122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-becd01b4-27a3-49ae-94ab-247f49fb2e87 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.105071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:18.107854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:18.118646 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a9414eea-5669-45db-8247-50e6a501112e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1325 microversion: 2.1 time: 0.375389 Oct 31 15:18:18.119240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 293/564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:17 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1325 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:18.145690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32306085-cb82-4ff1-8362-913496979b5c tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Calling method '.version_select at 0x7f16e20aff70>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.147654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32306085-cb82-4ff1-8362-913496979b5c tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.148144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32306085-cb82-4ff1-8362-913496979b5c tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.148577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32306085-cb82-4ff1-8362-913496979b5c tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.162035 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-becd01b4-27a3-49ae-94ab-247f49fb2e87 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1647 microversion: 2.1 time: 0.341131 Oct 31 15:18:18.168096 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 272/565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:17 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1647 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:18.182943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.184296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:18.191517 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32306085-cb82-4ff1-8362-913496979b5c tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 265 microversion: 2.1 time: 0.051366 Oct 31 15:18:18.192426 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 294/566] 10.222.0.20 () {58 vars in 1179 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 265 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:18.198971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.200258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:18.202381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.203089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.203673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.204584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.205254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.205839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.232749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.233258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.233690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.234384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.234831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.235245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.491474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:18.502142 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b58a285-3af7-4fef-82f4-e18e5b1a3089 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1307 microversion: 2.1 time: 0.308243 Oct 31 15:18:18.502796 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 295/567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1307 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:18.516955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18ac51a3-c7ac-4cfd-b22c-428adafb651c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.528303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ac51a3-c7ac-4cfd-b22c-428adafb651c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.529642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ac51a3-c7ac-4cfd-b22c-428adafb651c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.533215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ac51a3-c7ac-4cfd-b22c-428adafb651c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.536480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ac51a3-c7ac-4cfd-b22c-428adafb651c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.537230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ac51a3-c7ac-4cfd-b22c-428adafb651c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.538985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ac51a3-c7ac-4cfd-b22c-428adafb651c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.591536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:18.609190 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-107cc40b-1e84-4547-8a00-dec329bbd3eb tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1319 microversion: 2.1 time: 0.439624 Oct 31 15:18:18.621160 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-18ac51a3-c7ac-4cfd-b22c-428adafb651c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.108141 Oct 31 15:18:18.621878 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 273/568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:18.622032 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 296/569] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:18.622181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Calling method '.version_select at 0x7f16e18038b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.622364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.630767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-26f69889-40cc-4348-995f-b626307164e7 req-3fe66a54-dc10-4258-be40-40edf8e2e417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d6d090-f0e9-4b70-a5e0-473827cc478e", "name": "network-vif-plugged", "status": "completed", "tag": "496315b9-ac9a-4aba-93e6-98d916bc927e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:18.632608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.633569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.674082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-26f69889-40cc-4348-995f-b626307164e7 req-3fe66a54-dc10-4258-be40-40edf8e2e417 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.676776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-26f69889-40cc-4348-995f-b626307164e7 req-3fe66a54-dc10-4258-be40-40edf8e2e417 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.677285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-26f69889-40cc-4348-995f-b626307164e7 req-3fe66a54-dc10-4258-be40-40edf8e2e417 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.691304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.693343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.693989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.712179 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-26f69889-40cc-4348-995f-b626307164e7 req-3fe66a54-dc10-4258-be40-40edf8e2e417 service nova] Creating event network-vif-plugged:496315b9-ac9a-4aba-93e6-98d916bc927e for instance 60d6d090-f0e9-4b70-a5e0-473827cc478e on n-h1-858384-17 Oct 31 15:18:18.724699 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-26f69889-40cc-4348-995f-b626307164e7 req-3fe66a54-dc10-4258-be40-40edf8e2e417 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105659 Oct 31 15:18:18.726975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.727648 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 297/570] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:18.731482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.732648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.765413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-17", "block_migration": true, "disk_over_commit": false}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:18.783568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:18.784279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-437f0def-2b5e-4ae8-a3fd-fd27b5d985ba tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.168882 Oct 31 15:18:18.784932 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 274/571] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:18.796689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c8484b24-cee2-4a57-983e-c95491a3fad8 req-8bc2c09d-ea00-4985-83bb-a33c1799218a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eae2e09-a74e-44d0-9ff9-966d56fa7a90", "tag": "dd87d55d-0615-4caa-842d-f124433f3410"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:18.814868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.815779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.816618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.818532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.819604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.820111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.827103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c8484b24-cee2-4a57-983e-c95491a3fad8 req-8bc2c09d-ea00-4985-83bb-a33c1799218a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.827807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c8484b24-cee2-4a57-983e-c95491a3fad8 req-8bc2c09d-ea00-4985-83bb-a33c1799218a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.828393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c8484b24-cee2-4a57-983e-c95491a3fad8 req-8bc2c09d-ea00-4985-83bb-a33c1799218a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.853907 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c8484b24-cee2-4a57-983e-c95491a3fad8 req-8bc2c09d-ea00-4985-83bb-a33c1799218a service nova] Creating event network-changed:dd87d55d-0615-4caa-842d-f124433f3410 for instance 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 on n-h2-858384-17 Oct 31 15:18:18.860945 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c8484b24-cee2-4a57-983e-c95491a3fad8 req-8bc2c09d-ea00-4985-83bb-a33c1799218a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069315 Oct 31 15:18:18.862577 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 275/572] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:18.872754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:18.873830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:18.881026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.881850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.882524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.883440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:18.884116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:18.887051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:18.931790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lazy-loading 'flavor' on Instance uuid 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:19.028394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Going to try to live migrate instance to n-h1-858384-17 {{(pid=120587) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:18:19.293481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:19.302527 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3f61ceb-faa0-4566-b465-f9706971fccb tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1314 microversion: 2.1 time: 0.435831 Oct 31 15:18:19.313967 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 276/573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:18 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:19.318905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b621b0a-bded-48f1-b457-6f01fffcf302 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Calling method '.version_select at 0x7f16e19759d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:19.320903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b621b0a-bded-48f1-b457-6f01fffcf302 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.321773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b621b0a-bded-48f1-b457-6f01fffcf302 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.322354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b621b0a-bded-48f1-b457-6f01fffcf302 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.364831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b621b0a-bded-48f1-b457-6f01fffcf302 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.365534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b621b0a-bded-48f1-b457-6f01fffcf302 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.366257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b621b0a-bded-48f1-b457-6f01fffcf302 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.375852 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b621b0a-bded-48f1-b457-6f01fffcf302 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.060578 Oct 31 15:18:19.377996 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 277/574] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:18:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:19.385147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:19.385753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:19.407318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.408092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.411771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.412782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.413738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.414453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.757041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:19.772349 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab4b2ac9-d926-41a7-9c7f-c91b7db1d122 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1325 microversion: 2.1 time: 0.390793 Oct 31 15:18:19.772934 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 278/575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:19 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1325 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:19.778496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b71948c5-5a4b-480c-92a4-1b8634ca3a25 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Calling method '.version_select at 0x7f16e1a2c0d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:19.779093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b71948c5-5a4b-480c-92a4-1b8634ca3a25 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.779575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b71948c5-5a4b-480c-92a4-1b8634ca3a25 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.780000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b71948c5-5a4b-480c-92a4-1b8634ca3a25 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.807790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b71948c5-5a4b-480c-92a4-1b8634ca3a25 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.809307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b71948c5-5a4b-480c-92a4-1b8634ca3a25 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.810004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b71948c5-5a4b-480c-92a4-1b8634ca3a25 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.834685 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b71948c5-5a4b-480c-92a4-1b8634ca3a25 tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.060621 Oct 31 15:18:19.838001 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 279/576] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:18:19 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:19.844710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:19.845927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:19.853649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.854301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.854881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:19.856056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:19.856678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:19.857268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.102229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:20.112304 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ae9047f-42cd-41ad-979d-4309001bd28f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1307 microversion: 2.1 time: 0.272675 Oct 31 15:18:20.129177 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 280/577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:19 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1307 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:20.134014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:20.134660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:20.140797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.141387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.141813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.142742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.143460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.143950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.478232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:20.486731 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ccabde51-7583-4ae2-b61c-6a97333cd400 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1319 microversion: 2.1 time: 0.356388 Oct 31 15:18:20.497789 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 281/578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:20 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:20.507387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Calling method '.version_select at 0x7f16e1803040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:20.509989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.510110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.510549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.524828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.525365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.525791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.537717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.538352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.538927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.587313 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91edc5d4-6a13-4f2d-8895-86de91f5ddef tempest-HypervisorAdminTestJSON-74059705 tempest-HypervisorAdminTestJSON-74059705-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.087120 Oct 31 15:18:20.604497 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 282/579] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 31 15:18:20 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:20.613054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:20.617936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:20.630382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.634235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.637914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:20.638750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:20.641581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:20.642467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.074045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:21.083523 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43a6ffa1-3e7d-44be-9255-24f1fdda3c48 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1314 microversion: 2.1 time: 0.477079 Oct 31 15:18:21.084123 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 283/580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:20 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:21.090726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fac6c17b-e574-4789-bc80-529746d10acb req-17118503-5a3c-42b0-958a-6449117e362a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98382f3-c2cd-4289-964b-8ddab6df3f83", "name": "network-vif-plugged", "status": "completed", "tag": "ed16b407-002a-4cdb-977d-bbd06aa0a782"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:21.102609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fac6c17b-e574-4789-bc80-529746d10acb req-17118503-5a3c-42b0-958a-6449117e362a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.103341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fac6c17b-e574-4789-bc80-529746d10acb req-17118503-5a3c-42b0-958a-6449117e362a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.103769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fac6c17b-e574-4789-bc80-529746d10acb req-17118503-5a3c-42b0-958a-6449117e362a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.118333 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fac6c17b-e574-4789-bc80-529746d10acb req-17118503-5a3c-42b0-958a-6449117e362a service nova] Creating event network-vif-plugged:ed16b407-002a-4cdb-977d-bbd06aa0a782 for instance e98382f3-c2cd-4289-964b-8ddab6df3f83 on n-h2-858384-17 Oct 31 15:18:21.133504 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fac6c17b-e574-4789-bc80-529746d10acb req-17118503-5a3c-42b0-958a-6449117e362a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047827 Oct 31 15:18:21.134181 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 284/581] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:21.148977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:21.149723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:21.167140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.173651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.174311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.175078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.175558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.175986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.520051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=20 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:21.851744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:21.860072 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87cb9b12-c3e7-4066-9f05-f58e108b5afd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1325 microversion: 2.1 time: 0.720459 Oct 31 15:18:21.861534 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 285/582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:21 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1325 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:21.866222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-58d1e9d2-62c7-4e97-99bb-d301880e31bf req-ddc9de26-0ed9-4cdc-aa07-3923f8ee6c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20f21ec1-2fb0-4adc-a4fb-c3d41643dca7", "tag": "6c3880f7-29f4-4ecb-96f6-a91817391f10"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:21.878245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-58d1e9d2-62c7-4e97-99bb-d301880e31bf req-ddc9de26-0ed9-4cdc-aa07-3923f8ee6c8b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.878937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-58d1e9d2-62c7-4e97-99bb-d301880e31bf req-ddc9de26-0ed9-4cdc-aa07-3923f8ee6c8b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.879513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-58d1e9d2-62c7-4e97-99bb-d301880e31bf req-ddc9de26-0ed9-4cdc-aa07-3923f8ee6c8b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.910380 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-58d1e9d2-62c7-4e97-99bb-d301880e31bf req-ddc9de26-0ed9-4cdc-aa07-3923f8ee6c8b service nova] Creating event network-changed:6c3880f7-29f4-4ecb-96f6-a91817391f10 for instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 on n-h1-858384-17 Oct 31 15:18:21.915997 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-58d1e9d2-62c7-4e97-99bb-d301880e31bf req-ddc9de26-0ed9-4cdc-aa07-3923f8ee6c8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052615 Oct 31 15:18:21.916834 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 286/583] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:21.924829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:21.925787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:21.934591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.935549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.936085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.936852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:21.937546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:21.938871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:21.970387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:22.048612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:22.372450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:22.380870 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c475def2-cd5c-4320-adf0-8ca6492c1494 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1307 microversion: 2.1 time: 0.461251 Oct 31 15:18:22.381500 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 287/584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:21 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:22.388580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:22.389852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:22.404444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:22.404941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:22.416566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:22.421732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:22.422524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:22.423172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:22.971614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:22.989049 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f6e12049-1159-4cce-8063-c380a1904f08 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1469 microversion: 2.1 time: 0.605642 Oct 31 15:18:22.990014 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 288/585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:22 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1469 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:22.996393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:22.997963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.006197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.007311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.008031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.008989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.010416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.011218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.303544 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e94e0eb5-bcb3-4a51-be0c-d6c9fee4a724 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72/action" status: 202 len: 0 microversion: 2.1 time: 4.574451 Oct 31 15:18:23.304175 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 298/586] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:18 2022] POST /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72/action => generated 0 bytes in 4576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:18:23.310633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.311249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.321814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.322545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.323186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.324357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.325005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.325802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.480604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:23.488843 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c763814-87ce-4f1c-8fd6-b9e848b228c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1314 microversion: 2.1 time: 0.497244 Oct 31 15:18:23.497568 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 289/587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:22 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:23.507411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.508024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.522111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.522610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.523043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.523927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.524539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.525140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.566463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:23.578399 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0aaa106-6929-4912-b65e-0cb51381fd68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1521 microversion: 2.1 time: 0.272813 Oct 31 15:18:23.579679 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 299/588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:23 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:23.593414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0d60fbea-920b-4304-a2d8-dc1bb0ed713c req-a4ed85e1-1cde-4203-aa07-332b9120214d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec22d439-86fc-48bc-a238-b9e3074d51fa", "name": "network-vif-plugged", "status": "completed", "tag": "af932539-7d08-4e92-83b1-db17d6e894a3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:23.605030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0d60fbea-920b-4304-a2d8-dc1bb0ed713c req-a4ed85e1-1cde-4203-aa07-332b9120214d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.605910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0d60fbea-920b-4304-a2d8-dc1bb0ed713c req-a4ed85e1-1cde-4203-aa07-332b9120214d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.606712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0d60fbea-920b-4304-a2d8-dc1bb0ed713c req-a4ed85e1-1cde-4203-aa07-332b9120214d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.618864 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0d60fbea-920b-4304-a2d8-dc1bb0ed713c req-a4ed85e1-1cde-4203-aa07-332b9120214d service nova] Creating event network-vif-plugged:af932539-7d08-4e92-83b1-db17d6e894a3 for instance ec22d439-86fc-48bc-a238-b9e3074d51fa on n-h2-858384-17 Oct 31 15:18:23.625188 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0d60fbea-920b-4304-a2d8-dc1bb0ed713c req-a4ed85e1-1cde-4203-aa07-332b9120214d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044085 Oct 31 15:18:23.626392 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 300/589] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:23.633486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.634435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.641872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.642637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.643293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.644171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.644788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.645452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.807418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:23.816175 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6fb54391-2cfc-467e-95ef-1ab248c7745b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.187946 Oct 31 15:18:23.819075 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 301/590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:23 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:23.825040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:23.825689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:23.831883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.832674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.833387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:23.834249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:23.835045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:23.835633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.068864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:24.081269 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2d89124-a333-4faf-8618-cc65e2bbfef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1307 microversion: 2.1 time: 0.261023 Oct 31 15:18:24.097241 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 302/591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:23 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1307 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:24.097241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:24.097241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:24.098022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.098497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.099469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.101006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.101724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.102501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.270574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:24.281821 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a9fd77f5-6702-442c-ab9e-a8c0919e1a11 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1521 microversion: 2.1 time: 0.196989 Oct 31 15:18:24.283141 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 303/592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:24 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:24.309055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e80f8146-fece-42e4-b7cf-5d4c8537522b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-981912863", "metadata": {"": ""}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e80f8146-fece-42e4-b7cf-5d4c8537522b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action HTTP/1.1 Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 106 Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:24.314735 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-981912863", "metadata": {"": ""}}} Oct 31 15:18:24.316276 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'e98382f3-c2cd-4289-964b-8ddab6df3f83', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-981912863', 'metadata': {'': ''}}}} Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'': ''} Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:24.317045 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:24.318826 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:24.320904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:24.320904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:24.320904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:18:24.320904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:18:24.320904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:24.320904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:24.320904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e80f8146-fece-42e4-b7cf-5d4c8537522b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:24.320904 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e80f8146-fece-42e4-b7cf-5d4c8537522b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action" status: 400 len: 170 microversion: 2.1 time: 0.013251 Oct 31 15:18:24.320904 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 304/593] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 31 15:18:24 2022] POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action => generated 170 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:18:24.326011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:24.326622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:24.335468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.336316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.337021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.338432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.339950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.341201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.507428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:24.519500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5ec8e762-7ac6-458d-9559-b59e3b179ee2 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1521 microversion: 2.1 time: 0.197519 Oct 31 15:18:24.520100 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 305/594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:24 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:24.606810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:24.637184 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc9fcb49-efce-4bec-96d5-c1f02c41d0af tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32" status: 200 len: 1469 microversion: 2.1 time: 1.137025 Oct 31 15:18:24.638613 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 290/595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:23 2022] GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32 => generated 1469 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:24.645508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:24.647086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:24.666835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.668361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.669343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.671183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.671934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.672552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.699647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Calling method '.version_select at 0x7f16e23d8a60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:24.702115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.702816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.703420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.719401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.720460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.721530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.733909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.734688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.735304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.742103 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce3da7e9-cb5a-4ac9-82bc-ce529765c410 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.220253 Oct 31 15:18:24.743105 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 306/596] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:18:24 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:24.747870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:24.748743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:24.751909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:24.756700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.757212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.757729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.758434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.759630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.760069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.921195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:24.929382 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d206ba4-7b48-458c-96e8-82f6603c3b05 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1521 microversion: 2.1 time: 0.185093 Oct 31 15:18:24.945785 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 307/597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:24 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:24.951457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:24.960473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:24.961786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Searching by: {'reservation_id': 'r-yd2t8x8o', 'deleted': False, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:24.968695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.969840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.970540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:24.971251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:24.971706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:24.972167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.016450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.025682 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9bd0bfd7-146f-4618-8b9f-ed13ac9b2613 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1314 microversion: 2.1 time: 0.385638 Oct 31 15:18:25.026363 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 291/598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:24 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.136046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:18:25.151565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4973321d-d30c-4478-9e71-40fb7958f96b tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] Calling method '.version_select at 0x7f16e16eeca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.153352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4973321d-d30c-4478-9e71-40fb7958f96b tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'b1fe7aa538244434889cefe22811147e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079c90cb8c2d44b5a2efe4d4ad6779d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4973321d-d30c-4478-9e71-40fb7958f96b tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] Request method failure captured: Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-hypervisors/n-h1-858384-17/search HTTP/1.1 Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-c_B_mNEADK3Bi_WO3KZxseBTNdnNuCAGK1y0sXRNuvxQ3l-HoaFP3-Au91J2y1bQwA3Ll0nY1Tn_CAUR6NvAgCAAa9y_n--bpawOew2jRTS4yTc7pZ8AiTXwhHHytLhrJ52A2Fj-SFJSFMY6UJj42YtPR9cayX8suv20Wu1Hetluk Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 079c90cb8c2d44b5a2efe4d4ad6779d1 Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907407047 Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:18:25.155030 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079c90cb8c2d44b5a2efe4d4ad6779d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_079c90cb8c2d44b5a2efe4d4ad6779d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079c90cb8c2d44b5a2efe4d4ad6779d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/079c90cb8c2d44b5a2efe4d4ad6779d1"}]}] Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1907407047 Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 079c90cb8c2d44b5a2efe4d4ad6779d1 Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907407047 Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b1fe7aa538244434889cefe22811147e Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 31 15:18:25.156343 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'n-h1-858384-17'} Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:18:25.157066 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 31 15:18:25.158770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.159915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4973321d-d30c-4478-9e71-40fb7958f96b tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:25.159915 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4973321d-d30c-4478-9e71-40fb7958f96b tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/n-h1-858384-17/search" status: 403 len: 117 microversion: 2.1 time: 0.128785 Oct 31 15:18:25.159915 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 292/599] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/os-hypervisors/n-h1-858384-17/search => generated 117 bytes in 130 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:25.163057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.163668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:25.171269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.171992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.172205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.172888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.173514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.173839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.248394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.255036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.255521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.255953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.377215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75a295da-2d87-49d4-b7c6-354c30cc6e43 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-yd2t8x8o" status: 200 len: 2931 microversion: 2.1 time: 0.429974 Oct 31 15:18:25.377825 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 308/600] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 31 15:18:24 2022] GET /compute/v2.1/servers/detail?reservation_id=r-yd2t8x8o => generated 2931 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.388969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c760fc3-5f55-454a-a467-27aa725cf00e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1346260224", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c760fc3-5f55-454a-a467-27aa725cf00e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action HTTP/1.1 Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 619 Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:25.394337 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:25.395667 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:18:25.396282 n-d-858384-17 devstack@n-api.service[120587]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1346260224", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 31 15:18:25.396282 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:25.396282 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'e98382f3-c2cd-4289-964b-8ddab6df3f83', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1346260224', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 31 15:18:25.396515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:25.397223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.399572 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.400331 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.400331 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.400331 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:18:25.400331 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:18:25.400331 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:18:25.400331 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.400777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c760fc3-5f55-454a-a467-27aa725cf00e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:25.400777 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c760fc3-5f55-454a-a467-27aa725cf00e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action" status: 400 len: 938 microversion: 2.1 time: 0.011202 Oct 31 15:18:25.400777 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 309/601] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 31 15:18:25 2022] POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action => generated 938 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:18:25.401874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.402568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:25.408897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.409415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.409853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.410589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.411106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.411535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.483371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.497199 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6cce450f-5bea-459c-9cd2-b957f979fd8f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.337494 Oct 31 15:18:25.498338 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 293/602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.503757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2fb65f6-670f-4c12-8e94-3c9c9067a9f0 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Calling method '.version_select at 0x7f16e177d430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.505871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2fb65f6-670f-4c12-8e94-3c9c9067a9f0 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.506378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2fb65f6-670f-4c12-8e94-3c9c9067a9f0 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.506805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2fb65f6-670f-4c12-8e94-3c9c9067a9f0 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.518846 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c2fb65f6-670f-4c12-8e94-3c9c9067a9f0 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2fb65f6-670f-4c12-8e94-3c9c9067a9f0 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Request method failure captured: Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-dAyy6k4rLZioLMFRNNxSrLRdlWhPqOJdtZrUaeYqPCPdIo3tfLNSEdmaR3UMUb-yXbry4eZF0KFy5lCHH0ugCBZk1PAfVDN2nkbcVnuV3wEhAf6VNJEw3HmzlkVJGUUQHLEjwQ1osOiwdDZO9q2Jm03bEu7Ed-c9bZQeriCyq0E-Y Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 2f1c29a9e52e49449a07691ca4f3ff38 Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1063631559 Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:18:25.520202 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f1c29a9e52e49449a07691ca4f3ff38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f1c29a9e52e49449a07691ca4f3ff38", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f1c29a9e52e49449a07691ca4f3ff38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f1c29a9e52e49449a07691ca4f3ff38"}]}] Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1063631559 Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 2f1c29a9e52e49449a07691ca4f3ff38 Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1063631559 Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: bb21faf5a51f430f98d13bfa77b67131 Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 15:18:25.521946 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.522792 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.524312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.524312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:25.524312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:25.524312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 31 15:18:25.524312 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.524312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2fb65f6-670f-4c12-8e94-3c9c9067a9f0 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:25.524312 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c2fb65f6-670f-4c12-8e94-3c9c9067a9f0 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.022022 Oct 31 15:18:25.524312 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 294/603] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:25.529182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.529782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:25.536613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.537347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.537947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.538643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.539255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.539681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.568475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.576142 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66ac1e8c-f4f4-48a8-bba8-17f573fbd72a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1307 microversion: 2.1 time: 0.178761 Oct 31 15:18:25.579479 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 310/604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.584076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7fc418b7-7613-4445-b7a9-5ea0575bbef4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.618045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.compute.server_groups [None req-7fc418b7-7613-4445-b7a9-5ea0575bbef4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Querying cell 0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) for 2 instances {{(pid=120587) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:18:25.619179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fc418b7-7613-4445-b7a9-5ea0575bbef4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.619677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fc418b7-7613-4445-b7a9-5ea0575bbef4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.620111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fc418b7-7613-4445-b7a9-5ea0575bbef4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.653589 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7fc418b7-7613-4445-b7a9-5ea0575bbef4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/54d02968-5863-4b5c-bfec-7539ced58c00" status: 200 len: 265 microversion: 2.1 time: 0.072803 Oct 31 15:18:25.654136 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 311/605] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/os-server-groups/54d02968-5863-4b5c-bfec-7539ced58c00 => generated 265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:25.661251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Calling method '.version_select at 0x7f16e1a95550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.663054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.663613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.664053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.680456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.680946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.681420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.692991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.693510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.693950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.696819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:25.703093 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5423ebe-efcd-41f1-b32e-9e13734a41db tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.047861 Oct 31 15:18:25.709384 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 312/606] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:25.709384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d538a7fb-4f7c-47a5-926a-4fb45db16f62 req-b336ebc3-266a-49a3-a434-0237870c0851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eae2e09-a74e-44d0-9ff9-966d56fa7a90", "name": "network-vif-plugged", "status": "completed", "tag": "dd87d55d-0615-4caa-842d-f124433f3410"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:25.720745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d538a7fb-4f7c-47a5-926a-4fb45db16f62 req-b336ebc3-266a-49a3-a434-0237870c0851 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.721256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d538a7fb-4f7c-47a5-926a-4fb45db16f62 req-b336ebc3-266a-49a3-a434-0237870c0851 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.721703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d538a7fb-4f7c-47a5-926a-4fb45db16f62 req-b336ebc3-266a-49a3-a434-0237870c0851 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.732698 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d538a7fb-4f7c-47a5-926a-4fb45db16f62 req-b336ebc3-266a-49a3-a434-0237870c0851 service nova] Creating event network-vif-plugged:dd87d55d-0615-4caa-842d-f124433f3410 for instance 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 on n-h2-858384-17 Oct 31 15:18:25.737653 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d538a7fb-4f7c-47a5-926a-4fb45db16f62 req-b336ebc3-266a-49a3-a434-0237870c0851 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032807 Oct 31 15:18:25.738416 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 313/607] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:25.743512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-654c0bc7-ad03-4cad-8496-117374af094e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.744206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-654c0bc7-ad03-4cad-8496-117374af094e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:25.751067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654c0bc7-ad03-4cad-8496-117374af094e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.751550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654c0bc7-ad03-4cad-8496-117374af094e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.751986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654c0bc7-ad03-4cad-8496-117374af094e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.752682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654c0bc7-ad03-4cad-8496-117374af094e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.753147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654c0bc7-ad03-4cad-8496-117374af094e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.753625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654c0bc7-ad03-4cad-8496-117374af094e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.850524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.859802 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6aaeb65-a5bb-43f7-b283-e3969f314484 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1521 microversion: 2.1 time: 0.335867 Oct 31 15:18:25.878986 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 295/608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.884484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf9f9851-3395-4cf9-9a2c-7b674fba33e9 tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] Calling method '.version_select at 0x7f16e177de50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.887201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bf9f9851-3395-4cf9-9a2c-7b674fba33e9 tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'b1fe7aa538244434889cefe22811147e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '079c90cb8c2d44b5a2efe4d4ad6779d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf9f9851-3395-4cf9-9a2c-7b674fba33e9 tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] Request method failure captured: Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-c_B_mNEADK3Bi_WO3KZxseBTNdnNuCAGK1y0sXRNuvxQ3l-HoaFP3-Au91J2y1bQwA3Ll0nY1Tn_CAUR6NvAgCAAa9y_n--bpawOew2jRTS4yTc7pZ8AiTXwhHHytLhrJ52A2Fj-SFJSFMY6UJj42YtPR9cayX8suv20Wu1Hetluk Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 079c90cb8c2d44b5a2efe4d4ad6779d1 Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907407047 Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:18:25.889611 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079c90cb8c2d44b5a2efe4d4ad6779d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_079c90cb8c2d44b5a2efe4d4ad6779d1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/079c90cb8c2d44b5a2efe4d4ad6779d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/079c90cb8c2d44b5a2efe4d4ad6779d1"}]}] Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1907407047 Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 079c90cb8c2d44b5a2efe4d4ad6779d1 Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907407047 Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b1fe7aa538244434889cefe22811147e Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 31 15:18:25.891205 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '1'} Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:18:25.892142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 31 15:18:25.893610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.895699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf9f9851-3395-4cf9-9a2c-7b674fba33e9 tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:25.896747 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf9f9851-3395-4cf9-9a2c-7b674fba33e9 tempest-HypervisorAdminNegativeUnderV252Test-1907407047 tempest-HypervisorAdminNegativeUnderV252Test-1907407047-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.016473 Oct 31 15:18:25.897919 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 296/609] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:25.903165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.904025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:25.911823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.912480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.913241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.914123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.914933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.915515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.929040 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-654c0bc7-ad03-4cad-8496-117374af094e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 200 len: 1622 microversion: 2.1 time: 0.189532 Oct 31 15:18:25.930216 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 314/610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 1622 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:25.938374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-549f8945-759a-487c-917c-9f231e555009 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Calling method '.version_select at 0x7f16e1d13ca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.940636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-549f8945-759a-487c-917c-9f231e555009 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.941248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-549f8945-759a-487c-917c-9f231e555009 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.941676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-549f8945-759a-487c-917c-9f231e555009 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.949964 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-549f8945-759a-487c-917c-9f231e555009 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] HTTP exception thrown: No hypervisor matching '2849f8d5-4642-4f89-89a2-448142ede760' could be found. Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-549f8945-759a-487c-917c-9f231e555009 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Request method failure captured: Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hypervisors/2849f8d5-4642-4f89-89a2-448142ede760/servers HTTP/1.1 Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-dAyy6k4rLZioLMFRNNxSrLRdlWhPqOJdtZrUaeYqPCPdIo3tfLNSEdmaR3UMUb-yXbry4eZF0KFy5lCHH0ugCBZk1PAfVDN2nkbcVnuV3wEhAf6VNJEw3HmzlkVJGUUQHLEjwQ1osOiwdDZO9q2Jm03bEu7Ed-c9bZQeriCyq0E-Y Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 2f1c29a9e52e49449a07691ca4f3ff38 Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1063631559 Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:18:25.951968 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f1c29a9e52e49449a07691ca4f3ff38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2f1c29a9e52e49449a07691ca4f3ff38", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2f1c29a9e52e49449a07691ca4f3ff38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2f1c29a9e52e49449a07691ca4f3ff38"}]}] Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1063631559 Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 2f1c29a9e52e49449a07691ca4f3ff38 Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1063631559 Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: bb21faf5a51f430f98d13bfa77b67131 Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: exception: No hypervisor matching '2849f8d5-4642-4f89-89a2-448142ede760' could be found. Oct 31 15:18:25.953596 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '2849f8d5-4642-4f89-89a2-448142ede760'} Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '2849f8d5-4642-4f89-89a2-448142ede760' could be found. Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.954391 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:25.955688 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:25.955688 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:25.955688 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:25.955688 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:25.955688 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '2849f8d5-4642-4f89-89a2-448142ede760' could be found. Oct 31 15:18:25.955688 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:25.955688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-549f8945-759a-487c-917c-9f231e555009 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] Returning 404 to user: No hypervisor matching '2849f8d5-4642-4f89-89a2-448142ede760' could be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:25.955688 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-549f8945-759a-487c-917c-9f231e555009 tempest-HypervisorAdminNegativeUnderV252Test-1063631559 tempest-HypervisorAdminNegativeUnderV252Test-1063631559-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2849f8d5-4642-4f89-89a2-448142ede760/servers" status: 404 len: 123 microversion: 2.1 time: 0.021697 Oct 31 15:18:25.955688 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 315/611] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/os-hypervisors/2849f8d5-4642-4f89-89a2-448142ede760/servers => generated 123 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:25.980627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-131fe492-456b-409e-a01a-d2789154d88e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:25.982623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-131fe492-456b-409e-a01a-d2789154d88e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:25.995408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-131fe492-456b-409e-a01a-d2789154d88e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:25.997950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-131fe492-456b-409e-a01a-d2789154d88e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:25.998521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-131fe492-456b-409e-a01a-d2789154d88e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:25.999554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-131fe492-456b-409e-a01a-d2789154d88e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.000145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-131fe492-456b-409e-a01a-d2789154d88e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.000680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-131fe492-456b-409e-a01a-d2789154d88e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.187642 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-131fe492-456b-409e-a01a-d2789154d88e tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32" status: 200 len: 1622 microversion: 2.1 time: 0.232181 Oct 31 15:18:26.189107 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 316/612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32 => generated 1622 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:26.194920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:26.195937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:26.203899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.204762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.205465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.206500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.207236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.207884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.385309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:26.395116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-91cb6ef7-5b4e-4c67-970f-609616f97229 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1314 microversion: 2.1 time: 0.204382 Oct 31 15:18:26.396590 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 317/613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:26 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:26.401455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f2287e2-d422-43c6-9323-08b88a4b296b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Action: 'create', calling method: .version_select at 0x7f16e1d13ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-654613140", "policies": ["anti-affinity"]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:26.424028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4f2287e2-d422-43c6-9323-08b88a4b296b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:26.430086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4f2287e2-d422-43c6-9323-08b88a4b296b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:26.484298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4f2287e2-d422-43c6-9323-08b88a4b296b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:26.502212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4f2287e2-d422-43c6-9323-08b88a4b296b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:26.542475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f2287e2-d422-43c6-9323-08b88a4b296b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.144567 Oct 31 15:18:26.554790 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 318/614] 10.222.0.20 () {60 vars in 1174 bytes} [Mon Oct 31 15:18:26 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:26.555194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:26.560918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:26.561937 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b5251bb-f449-4030-a36b-e1f60126c9a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1521 microversion: 2.1 time: 0.662730 Oct 31 15:18:26.579366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:26.583334 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 297/615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:25 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1521 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:26.588141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.588353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e68a83f-0981-4b44-ba82-9bf4c797c420 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:26.589010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.589682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.590609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.591225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.592097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e68a83f-0981-4b44-ba82-9bf4c797c420 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action HTTP/1.1 Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 285 Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:18:26.600563 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:18:26.602199 n-d-858384-17 devstack@n-api.service[120588]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'e98382f3-c2cd-4289-964b-8ddab6df3f83', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:18:26.603395 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:18:26.604619 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:18:26.607317 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:18:26.614108 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:18:26.614108 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:26.614108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e68a83f-0981-4b44-ba82-9bf4c797c420 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:26.614108 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e68a83f-0981-4b44-ba82-9bf4c797c420 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action" status: 400 len: 619 microversion: 2.1 time: 0.017648 Oct 31 15:18:26.614650 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 298/616] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 31 15:18:26 2022] POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:18:26.614650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:26.614650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:26.630415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.630908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.631342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.632158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.632614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.633036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.888840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:26.898037 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4d9cec6-af18-4c74-beca-bc436387fee2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.351690 Oct 31 15:18:26.898872 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 319/617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:26 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:26.919293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:26.920256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:26.928037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.928788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.929409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:26.930302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:26.930938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:26.931570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.024013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:27.044217 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-367f5d5f-6d32-4dd5-80c2-f57678dbd28b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1307 microversion: 2.1 time: 0.436499 Oct 31 15:18:27.045501 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 299/618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:26 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1307 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:27.062200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1037428549", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "da6f21db-a59f-4888-8e2c-a1d21190c934"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:27.168695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:27.222031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:27.231457 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2148507-cff8-44d2-a355-1c6162e7678c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1521 microversion: 2.1 time: 0.331372 Oct 31 15:18:27.247551 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 320/619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:26 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:27.258042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e4e4e866-d33e-48c2-a6d4-2552f39c8324 req-cc7166ee-c39e-41cd-944a-032f8d349941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c28632-29a8-4fd6-aef3-d4d5a0f22b72", "name": "network-vif-unplugged", "status": "completed", "tag": "af2dcd80-0441-41c3-887e-cb8c0720e186"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:27.270163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e4e4e866-d33e-48c2-a6d4-2552f39c8324 req-cc7166ee-c39e-41cd-944a-032f8d349941 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.270887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e4e4e866-d33e-48c2-a6d4-2552f39c8324 req-cc7166ee-c39e-41cd-944a-032f8d349941 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.271485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e4e4e866-d33e-48c2-a6d4-2552f39c8324 req-cc7166ee-c39e-41cd-944a-032f8d349941 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.284232 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e4e4e866-d33e-48c2-a6d4-2552f39c8324 req-cc7166ee-c39e-41cd-944a-032f8d349941 service nova] Creating event network-vif-unplugged:af2dcd80-0441-41c3-887e-cb8c0720e186 for instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 on n-h2-858384-17 Oct 31 15:18:27.289752 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e4e4e866-d33e-48c2-a6d4-2552f39c8324 req-cc7166ee-c39e-41cd-944a-032f8d349941 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040706 Oct 31 15:18:27.290984 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 321/620] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:27.297063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:27.298008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:27.310609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.311186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.311522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.312237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.312697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.313122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.524758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:27.538938 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8181b0f-62f0-454c-8147-135c458cb948 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1521 microversion: 2.1 time: 0.246417 Oct 31 15:18:27.547185 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 322/621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:27 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:27.565423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:27.566547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:27.575028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.575879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.576819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.580110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.581186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.582493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.676440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:27.677184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:27.677814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:27.678508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:27.679122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:27.705364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.706190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.716991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.722070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.723026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.723722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.769781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:27.776198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:27.792912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Going to run 2 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:27.796347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 152b38e0-09fd-4cb1-b1b6-0be97849d1b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:27.880117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:27.892583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:27.960760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:27.967674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:27.971942 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f50d7ad-2a36-4327-9acb-a5ed056b2b28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1314 microversion: 2.1 time: 0.423461 Oct 31 15:18:27.973204 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 323/622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:27 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:27.978644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee499ef0-1e9a-4788-b234-e690e683e035 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1650245791"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:27.981907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee499ef0-1e9a-4788-b234-e690e683e035 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:27.988343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee499ef0-1e9a-4788-b234-e690e683e035 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.989115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee499ef0-1e9a-4788-b234-e690e683e035 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.989267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:27.989934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee499ef0-1e9a-4788-b234-e690e683e035 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:27.990854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee499ef0-1e9a-4788-b234-e690e683e035 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:27.991535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee499ef0-1e9a-4788-b234-e690e683e035 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:27.992161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee499ef0-1e9a-4788-b234-e690e683e035 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.008641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:28.034403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=152b38e0-09fd-4cb1-b1b6-0be97849d1b1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:28.153850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:28.163000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:28.237321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:28.243604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'server_group_members'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:28.302698 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee499ef0-1e9a-4788-b234-e690e683e035 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action" status: 202 len: 0 microversion: 2.1 time: 0.327851 Oct 31 15:18:28.303838 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 324/623] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:27 2022] POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:18:28.311587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e7c9e9d4-088f-488e-82eb-fc38d29190d4 req-74bdb01d-bb24-4bcd-944d-15ad1288f434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f21ec1-2fb0-4adc-a4fb-c3d41643dca7", "name": "network-vif-plugged", "status": "completed", "tag": "6c3880f7-29f4-4ecb-96f6-a91817391f10"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:28.324186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e7c9e9d4-088f-488e-82eb-fc38d29190d4 req-74bdb01d-bb24-4bcd-944d-15ad1288f434 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.325195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e7c9e9d4-088f-488e-82eb-fc38d29190d4 req-74bdb01d-bb24-4bcd-944d-15ad1288f434 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.325791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e7c9e9d4-088f-488e-82eb-fc38d29190d4 req-74bdb01d-bb24-4bcd-944d-15ad1288f434 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.336681 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2408bc7f-ade7-4265-8b93-094ed3941a71 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.289672 Oct 31 15:18:28.337795 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 300/624] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 1291 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:18:28.347622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:28.348294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:28.366572 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e7c9e9d4-088f-488e-82eb-fc38d29190d4 req-74bdb01d-bb24-4bcd-944d-15ad1288f434 service nova] Creating event network-vif-plugged:6c3880f7-29f4-4ecb-96f6-a91817391f10 for instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 on n-h1-858384-17 Oct 31 15:18:28.377993 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e7c9e9d4-088f-488e-82eb-fc38d29190d4 req-74bdb01d-bb24-4bcd-944d-15ad1288f434 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072153 Oct 31 15:18:28.379598 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 325/625] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:28.380660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.381175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.381808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.385010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.385953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.388165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.404282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:28.405925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:28.450593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.452653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.453319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.455996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.461517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.462871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.797996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:28.812157 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5dcac710-9603-43a3-8cd0-46fd46f35c1f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1307 microversion: 2.1 time: 0.430505 Oct 31 15:18:28.813419 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 326/626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:28 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1307 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:28.818264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-78606618"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:28.824717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:28.836312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.837018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.837446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.838388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:28.839002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:28.841738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:28.940531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:28.949166 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ee27047a-80ec-41b1-b8a7-cb7125515bb7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.609643 Oct 31 15:18:28.949754 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 301/627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:28 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:28.969362 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Cannot 'createImage' instance e98382f3-c2cd-4289-964b-8ddab6df3f83 while it is in task_state image_snapshot Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action HTTP/1.1 Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 83 Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:28.972239 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-78606618"}} Oct 31 15:18:28.973604 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: exception: Cannot 'createImage' instance e98382f3-c2cd-4289-964b-8ddab6df3f83 while it is in task_state image_snapshot Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'e98382f3-c2cd-4289-964b-8ddab6df3f83', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-78606618'}}} Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:28.974596 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e98382f3-c2cd-4289-964b-8ddab6df3f83 while it is in task_state image_snapshot Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e98382f3-c2cd-4289-964b-8ddab6df3f83 while it is in task_state image_snapshot Oct 31 15:18:28.975710 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:28.977026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:28.978605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 409 to user: Cannot 'createImage' instance e98382f3-c2cd-4289-964b-8ddab6df3f83 while it is in task_state image_snapshot {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:28.980114 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-39dd2394-c92a-4a99-a5e6-8693eee522c1 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action" status: 409 len: 159 microversion: 2.1 time: 0.165203 Oct 31 15:18:28.983604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:28.985197 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 327/628] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:28 2022] POST /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83/action => generated 159 bytes in 171 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:18:28.987119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Searching by: {'deleted': False, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:28.991898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-642d368f-0e30-4490-9f1f-04c68c53ec4a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '.version_select at 0x7f16e17cd280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.028365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.028950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.029423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.031059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.032812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.034104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.097332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:18:29.183935 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-66bad2b5-5b8a-4fbb-b51e-a1af9ea27b4b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.231452 Oct 31 15:18:29.185455 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 302/629] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:18:28 2022] GET /compute/v2.1/servers => generated 1665 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:29.190909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.192266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.201682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.202675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.203691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.204690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.205466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.206332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.247824 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-642d368f-0e30-4490-9f1f-04c68c53ec4a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/images/aa39e1be-c3dd-4214-8651-e0ac20def10c" status: 204 len: 0 microversion: 2.1 time: 0.261004 Oct 31 15:18:29.248980 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 328/630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:28 2022] DELETE /compute/v2.1/images/aa39e1be-c3dd-4214-8651-e0ac20def10c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:29.257787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-afd613ea-5c44-4825-b817-fa7de80e2115 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.258925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-afd613ea-5c44-4825-b817-fa7de80e2115 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.337940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-afd613ea-5c44-4825-b817-fa7de80e2115 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.349858 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-afd613ea-5c44-4825-b817-fa7de80e2115 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1219 microversion: 2.1 time: 0.096595 Oct 31 15:18:29.365362 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 329/631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:29.365362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.365362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.373784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.374360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.374869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.375809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.376341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.377308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.525031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.537197 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1c09db7-5aa3-4298-a5be-6125c267f013 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1464 microversion: 2.1 time: 0.350659 Oct 31 15:18:29.549456 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 303/632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1464 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:29.550530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-08eda97a-05d9-4198-b6e3-75973bbe1ef3 req-68ac5c85-b1d9-4a36-950b-ab30a672fe0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c28632-29a8-4fd6-aef3-d4d5a0f22b72", "tag": "af2dcd80-0441-41c3-887e-cb8c0720e186"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:29.556328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.567521 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de788f4c-91a2-4893-882f-c776b4c392f7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1533 microversion: 2.1 time: 0.207601 Oct 31 15:18:29.569002 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 330/633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1533 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:29.574007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.574624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.591473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08eda97a-05d9-4198-b6e3-75973bbe1ef3 req-68ac5c85-b1d9-4a36-950b-ab30a672fe0c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.591972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08eda97a-05d9-4198-b6e3-75973bbe1ef3 req-68ac5c85-b1d9-4a36-950b-ab30a672fe0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.592411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08eda97a-05d9-4198-b6e3-75973bbe1ef3 req-68ac5c85-b1d9-4a36-950b-ab30a672fe0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.593906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.594688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.597381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.599379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.600303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.600947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.621979 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-08eda97a-05d9-4198-b6e3-75973bbe1ef3 req-68ac5c85-b1d9-4a36-950b-ab30a672fe0c service nova] Creating event network-changed:af2dcd80-0441-41c3-887e-cb8c0720e186 for instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 on n-h2-858384-17 Oct 31 15:18:29.630154 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-08eda97a-05d9-4198-b6e3-75973bbe1ef3 req-68ac5c85-b1d9-4a36-950b-ab30a672fe0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088903 Oct 31 15:18:29.630785 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 304/634] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:29.837789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.838754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.846706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:29.849156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.849867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.850402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.851347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.852022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.852678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.858066 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f28c8e5-6d43-41cc-9060-baf17c455262 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1463 microversion: 2.1 time: 0.286266 Oct 31 15:18:29.858709 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 331/635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1463 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:29.974700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:29.975301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:29.998009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:29.998505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:29.998937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:29.999649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.000094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.002280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.363908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:30.390494 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f29e158-693b-482c-a0e0-e2d3233b8039 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.419482 Oct 31 15:18:30.391109 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 332/636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:30.409979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1636920522", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ec22d439-86fc-48bc-a238-b9e3074d51fa"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:30.539004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:30.607922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:30.619194 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2bbf3b7f-53c1-47b1-954a-9b9722f542c4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1307 microversion: 2.1 time: 0.785852 Oct 31 15:18:30.629285 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 305/637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:29 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1307 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:30.671261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:30.675568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:30.695860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.697283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.699559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.700804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.704702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.705568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.833306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:30.844536 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fcd81a77-2138-43c0-9b6e-c71effb5e569 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1271 microversion: 2.1 time: 0.213824 Oct 31 15:18:30.846957 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 306/638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:30 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:30.853810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:30.856502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:30.888058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.888970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.889625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.890828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.891486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.892542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.956404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:30.956899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:30.957632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:30.959645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:30.960263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:30.980558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.981102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.981570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.982344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:30.982803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:30.983224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:30.990022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=11 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:31.038250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Getting quotas for project ac787024261942edb9505c9d989aeff2. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:31.053091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Getting quotas for user bd109e04ce664c468fd5a2a19d840c7c and project ac787024261942edb9505c9d989aeff2. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:31.072916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:31.091704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:31.198137 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9946408c-2389-4220-bfb3-e67e3f5e2caf tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802957 Oct 31 15:18:31.206942 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 333/639] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:31.215267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e5da6e1e-4c4b-4dee-9368-1072347ec522 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:31.215958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e5da6e1e-4c4b-4dee-9368-1072347ec522 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:31.227777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:31.255019 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71730138-ff07-425d-a9e6-977573daf2b3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1539 microversion: 2.1 time: 0.406783 Oct 31 15:18:31.259326 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 307/640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:30 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1539 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:31.304790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e5da6e1e-4c4b-4dee-9368-1072347ec522 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:31.313732 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e5da6e1e-4c4b-4dee-9368-1072347ec522 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1214 microversion: 2.1 time: 0.105366 Oct 31 15:18:31.319468 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 334/641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:31 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:31.419263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:31.420228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:31.432261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.437563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.442285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.443243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.443915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.444576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.502165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:31.874830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:31.884511 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b50f0a0-1c9b-4af1-b064-360ada31d949 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.469831 Oct 31 15:18:31.901346 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 335/642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:31 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:31.909775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:31.910657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:31.920324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:31.923321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.924240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.925772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.927001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:31.928175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:31.928780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:31.947297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1073600662", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "390a7fc2-64bf-4547-850c-d9842b2f402b"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:32.102733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] validate_networks() for [('390a7fc2-64bf-4547-850c-d9842b2f402b', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:32.460807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:32.471009 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3328fccd-5269-45de-8ab6-ac6e4f1484ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1487 microversion: 2.1 time: 0.567133 Oct 31 15:18:32.475238 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 336/643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:31 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1487 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:32.493184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:32.496082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:32.503475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.504071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.504638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.505696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.506233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.507127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.616614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:32.632997 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a758651-9b89-409b-a3b4-f15c2c555364 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1277 microversion: 2.1 time: 0.155101 Oct 31 15:18:32.654024 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 337/644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:32 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:32.659390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:32.660365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:32.669663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.673432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.674543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.675328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:32.675789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:32.676454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:32.960487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:32.974452 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69ac4546-8835-4cd2-b6c3-316196cc0172 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1521 microversion: 2.1 time: 0.318850 Oct 31 15:18:32.975060 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 338/645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:32 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:32.994284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:32.995708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:33.009709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.011566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.012088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.013041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.013793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.014615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.132631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:33.170353 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e269d343-0a09-4f3c-b914-63195f8ecce0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1266 microversion: 2.1 time: 0.194147 Oct 31 15:18:33.185153 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 339/646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:32 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:33.185153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13010283-e9e8-42bd-9556-2d0552616ada tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:33.217651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13010283-e9e8-42bd-9556-2d0552616ada tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.223638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13010283-e9e8-42bd-9556-2d0552616ada tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.224541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13010283-e9e8-42bd-9556-2d0552616ada tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.252334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:33.262867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:33.265014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:33.265458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:33.272946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:33.316248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.316740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.319246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.324471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.326699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.327991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.384391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-13010283-e9e8-42bd-9556-2d0552616ada tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:18:33.414833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Getting quotas for project 7742c88f9c1141b7aaadd8e3c855b075. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:33.454523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Getting quotas for user 36899fc1a6f4463a85c9dc6fd2641095 and project 7742c88f9c1141b7aaadd8e3c855b075. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:33.508785 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13010283-e9e8-42bd-9556-2d0552616ada tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7/action" status: 202 len: 0 microversion: 2.1 time: 0.335311 Oct 31 15:18:33.509893 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 340/647] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:33 2022] POST /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:18:33.519426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:33.528765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:33.540062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:33.542678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:33.569492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.571097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.571535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.572299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.574566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.577507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.676960 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-366c00f5-dfe9-420a-a5d4-6285e62bf444 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.383454 Oct 31 15:18:33.680138 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 308/648] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:33.696412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:33.699976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:33.716354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.721848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.722690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.724616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:33.730691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:33.731456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:33.815441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:33.830979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:34.038054 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a82fdee6-0648-44cb-9e75-45f358ebe081 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 204 len: 0 microversion: 2.1 time: 0.356188 Oct 31 15:18:34.038921 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 309/649] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:33 2022] DELETE /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:34.047443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.048171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.071833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.076379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.077166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.078847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.079597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.080768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.087765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.103027 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c17d54d6-23b6-4b25-8550-8ee2d89d761e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.590969 Oct 31 15:18:34.105407 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 341/650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:33 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:34.118908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.120578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.134172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.134804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.135432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.139066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.139786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.140463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.413237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.427919 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80a943a3-f213-421a-bccd-633db2cced20 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1319 microversion: 2.1 time: 0.321258 Oct 31 15:18:34.428469 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 342/651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:34.444170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9dbb351-e91c-4bfc-9911-57464c91a278 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.444983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b9dbb351-e91c-4bfc-9911-57464c91a278 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.502016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.517826 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0813d6a-01bf-4b85-ba9f-ecc8db9b75d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.473778 Oct 31 15:18:34.519030 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 310/652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:34.526507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.527527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.568958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.573293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.574461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.576661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.577881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.579008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.698644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b9dbb351-e91c-4bfc-9911-57464c91a278 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.709221 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9dbb351-e91c-4bfc-9911-57464c91a278 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1224 microversion: 2.1 time: 0.279518 Oct 31 15:18:34.715207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 343/653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1224 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:34.728445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:34.730274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:34.744582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.748654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.749110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.750237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:34.750870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:34.752019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:34.897415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.914281 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ff63bcf-d787-439b-8db5-8e540b606a2a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1527 microversion: 2.1 time: 0.393835 Oct 31 15:18:34.916290 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 311/654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1527 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:34.988960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:34.999280 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-144ff878-d79e-4215-86de-31afece27992 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1272 microversion: 2.1 time: 0.281163 Oct 31 15:18:34.999881 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 344/655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:34 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:35.132402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:35.133707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:35.142386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.145374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.148788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.150217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.150696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.151126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.314413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5e92702e-1f26-4bce-98c2-19c64fc3167d req-8bc396d5-d7b5-4f2a-919f-5b955de1aa08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "152b38e0-09fd-4cb1-b1b6-0be97849d1b1", "tag": "6bbdfe4c-560c-4c43-a6c2-cb72160fdd05"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:35.352247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5e92702e-1f26-4bce-98c2-19c64fc3167d req-8bc396d5-d7b5-4f2a-919f-5b955de1aa08 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.352881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5e92702e-1f26-4bce-98c2-19c64fc3167d req-8bc396d5-d7b5-4f2a-919f-5b955de1aa08 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.353440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5e92702e-1f26-4bce-98c2-19c64fc3167d req-8bc396d5-d7b5-4f2a-919f-5b955de1aa08 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.701547 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5e92702e-1f26-4bce-98c2-19c64fc3167d req-8bc396d5-d7b5-4f2a-919f-5b955de1aa08 service nova] Creating event network-changed:6bbdfe4c-560c-4c43-a6c2-cb72160fdd05 for instance 152b38e0-09fd-4cb1-b1b6-0be97849d1b1 on n-h2-858384-17 Oct 31 15:18:35.710587 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5e92702e-1f26-4bce-98c2-19c64fc3167d req-8bc396d5-d7b5-4f2a-919f-5b955de1aa08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.399955 Oct 31 15:18:35.711810 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 345/656] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:35.720551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:35.721883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:35.730728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.731501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.732101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.732913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.733506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.734021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.813226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:35.826423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-427881c8-8e02-4a2b-9347-121e8553a2c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.698972 Oct 31 15:18:35.826998 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 312/657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:35 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:35.846147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:35.846954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:35.862372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.862892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.863339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:35.864063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:35.864524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:35.864953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.542778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:36.554587 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3dc7b865-1536-4def-b4a2-62b548630a1d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.725694 Oct 31 15:18:36.579495 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 313/658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:35 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:36.596839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:36.612012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:36.615227 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-540565a4-7e83-4b01-9345-adb7a82d7630 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1319 microversion: 2.1 time: 0.902116 Oct 31 15:18:36.616723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:36.634803 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 346/659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:35 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1319 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:36.640285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:36.650601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.651373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.652061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.655692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:36.658732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.662064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.662732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.675066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.676757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.679230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:36.680369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:36.685039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:36.685864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.220383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:37.234841 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd678f09-c36c-4c6f-b5db-0fb25a5f4d93 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1527 microversion: 2.1 time: 0.596813 Oct 31 15:18:37.236166 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 347/660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:36 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1527 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:37.245695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.246442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.266344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.273581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.278962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.282777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.286659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.288190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.314045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:37.326951 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d95cfc62-c85a-4e3f-9993-363915c5becf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1282 microversion: 2.1 time: 0.745691 Oct 31 15:18:37.349820 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 314/661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:36 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1282 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:37.357011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.358326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.365331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.366254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.367133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.368086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.369327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.370564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.557360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:37.580253 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1e8126f-5b3a-4ff0-be6e-a2fd168f5fb0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1272 microversion: 2.1 time: 0.342551 Oct 31 15:18:37.580977 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 348/662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:37 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1272 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:37.585878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a9972fc3-cd85-4ccf-8abd-ee2a1b787a81 req-d62b2051-c6f9-4331-9acd-9bb1d813e68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98382f3-c2cd-4289-964b-8ddab6df3f83", "name": "network-vif-plugged", "status": "completed", "tag": "ed16b407-002a-4cdb-977d-bbd06aa0a782"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:37.596740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a9972fc3-cd85-4ccf-8abd-ee2a1b787a81 req-d62b2051-c6f9-4331-9acd-9bb1d813e68b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.597488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a9972fc3-cd85-4ccf-8abd-ee2a1b787a81 req-d62b2051-c6f9-4331-9acd-9bb1d813e68b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.598078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a9972fc3-cd85-4ccf-8abd-ee2a1b787a81 req-d62b2051-c6f9-4331-9acd-9bb1d813e68b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.609980 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a9972fc3-cd85-4ccf-8abd-ee2a1b787a81 req-d62b2051-c6f9-4331-9acd-9bb1d813e68b service nova] Creating event network-vif-plugged:ed16b407-002a-4cdb-977d-bbd06aa0a782 for instance e98382f3-c2cd-4289-964b-8ddab6df3f83 on n-h2-858384-17 Oct 31 15:18:37.614972 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a9972fc3-cd85-4ccf-8abd-ee2a1b787a81 req-d62b2051-c6f9-4331-9acd-9bb1d813e68b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032643 Oct 31 15:18:37.615674 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 349/663] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:37.621290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-686da0b5-0a2e-489f-905b-7b4e46c5976b req-ef38533a-6cd2-4cd9-bfc3-e2ebd2f611ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "266056a8-99ee-4881-a541-2dc01f75be2e", "tag": "835f9778-f56f-4bda-91b0-0876dc11a5b3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:37.631046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-686da0b5-0a2e-489f-905b-7b4e46c5976b req-ef38533a-6cd2-4cd9-bfc3-e2ebd2f611ab service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.631519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-686da0b5-0a2e-489f-905b-7b4e46c5976b req-ef38533a-6cd2-4cd9-bfc3-e2ebd2f611ab service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.631948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-686da0b5-0a2e-489f-905b-7b4e46c5976b req-ef38533a-6cd2-4cd9-bfc3-e2ebd2f611ab service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.644020 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-686da0b5-0a2e-489f-905b-7b4e46c5976b req-ef38533a-6cd2-4cd9-bfc3-e2ebd2f611ab service nova] Creating event network-changed:835f9778-f56f-4bda-91b0-0876dc11a5b3 for instance 266056a8-99ee-4881-a541-2dc01f75be2e on n-h1-858384-17 Oct 31 15:18:37.648869 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-686da0b5-0a2e-489f-905b-7b4e46c5976b req-ef38533a-6cd2-4cd9-bfc3-e2ebd2f611ab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031883 Oct 31 15:18:37.649495 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 350/664] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:37.655118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.656270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.662749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.663449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.663879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.664576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.665020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.665621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.811311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:37.819033 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0fa572b-25a3-448a-8626-f2eb9d8060ae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.168227 Oct 31 15:18:37.820059 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 351/665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:37 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:37.826822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:37.827422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:37.833312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.833789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.834556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:37.835301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:37.835762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:37.836174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.154873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:38.163352 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-04debfd5-e07d-494a-8530-e77489406617 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1319 microversion: 2.1 time: 0.342055 Oct 31 15:18:38.163952 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 352/666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:37 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:38.173169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d1ba3f0c-30c2-4985-916a-2d5c940f3da8 req-09630689-ce35-4460-82a6-1e7068f0e278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98382f3-c2cd-4289-964b-8ddab6df3f83", "name": "network-vif-deleted", "tag": "ed16b407-002a-4cdb-977d-bbd06aa0a782"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:38.195266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d1ba3f0c-30c2-4985-916a-2d5c940f3da8 req-09630689-ce35-4460-82a6-1e7068f0e278 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.197096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d1ba3f0c-30c2-4985-916a-2d5c940f3da8 req-09630689-ce35-4460-82a6-1e7068f0e278 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.200087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d1ba3f0c-30c2-4985-916a-2d5c940f3da8 req-09630689-ce35-4460-82a6-1e7068f0e278 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.222073 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d1ba3f0c-30c2-4985-916a-2d5c940f3da8 req-09630689-ce35-4460-82a6-1e7068f0e278 service nova] Creating event network-vif-deleted:ed16b407-002a-4cdb-977d-bbd06aa0a782 for instance e98382f3-c2cd-4289-964b-8ddab6df3f83 on n-h2-858384-17 Oct 31 15:18:38.225671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:38.234697 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d1ba3f0c-30c2-4985-916a-2d5c940f3da8 req-09630689-ce35-4460-82a6-1e7068f0e278 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069549 Oct 31 15:18:38.240482 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f0881ca-e19b-4125-b395-82f410b15ef7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.888868 Oct 31 15:18:38.240642 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 353/667] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:38.244725 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 315/668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:37 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:38.259551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:38.261370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:38.276511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.286042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.286757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.287668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.288293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.288913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.369590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.371356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.372013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.373267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lazy-loading 'fault' on Instance uuid e98382f3-c2cd-4289-964b-8ddab6df3f83 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:38.470608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:38.485716 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2cbf3fe7-b16a-420c-b1a2-0af9f4cada06 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 200 len: 1315 microversion: 2.1 time: 0.230134 Oct 31 15:18:38.486314 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 316/669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:38 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:38.490912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:38.491691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:38.510905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.511471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.511917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.512638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.513349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.514012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.528537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1684991130", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:38.615764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:38.625472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:38.638839 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f6b15b40-6764-4c28-bf69-0f3e2f40b9ab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1282 microversion: 2.1 time: 0.151111 Oct 31 15:18:38.646672 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 317/670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:38 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:38.655017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:38.656101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:38.670676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.671471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.672270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:38.673182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:38.673951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:38.674615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.296446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:39.310647 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c3908ad-ae59-4835-9a16-63c18f1701ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1314 microversion: 2.1 time: 0.662397 Oct 31 15:18:39.325159 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 318/671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:38 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:39.325159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.325159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:39.334397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.335117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.335625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.337066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.337796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.338412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.384988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:39.384988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:39.386188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:39.386446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:39.387437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:39.412508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.413258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.413893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.414660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.415133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.415561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.438401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Getting quotas for project 221a42dc77ef445d94698a737decde27. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:39.453451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Getting quotas for user 4ec0fed1db704ee89c1a0b9c83b5b010 and project 221a42dc77ef445d94698a737decde27. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:39.474018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:39.485739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:39.544350 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c68534b6-8a61-40bc-864b-4dea8b767d9a tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302520 Oct 31 15:18:39.545653 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 354/672] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:39.550653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.551624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:39.559883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.560376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.560810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.569231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.569814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.570395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.593713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:39.741953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:39.745665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:39.751324 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc6a7fdf-f2f6-4214-9b9d-7281ca430244 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1319 microversion: 2.1 time: 0.204281 Oct 31 15:18:39.755837 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07da8afe-4611-46e0-9807-59dde28ecae9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.443249 Oct 31 15:18:39.762949 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 355/673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:39.769582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.770194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:39.773177 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 319/674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:39.778048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.778853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.779417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.780014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.780524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.780900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.781628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.782243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:39.788801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.790018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.790394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.791159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.791924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.792356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.809613 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 HTTP/1.1 Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:18:39.811365 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:18:39.813018 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'e98382f3-c2cd-4289-964b-8ddab6df3f83'} Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:39.813986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:18:39.815497 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:39.816831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:39.816831 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c95c4b7-8c8e-40ee-b169-cb1e48f71860 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 404 len: 111 microversion: 2.1 time: 0.036421 Oct 31 15:18:39.821039 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 320/675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:39.827298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f237086c-8292-471a-b55d-8a805b976be0 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.827909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f237086c-8292-471a-b55d-8a805b976be0 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:39.833546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:39.914711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f237086c-8292-471a-b55d-8a805b976be0 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:39.926625 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f237086c-8292-471a-b55d-8a805b976be0 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1223 microversion: 2.1 time: 0.104186 Oct 31 15:18:39.927586 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 321/676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:39.942010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:39.947028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:39.948583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:39.953039 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-81aa1eb4-0b41-4b96-a2db-c950cd0951f8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1504 microversion: 2.1 time: 0.188622 Oct 31 15:18:39.955312 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 356/677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:39.965522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.965522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.965522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.965522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:39.965894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:39.965894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:39.978270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e339ee3e-c423-4d21-a535-64a4744675c6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'create', calling method: .version_select at 0x7f16e181d4c0>, body: {"keypair": {"name": "tempest-keypair-1844556852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWDA/m3BTyPC/JfLSv2Z0cIiBuFpLXkbdjHIhqW9T4nuGZSbCAeyGgUGT/A43cM5PIdnTfJ2YyXFEfqOx2gXOU+FuQHmi223UKsWnaN/BKAYTk5Nt1PXi6tNTptQt39mA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:40.004074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e339ee3e-c423-4d21-a535-64a4744675c6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Getting quotas for project 786fdf71bdb44504b15ae68b83e9dd41. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:40.012081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e339ee3e-c423-4d21-a535-64a4744675c6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Getting quotas for user 748f45dc720144a49ca38e9e3b185410 and project 786fdf71bdb44504b15ae68b83e9dd41. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:40.046749 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e339ee3e-c423-4d21-a535-64a4744675c6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078772 Oct 31 15:18:40.047559 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 357/678] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:18:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:40.251546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:40.262566 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1000b5a7-b345-4915-bd3c-46991d4105e6 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.332332 Oct 31 15:18:40.263528 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 322/679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:39 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:40.337826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:40.338496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:40.358021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.358523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.358956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.359670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.360138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.360567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.547449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bab03f49-92aa-4fb2-80e6-c2a2e276cc23 req-6014d567-136d-4d2a-a0bb-f52ca6ba1b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8e70ba-60c3-4268-92f5-c91ce4e6e572", "tag": "cae26543-73d8-43db-bcb0-0b345da586e5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:40.593472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bab03f49-92aa-4fb2-80e6-c2a2e276cc23 req-6014d567-136d-4d2a-a0bb-f52ca6ba1b7f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.594120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bab03f49-92aa-4fb2-80e6-c2a2e276cc23 req-6014d567-136d-4d2a-a0bb-f52ca6ba1b7f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.594813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bab03f49-92aa-4fb2-80e6-c2a2e276cc23 req-6014d567-136d-4d2a-a0bb-f52ca6ba1b7f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.634672 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bab03f49-92aa-4fb2-80e6-c2a2e276cc23 req-6014d567-136d-4d2a-a0bb-f52ca6ba1b7f service nova] Creating event network-changed:cae26543-73d8-43db-bcb0-0b345da586e5 for instance 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 on n-h2-858384-17 Oct 31 15:18:40.644687 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bab03f49-92aa-4fb2-80e6-c2a2e276cc23 req-6014d567-136d-4d2a-a0bb-f52ca6ba1b7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103373 Oct 31 15:18:40.648383 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 323/680] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:18:40.718991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:40.735233 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-88a84cb1-d2e8-42cb-abf0-0c9fffadd5d1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1314 microversion: 2.1 time: 0.401621 Oct 31 15:18:40.735744 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 358/681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:40 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:40.776086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:40.777404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:40.783777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:40.786385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:40.800217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.801863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.802762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.804135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.804374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.805964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.809248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.809839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.810132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:40.810664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:40.811203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:40.811774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.076309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.084062 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-761ac2c7-0580-4964-a747-84226e8790d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.305312 Oct 31 15:18:41.097852 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 359/682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:40 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:41.107847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.108748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:41.115358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.116079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.116707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.117622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.118262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.118849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.391069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.391705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.400418 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5901e458-708e-4ad8-8476-f68b02313eeb tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1283 microversion: 2.1 time: 0.301141 Oct 31 15:18:41.402151 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 360/683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1283 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:41.405051 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fb72cf2a-9049-43bb-8f3e-4ac2efd656a8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1319 microversion: 2.1 time: 0.633574 Oct 31 15:18:41.410985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.411880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:41.418650 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 324/684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:40 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1319 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:41.419100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.419684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.420215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.421011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.421683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.422366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.430434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.431154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:41.441536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.442005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.442473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.443239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.443805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.444292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.925350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:41.935832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c8f498d-4037-4504-87ba-a1b44886b083 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1494 microversion: 2.1 time: 0.532247 Oct 31 15:18:41.936438 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 361/685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1494 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:41.956003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:41.956994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:41.966966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.967665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.968100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:41.969099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:41.970521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:41.985775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.118325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.132208 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4046efeb-56c9-4d2d-b0ca-a1e4a43d6c4e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.711564 Oct 31 15:18:42.146602 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 325/686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:42.150384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa655c08-d6eb-40b9-bff5-00d41f013471 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '.version_select at 0x7f16e1676e50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.158404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa655c08-d6eb-40b9-bff5-00d41f013471 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.159171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa655c08-d6eb-40b9-bff5-00d41f013471 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.160024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa655c08-d6eb-40b9-bff5-00d41f013471 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.177400 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa655c08-d6eb-40b9-bff5-00d41f013471 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 402 microversion: 2.1 time: 0.032456 Oct 31 15:18:42.178469 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 326/687] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/os-migrations => generated 402 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:42.184331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.185224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:42.191700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.192200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.192637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.193716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.194186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.194615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.199873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:42.296189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.308321 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-63f6c5c6-17f4-468a-bde9-0673aac1b68a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1314 microversion: 2.1 time: 0.368616 Oct 31 15:18:42.327818 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 362/688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:41 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:42.333574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50327e21-704c-474c-8088-241c98e7a74f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.334614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-50327e21-704c-474c-8088-241c98e7a74f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:42.350181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50327e21-704c-474c-8088-241c98e7a74f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.351201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50327e21-704c-474c-8088-241c98e7a74f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.351887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50327e21-704c-474c-8088-241c98e7a74f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.352986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50327e21-704c-474c-8088-241c98e7a74f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.353756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50327e21-704c-474c-8088-241c98e7a74f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.354800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50327e21-704c-474c-8088-241c98e7a74f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.552296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.568061 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fefeaa94-0924-4f1d-b5e6-b6f37861e406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.388340 Oct 31 15:18:42.568970 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 327/689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:42.575298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.576246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:42.589604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.590538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.591189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.592017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.592567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.593078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.825980 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-50327e21-704c-474c-8088-241c98e7a74f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1647 microversion: 2.1 time: 0.496336 Oct 31 15:18:42.830658 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 363/690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1647 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:42.842385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:42.858010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:42.859423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f07c4878-dd33-48b1-afa2-302e1fa6647e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1319 microversion: 2.1 time: 0.289033 Oct 31 15:18:42.860906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:42.863343 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 328/691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:42.878420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.878420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.878420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.878420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.878966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.878966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.937830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-718da767-6bfc-4363-8298-874459a11dfa req-35582782-2444-453f-afcb-337b8e3351f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7bdeeb-cdce-44a1-929e-1d817a2b80ae", "tag": "2c55825a-fb54-4ab3-bbd2-1d30165b004b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:42.973839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-718da767-6bfc-4363-8298-874459a11dfa req-35582782-2444-453f-afcb-337b8e3351f0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:42.975352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-718da767-6bfc-4363-8298-874459a11dfa req-35582782-2444-453f-afcb-337b8e3351f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:42.976226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-718da767-6bfc-4363-8298-874459a11dfa req-35582782-2444-453f-afcb-337b8e3351f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:42.994326 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-718da767-6bfc-4363-8298-874459a11dfa req-35582782-2444-453f-afcb-337b8e3351f0 service nova] Creating event network-changed:2c55825a-fb54-4ab3-bbd2-1d30165b004b for instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae on n-h1-858384-17 Oct 31 15:18:43.009524 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-718da767-6bfc-4363-8298-874459a11dfa req-35582782-2444-453f-afcb-337b8e3351f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088886 Oct 31 15:18:43.013161 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 329/692] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:43.019335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1047559835", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "21925cce-417c-497a-868e-676a18905b25"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:43.050930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:43.064387 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4dae12bd-be13-4a00-83c1-223758cf6257 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1281 microversion: 2.1 time: 0.232292 Oct 31 15:18:43.065441 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 364/693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:42 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:43.070880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2fc06a95-b822-4b20-a9b6-ed12dfc7aa94 req-fdced35f-5124-4dbd-b153-c69ed79e3258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152b38e0-09fd-4cb1-b1b6-0be97849d1b1", "name": "network-vif-plugged", "status": "completed", "tag": "6bbdfe4c-560c-4c43-a6c2-cb72160fdd05"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:43.101532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2fc06a95-b822-4b20-a9b6-ed12dfc7aa94 req-fdced35f-5124-4dbd-b153-c69ed79e3258 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.102120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2fc06a95-b822-4b20-a9b6-ed12dfc7aa94 req-fdced35f-5124-4dbd-b153-c69ed79e3258 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.102645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2fc06a95-b822-4b20-a9b6-ed12dfc7aa94 req-fdced35f-5124-4dbd-b153-c69ed79e3258 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.109046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] validate_networks() for [('21925cce-417c-497a-868e-676a18905b25', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:43.139796 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2fc06a95-b822-4b20-a9b6-ed12dfc7aa94 req-fdced35f-5124-4dbd-b153-c69ed79e3258 service nova] Creating event network-vif-plugged:6bbdfe4c-560c-4c43-a6c2-cb72160fdd05 for instance 152b38e0-09fd-4cb1-b1b6-0be97849d1b1 on n-h2-858384-17 Oct 31 15:18:43.147063 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2fc06a95-b822-4b20-a9b6-ed12dfc7aa94 req-fdced35f-5124-4dbd-b153-c69ed79e3258 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079563 Oct 31 15:18:43.148282 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 365/694] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:43.166137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:43.169378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:43.192296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.192874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.193413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.194614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.195089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.195516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.383321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:43.842150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:43.851614 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1064cfb3-d9c5-4aed-9884-3914d47bc3bf tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.694935 Oct 31 15:18:43.852268 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 366/695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:43 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:43.860400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:43.861967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:43.868638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.869730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.870546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.871591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.872204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.873476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.943344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:43.943758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:43.944225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:43.944626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:43.945027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:43.960277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.960992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.961506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.962918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:43.963950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:43.964473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:43.983247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for project 330c65ee73534d8080c0ec2441c55f16. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:43.989523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for user 02e166a77a2c45ccab7a1f343e53542e and project 330c65ee73534d8080c0ec2441c55f16. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:44.011378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:44.015633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:44.074207 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-920bf782-54c9-4ef4-9ca9-63f4674fb204 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059449 Oct 31 15:18:44.075240 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 330/696] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:44.079942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:44.080559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:44.090344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.090840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.091280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.092301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.093193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.094888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.162404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:44.173902 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fdb5002d-c52b-4449-977f-0960cfd20a87 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1314 microversion: 2.1 time: 0.320165 Oct 31 15:18:44.187241 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 367/697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:43 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:44.200734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:44.201441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:44.209637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.210257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.210700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.211961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.213856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.214653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.257060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:44.265977 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7fe1184-7469-4bdd-975f-cff2ac8e3cae tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.189521 Oct 31 15:18:44.266918 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 331/698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:44 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:44.271935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-487675956", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:44.343287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] validate_networks() for [('b9ce60b0-eb78-46d2-9cec-4aebad5fe7ad', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:44.544121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:44.559681 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d595402-5bf5-4ff3-8335-04e3fd0de960 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1319 microversion: 2.1 time: 0.365070 Oct 31 15:18:44.563475 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 368/699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:44 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:44.581501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b37dcd5-d798-4865-88a2-dcb2715459fb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:44.583061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b37dcd5-d798-4865-88a2-dcb2715459fb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:44.878935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b37dcd5-d798-4865-88a2-dcb2715459fb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:44.896222 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b37dcd5-d798-4865-88a2-dcb2715459fb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1211 microversion: 2.1 time: 0.330814 Oct 31 15:18:44.902110 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 369/700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:44 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1211 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:44.928140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:44.933119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:44.943888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.945818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.946642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:44.948534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:44.949453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:44.950332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.184441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:45.194305 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f3db8cd-19ab-4d54-a27a-ee85d37377f9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1323 microversion: 2.1 time: 0.288038 Oct 31 15:18:45.205570 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 370/701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:44 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1323 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:45.215833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.216448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:45.224788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.231703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.232478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.233466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.234097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.234693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.564846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:45.578057 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eceb1a02-5af5-40a5-9b00-c97ce5410c9d tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.371183 Oct 31 15:18:45.578866 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 371/702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:45 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:45.593410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-da69934e-6d39-4158-bb76-dfe3539676ea req-c09fddb8-8817-478c-9851-cd99aa5c5a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "266056a8-99ee-4881-a541-2dc01f75be2e", "name": "network-vif-plugged", "status": "completed", "tag": "835f9778-f56f-4bda-91b0-0876dc11a5b3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:45.608117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:45.643552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-da69934e-6d39-4158-bb76-dfe3539676ea req-c09fddb8-8817-478c-9851-cd99aa5c5a34 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.644033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-da69934e-6d39-4158-bb76-dfe3539676ea req-c09fddb8-8817-478c-9851-cd99aa5c5a34 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.644461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-da69934e-6d39-4158-bb76-dfe3539676ea req-c09fddb8-8817-478c-9851-cd99aa5c5a34 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.668776 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-da69934e-6d39-4158-bb76-dfe3539676ea req-c09fddb8-8817-478c-9851-cd99aa5c5a34 service nova] Creating event network-vif-plugged:835f9778-f56f-4bda-91b0-0876dc11a5b3 for instance 266056a8-99ee-4881-a541-2dc01f75be2e on n-h1-858384-17 Oct 31 15:18:45.679285 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-da69934e-6d39-4158-bb76-dfe3539676ea req-c09fddb8-8817-478c-9851-cd99aa5c5a34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097316 Oct 31 15:18:45.680570 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 372/703] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:45.687197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.709514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:45.725177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.725923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.726561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.727496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.728114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.729232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.888298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:45.890279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:45.891395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:45.892043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:45.893553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:45.894065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:45.913250 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d279aaf5-8d10-4a0d-b142-ee4aaf424997 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1314 microversion: 2.1 time: 0.231285 Oct 31 15:18:45.929851 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 373/704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:45 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:45.931644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.934914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.935612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.936628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.937663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.938090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:45.938562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.938706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:45.945148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.945886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.946485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.947354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:45.948665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:45.949362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:45.978210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Getting quotas for project 786fdf71bdb44504b15ae68b83e9dd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:45.983971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Getting quotas for user 748f45dc720144a49ca38e9e3b185410 and project 786fdf71bdb44504b15ae68b83e9dd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:45.998921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:46.001270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:46.048887 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63a74945-fc44-4b82-b23c-06364a4c9f94 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.780812 Oct 31 15:18:46.065760 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 332/705] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:46.074467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.076037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.086699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.087554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.088811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.089801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.090484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.091127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.233033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.242335 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87bef51f-bacd-4741-a1cf-f4c620939344 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.311320 Oct 31 15:18:46.242931 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 374/706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:45 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.252112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8d4376d9-6da8-40c7-bc2b-f3610caa92c6 req-5b71465c-3885-48e9-a8be-2eea45d008eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92172ef0-99b7-42b9-a137-471d84265698", "tag": "8ebfd523-0a2a-4cc4-90a8-9dc8c818c1d2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:46.281384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8d4376d9-6da8-40c7-bc2b-f3610caa92c6 req-5b71465c-3885-48e9-a8be-2eea45d008eb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.281877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8d4376d9-6da8-40c7-bc2b-f3610caa92c6 req-5b71465c-3885-48e9-a8be-2eea45d008eb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.282310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8d4376d9-6da8-40c7-bc2b-f3610caa92c6 req-5b71465c-3885-48e9-a8be-2eea45d008eb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.304653 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8d4376d9-6da8-40c7-bc2b-f3610caa92c6 req-5b71465c-3885-48e9-a8be-2eea45d008eb service nova] Creating event network-changed:8ebfd523-0a2a-4cc4-90a8-9dc8c818c1d2 for instance 92172ef0-99b7-42b9-a137-471d84265698 on n-h2-858384-17 Oct 31 15:18:46.309728 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8d4376d9-6da8-40c7-bc2b-f3610caa92c6 req-5b71465c-3885-48e9-a8be-2eea45d008eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065400 Oct 31 15:18:46.310862 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 375/707] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:46.318733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.319438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.327689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.328180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.328604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.329478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.330028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.330473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.334979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:46.411744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.423544 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c06312c-8faf-41d3-b205-7bf7ee309861 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1319 microversion: 2.1 time: 0.354079 Oct 31 15:18:46.425251 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 333/708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.426894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.430856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-479d417a-5080-45cd-9705-220df618d1cc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.433909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-479d417a-5080-45cd-9705-220df618d1cc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.448174 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccc045dc-5fa4-4d05-a4a6-655198423015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1269 microversion: 2.1 time: 0.134791 Oct 31 15:18:46.449467 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 376/709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1269 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.455684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.456685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.467569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.468212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.469871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.471051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.471854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.472565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.536992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-479d417a-5080-45cd-9705-220df618d1cc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.546096 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-479d417a-5080-45cd-9705-220df618d1cc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1224 microversion: 2.1 time: 0.119560 Oct 31 15:18:46.547305 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 334/710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.606063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.607272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.616725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.618102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.619997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.622434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.623133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.623816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.708826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.722954 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6998a9f8-359a-48ec-8a94-e5f34da97d65 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1323 microversion: 2.1 time: 0.271400 Oct 31 15:18:46.743364 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 377/711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.906584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:46.914250 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df526648-eaea-440c-883e-b9d82bf59a5a tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.314802 Oct 31 15:18:46.914808 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 335/712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:46.943050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:46.943663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:46.950871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.951296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.951738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:46.952476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:46.952942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:46.953435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.090682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:47.099405 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f65def0-4698-4c0f-a527-3a386682e656 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1314 microversion: 2.1 time: 0.160355 Oct 31 15:18:47.100000 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 378/713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:46 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:47.271648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:47.272514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:47.281449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.282044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.282685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.283991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.284541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.284982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.452862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:47.454043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:47.460544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.461147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.461672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.462436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.462927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.463439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.463584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:47.472181 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c969fce-0729-4055-bbff-a1537afa3841 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.205025 Oct 31 15:18:47.472762 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 336/714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:47.492058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:47.492755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:47.499992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.500419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.500851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.501584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.502239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.502862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.612254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:47.621030 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2ab68695-d387-43be-8afd-ad7226833718 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1469 microversion: 2.1 time: 0.176161 Oct 31 15:18:47.622105 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 379/715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:47.626303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:47.626905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:47.632673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.633179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.633946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.635727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.636535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.637312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.669922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:47.678505 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-944589aa-f627-4e2a-9891-bfee4e7f68d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.204667 Oct 31 15:18:47.679162 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 337/716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:47.685848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:47.686657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 152b38e0-09fd-4cb1-b1b6-0be97849d1b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:47.693971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.694898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.695614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.696548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.697245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.698548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.740945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:47.753090 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-43d042b1-e339-4d3a-a291-366027b2d23e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1228 microversion: 2.1 time: 0.130131 Oct 31 15:18:47.756027 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 380/717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1228 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:47.765907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-29b703a7-aa9c-4861-a456-433a6a4f0e7a req-5edf67a9-2c80-42b4-9d6e-a82244539b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8e70ba-60c3-4268-92f5-c91ce4e6e572", "name": "network-vif-plugged", "status": "completed", "tag": "cae26543-73d8-43db-bcb0-0b345da586e5"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:47.779906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-29b703a7-aa9c-4861-a456-433a6a4f0e7a req-5edf67a9-2c80-42b4-9d6e-a82244539b31 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.780950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-29b703a7-aa9c-4861-a456-433a6a4f0e7a req-5edf67a9-2c80-42b4-9d6e-a82244539b31 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.781621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-29b703a7-aa9c-4861-a456-433a6a4f0e7a req-5edf67a9-2c80-42b4-9d6e-a82244539b31 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.805407 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-29b703a7-aa9c-4861-a456-433a6a4f0e7a req-5edf67a9-2c80-42b4-9d6e-a82244539b31 service nova] Creating event network-vif-plugged:cae26543-73d8-43db-bcb0-0b345da586e5 for instance 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 on n-h2-858384-17 Oct 31 15:18:47.811772 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-29b703a7-aa9c-4861-a456-433a6a4f0e7a req-5edf67a9-2c80-42b4-9d6e-a82244539b31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054234 Oct 31 15:18:47.812911 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 381/718] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:47.818712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:47.819987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:47.826817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.827606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.828245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.830191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:47.830674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:47.831281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:47.965529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:47.990196 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-37d3982c-41cc-4749-a815-882828511abd tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1" status: 200 len: 1467 microversion: 2.1 time: 0.308896 Oct 31 15:18:47.992033 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 338/719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1 => generated 1467 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.002388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.003292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.014528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.015018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.015595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.016298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.016760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.017185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.202290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.212118 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db12581b-72b3-4c58-a3c5-a54e5c145dec tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1323 microversion: 2.1 time: 0.397971 Oct 31 15:18:48.212959 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 382/720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.229414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.234873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.236005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Searching by: {'reservation_id': 'r-gje9pof0', 'deleted': False, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:48.236950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.241678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.242756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.243234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.244753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.245577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.246126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.246460 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7bdbbce8-7e09-4926-9f2e-fa2d9feeec24 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.253138 Oct 31 15:18:48.247049 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 339/721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:47 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.252375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.252981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.259055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.259469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.260999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.261807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.262269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.262683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.346430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:18:48.422527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.429628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.430112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.430555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.466812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.476656 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e3f4416-adae-49ea-b2f4-dfe299054c84 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1314 microversion: 2.1 time: 0.228433 Oct 31 15:18:48.485217 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 340/722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.501878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.502590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.509446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.510117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.510626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.511501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.512095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.512612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.620886 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-63bd95c9-432e-428a-9836-b1bbeb8f98b8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-gje9pof0" status: 200 len: 2929 microversion: 2.1 time: 0.405937 Oct 31 15:18:48.625178 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 383/723] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/detail?reservation_id=r-gje9pof0 => generated 2929 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.652330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a7ed270-e57e-42d9-90b5-03d4592ccb37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.669492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.compute.server_groups [None req-5a7ed270-e57e-42d9-90b5-03d4592ccb37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Querying cell 0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) for 2 instances {{(pid=120587) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:18:48.670268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a7ed270-e57e-42d9-90b5-03d4592ccb37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.670823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a7ed270-e57e-42d9-90b5-03d4592ccb37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.671314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a7ed270-e57e-42d9-90b5-03d4592ccb37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.693916 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5a7ed270-e57e-42d9-90b5-03d4592ccb37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/da6f21db-a59f-4888-8e2c-a1d21190c934" status: 200 len: 270 microversion: 2.1 time: 0.045947 Oct 31 15:18:48.700909 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 384/724] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/os-server-groups/da6f21db-a59f-4888-8e2c-a1d21190c934 => generated 270 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:48.704583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.705513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.713286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.714181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.715428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.715428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.716203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.716641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.761612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.776229 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7d550d3-eeb2-4223-8394-fdb156b4db38 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.277641 Oct 31 15:18:48.793268 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 341/725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.798582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b079122a-a50d-4ca7-8b5f-faedb456046c tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.800467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b079122a-a50d-4ca7-8b5f-faedb456046c tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:48.809793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b079122a-a50d-4ca7-8b5f-faedb456046c tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.815240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b079122a-a50d-4ca7-8b5f-faedb456046c tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.815983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b079122a-a50d-4ca7-8b5f-faedb456046c tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.817000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b079122a-a50d-4ca7-8b5f-faedb456046c tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.818230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b079122a-a50d-4ca7-8b5f-faedb456046c tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.818756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b079122a-a50d-4ca7-8b5f-faedb456046c tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.929585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:48.939674 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1321ab6a-bb7b-4ab6-8c3f-8e2b46441be1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.240178 Oct 31 15:18:48.953268 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 385/726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:48.953268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0a12b575-eb29-45b6-958b-6ce1af483e9b req-6d58dec1-6c77-409b-b15f-a0c92abde590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112e7afd-0280-4245-8d39-46c540af14e2", "tag": "716e0d1b-2fef-4c26-a4d6-5c354e43d8eb"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:48.959505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0a12b575-eb29-45b6-958b-6ce1af483e9b req-6d58dec1-6c77-409b-b15f-a0c92abde590 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:48.960303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0a12b575-eb29-45b6-958b-6ce1af483e9b req-6d58dec1-6c77-409b-b15f-a0c92abde590 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:48.961525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0a12b575-eb29-45b6-958b-6ce1af483e9b req-6d58dec1-6c77-409b-b15f-a0c92abde590 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:48.979110 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0a12b575-eb29-45b6-958b-6ce1af483e9b req-6d58dec1-6c77-409b-b15f-a0c92abde590 service nova] Creating event network-changed:716e0d1b-2fef-4c26-a4d6-5c354e43d8eb for instance 112e7afd-0280-4245-8d39-46c540af14e2 on n-h2-858384-17 Oct 31 15:18:48.985383 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0a12b575-eb29-45b6-958b-6ce1af483e9b req-6d58dec1-6c77-409b-b15f-a0c92abde590 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043169 Oct 31 15:18:48.986594 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 386/727] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:48.992989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:48.995547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:49.004034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.004528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.004989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.005870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.006891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.007317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.073890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:49.082674 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-519cca26-44a5-4363-92ba-650729647184 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1276 microversion: 2.1 time: 0.094704 Oct 31 15:18:49.084011 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 387/728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:49.133274 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b079122a-a50d-4ca7-8b5f-faedb456046c tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 200 len: 1622 microversion: 2.1 time: 0.339698 Oct 31 15:18:49.134214 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 342/729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:48 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 1622 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:49.157786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41a21d64-94c0-47fe-884c-ba4a65352d38 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.158437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41a21d64-94c0-47fe-884c-ba4a65352d38 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] [instance: 152b38e0-09fd-4cb1-b1b6-0be97849d1b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:49.164540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a21d64-94c0-47fe-884c-ba4a65352d38 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.165287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a21d64-94c0-47fe-884c-ba4a65352d38 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.165932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a21d64-94c0-47fe-884c-ba4a65352d38 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.166858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a21d64-94c0-47fe-884c-ba4a65352d38 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.167476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a21d64-94c0-47fe-884c-ba4a65352d38 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.168099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a21d64-94c0-47fe-884c-ba4a65352d38 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.236054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.237364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:49.243606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.245578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.246275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.247472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.248137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.248759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.465081 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41a21d64-94c0-47fe-884c-ba4a65352d38 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1" status: 200 len: 1620 microversion: 2.1 time: 0.311269 Oct 31 15:18:49.465716 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 388/730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:49 2022] GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1 => generated 1620 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:49.485153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.485776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:49.493740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.494274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.494719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.495788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.496287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.496723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.519740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:49.528754 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-972b4c01-5c69-4de6-9011-7d8162ee0607 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1323 microversion: 2.1 time: 0.296429 Oct 31 15:18:49.529699 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 343/731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:49 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1323 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:49.550112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.550905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:49.557652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.558358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.558901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.560098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.560225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.560782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.703904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:49.712500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c78a8012-afc1-41e8-9f7c-442c77549e99 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.245754 Oct 31 15:18:49.713587 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 389/732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:49 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:49.718189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1392119259", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "6f6d49c8-10cb-4bbd-a978-69db51f46d2b"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:49.781608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:49.799449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:49.808529 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c5c83d02-b5de-44ef-ac41-8572a8b814d6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1314 microversion: 2.1 time: 0.265647 Oct 31 15:18:49.809361 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 344/733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:49 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:49.813884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:49.814919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:49.821529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.821939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.823174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:49.823973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:49.824529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:49.825044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.048738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:50.058853 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a754a40-fd94-41a2-afe1-489bc3f48e5a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.248172 Oct 31 15:18:50.059384 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 345/734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:49 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:50.064729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:50.065374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:50.071833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.073373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.074142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.075070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.075704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.076290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.308822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:50.314547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:50.320146 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c75749cb-2580-4fb9-82ba-6deca0ead77c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.259391 Oct 31 15:18:50.333584 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 346/735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:50 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:50.337375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:50.338939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:50.345585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.346281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.346724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.347719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.350144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.350593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.488961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:50.491767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:50.494668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:50.496925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:50.499086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:50.514211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.515026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.516070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.517450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.518100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.519081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.550856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:50.573024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:50.587153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:50.602924 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f106a1a9-acde-4b30-bbe4-eacc65d5a30b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1324 microversion: 2.1 time: 0.280990 Oct 31 15:18:50.603557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:50.604361 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 347/736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:50 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:50.606476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:50.609715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:50.615562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:50.626141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.628659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.629284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.630118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.632457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.633008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.686974 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d5d47b7-bd10-4764-80ff-41ea69dc5bf4 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972294 Oct 31 15:18:50.688756 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 390/737] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:50.700684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f235c98a-5c10-4065-bc58-2beef335b2f6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:50.701697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f235c98a-5c10-4065-bc58-2beef335b2f6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:50.808406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f235c98a-5c10-4065-bc58-2beef335b2f6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:50.819059 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f235c98a-5c10-4065-bc58-2beef335b2f6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1217 microversion: 2.1 time: 0.123777 Oct 31 15:18:50.820761 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 391/738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:50 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:50.827359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:50.828029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:50.835564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.836067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.836508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:50.837427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:50.839463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:50.844888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.010377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.020069 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7439d51b-aeaf-4cf2-b78e-70fbaa93de89 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1323 microversion: 2.1 time: 0.414197 Oct 31 15:18:51.023170 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 348/739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:50 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1323 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.037813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.038839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:51.044964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.056568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.057422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.058704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.058846 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fbf0f687-6751-4964-91f5-015e5fc0a759 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.236280 Oct 31 15:18:51.059666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.060407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.061099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.067207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 392/740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:50 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.082142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4075f6ee-5621-4e2d-a2dd-2d8c2a7a10ca req-f11e85e8-437e-4037-bc71-55f8b38aba66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7bdeeb-cdce-44a1-929e-1d817a2b80ae", "name": "network-vif-plugged", "status": "completed", "tag": "2c55825a-fb54-4ab3-bbd2-1d30165b004b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:51.100070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4075f6ee-5621-4e2d-a2dd-2d8c2a7a10ca req-f11e85e8-437e-4037-bc71-55f8b38aba66 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.100672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4075f6ee-5621-4e2d-a2dd-2d8c2a7a10ca req-f11e85e8-437e-4037-bc71-55f8b38aba66 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.101250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4075f6ee-5621-4e2d-a2dd-2d8c2a7a10ca req-f11e85e8-437e-4037-bc71-55f8b38aba66 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.124610 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4075f6ee-5621-4e2d-a2dd-2d8c2a7a10ca req-f11e85e8-437e-4037-bc71-55f8b38aba66 service nova] Creating event network-vif-plugged:2c55825a-fb54-4ab3-bbd2-1d30165b004b for instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae on n-h1-858384-17 Oct 31 15:18:51.136259 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4075f6ee-5621-4e2d-a2dd-2d8c2a7a10ca req-f11e85e8-437e-4037-bc71-55f8b38aba66 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067279 Oct 31 15:18:51.137602 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 393/741] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:51.156028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.157441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:51.187558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.190014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.190687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.191630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.193870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.195456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.392375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.400604 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-efa3e244-2bc8-4702-90fe-879cd8d01fcd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.261268 Oct 31 15:18:51.401429 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 394/742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.406498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.407316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:51.414135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.414752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.415190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.416212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.417002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.417270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.538849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.547936 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-efb81c37-4122-4e3c-b29f-3e6bc8542969 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1464 microversion: 2.1 time: 0.522026 Oct 31 15:18:51.551269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.554627 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 349/743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1464 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.559920 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef93e7ef-46e0-487b-af3c-e35db6696f65 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.157708 Oct 31 15:18:51.568663 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 395/744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.626232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.627103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:51.633352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.634112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.634704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.635519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.636070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.636587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.642825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:51.714775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9918253e-444b-4c3b-9767-fbb01a7a9846 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.720050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9918253e-444b-4c3b-9767-fbb01a7a9846 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Searching by: {'deleted': False, 'project_id': '7a8aad0794c24edab5f2efea3e0f7516'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:51.726320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9918253e-444b-4c3b-9767-fbb01a7a9846 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.726799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9918253e-444b-4c3b-9767-fbb01a7a9846 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.727386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9918253e-444b-4c3b-9767-fbb01a7a9846 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.728985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9918253e-444b-4c3b-9767-fbb01a7a9846 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.729625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9918253e-444b-4c3b-9767-fbb01a7a9846 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.730042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9918253e-444b-4c3b-9767-fbb01a7a9846 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.783489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.791388 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-40021ba4-554f-4871-82d4-b8ce48e5457a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1324 microversion: 2.1 time: 0.168792 Oct 31 15:18:51.792191 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 396/745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:51.826477 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9918253e-444b-4c3b-9767-fbb01a7a9846 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.250190 Oct 31 15:18:51.827394 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 350/746] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:18:51.846736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.847924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:51.851111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:51.854600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.855163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.855665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.856437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.856565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Searching by: {'deleted': False} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:51.857009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.857536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.862034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.862512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.862926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.863663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.864094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.864512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:51.948286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:51.957588 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dde13b13-3b24-4ee6-a5f4-fef21e0098e3 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1221 microversion: 2.1 time: 0.115014 Oct 31 15:18:51.958805 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 397/747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:51.985661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c5668426-5948-4606-b20a-12f1c44ffb79 req-dee636ff-168c-4a3c-b7f9-3023ffb85b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de28ff5-937b-433f-831c-c8c899fc3b79", "tag": "c0a49432-5df0-4d35-9176-f53f1d0aa323"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:51.993492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Listed batch of 16 results from cell out of 1000 limit. Returned 16 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:18:51.997236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c5668426-5948-4606-b20a-12f1c44ffb79 req-dee636ff-168c-4a3c-b7f9-3023ffb85b95 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:51.997677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c5668426-5948-4606-b20a-12f1c44ffb79 req-dee636ff-168c-4a3c-b7f9-3023ffb85b95 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:51.998114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c5668426-5948-4606-b20a-12f1c44ffb79 req-dee636ff-168c-4a3c-b7f9-3023ffb85b95 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.012699 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c5668426-5948-4606-b20a-12f1c44ffb79 req-dee636ff-168c-4a3c-b7f9-3023ffb85b95 service nova] Creating event network-changed:c0a49432-5df0-4d35-9176-f53f1d0aa323 for instance 0de28ff5-937b-433f-831c-c8c899fc3b79 on n-h2-858384-17 Oct 31 15:18:52.022866 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c5668426-5948-4606-b20a-12f1c44ffb79 req-dee636ff-168c-4a3c-b7f9-3023ffb85b95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041569 Oct 31 15:18:52.026842 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 398/748] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:52.050343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.050950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:52.057895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.058291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.058727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.059431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.059885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.060372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.084170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=45 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:52.105985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.106873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.107475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.211237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:52.223005 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d2ac86e-1c92-4388-bb44-b18848202446 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1323 microversion: 2.1 time: 0.176740 Oct 31 15:18:52.223613 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 399/749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:52 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1323 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:52.228942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.229956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:52.236283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.236930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.237658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.238666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.239695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.240269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.383132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:52.391659 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da00dfae-7533-4524-b896-4f49f747b481 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.167061 Oct 31 15:18:52.392379 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 400/750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:52 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:52.424365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.425069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:52.431419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.431990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.432435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.433228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.433865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.434304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.571994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:52.586378 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b4f8a3e6-cf40-4479-be42-5b92e16dda33 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.166022 Oct 31 15:18:52.586980 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 401/751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:52 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:52.592750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.593524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:52.599849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.600338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.600772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.601486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.601946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.602378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.617260 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4699920c-4b2c-4686-8bcd-64131ec88fbc tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 25207 microversion: 2.1 time: 0.770989 Oct 31 15:18:52.618642 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 351/752] 10.222.0.20 () {58 vars in 1171 bytes} [Mon Oct 31 15:18:51 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 25207 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:18:52.623921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.624520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:52.630591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.631155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.631665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.632439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.632969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.633661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.660449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:52.746412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:52.751104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:52.758407 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-890b2b6c-1485-43e8-aded-18ef0bcf057b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.169702 Oct 31 15:18:52.760962 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 402/753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:52 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:52.766707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45c8a7bf-a3c4-4ec3-9b0b-92b70ab54c39 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.767754 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54924216-1b9e-4839-9f91-90c124af2639 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 204 len: 0 microversion: 2.1 time: 0.147045 Oct 31 15:18:52.768340 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 352/754] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:52 2022] DELETE /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:52.773184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-45c8a7bf-a3c4-4ec3-9b0b-92b70ab54c39 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Searching by: {'deleted': False, 'project_id': '7a8aad0794c24edab5f2efea3e0f7516'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:52.782240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c8a7bf-a3c4-4ec3-9b0b-92b70ab54c39 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.782823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c8a7bf-a3c4-4ec3-9b0b-92b70ab54c39 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.783328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c8a7bf-a3c4-4ec3-9b0b-92b70ab54c39 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.784305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c8a7bf-a3c4-4ec3-9b0b-92b70ab54c39 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.784736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c8a7bf-a3c4-4ec3-9b0b-92b70ab54c39 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.785282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c8a7bf-a3c4-4ec3-9b0b-92b70ab54c39 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.794590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.797924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:52.811358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.811818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.812287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.813065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.813605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.814122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.906270 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45c8a7bf-a3c4-4ec3-9b0b-92b70ab54c39 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=ac787024261942edb9505c9d989aeff2" status: 200 len: 15 microversion: 2.1 time: 0.143896 Oct 31 15:18:52.907174 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 403/755] 10.222.0.20 () {58 vars in 1231 bytes} [Mon Oct 31 15:18:52 2022] GET /compute/v2.1/servers/detail?tenant_id=ac787024261942edb9505c9d989aeff2 => generated 15 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:18:52.911735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:52.912505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:52.919693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.920184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.920624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.921387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:52.921850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:52.922363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:52.992698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.001539 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3bf101c6-ffbe-416d-bdc8-82cf4264fd05 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1711 microversion: 2.1 time: 0.216773 Oct 31 15:18:53.002137 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 353/756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:52 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1711 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:53.006519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.012804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Searching by: {'tenant_id': 'ac787024261942edb9505c9d989aeff2', 'deleted': False} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:53.017679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.018158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.018592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.019369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.019768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.020205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.051005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:18:53.060759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.068645 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a77992a5-4491-4bdb-9141-f17340233cc3 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1324 microversion: 2.1 time: 0.160501 Oct 31 15:18:53.069251 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 404/757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:52 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1324 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:53.073905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.074461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.080007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.080491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.080925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.081635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.082110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.082528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.128366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.128851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.129313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.150155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.158833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c6b8dae-fc30-4d5c-b451-162910166b69 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1287 microversion: 2.1 time: 0.088604 Oct 31 15:18:53.159421 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 405/758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:53.175342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c5eefe6a-692c-4828-8084-232c9cc1ffa2 req-b8d45091-2359-4e32-8b52-e8b73643aa13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92172ef0-99b7-42b9-a137-471d84265698", "name": "network-vif-plugged", "status": "completed", "tag": "8ebfd523-0a2a-4cc4-90a8-9dc8c818c1d2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:53.185569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c5eefe6a-692c-4828-8084-232c9cc1ffa2 req-b8d45091-2359-4e32-8b52-e8b73643aa13 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.186069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c5eefe6a-692c-4828-8084-232c9cc1ffa2 req-b8d45091-2359-4e32-8b52-e8b73643aa13 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.186499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c5eefe6a-692c-4828-8084-232c9cc1ffa2 req-b8d45091-2359-4e32-8b52-e8b73643aa13 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.198193 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c5eefe6a-692c-4828-8084-232c9cc1ffa2 req-b8d45091-2359-4e32-8b52-e8b73643aa13 service nova] Creating event network-vif-plugged:8ebfd523-0a2a-4cc4-90a8-9dc8c818c1d2 for instance 92172ef0-99b7-42b9-a137-471d84265698 on n-h2-858384-17 Oct 31 15:18:53.203421 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c5eefe6a-692c-4828-8084-232c9cc1ffa2 req-b8d45091-2359-4e32-8b52-e8b73643aa13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031820 Oct 31 15:18:53.204017 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 406/759] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:53.239632 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a47b93a-e405-4d00-9ede-b85999c2e2df tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ac787024261942edb9505c9d989aeff2" status: 200 len: 4833 microversion: 2.1 time: 0.236438 Oct 31 15:18:53.240235 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 354/760] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ac787024261942edb9505c9d989aeff2 => generated 4833 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:53.247929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.248711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.254847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.255412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.255913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.256690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.257237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.257658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.266922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef7876b4-22a2-43c2-9dc7-6f2ced59bc2a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.272780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ef7876b4-22a2-43c2-9dc7-6f2ced59bc2a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Searching by: {'tenant_id': '7a8aad0794c24edab5f2efea3e0f7516', 'deleted': False} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:53.278151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef7876b4-22a2-43c2-9dc7-6f2ced59bc2a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.278625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef7876b4-22a2-43c2-9dc7-6f2ced59bc2a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.279083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef7876b4-22a2-43c2-9dc7-6f2ced59bc2a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.279785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef7876b4-22a2-43c2-9dc7-6f2ced59bc2a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.280228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef7876b4-22a2-43c2-9dc7-6f2ced59bc2a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.280638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef7876b4-22a2-43c2-9dc7-6f2ced59bc2a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.307580 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef7876b4-22a2-43c2-9dc7-6f2ced59bc2a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7a8aad0794c24edab5f2efea3e0f7516" status: 200 len: 15 microversion: 2.1 time: 0.044231 Oct 31 15:18:53.308333 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 355/761] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7a8aad0794c24edab5f2efea3e0f7516 => generated 15 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:18:53.330930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-966ee645-f8f1-454f-99d0-104e27d3bb97 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.335886 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-966ee645-f8f1-454f-99d0-104e27d3bb97 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008740 Oct 31 15:18:53.336683 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 356/762] 10.222.0.20 () {58 vars in 1189 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:18:53.358248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a92919aa-698a-4aa0-913a-d0b0925f1ae7 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:53.360407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a92919aa-698a-4aa0-913a-d0b0925f1ae7 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.366308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a92919aa-698a-4aa0-913a-d0b0925f1ae7 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.366785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a92919aa-698a-4aa0-913a-d0b0925f1ae7 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.367216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a92919aa-698a-4aa0-913a-d0b0925f1ae7 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.367901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a92919aa-698a-4aa0-913a-d0b0925f1ae7 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.368347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a92919aa-698a-4aa0-913a-d0b0925f1ae7 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.368759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a92919aa-698a-4aa0-913a-d0b0925f1ae7 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.390991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.399273 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-affb3b0e-64e5-4e9c-aa4c-7d8717112d0f tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1323 microversion: 2.1 time: 0.155567 Oct 31 15:18:53.400013 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 407/763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1323 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:53.415902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.416512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.422410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.422902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.423338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.424042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.424550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.424974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.442510 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a92919aa-698a-4aa0-913a-d0b0925f1ae7 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action" status: 202 len: 0 microversion: 2.1 time: 0.087904 Oct 31 15:18:53.446145 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 357/764] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:53 2022] POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:18:53.451703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.456540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.457267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'ac787024261942edb9505c9d989aeff2'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:53.462243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.462839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.463185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.463903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.464352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.464768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.549661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:18:53.555315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.563788 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce2cdc22-2699-4b95-909d-8256346d3fdd tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1324 microversion: 2.1 time: 0.151650 Oct 31 15:18:53.564590 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 408/765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1324 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:53.607619 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d83679b2-1837-42cd-9291-5fae309e9165 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.160215 Oct 31 15:18:53.608130 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 358/766] 10.222.0.20 () {58 vars in 1150 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:53.609808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.610421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.616401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.616886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.617344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.618040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.618496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.619488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.619604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da36f44b-056f-4f26-9333-3da34ab59a86 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:53.621800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da36f44b-056f-4f26-9333-3da34ab59a86 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.627544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da36f44b-056f-4f26-9333-3da34ab59a86 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.628021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da36f44b-056f-4f26-9333-3da34ab59a86 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.628448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da36f44b-056f-4f26-9333-3da34ab59a86 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.629154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da36f44b-056f-4f26-9333-3da34ab59a86 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.629606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da36f44b-056f-4f26-9333-3da34ab59a86 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.630021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da36f44b-056f-4f26-9333-3da34ab59a86 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.692947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:53.702561 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da36f44b-056f-4f26-9333-3da34ab59a86 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action" status: 202 len: 0 microversion: 2.1 time: 0.086863 Oct 31 15:18:53.703272 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 359/767] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:53 2022] POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:18:53.711649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5a62ff6-110b-4e20-9e09-510210116aca tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.712253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5a62ff6-110b-4e20-9e09-510210116aca tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.719013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a62ff6-110b-4e20-9e09-510210116aca tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.719497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a62ff6-110b-4e20-9e09-510210116aca tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.719927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a62ff6-110b-4e20-9e09-510210116aca tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.720610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a62ff6-110b-4e20-9e09-510210116aca tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.721058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a62ff6-110b-4e20-9e09-510210116aca tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.721500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a62ff6-110b-4e20-9e09-510210116aca tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.757840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.766973 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09b1de5a-f141-4dcb-b37d-32edad3adb61 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.160954 Oct 31 15:18:53.767596 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 409/768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:53.786006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.786611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.792837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.793391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.793828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.794578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.795038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.795457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.855820 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5a62ff6-110b-4e20-9e09-510210116aca tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1616 microversion: 2.1 time: 0.148336 Oct 31 15:18:53.856648 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 360/769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1616 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:53.878371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-35848224-2cf2-4d80-aeb8-ec10d9469f35 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:53.878971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-35848224-2cf2-4d80-aeb8-ec10d9469f35 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:53.885666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35848224-2cf2-4d80-aeb8-ec10d9469f35 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.886147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35848224-2cf2-4d80-aeb8-ec10d9469f35 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.886574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35848224-2cf2-4d80-aeb8-ec10d9469f35 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.887257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35848224-2cf2-4d80-aeb8-ec10d9469f35 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:53.887701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35848224-2cf2-4d80-aeb8-ec10d9469f35 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:53.888111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35848224-2cf2-4d80-aeb8-ec10d9469f35 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:53.927832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:53.935838 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9dbbfef0-634e-4b97-8ad4-b30f5a4ca78f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.153620 Oct 31 15:18:53.936419 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 410/770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:54.016745 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-35848224-2cf2-4d80-aeb8-ec10d9469f35 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1616 microversion: 2.1 time: 0.141853 Oct 31 15:18:54.029155 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 361/771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:53 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1616 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.029360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.029360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.035263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:54.040734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.043201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.044493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.045961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.048716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.053605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Searching by: {'host': 'n-h2-858384-17', 'deleted': False} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:54.054336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.054899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.060602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.061155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.061633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.063363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.063910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.064345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.187368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:18:54.251053 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ded54d49-f989-4257-bcb1-ca79f0aeb0e1 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=n-h2-858384-17&all_tenants=1" status: 200 len: 2644 microversion: 2.1 time: 0.211564 Oct 31 15:18:54.251661 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 362/772] 10.222.0.20 () {58 vars in 1192 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers?host=n-h2-858384-17&all_tenants=1 => generated 2644 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.256213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.256811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.264370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.264850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.265306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.266002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.266448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.266866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.362404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:54.372973 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e654836-2a43-4b2f-8768-ae1725e82fb2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1711 microversion: 2.1 time: 0.349923 Oct 31 15:18:54.377566 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 411/773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1711 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.382395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.383751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.391696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.392569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.393202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.393977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.394503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.394991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.448023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:54.455673 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf12f6cc-7747-4161-bec7-21fed9e55800 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1324 microversion: 2.1 time: 0.203050 Oct 31 15:18:54.456255 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 363/774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.460445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a50991dc-9339-41e9-a8f8-a47255f445be tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.466903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a50991dc-9339-41e9-a8f8-a47255f445be tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:18:54.469003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:54.471955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50991dc-9339-41e9-a8f8-a47255f445be tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.472436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50991dc-9339-41e9-a8f8-a47255f445be tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.472866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50991dc-9339-41e9-a8f8-a47255f445be tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.473619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50991dc-9339-41e9-a8f8-a47255f445be tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.474076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50991dc-9339-41e9-a8f8-a47255f445be tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.474496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50991dc-9339-41e9-a8f8-a47255f445be tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.479490 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b32f2f0d-3b97-443b-a4e6-c492750f023f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1275 microversion: 2.1 time: 0.099853 Oct 31 15:18:54.480448 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 412/775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.486787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.487871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.495174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.495935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.496614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.497602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.498160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.498662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.503441 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a50991dc-9339-41e9-a8f8-a47255f445be tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.046121 Oct 31 15:18:54.504195 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 364/776] 10.222.0.20 () {58 vars in 1196 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:18:54.531697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-367c5a39-47dc-4a73-bd31-9e7a7d3fa38a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:54.534989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-367c5a39-47dc-4a73-bd31-9e7a7d3fa38a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.543381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367c5a39-47dc-4a73-bd31-9e7a7d3fa38a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.544168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367c5a39-47dc-4a73-bd31-9e7a7d3fa38a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.544832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367c5a39-47dc-4a73-bd31-9e7a7d3fa38a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.545750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367c5a39-47dc-4a73-bd31-9e7a7d3fa38a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.546208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367c5a39-47dc-4a73-bd31-9e7a7d3fa38a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.546762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-367c5a39-47dc-4a73-bd31-9e7a7d3fa38a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.637950 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-367c5a39-47dc-4a73-bd31-9e7a7d3fa38a tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action" status: 202 len: 0 microversion: 2.1 time: 0.115055 Oct 31 15:18:54.639010 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 365/777] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:54 2022] POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:18:54.646183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.647071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.657765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.658263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.658700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.659443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.659893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.660331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.799315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:54.812409 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e19108b9-3340-4f70-a54a-5a2e07f042d9 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1323 microversion: 2.1 time: 0.330096 Oct 31 15:18:54.813076 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 413/778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.817773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:54.820563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.842316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.842816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.843311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.848894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.849561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.850013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.894073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:54.904272 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7df48e7d-f168-49a9-a3ec-6305ad90a769 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1520 microversion: 2.1 time: 0.264039 Oct 31 15:18:54.917856 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 366/779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:54.929222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:54.929906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:54.937383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.938120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.938741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.939459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:54.940319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:54.940319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:54.956490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:54.979193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:54.980494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:54.989956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:54.990323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:54.990742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:55.114239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:55.137660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.138270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.138731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.139492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.139958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.140388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.196017 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d954696-fcd4-4ab4-a26c-023a522af57b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action" status: 202 len: 1067 microversion: 2.1 time: 0.381839 Oct 31 15:18:55.210938 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 414/780] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:18:54 2022] POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action => generated 1067 bytes in 397 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 15:18:55.216852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17d69d57-6d01-4638-9566-05587561e88f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Action: 'create', calling method: .version_select at 0x7f16e163ab80>, body: {"pool": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:55.250984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:55.260954 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c39b982-8961-4ebc-a884-19e3480ed4ee tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.341764 Oct 31 15:18:55.265372 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 367/781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:54 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:55.283884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:55.284883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:55.301707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.302598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.303982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.304915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.305684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.322842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.681706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:55.691820 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7de52abb-4675-491b-b691-10139c78b812 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.425136 Oct 31 15:18:55.692413 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 368/782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:55 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:55.698969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:55.699564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:55.705501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.705989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.706421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:55.711216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:55.711750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:55.714941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.066197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:56.086000 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-060f61e1-f458-4c2d-b735-8c7b277e4a04 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1471 microversion: 2.1 time: 0.390250 Oct 31 15:18:56.106689 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 369/783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:55 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1471 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:56.120132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:56.121451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:56.135070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.138522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.139221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.140131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.140751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.141363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.250409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:56.264392 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc7fea2f-2eaf-43e8-80b6-5a781822dd46 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1645 microversion: 2.1 time: 0.156321 Oct 31 15:18:56.273727 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 370/784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:56 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1645 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:56.279963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:56.281358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:56.289292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.289784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.290217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.292040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.292500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.292923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.594919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:56.620570 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14246f87-af6e-4638-83ac-439ce40002fd tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1324 microversion: 2.1 time: 0.342739 Oct 31 15:18:56.622392 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 371/785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:56 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1324 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:56.630939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:56.631713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:56.642248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.642248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.643062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:56.647730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:56.648163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:56.648885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.254875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:57.269150 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d1b8679c-79cf-4ae8-a7ec-54e6c931ea84 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1317 microversion: 2.1 time: 0.644935 Oct 31 15:18:57.291072 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 372/786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:56 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:57.329920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:57.332290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:57.346086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.346893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.348771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.350328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.351880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.352935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.654063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:57.663865 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52c233d7-2843-470b-8f01-349b9b954669 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1472 microversion: 2.1 time: 0.371164 Oct 31 15:18:57.668199 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 373/787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:57 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:57.684482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:57.688478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:57.696349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.697179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.697700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.704827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:57.709416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:57.709899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:57.990212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.003397 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92f76cc5-5fd3-4a82-bc30-b1a4f2a9c523 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.333155 Oct 31 15:18:58.004005 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 374/788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:57 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.010577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.011237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.020605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.021101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.021573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.022279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.022735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.023657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.032680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:18:58.221362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.221497 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17d69d57-6d01-4638-9566-05587561e88f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.009190 Oct 31 15:18:58.225462 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 415/789] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:18:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:58.228345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-12ff02b2-869e-428c-aa2e-26aaba5ed69f req-11812dfa-5a79-46f4-9f75-ea6cad3b13fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ba359d8-3cd9-44f1-83e3-9994bc8baae6", "tag": "6d732725-2cca-4497-bb96-95c374f7d00e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:58.238049 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-711122e3-75f6-458e-9ccf-47dab2f216c8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.232722 Oct 31 15:18:58.239319 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 375/790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.240102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-12ff02b2-869e-428c-aa2e-26aaba5ed69f req-11812dfa-5a79-46f4-9f75-ea6cad3b13fa service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.240591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-12ff02b2-869e-428c-aa2e-26aaba5ed69f req-11812dfa-5a79-46f4-9f75-ea6cad3b13fa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.241024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-12ff02b2-869e-428c-aa2e-26aaba5ed69f req-11812dfa-5a79-46f4-9f75-ea6cad3b13fa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.261280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bfb25f32-ca9c-4c4c-9b75-e851cbeefc3a req-f5fb04f1-c247-4b6e-bf78-6a0f3a3c7baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6", "name": "network-vif-deleted", "tag": "bc618eb3-b5b3-4e3c-b9ac-96906d79a8f0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:58.261923 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-12ff02b2-869e-428c-aa2e-26aaba5ed69f req-11812dfa-5a79-46f4-9f75-ea6cad3b13fa service nova] Creating event network-changed:6d732725-2cca-4497-bb96-95c374f7d00e for instance 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 on n-h2-858384-17 Oct 31 15:18:58.261923 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-12ff02b2-869e-428c-aa2e-26aaba5ed69f req-11812dfa-5a79-46f4-9f75-ea6cad3b13fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035165 Oct 31 15:18:58.261923 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 416/791] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:58.265219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfb25f32-ca9c-4c4c-9b75-e851cbeefc3a req-f5fb04f1-c247-4b6e-bf78-6a0f3a3c7baa service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.266886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfb25f32-ca9c-4c4c-9b75-e851cbeefc3a req-f5fb04f1-c247-4b6e-bf78-6a0f3a3c7baa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.267452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfb25f32-ca9c-4c4c-9b75-e851cbeefc3a req-f5fb04f1-c247-4b6e-bf78-6a0f3a3c7baa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.269111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.269858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.277989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.278492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.278939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.279677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.280148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.280579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.285927 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bfb25f32-ca9c-4c4c-9b75-e851cbeefc3a req-f5fb04f1-c247-4b6e-bf78-6a0f3a3c7baa service nova] Creating event network-vif-deleted:bc618eb3-b5b3-4e3c-b9ac-96906d79a8f0 for instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 on n-h1-858384-17 Oct 31 15:18:58.292327 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bfb25f32-ca9c-4c4c-9b75-e851cbeefc3a req-f5fb04f1-c247-4b6e-bf78-6a0f3a3c7baa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051657 Oct 31 15:18:58.293116 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 376/792] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:58.300047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ac7d17ce-b4a2-43e8-8c41-bc90d66f6ad6 req-cffb8e20-e072-4371-a227-706016df7b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112e7afd-0280-4245-8d39-46c540af14e2", "name": "network-vif-plugged", "status": "completed", "tag": "716e0d1b-2fef-4c26-a4d6-5c354e43d8eb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:58.311811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ac7d17ce-b4a2-43e8-8c41-bc90d66f6ad6 req-cffb8e20-e072-4371-a227-706016df7b47 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.312472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ac7d17ce-b4a2-43e8-8c41-bc90d66f6ad6 req-cffb8e20-e072-4371-a227-706016df7b47 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.312997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ac7d17ce-b4a2-43e8-8c41-bc90d66f6ad6 req-cffb8e20-e072-4371-a227-706016df7b47 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.326826 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ac7d17ce-b4a2-43e8-8c41-bc90d66f6ad6 req-cffb8e20-e072-4371-a227-706016df7b47 service nova] Creating event network-vif-plugged:716e0d1b-2fef-4c26-a4d6-5c354e43d8eb for instance 112e7afd-0280-4245-8d39-46c540af14e2 on n-h2-858384-17 Oct 31 15:18:58.333619 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ac7d17ce-b4a2-43e8-8c41-bc90d66f6ad6 req-cffb8e20-e072-4371-a227-706016df7b47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038707 Oct 31 15:18:58.334752 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 377/793] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:18:58.343887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.344670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.353702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.354209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.354743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.355510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.356038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.356546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.396919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.397682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.398471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.398922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lazy-loading 'fault' on Instance uuid 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:18:58.445256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa8b2998637d46cea5484de42091b1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '726e2d465c8d41eb904f9a561363b927', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.452916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.454514 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f1a1d92b-b563-4b89-8832-295f1ece74f1 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 200 len: 1354 microversion: 2.1 time: 0.118120 Oct 31 15:18:58.455308 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 378/794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 1354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.460979 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ada08a00-3f27-4b19-9e91-c4f204ec785b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1471 microversion: 2.1 time: 0.196301 Oct 31 15:18:58.463101 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 417/795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.467136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.467783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.473018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.473660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.480924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.481394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.481815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.481977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.482310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.482751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.483008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.483462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.483882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.484236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.484857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.485489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.508710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Request method failure captured: Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698/diagnostics HTTP/1.1 Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-dMWygsJuqYRSvqYvASkOCbvsScZMzcvV0RWNDUGOp2fgVXq_baebOIrYxk-fjQX1jZDRLTbNWiThaYZ66h9ddGnVGoXa0MuLFp3AzMUDpGspa_pvQkjl0q0ipw-9ytR0yHMGdV-fgUrDkr7Y4nQIfBkC6u6thot_KZxZPIujSO4Bk Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 221a42dc77ef445d94698a737decde27 Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-291955756 Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:58.511344 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/221a42dc77ef445d94698a737decde27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_221a42dc77ef445d94698a737decde27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/221a42dc77ef445d94698a737decde27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/221a42dc77ef445d94698a737decde27"}]}] Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-291955756 Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 221a42dc77ef445d94698a737decde27 Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-291955756 Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerDiagnosticsNegativeTest-291955756-project Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ec0fed1db704ee89c1a0b9c83b5b010 Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-291955756-project Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:58.512892 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': '92172ef0-99b7-42b9-a137-471d84265698'} Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:18:58.513718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:58.515142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:58.516272 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-784c0fad-62ae-43f4-8fa9-67e262e53afc tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.050270 Oct 31 15:18:58.516272 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 418/796] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698/diagnostics => generated 117 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:58.519319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.520114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.527397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.528407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.529087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.530054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.530597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.531033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.638922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.646998 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-346a386f-7cc0-418d-8b77-aaa5bc56554f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1324 microversion: 2.1 time: 0.190402 Oct 31 15:18:58.647806 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 379/797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1324 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.654521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1877867870", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "390a7fc2-64bf-4547-850c-d9842b2f402b"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:18:58.683805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:58.691638 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9dd2fc8-70ca-4e19-8a6c-ebfa5a67a3c0 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1317 microversion: 2.1 time: 0.176808 Oct 31 15:18:58.692306 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 419/798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:58.697758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.698512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.704660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.705256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.705807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.707474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.708063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.708633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.719036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] validate_networks() for [('390a7fc2-64bf-4547-850c-d9842b2f402b', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:18:58.735422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:18:58.820100 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8370eade-407c-4e1f-81b0-36938f9302b1 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 204 len: 0 microversion: 2.1 time: 0.126019 Oct 31 15:18:58.824897 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 420/799] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:58 2022] DELETE /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:18:58.834753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:58.836016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:58.863220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.866955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.870723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:58.871689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:58.872367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:58.872813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.108729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.122233 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-251d04cf-b860-448a-a736-7793ff519eb4 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1478 microversion: 2.1 time: 0.292186 Oct 31 15:18:59.124047 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 421/800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:58 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1478 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:18:59.130382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.131765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.146318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.146847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.147288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.149274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.150540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.150989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.246200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:18:59.246637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:18:59.247102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:18:59.247498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:18:59.247993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:18:59.259895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.260590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.261202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.262093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.262660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.262947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.281467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Getting quotas for project 7742c88f9c1141b7aaadd8e3c855b075. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:18:59.286952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Getting quotas for user 36899fc1a6f4463a85c9dc6fd2641095 and project 7742c88f9c1141b7aaadd8e3c855b075. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:18:59.299981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:18:59.302648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:18:59.308993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.317515 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9f7b960-dc6f-4999-804e-7dfd187d2aa7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.192354 Oct 31 15:18:59.318089 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 422/801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:59.324452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.325261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.333591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.334595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.335690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.336518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.337261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.338523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.357001 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2d16ee0e-d8e3-4893-8dff-c888a79660b8 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708420 Oct 31 15:18:59.359846 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 380/802] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:18:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:18:59.377401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b79d4bf2-4c8b-429a-9166-a7a4cb760968 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.378640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b79d4bf2-4c8b-429a-9166-a7a4cb760968 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.458725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b79d4bf2-4c8b-429a-9166-a7a4cb760968 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.470996 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b79d4bf2-4c8b-429a-9166-a7a4cb760968 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1224 microversion: 2.1 time: 0.100719 Oct 31 15:18:59.471622 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 381/803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:59.480763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.481553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.490866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.491356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.491784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.492478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.492927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.493373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.511079 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] HTTP exception thrown: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Request method failure captured: Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 HTTP/1.1 Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a-2GXcEDlt2TNWJoer5DHG7qeKA78i9C3SkTwnIAIl8CBNyJHiFjAQWdcB4oWKK8_ITZXJiW0g3pVQ4ZKJYezEldp3phh3MzvtS0_3ZNDGh0iHtsGbKXjQ9omx8_hHCkwpNoDdDTOc503rZco7EngPMFXDjwbo8qXdxA9kZa_DK3c Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:18:59.513298 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_726e2d465c8d41eb904f9a561363b927", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/726e2d465c8d41eb904f9a561363b927"}]}] Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: fa8b2998637d46cea5484de42091b1ef Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:18:59.514566 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6'} Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:59.515375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:18:59.516547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.518710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Returning 404 to user: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:59.519477 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d4c749c-8afb-416e-8ecb-d70bca71ed2b tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 404 len: 111 microversion: 2.1 time: 0.043906 Oct 31 15:18:59.523092 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 382/804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:59.526977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.527580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.535352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.535586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.535942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.536656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.537257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.537673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.564125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.574187 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e3764dc0-e032-475e-afbc-5fa2656597e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.254439 Oct 31 15:18:59.574864 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 423/805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:59.580211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.580771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.587431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.588316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.588946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.589936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.590452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.591010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.608021 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] HTTP exception thrown: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Request method failure captured: Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 HTTP/1.1 Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a-2GXcEDlt2TNWJoer5DHG7qeKA78i9C3SkTwnIAIl8CBNyJHiFjAQWdcB4oWKK8_ITZXJiW0g3pVQ4ZKJYezEldp3phh3MzvtS0_3ZNDGh0iHtsGbKXjQ9omx8_hHCkwpNoDdDTOc503rZco7EngPMFXDjwbo8qXdxA9kZa_DK3c Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:59.609794 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_726e2d465c8d41eb904f9a561363b927", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/726e2d465c8d41eb904f9a561363b927"}]}] Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: fa8b2998637d46cea5484de42091b1ef Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.611105 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '4dacf152-1913-4810-84fa-113047bf0e73'} Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:59.611866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.613023 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.614348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Returning 404 to user: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:59.614348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d3b8e47-1b59-44ce-b113-8a475f4290af tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 404 len: 111 microversion: 2.1 time: 0.034985 Oct 31 15:18:59.617165 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 424/806] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:18:59 2022] DELETE /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:59.620613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.621263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.627198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.627688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.628126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.628841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.629341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.629818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.644753 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] HTTP exception thrown: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Request method failure captured: Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 HTTP/1.1 Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a-2GXcEDlt2TNWJoer5DHG7qeKA78i9C3SkTwnIAIl8CBNyJHiFjAQWdcB4oWKK8_ITZXJiW0g3pVQ4ZKJYezEldp3phh3MzvtS0_3ZNDGh0iHtsGbKXjQ9omx8_hHCkwpNoDdDTOc503rZco7EngPMFXDjwbo8qXdxA9kZa_DK3c Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:18:59.646349 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_726e2d465c8d41eb904f9a561363b927", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/726e2d465c8d41eb904f9a561363b927"}]}] Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: fa8b2998637d46cea5484de42091b1ef Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.647710 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '4dacf152-1913-4810-84fa-113047bf0e73'} Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:18:59.648441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:18:59.649600 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:18:59.653071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Returning 404 to user: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:18:59.653071 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a0c4265-92be-4866-8f36-8e4f2ffc59ed tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 404 len: 111 microversion: 2.1 time: 0.031629 Oct 31 15:18:59.653071 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 425/807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:18:59.656885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-231d336f-d6e7-49cb-81ae-7860a224710e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '.version_select at 0x7f16e1bf5790>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.678621 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-231d336f-d6e7-49cb-81ae-7860a224710e tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-123702585" status: 202 len: 0 microversion: 2.1 time: 0.025566 Oct 31 15:18:59.679549 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 426/808] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:18:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-123702585 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:18:59.685487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.686966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.699654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.700145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.700596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.701390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.701869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.702290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.704975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.720772 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca4d0a4a-a9c7-4d65-b96c-8b12ecdfc787 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1471 microversion: 2.1 time: 0.197725 Oct 31 15:18:59.721687 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 383/809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:59.735755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:18:59.736618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:18:59.742616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.743099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.744413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.745115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:18:59.745601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:18:59.746170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:18:59.894781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.903627 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ec1cf6f-bd76-4a7b-8f71-c96f16b4fae7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1317 microversion: 2.1 time: 0.179777 Oct 31 15:18:59.904832 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 384/810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:18:59.918695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:18:59.936750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c410b65f-1b87-4b00-9c71-75667a0b56af tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1324 microversion: 2.1 time: 0.256035 Oct 31 15:18:59.937355 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 427/811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:18:59 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:00.148002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.149537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.156408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.156902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.157576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.158444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.159077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.159672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.308649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:00.316565 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-464ab017-7c0f-4b66-b4f4-63095e487944 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1478 microversion: 2.1 time: 0.172442 Oct 31 15:19:00.329385 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 385/812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1478 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:00.347771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.348440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.356056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.356539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.356968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.357710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.358358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.358651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f316d625-cd29-4068-b07e-2a87ac5b5a1a req-7065d7cd-3799-4da3-b0cc-e7c9e49b306d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de28ff5-937b-433f-831c-c8c899fc3b79", "name": "network-vif-plugged", "status": "completed", "tag": "c0a49432-5df0-4d35-9176-f53f1d0aa323"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:00.358954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.370628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f316d625-cd29-4068-b07e-2a87ac5b5a1a req-7065d7cd-3799-4da3-b0cc-e7c9e49b306d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.371290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f316d625-cd29-4068-b07e-2a87ac5b5a1a req-7065d7cd-3799-4da3-b0cc-e7c9e49b306d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.371823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f316d625-cd29-4068-b07e-2a87ac5b5a1a req-7065d7cd-3799-4da3-b0cc-e7c9e49b306d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.383827 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f316d625-cd29-4068-b07e-2a87ac5b5a1a req-7065d7cd-3799-4da3-b0cc-e7c9e49b306d service nova] Creating event network-vif-plugged:c0a49432-5df0-4d35-9176-f53f1d0aa323 for instance 0de28ff5-937b-433f-831c-c8c899fc3b79 on n-h2-858384-17 Oct 31 15:19:00.390305 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f316d625-cd29-4068-b07e-2a87ac5b5a1a req-7065d7cd-3799-4da3-b0cc-e7c9e49b306d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037820 Oct 31 15:19:00.391490 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 386/813] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:00.499446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.500139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.507429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.507922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.508396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.509152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.509739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.510278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.560482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:00.568644 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45424703-860d-49ae-9261-b6407ea1fc42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.230283 Oct 31 15:19:00.569246 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 428/814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:00.576312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:00.583022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8d55c162-bdc1-43f3-b575-9d3aceb2619d tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.585994 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1aa81ee1-e3ef-4fde-b53a-a0293e765d15 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1276 microversion: 2.1 time: 0.090658 Oct 31 15:19:00.586606 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 387/815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:00.596446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.597052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.601896 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8d55c162-bdc1-43f3-b575-9d3aceb2619d tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1238317695" status: 202 len: 0 microversion: 2.1 time: 0.023654 Oct 31 15:19:00.603545 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 429/816] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:19:00 2022] DELETE /compute/v2.1/flavors/1238317695 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:00.604090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.604554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.604986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.605709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.606255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.606681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.610743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c4d0977-45f3-47ae-9992-95bd55f61b19 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.631836 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c4d0977-45f3-47ae-9992-95bd55f61b19 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.024487 Oct 31 15:19:00.632421 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 430/817] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:00.651175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-776d8005-efbb-4895-96c2-420a72ef6201 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.669066 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-776d8005-efbb-4895-96c2-420a72ef6201 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2033485829" status: 202 len: 0 microversion: 2.1 time: 0.021306 Oct 31 15:19:00.669811 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 431/818] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:19:00 2022] DELETE /compute/v2.1/flavors/2033485829 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:19:00.677416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f05948a-e521-4ef5-8a0b-8aa393b3ebd9 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.699344 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f05948a-e521-4ef5-8a0b-8aa393b3ebd9 tempest-ServersWithSpecificFlavorTestJSON-1011367433 tempest-ServersWithSpecificFlavorTestJSON-1011367433-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025200 Oct 31 15:19:00.700299 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 432/819] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:00.731717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.732039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.738102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.738586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.739028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.739924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.740381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.741152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.755303 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] HTTP exception thrown: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Request method failure captured: Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 HTTP/1.1 Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a-2GXcEDlt2TNWJoer5DHG7qeKA78i9C3SkTwnIAIl8CBNyJHiFjAQWdcB4oWKK8_ITZXJiW0g3pVQ4ZKJYezEldp3phh3MzvtS0_3ZNDGh0iHtsGbKXjQ9omx8_hHCkwpNoDdDTOc503rZco7EngPMFXDjwbo8qXdxA9kZa_DK3c Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:19:00.756863 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_726e2d465c8d41eb904f9a561363b927", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/726e2d465c8d41eb904f9a561363b927"}]}] Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: fa8b2998637d46cea5484de42091b1ef Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.758559 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6'} Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:00.759473 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.760880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.764620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Returning 404 to user: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:00.764620 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f5c2326-deca-4fce-b2ba-d726ca8bd02d tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 404 len: 111 microversion: 2.1 time: 0.031603 Oct 31 15:19:00.764620 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 433/820] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:00 2022] DELETE /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:19:00.767303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.768280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.774677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.775411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.776137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.776999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.777651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.778212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.801375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:00.812818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=44 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:00.814787 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e1f2587e-b983-4589-819c-6ea4f001c2aa tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.220297 Oct 31 15:19:00.816284 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 388/821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:00.826913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.827867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.840022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.840928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.841786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.842622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.843193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.844329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.886144 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] HTTP exception thrown: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Request method failure captured: Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 HTTP/1.1 Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a-2GXcEDlt2TNWJoer5DHG7qeKA78i9C3SkTwnIAIl8CBNyJHiFjAQWdcB4oWKK8_ITZXJiW0g3pVQ4ZKJYezEldp3phh3MzvtS0_3ZNDGh0iHtsGbKXjQ9omx8_hHCkwpNoDdDTOc503rZco7EngPMFXDjwbo8qXdxA9kZa_DK3c Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:19:00.891112 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_726e2d465c8d41eb904f9a561363b927", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/726e2d465c8d41eb904f9a561363b927"}]}] Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: fa8b2998637d46cea5484de42091b1ef Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.893041 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6'} Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:00.893823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. Oct 31 15:19:00.895032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.896193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Returning 404 to user: Instance 7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:00.898231 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33dbe1a5-19fd-451e-a085-c7b9ebed4408 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6" status: 404 len: 111 microversion: 2.1 time: 0.080598 Oct 31 15:19:00.900162 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 389/822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/7dfdd1f2-2c4a-4ca0-9698-398b6eb1b3d6 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:00.912140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.912705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.930783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.932105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.932706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.933672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.934178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.943599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.969254 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] HTTP exception thrown: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Request method failure captured: Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 HTTP/1.1 Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-a-2GXcEDlt2TNWJoer5DHG7qeKA78i9C3SkTwnIAIl8CBNyJHiFjAQWdcB4oWKK8_ITZXJiW0g3pVQ4ZKJYezEldp3phh3MzvtS0_3ZNDGh0iHtsGbKXjQ9omx8_hHCkwpNoDdDTOc503rZco7EngPMFXDjwbo8qXdxA9kZa_DK3c Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:19:00.972031 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_726e2d465c8d41eb904f9a561363b927", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/726e2d465c8d41eb904f9a561363b927"}]}] Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: fa8b2998637d46cea5484de42091b1ef Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:00.973458 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '4dacf152-1913-4810-84fa-113047bf0e73'} Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:00.974198 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:00.976117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:00.979405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Returning 404 to user: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:00.979405 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a674be5e-e732-4140-ab7c-f830dde7a0f4 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 404 len: 111 microversion: 2.1 time: 0.069218 Oct 31 15:19:00.979405 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 390/823] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:00 2022] DELETE /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:00.979862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:00.980207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:00.987354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:00.988926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.989676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.990320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:00.991757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:00.992423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:00.993000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.083727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.094336 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-31eb88b9-b55e-43aa-b7c3-53d739c0aa9f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1471 microversion: 2.1 time: 0.330860 Oct 31 15:19:01.095174 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 434/824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1471 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:01.099976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:01.100789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:01.107264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.107959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.108552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.109475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.110079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.110652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.269450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.278069 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-86877e23-d9e6-4acc-88b1-a2347b755247 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1324 microversion: 2.1 time: 0.181562 Oct 31 15:19:01.292683 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 435/825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:01 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1324 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:01.292683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:01.292683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] [instance: 4dacf152-1913-4810-84fa-113047bf0e73] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:01.299838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.300488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.301024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.302097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.302662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.303289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.323779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] HTTP exception thrown: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Request method failure captured: Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 HTTP/1.1 Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-a-2GXcEDlt2TNWJoer5DHG7qeKA78i9C3SkTwnIAIl8CBNyJHiFjAQWdcB4oWKK8_ITZXJiW0g3pVQ4ZKJYezEldp3phh3MzvtS0_3ZNDGh0iHtsGbKXjQ9omx8_hHCkwpNoDdDTOc503rZco7EngPMFXDjwbo8qXdxA9kZa_DK3c Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:19:01.325581 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_726e2d465c8d41eb904f9a561363b927", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/726e2d465c8d41eb904f9a561363b927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/726e2d465c8d41eb904f9a561363b927"}]}] Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 726e2d465c8d41eb904f9a561363b927 Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926 Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: fa8b2998637d46cea5484de42091b1ef Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-271714926-project Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:01.327152 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '4dacf152-1913-4810-84fa-113047bf0e73'} Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:01.328149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. Oct 31 15:19:01.329670 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:01.331575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] Returning 404 to user: Instance 4dacf152-1913-4810-84fa-113047bf0e73 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:01.332869 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c01ffa8a-e887-41f9-92d3-db3ec1e9baf2 tempest-ServersWithSpecificFlavorTestJSON-271714926 tempest-ServersWithSpecificFlavorTestJSON-271714926-project] 10.222.0.20 "GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73" status: 404 len: 111 microversion: 2.1 time: 0.044837 Oct 31 15:19:01.334987 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 436/826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:01 2022] GET /compute/v2.1/servers/4dacf152-1913-4810-84fa-113047bf0e73 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:01.345964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:01.346682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:01.353695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.354894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.355563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.356357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.356895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.357659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.363302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.378428 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-280b0577-11ba-4829-b7e0-234623810643 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1317 microversion: 2.1 time: 0.403143 Oct 31 15:19:01.390613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:01.392009 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 391/827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:00 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:01.593846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:01.594717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:01.601411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.601905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.602441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.603194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.603679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.604109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.681935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.691192 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5803b07f-05ca-4ade-902b-34bc3b829b0e tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1478 microversion: 2.1 time: 0.351952 Oct 31 15:19:01.697465 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 437/828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:01 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1478 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:01.711254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:01.712919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:01.719612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.720232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.720776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.721826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.722416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.723094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.806649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.815265 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bef35e03-8410-474c-9a7b-801a5e008655 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1282 microversion: 2.1 time: 0.114995 Oct 31 15:19:01.832983 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 438/829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:01 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:01.839218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:01.839833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:01.846065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.846563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.847000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.847734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:01.848194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:01.848619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:01.899655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:01.909820 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f561f4c-2e12-454a-8a0b-875dd8e95ff1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.321141 Oct 31 15:19:01.926856 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 392/830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:01 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:02.064167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:02.073009 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1661191-d065-4c7e-8e41-f657f988f4e0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1311 microversion: 2.1 time: 0.238336 Oct 31 15:19:02.073793 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 439/831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:01 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1311 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:02.121318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.122206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:02.128487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.129383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.129873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.130805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.131291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.132505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.303556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.304280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:02.312798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.313223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.313654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.314359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.314809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.315230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.381379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:02.392658 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a664ebd-548b-4a3e-b57b-befbcfa5b18c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1471 microversion: 2.1 time: 0.276603 Oct 31 15:19:02.393262 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 393/832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:02 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1471 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:02.407307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.407814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:02.421971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.422547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.423093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.423872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.424680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.426753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.733764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:02.752382 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-647951c1-3720-4418-91b3-90e36840be8c tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1324 microversion: 2.1 time: 0.453540 Oct 31 15:19:02.753452 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 440/833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:02 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1324 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:02.774574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-03a47f15-91f4-48ef-bb2c-c67cf9d9bc9e req-99405c6d-ebac-4057-b1a6-43dd17e19d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92172ef0-99b7-42b9-a137-471d84265698", "name": "network-vif-deleted", "tag": "8ebfd523-0a2a-4cc4-90a8-9dc8c818c1d2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:02.788364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-03a47f15-91f4-48ef-bb2c-c67cf9d9bc9e req-99405c6d-ebac-4057-b1a6-43dd17e19d29 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.789438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-03a47f15-91f4-48ef-bb2c-c67cf9d9bc9e req-99405c6d-ebac-4057-b1a6-43dd17e19d29 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.790787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-03a47f15-91f4-48ef-bb2c-c67cf9d9bc9e req-99405c6d-ebac-4057-b1a6-43dd17e19d29 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.812545 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-03a47f15-91f4-48ef-bb2c-c67cf9d9bc9e req-99405c6d-ebac-4057-b1a6-43dd17e19d29 service nova] Creating event network-vif-deleted:8ebfd523-0a2a-4cc4-90a8-9dc8c818c1d2 for instance 92172ef0-99b7-42b9-a137-471d84265698 on n-h2-858384-17 Oct 31 15:19:02.822237 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-03a47f15-91f4-48ef-bb2c-c67cf9d9bc9e req-99405c6d-ebac-4057-b1a6-43dd17e19d29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067010 Oct 31 15:19:02.823645 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 441/834] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:02.830036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.852100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:02.872673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=9 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:02.875835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.876480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.876957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.877969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.878452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.879231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.894009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:02.905766 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5068bacc-1083-4c15-9f17-af7e8b92a891 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1317 microversion: 2.1 time: 0.502784 Oct 31 15:19:02.920291 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 394/835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:02 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:02.920291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:02.920291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:02.938906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.940864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.942862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:02.951164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:02.951771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:02.952338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.042750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec0fed1db704ee89c1a0b9c83b5b010', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221a42dc77ef445d94698a737decde27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:03.075419 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee91ecda-9fdb-43ba-9100-9c83c215fba2 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 200 len: 1308 microversion: 2.1 time: 0.228409 Oct 31 15:19:03.076459 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 442/836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:02 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:03.096594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:03.100738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:03.109402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.109991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.110498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.111282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.111850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.112376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.386514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:03.403145 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b3dad81c-910a-4293-8bb2-849cb0a543de tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.321303 Oct 31 15:19:03.403775 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 443/837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:03 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:03.414764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:03.417919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:03.434873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.435380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.435827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.437707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.438166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.439525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.620759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:03.644344 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c6cc59c-f648-4eb8-a375-f86a74e70bd4 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1324 microversion: 2.1 time: 0.733351 Oct 31 15:19:03.645451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 395/838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:02 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1324 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:03.670213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2bf2d0c3-865d-4f8e-9104-ca0e70b5abc9 req-2ea9501f-185f-4c3f-bd43-de6e2bc906bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba359d8-3cd9-44f1-83e3-9994bc8baae6", "name": "network-vif-plugged", "status": "completed", "tag": "6d732725-2cca-4497-bb96-95c374f7d00e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:03.681425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2bf2d0c3-865d-4f8e-9104-ca0e70b5abc9 req-2ea9501f-185f-4c3f-bd43-de6e2bc906bf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.682286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2bf2d0c3-865d-4f8e-9104-ca0e70b5abc9 req-2ea9501f-185f-4c3f-bd43-de6e2bc906bf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.682936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2bf2d0c3-865d-4f8e-9104-ca0e70b5abc9 req-2ea9501f-185f-4c3f-bd43-de6e2bc906bf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.700020 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2bf2d0c3-865d-4f8e-9104-ca0e70b5abc9 req-2ea9501f-185f-4c3f-bd43-de6e2bc906bf service nova] Creating event network-vif-plugged:6d732725-2cca-4497-bb96-95c374f7d00e for instance 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 on n-h2-858384-17 Oct 31 15:19:03.705933 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2bf2d0c3-865d-4f8e-9104-ca0e70b5abc9 req-2ea9501f-185f-4c3f-bd43-de6e2bc906bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042582 Oct 31 15:19:03.707069 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 396/839] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:03.714425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:03.715370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:03.723286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:03.733691 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b4eb4f3b-78d7-4bc8-98e3-1ecf2dc0cece tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1494 microversion: 2.1 time: 0.326960 Oct 31 15:19:03.738192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.741360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.742144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.743129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.744498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.745298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.758221 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 444/840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:03 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1494 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:03.764198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f74ccab0-3e24-4061-a0cf-09eeb7ee677c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:03.767125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f74ccab0-3e24-4061-a0cf-09eeb7ee677c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:03.784085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f74ccab0-3e24-4061-a0cf-09eeb7ee677c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.784584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f74ccab0-3e24-4061-a0cf-09eeb7ee677c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.786585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f74ccab0-3e24-4061-a0cf-09eeb7ee677c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:03.790266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f74ccab0-3e24-4061-a0cf-09eeb7ee677c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:03.791296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f74ccab0-3e24-4061-a0cf-09eeb7ee677c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:03.792121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f74ccab0-3e24-4061-a0cf-09eeb7ee677c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.398491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:04.403031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:04.405222 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f74ccab0-3e24-4061-a0cf-09eeb7ee677c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1647 microversion: 2.1 time: 0.644977 Oct 31 15:19:04.417654 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 445/841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:03 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1647 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:04.432682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:04.436407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:04.441349 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd0d7d3c-8ba7-4834-bf7f-2d777df5d798 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1471 microversion: 2.1 time: 0.732697 Oct 31 15:19:04.443793 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 397/842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:03 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1471 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:04.448904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.450515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.451164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.452249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.455490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.457888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:04.458042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.458693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:04.474947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.475590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.476127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.476992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.478126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.484034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.820280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:04.829894 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e6d3b1d-5189-4455-ad66-95e181e9774b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1520 microversion: 2.1 time: 0.403115 Oct 31 15:19:04.830491 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 446/843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:04 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:04.833787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:04.838776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:04.839869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] [instance: 92172ef0-99b7-42b9-a137-471d84265698] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:04.859298 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7cbd99b4-0cec-4d0f-8b82-1966f94c41a2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1317 microversion: 2.1 time: 0.413396 Oct 31 15:19:04.861419 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 398/844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:04 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:04.864470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.869449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.869912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.870651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.871171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.872617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:04.873034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.873731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:04.883004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.885230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.888822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.890349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.891003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.891594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.897109 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] HTTP exception thrown: Instance 92172ef0-99b7-42b9-a137-471d84265698 could not be found. Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Request method failure captured: Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 HTTP/1.1 Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-dMWygsJuqYRSvqYvASkOCbvsScZMzcvV0RWNDUGOp2fgVXq_baebOIrYxk-fjQX1jZDRLTbNWiThaYZ66h9ddGnVGoXa0MuLFp3AzMUDpGspa_pvQkjl0q0ipw-9ytR0yHMGdV-fgUrDkr7Y4nQIfBkC6u6thot_KZxZPIujSO4Bk Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 221a42dc77ef445d94698a737decde27 Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-291955756 Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:19:04.903053 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/221a42dc77ef445d94698a737decde27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_221a42dc77ef445d94698a737decde27", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/221a42dc77ef445d94698a737decde27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/221a42dc77ef445d94698a737decde27"}]}] Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-291955756 Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 221a42dc77ef445d94698a737decde27 Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-291955756 Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerDiagnosticsNegativeTest-291955756-project Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ec0fed1db704ee89c1a0b9c83b5b010 Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-291955756-project Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 92172ef0-99b7-42b9-a137-471d84265698 could not be found. Oct 31 15:19:04.904659 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '92172ef0-99b7-42b9-a137-471d84265698'} Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92172ef0-99b7-42b9-a137-471d84265698 could not be found. Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:04.905637 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92172ef0-99b7-42b9-a137-471d84265698 could not be found. Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92172ef0-99b7-42b9-a137-471d84265698 could not be found. Oct 31 15:19:04.907219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:04.908622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] Returning 404 to user: Instance 92172ef0-99b7-42b9-a137-471d84265698 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:04.908622 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f89b88e-8216-46ce-930f-7667353f8136 tempest-ServerDiagnosticsNegativeTest-291955756 tempest-ServerDiagnosticsNegativeTest-291955756-project] 10.222.0.20 "GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698" status: 404 len: 111 microversion: 2.1 time: 0.071683 Oct 31 15:19:04.913155 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 447/845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:04 2022] GET /compute/v2.1/servers/92172ef0-99b7-42b9-a137-471d84265698 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:04.921603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c04ec09-794f-4de6-8bc0-332df9d17d88 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:04.925804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c04ec09-794f-4de6-8bc0-332df9d17d88 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:04.932434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c04ec09-794f-4de6-8bc0-332df9d17d88 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.933162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c04ec09-794f-4de6-8bc0-332df9d17d88 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.933880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c04ec09-794f-4de6-8bc0-332df9d17d88 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:04.934783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c04ec09-794f-4de6-8bc0-332df9d17d88 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:04.935401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c04ec09-794f-4de6-8bc0-332df9d17d88 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:04.935989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c04ec09-794f-4de6-8bc0-332df9d17d88 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.179752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:05.194315 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07d97d1e-1565-4c20-826e-3284486ebfd4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.331321 Oct 31 15:19:05.195623 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 399/846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:04 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.207416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.211227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.227962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.229316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.229924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.230802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.231414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.231991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.311275 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c04ec09-794f-4de6-8bc0-332df9d17d88 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1647 microversion: 2.1 time: 0.396112 Oct 31 15:19:05.312470 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 448/847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:04 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1647 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.317370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.318095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.325027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.325892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.326712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.327672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.329941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.330566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.559735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:05.589762 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-613075af-b8d4-455f-8706-aedf64257c1c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1324 microversion: 2.1 time: 0.391022 Oct 31 15:19:05.601237 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 400/848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1324 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.601237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ef3d373e-647a-4795-a97e-d0095e932ce8 req-ec05e24a-a2ed-46d8-9c69-6a412f405326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72b4f6b-9440-4133-86b7-51c220a045e8", "tag": "846e803d-aa39-4944-9fc5-b4924f9abb1e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:05.613493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef3d373e-647a-4795-a97e-d0095e932ce8 req-ec05e24a-a2ed-46d8-9c69-6a412f405326 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.614101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef3d373e-647a-4795-a97e-d0095e932ce8 req-ec05e24a-a2ed-46d8-9c69-6a412f405326 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.614709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef3d373e-647a-4795-a97e-d0095e932ce8 req-ec05e24a-a2ed-46d8-9c69-6a412f405326 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.617177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:05.626703 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c6521dd-d86b-42ee-bc8a-be040eda748b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1520 microversion: 2.1 time: 0.312372 Oct 31 15:19:05.627819 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 449/849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.640687 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ef3d373e-647a-4795-a97e-d0095e932ce8 req-ec05e24a-a2ed-46d8-9c69-6a412f405326 service nova] Creating event network-changed:846e803d-aa39-4944-9fc5-b4924f9abb1e for instance a72b4f6b-9440-4133-86b7-51c220a045e8 on n-h1-858384-17 Oct 31 15:19:05.646462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45281e4e-451e-4dc5-a443-9377d2f12a96 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.654674 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ef3d373e-647a-4795-a97e-d0095e932ce8 req-ec05e24a-a2ed-46d8-9c69-6a412f405326 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060855 Oct 31 15:19:05.657003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45281e4e-451e-4dc5-a443-9377d2f12a96 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.657003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45281e4e-451e-4dc5-a443-9377d2f12a96 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.657279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45281e4e-451e-4dc5-a443-9377d2f12a96 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.657998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45281e4e-451e-4dc5-a443-9377d2f12a96 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.658480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45281e4e-451e-4dc5-a443-9377d2f12a96 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.658930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45281e4e-451e-4dc5-a443-9377d2f12a96 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.661246 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 401/850] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:05.667116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:05.667841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.676471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.677245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.677692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.678535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.680262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.682716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.717262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:05.730844 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45281e4e-451e-4dc5-a443-9377d2f12a96 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.101668 Oct 31 15:19:05.731917 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 450/851] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:05.742485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1d19210-696c-4141-ba09-9db578ab7cdc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1226498668"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:05.746685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1d19210-696c-4141-ba09-9db578ab7cdc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.756259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d19210-696c-4141-ba09-9db578ab7cdc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.756883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d19210-696c-4141-ba09-9db578ab7cdc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.759562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d19210-696c-4141-ba09-9db578ab7cdc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.760580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d19210-696c-4141-ba09-9db578ab7cdc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.761063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d19210-696c-4141-ba09-9db578ab7cdc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.761532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d19210-696c-4141-ba09-9db578ab7cdc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.865380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:05.873872 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-12ea6350-d3be-414a-99ad-7a46f5b77d63 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1471 microversion: 2.1 time: 0.211428 Oct 31 15:19:05.874456 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 402/852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:05 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:05.898916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0a87eed-ec69-4dee-844d-1f988d65b627 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:05.900113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0a87eed-ec69-4dee-844d-1f988d65b627 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:05.908268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a87eed-ec69-4dee-844d-1f988d65b627 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.908605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a87eed-ec69-4dee-844d-1f988d65b627 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.909047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a87eed-ec69-4dee-844d-1f988d65b627 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:05.909833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a87eed-ec69-4dee-844d-1f988d65b627 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:05.911295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a87eed-ec69-4dee-844d-1f988d65b627 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:05.911723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0a87eed-ec69-4dee-844d-1f988d65b627 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.007478 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1d19210-696c-4141-ba09-9db578ab7cdc tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79/action" status: 202 len: 0 microversion: 2.1 time: 0.274114 Oct 31 15:19:06.008413 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 451/853] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:05 2022] POST /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:19:06.014743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.015441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:06.022066 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0a87eed-ec69-4dee-844d-1f988d65b627 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2/action" status: 202 len: 0 microversion: 2.1 time: 0.144240 Oct 31 15:19:06.023096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.023591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.024110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.025693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.029296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.029437 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 403/854] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:05 2022] POST /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:06.029540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.038858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92c748d3-bd4f-469b-99ae-62da093fcded tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '.version_select at 0x7f16e1e0cb80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.297661 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92c748d3-bd4f-469b-99ae-62da093fcded tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/images/df4dbcd5-e6d8-4af8-860c-9736080c05dc" status: 204 len: 0 microversion: 2.1 time: 0.270027 Oct 31 15:19:06.298456 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 404/855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] DELETE /compute/v2.1/images/df4dbcd5-e6d8-4af8-860c-9736080c05dc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:06.308291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50a07965-b5f8-4a4c-bbb0-751146431b4f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.309723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50a07965-b5f8-4a4c-bbb0-751146431b4f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:06.325901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a07965-b5f8-4a4c-bbb0-751146431b4f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.326820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a07965-b5f8-4a4c-bbb0-751146431b4f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.327809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a07965-b5f8-4a4c-bbb0-751146431b4f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.330180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a07965-b5f8-4a4c-bbb0-751146431b4f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.331401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a07965-b5f8-4a4c-bbb0-751146431b4f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.334565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a07965-b5f8-4a4c-bbb0-751146431b4f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.427463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:06.441243 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-621dc9e8-6360-43ac-8f8b-7c39df753059 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1317 microversion: 2.1 time: 0.429598 Oct 31 15:19:06.445982 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 452/856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1317 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:06.457883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.459962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:06.476417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.479004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.479591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.480641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.481995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.482425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.686332 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50a07965-b5f8-4a4c-bbb0-751146431b4f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1652 microversion: 2.1 time: 0.386521 Oct 31 15:19:06.686931 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 405/857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1652 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:06.713973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51ba5829-89dd-487c-a5de-01e15dc4e355 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '.version_select at 0x7f16e16761f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.735991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:06.740180 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-51ba5829-89dd-487c-a5de-01e15dc4e355 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Image not found. Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51ba5829-89dd-487c-a5de-01e15dc4e355 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/images/df4dbcd5-e6d8-4af8-860c-9736080c05dc HTTP/1.1 Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:19:06.741750 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'df4dbcd5-e6d8-4af8-860c-9736080c05dc'} Oct 31 15:19:06.744386 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:19:06.745505 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID df4dbcd5-e6d8-4af8-860c-9736080c05dc Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:19:06.746878 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df4dbcd5-e6d8-4af8-860c-9736080c05dc could not be found. Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:06.748293 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:19:06.749655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:06.750876 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-766c78ae-fa9b-4e4f-96bd-828988c20f3c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.297764 Oct 31 15:19:06.753051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51ba5829-89dd-487c-a5de-01e15dc4e355 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:06.753051 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51ba5829-89dd-487c-a5de-01e15dc4e355 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/images/df4dbcd5-e6d8-4af8-860c-9736080c05dc" status: 404 len: 62 microversion: 2.1 time: 0.050397 Oct 31 15:19:06.753786 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 406/858] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:06 2022] GET /compute/v2.1/images/df4dbcd5-e6d8-4af8-860c-9736080c05dc => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:19:06.757871 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 453/859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:06.762798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.763577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:06.768826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.769494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:06.773440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.773933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.774993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.775991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.776203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.776796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.778720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.779215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.779840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.781201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.781670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.782106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.933197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:06.935481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:06.943026 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a1efd7ab-bee6-45bb-b334-c0b648a9760a tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1532 microversion: 2.1 time: 0.178611 Oct 31 15:19:06.943625 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 454/860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1532 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:06.949529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:06.950144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:06.956171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.956808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.957351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:06.958065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:06.958696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:06.959285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.119329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:07.127840 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9cf996c-24c9-49cb-b59b-41218ef16073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1471 microversion: 2.1 time: 0.183230 Oct 31 15:19:07.128429 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 455/861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:07.190872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:07.199356 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cbabe3e2-cb88-4431-8952-95c9a6b0a8dc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1324 microversion: 2.1 time: 0.444361 Oct 31 15:19:07.199924 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 407/862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:06 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1324 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:07.470163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:07.471266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:07.479096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.479583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.480205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.481587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.482542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.483115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.668441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:07.677480 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5be123f8-dd6e-4b26-9589-49384f204b30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1467 microversion: 2.1 time: 0.211169 Oct 31 15:19:07.678159 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 456/863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:07 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1467 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:07.702154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36a3ab91-b2fb-4f67-8c00-8c4ef43aef6f tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:07.702877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-36a3ab91-b2fb-4f67-8c00-8c4ef43aef6f tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:07.715378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dac60d4d-04f8-4bac-9cf7-6f6e884166d7 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:07.715775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36a3ab91-b2fb-4f67-8c00-8c4ef43aef6f tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.716239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dac60d4d-04f8-4bac-9cf7-6f6e884166d7 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:07.716648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36a3ab91-b2fb-4f67-8c00-8c4ef43aef6f tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.717435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36a3ab91-b2fb-4f67-8c00-8c4ef43aef6f tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.719743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36a3ab91-b2fb-4f67-8c00-8c4ef43aef6f tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.722683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36a3ab91-b2fb-4f67-8c00-8c4ef43aef6f tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.724140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36a3ab91-b2fb-4f67-8c00-8c4ef43aef6f tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.728589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dac60d4d-04f8-4bac-9cf7-6f6e884166d7 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.730410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dac60d4d-04f8-4bac-9cf7-6f6e884166d7 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.731759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dac60d4d-04f8-4bac-9cf7-6f6e884166d7 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.732927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dac60d4d-04f8-4bac-9cf7-6f6e884166d7 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.733427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dac60d4d-04f8-4bac-9cf7-6f6e884166d7 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.735832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dac60d4d-04f8-4bac-9cf7-6f6e884166d7 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.939998 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dac60d4d-04f8-4bac-9cf7-6f6e884166d7 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1652 microversion: 2.1 time: 0.234186 Oct 31 15:19:07.953935 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 457/864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:07 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1652 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:07.969348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:07.970057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:07.979911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.984788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.987176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:07.988556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:07.990947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:07.991564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.158807 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-36a3ab91-b2fb-4f67-8c00-8c4ef43aef6f tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1620 microversion: 2.1 time: 0.460161 Oct 31 15:19:08.161808 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 408/865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:07 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1620 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:08.177232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:08.178180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:08.187483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.190123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.191027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.192535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.197067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.197935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.362709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:08.372255 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfc98b4f-3c12-48c8-85e7-b7aba219cffc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.417179 Oct 31 15:19:08.392337 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 458/866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:07 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:08.398417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:08.407127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:08.407886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:08.410430 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5a231a4-b705-412f-a8db-72c7cd8f7c3f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1532 microversion: 2.1 time: 0.247297 Oct 31 15:19:08.412154 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 409/867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:08 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1532 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:08.423894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.424528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.425308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.432909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:08.436246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.438248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.438783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.440898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:08.455922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.457269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.459009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.460922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.462619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.463045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.648646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:08.658854 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b691b553-2239-4612-87f0-9b70d38d7cab tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1324 microversion: 2.1 time: 0.245097 Oct 31 15:19:08.660695 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 410/868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:08 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:08.669590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1769370245", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["6f6d49c8-10cb-4bbd-a978-69db51f46d2b"]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:08.734768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:08.742268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:08.752326 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b2aef565-81c1-42e6-814e-116b50b31a0a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1477 microversion: 2.1 time: 0.358412 Oct 31 15:19:08.753377 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 459/869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:08 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1477 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:08.970268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86dc6222-b486-4f15-8aeb-de5bbd9d6480 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:08.971202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-86dc6222-b486-4f15-8aeb-de5bbd9d6480 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:08.977923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86dc6222-b486-4f15-8aeb-de5bbd9d6480 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.978646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86dc6222-b486-4f15-8aeb-de5bbd9d6480 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.979094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86dc6222-b486-4f15-8aeb-de5bbd9d6480 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:08.979806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86dc6222-b486-4f15-8aeb-de5bbd9d6480 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:08.980267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86dc6222-b486-4f15-8aeb-de5bbd9d6480 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:08.980772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86dc6222-b486-4f15-8aeb-de5bbd9d6480 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.059891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:09.060621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:09.061549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:09.062580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:09.063071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:09.075333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.076494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.076934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.077730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.078394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.079839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.106579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:09.118704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:09.132293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:09.135922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:09.192220 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d1b0da41-4c48-4b13-8b58-23234db6cb30 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530189 Oct 31 15:19:09.194399 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 411/870] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:19:09.206909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a53bf4e-9b89-4cac-91da-6ef7a65c2564 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:09.208744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a53bf4e-9b89-4cac-91da-6ef7a65c2564 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:09.297278 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-86dc6222-b486-4f15-8aeb-de5bbd9d6480 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1632 microversion: 2.1 time: 0.331630 Oct 31 15:19:09.309819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a53bf4e-9b89-4cac-91da-6ef7a65c2564 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:09.315048 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 460/871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:08 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1632 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:09.318769 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a53bf4e-9b89-4cac-91da-6ef7a65c2564 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1217 microversion: 2.1 time: 0.115653 Oct 31 15:19:09.322543 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 412/872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:09 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:09.359329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-17", "block_migration": true, "disk_over_commit": false}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:09.375737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:09.390746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.391241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.391698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.392399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.392860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.393626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.400014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:09.401086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:09.408573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.409074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.409543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.410250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.436218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.436972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.477548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lazy-loading 'flavor' on Instance uuid 112e7afd-0280-4245-8d39-46c540af14e2 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:09.495681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Going to try to live migrate instance to n-h1-858384-17 {{(pid=120587) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:19:09.732962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:09.740750 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-88caa1cd-2285-45e3-9f2c-c598235d1d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.345072 Oct 31 15:19:09.741371 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 413/873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:09 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:19:09.758475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:09.763860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:09.774084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.776876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.781313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:09.782288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:09.782949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:09.784923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:10.326116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:10.336039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a05ed768-ee79-4e15-86f6-3adeeba6f55e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1532 microversion: 2.1 time: 0.583364 Oct 31 15:19:10.339104 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 414/874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:09 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1532 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:10.353170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:10.354018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:10.369079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:10.369782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:10.370387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:10.375811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:10.379439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:10.380979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:10.626144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:10.637921 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c74c2c0-19ee-4490-8413-22e9ae544097 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1324 microversion: 2.1 time: 0.293770 Oct 31 15:19:10.638513 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 415/875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:10 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1324 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:10.657645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:10.658262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:10.677418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:10.677925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:10.678374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:10.679078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:10.679535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:10.679959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.051509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:11.061641 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70b13d64-9a97-4df8-afe0-6f07bf0e2b3e tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1477 microversion: 2.1 time: 0.422049 Oct 31 15:19:11.068840 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 416/876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:10 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1477 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:11.081098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-57ebf5f9-e684-47c8-bc32-38234b9d92a2 req-80c6d52a-793d-4b9d-964f-9ab352df3c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72b4f6b-9440-4133-86b7-51c220a045e8", "name": "network-vif-plugged", "status": "completed", "tag": "846e803d-aa39-4944-9fc5-b4924f9abb1e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:11.101240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57ebf5f9-e684-47c8-bc32-38234b9d92a2 req-80c6d52a-793d-4b9d-964f-9ab352df3c36 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.103672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57ebf5f9-e684-47c8-bc32-38234b9d92a2 req-80c6d52a-793d-4b9d-964f-9ab352df3c36 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.104121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57ebf5f9-e684-47c8-bc32-38234b9d92a2 req-80c6d52a-793d-4b9d-964f-9ab352df3c36 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.129804 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-57ebf5f9-e684-47c8-bc32-38234b9d92a2 req-80c6d52a-793d-4b9d-964f-9ab352df3c36 service nova] Creating event network-vif-plugged:846e803d-aa39-4944-9fc5-b4924f9abb1e for instance a72b4f6b-9440-4133-86b7-51c220a045e8 on n-h1-858384-17 Oct 31 15:19:11.144561 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-57ebf5f9-e684-47c8-bc32-38234b9d92a2 req-80c6d52a-793d-4b9d-964f-9ab352df3c36 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074193 Oct 31 15:19:11.145202 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 417/877] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:11.159892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:11.160932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:11.175185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.176078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.176703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.178201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.179994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.180682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.220720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:11.510103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:11.518988 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b8d4b50-2181-49a2-adb7-dce3d8f87f62 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1269 microversion: 2.1 time: 0.372236 Oct 31 15:19:11.520589 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 418/878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:11 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1269 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:11.526497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:11.527474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:11.535724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.536535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.537196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.538063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.538686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.539340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.956866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:11.970972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c36f6c0b-b5d5-4dee-b465-36bf556f7be3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.448844 Oct 31 15:19:11.971575 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 419/879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:11 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:11.986972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:11.986972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:11.997079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.997630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.998088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:11.998809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:11.999274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:11.999699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.377678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:12.391561 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-17a9ea04-2d08-4ee5-a235-0fb37d76b4e0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1538 microversion: 2.1 time: 0.417350 Oct 31 15:19:12.403821 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 420/880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:11 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1538 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:12.411102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:12.417629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:12.426619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.427054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.427964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.429301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.429838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.432355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.772480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:12.783653 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c508a37-fdea-424a-a8e5-726e7b9f4dd0 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1324 microversion: 2.1 time: 0.378258 Oct 31 15:19:12.797201 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 421/881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:12 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:12.802156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:12.802617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:12.817527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.818318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.818938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.820370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.821043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.821687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.823862 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8db382ff-6107-4e5b-8fe9-1e7d56076ef6 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2/action" status: 202 len: 0 microversion: 2.1 time: 3.480820 Oct 31 15:19:12.824762 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 461/882] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:09 2022] POST /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2/action => generated 0 bytes in 3486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:12.849910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:12.855490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:12.892140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.894027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.895276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:12.896376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:12.898229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:12.922782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.271192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:13.285528 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1fe4580a-b09c-4690-8b36-f61df0f674b5 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1477 microversion: 2.1 time: 0.499473 Oct 31 15:19:13.287635 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 422/883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:12 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1477 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:13.305680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:13.307007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:13.316889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.317968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.321255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.322173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.326026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.326398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.540131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:13.548566 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b12f8bd-23bf-49a8-aa60-f71624326c5b tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1317 microversion: 2.1 time: 0.720346 Oct 31 15:19:13.572472 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 462/884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:12 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1317 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:13.578561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:13.579119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:13.590433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.591616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.592264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.593766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.594448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.595088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.720085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:13.739299 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd118a68-40ad-46a0-bed7-5c688d4a8f54 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1504 microversion: 2.1 time: 0.450211 Oct 31 15:19:13.740534 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 423/885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:13 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1504 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:13.747856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c251756d-2266-45d5-a371-f98625101a8f req-487bc1fb-1cd1-46ca-9f6b-0b4158e27b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec22d439-86fc-48bc-a238-b9e3074d51fa", "name": "network-vif-unplugged", "status": "completed", "tag": "af932539-7d08-4e92-83b1-db17d6e894a3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:13.770427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c251756d-2266-45d5-a371-f98625101a8f req-487bc1fb-1cd1-46ca-9f6b-0b4158e27b75 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.772012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c251756d-2266-45d5-a371-f98625101a8f req-487bc1fb-1cd1-46ca-9f6b-0b4158e27b75 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.772707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c251756d-2266-45d5-a371-f98625101a8f req-487bc1fb-1cd1-46ca-9f6b-0b4158e27b75 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.797494 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c251756d-2266-45d5-a371-f98625101a8f req-487bc1fb-1cd1-46ca-9f6b-0b4158e27b75 service nova] Creating event network-vif-unplugged:af932539-7d08-4e92-83b1-db17d6e894a3 for instance ec22d439-86fc-48bc-a238-b9e3074d51fa on n-h2-858384-17 Oct 31 15:19:13.804712 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c251756d-2266-45d5-a371-f98625101a8f req-487bc1fb-1cd1-46ca-9f6b-0b4158e27b75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062268 Oct 31 15:19:13.806635 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 424/886] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:13.814446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:13.815196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:13.824451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.825659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.826263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:13.827161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:13.827797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:13.828607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.022358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:14.043149 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-88b3246d-474e-4e42-a96e-40728dead0db tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1497 microversion: 2.1 time: 0.479637 Oct 31 15:19:14.047209 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 463/887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:13 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1497 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:14.065833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:14.071934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:14.090431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.091244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.091778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.093001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.095276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.098181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.456901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:14.464953 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eaf34016-f385-4b06-ad93-63c699000873 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1520 microversion: 2.1 time: 0.656615 Oct 31 15:19:14.465584 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 425/888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:13 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1520 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:14.478363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:14.481261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:14.495661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.498040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.498585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.499210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.499673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.500098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.528163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:14.547958 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6abae6ad-7d52-4651-b38f-de36f3c6728b tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 200 len: 1520 microversion: 2.1 time: 0.499366 Oct 31 15:19:14.548870 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 464/889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:14 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:14.561897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:14.562403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:14.568959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.574179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.574679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.575425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.575901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.576327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.607741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:14.737846 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0f8a479a-e9c5-4031-aad4-f9fc44c869a6 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 204 len: 0 microversion: 2.1 time: 0.187387 Oct 31 15:19:14.738855 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 465/890] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:14 2022] DELETE /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:14.747723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Action: 'action', calling method: .version_select at 0x7f16e308b1f0>, body: {"addFloatingIp": {"address": "172.25.1.70"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:14.750723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:14.757850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.759447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.760182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.761195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.762077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.762698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.856005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "refresh_cache-2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:14.856973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquired lock "refresh_cache-2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:14.937356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:14.955690 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-103907ab-660e-4c13-934e-4638dd3c37dc tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1477 microversion: 2.1 time: 0.486663 Oct 31 15:19:14.956885 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 426/891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:14 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1477 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:14.969654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:14.970352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:14.983450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.983956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.984399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:14.985163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:14.985626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:14.986344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.416141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:15.431986 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a658ac9-9e2e-4dcb-a6bb-c06decb11b17 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1317 microversion: 2.1 time: 0.471704 Oct 31 15:19:15.434522 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 427/892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:14 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1317 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:15.443867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:15.448108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:15.460811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.468913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.473724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.474764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.476788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.479651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.685660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:15.859188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:15.876596 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd2bf8ab-2d35-4781-8aa5-ea355cc845b0 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1526 microversion: 2.1 time: 0.433213 Oct 31 15:19:15.877597 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 428/893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:15 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1526 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:15.882239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:15.885523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:15.897759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.901615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.902181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:15.902997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:15.903896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:15.904026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:16.627435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:16.639288 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3695be5a-c999-47cc-aaf8-97aabae2635a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1504 microversion: 2.1 time: 0.760707 Oct 31 15:19:16.641458 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 429/894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:15 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1504 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:16.653725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:16.654713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:16.670901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:16.671403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:16.671834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:16.672913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:16.673566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:16.675153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.765881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:17.777016 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11750299-d57a-4807-abcb-4223a97b29ca tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 200 len: 1474 microversion: 2.1 time: 1.132903 Oct 31 15:19:17.778843 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 430/895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:16 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 1474 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:17.797446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-16807ea8-de21-4e1e-ab30-819589dcf760 req-525e9725-b84e-4bf2-98d6-316c2a429780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5", "tag": "c49966ed-57bd-47b7-a75e-48cdd441c845"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:17.813678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-16807ea8-de21-4e1e-ab30-819589dcf760 req-525e9725-b84e-4bf2-98d6-316c2a429780 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.814502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-16807ea8-de21-4e1e-ab30-819589dcf760 req-525e9725-b84e-4bf2-98d6-316c2a429780 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.815121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-16807ea8-de21-4e1e-ab30-819589dcf760 req-525e9725-b84e-4bf2-98d6-316c2a429780 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.828557 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-16807ea8-de21-4e1e-ab30-819589dcf760 req-525e9725-b84e-4bf2-98d6-316c2a429780 service nova] Creating event network-changed:c49966ed-57bd-47b7-a75e-48cdd441c845 for instance 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 on n-h2-858384-17 Oct 31 15:19:17.837032 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-16807ea8-de21-4e1e-ab30-819589dcf760 req-525e9725-b84e-4bf2-98d6-316c2a429780 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055140 Oct 31 15:19:17.838893 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 431/896] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:17.853513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-08ed0ef8-cb7f-4f50-aed9-47b41dac55f8 req-69c40845-f8d3-458a-89f1-de27c0eb18eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de28ff5-937b-433f-831c-c8c899fc3b79", "name": "network-vif-plugged", "status": "completed", "tag": "c0a49432-5df0-4d35-9176-f53f1d0aa323"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:17.870204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08ed0ef8-cb7f-4f50-aed9-47b41dac55f8 req-69c40845-f8d3-458a-89f1-de27c0eb18eb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.871755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08ed0ef8-cb7f-4f50-aed9-47b41dac55f8 req-69c40845-f8d3-458a-89f1-de27c0eb18eb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.872788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08ed0ef8-cb7f-4f50-aed9-47b41dac55f8 req-69c40845-f8d3-458a-89f1-de27c0eb18eb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.917009 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-08ed0ef8-cb7f-4f50-aed9-47b41dac55f8 req-69c40845-f8d3-458a-89f1-de27c0eb18eb service nova] Creating event network-vif-plugged:c0a49432-5df0-4d35-9176-f53f1d0aa323 for instance 0de28ff5-937b-433f-831c-c8c899fc3b79 on n-h2-858384-17 Oct 31 15:19:17.925854 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-08ed0ef8-cb7f-4f50-aed9-47b41dac55f8 req-69c40845-f8d3-458a-89f1-de27c0eb18eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083617 Oct 31 15:19:17.927616 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 432/897] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:17.930615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Building network info cache for instance {{(pid=120587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:17.936294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:17.937103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:17.947566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.948104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.948531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:17.949343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:17.950409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:17.951347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:18.462103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:18.475432 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-35089ab9-2ab4-42c7-92fe-b113061f1450 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1477 microversion: 2.1 time: 0.543985 Oct 31 15:19:18.479088 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 433/898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:17 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1477 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:18.493876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e7b0ea16-2c7f-42ef-9c71-68fe6e7261ab req-d2ac9a3d-b639-43e5-820d-67b7bdfe4b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112e7afd-0280-4245-8d39-46c540af14e2", "name": "network-vif-unplugged", "status": "completed", "tag": "716e0d1b-2fef-4c26-a4d6-5c354e43d8eb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:18.509818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e7b0ea16-2c7f-42ef-9c71-68fe6e7261ab req-d2ac9a3d-b639-43e5-820d-67b7bdfe4b19 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:18.510603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e7b0ea16-2c7f-42ef-9c71-68fe6e7261ab req-d2ac9a3d-b639-43e5-820d-67b7bdfe4b19 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:18.511215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e7b0ea16-2c7f-42ef-9c71-68fe6e7261ab req-d2ac9a3d-b639-43e5-820d-67b7bdfe4b19 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:18.530830 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e7b0ea16-2c7f-42ef-9c71-68fe6e7261ab req-d2ac9a3d-b639-43e5-820d-67b7bdfe4b19 service nova] Creating event network-vif-unplugged:716e0d1b-2fef-4c26-a4d6-5c354e43d8eb for instance 112e7afd-0280-4245-8d39-46c540af14e2 on n-h2-858384-17 Oct 31 15:19:18.537214 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e7b0ea16-2c7f-42ef-9c71-68fe6e7261ab req-d2ac9a3d-b639-43e5-820d-67b7bdfe4b19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054317 Oct 31 15:19:18.538510 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 434/899] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:18.545465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:18.546641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:18.550456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:18.558405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:18.564337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:18.566861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:18.568298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:18.568298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:18.568505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.095394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=22 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:19.197358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Updating instance_info_cache with network_info: [{"id": "2c55825a-fb54-4ab3-bbd2-1d30165b004b", "address": "fa:16:3e:99:d1:82", "network": {"id": "390a7fc2-64bf-4547-850c-d9842b2f402b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1729819416-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7742c88f9c1141b7aaadd8e3c855b075", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2c55825a-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:19.204708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:19.221427 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-90bcf3cc-9d40-4977-af6e-a87d836a7774 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1317 microversion: 2.1 time: 0.680634 Oct 31 15:19:19.223434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:19.225586 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 435/900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:18 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:19.235231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Releasing lock "refresh_cache-2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:19:19.238807 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a664bcda-b634-457f-97c8-c80d55b65415 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "POST /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae/action" status: 202 len: 0 microversion: 2.1 time: 4.497869 Oct 31 15:19:19.244886 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 466/901] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:14 2022] POST /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae/action => generated 0 bytes in 4505 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:19:19.246295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:19.249649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:19.256593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:19.259902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:19.267658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.269367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.270135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.271267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.271955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.274245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.297084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.301917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.302528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.303721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.304385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.305296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.332757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=19 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:19.422507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:19.435040 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2992d0ea-d140-4e79-8338-b1b1ef7e49a7 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 200 len: 1484 microversion: 2.1 time: 0.207942 Oct 31 15:19:19.436361 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 436/902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:19 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 1484 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:19.446226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-133a20ee-2f93-496e-b3bd-9b62f4b6616e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-927901669"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:19.450987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-133a20ee-2f93-496e-b3bd-9b62f4b6616e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:19.468465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-133a20ee-2f93-496e-b3bd-9b62f4b6616e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.481483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-133a20ee-2f93-496e-b3bd-9b62f4b6616e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.482365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-133a20ee-2f93-496e-b3bd-9b62f4b6616e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.483379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-133a20ee-2f93-496e-b3bd-9b62f4b6616e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.484016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-133a20ee-2f93-496e-b3bd-9b62f4b6616e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.485337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-133a20ee-2f93-496e-b3bd-9b62f4b6616e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.544083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:19.800372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:19.812646 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41744f89-5da4-4403-9f53-f3e0838affff tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1504 microversion: 2.1 time: 0.566332 Oct 31 15:19:19.815459 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 467/903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:19 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1504 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:19.835801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.70"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:19.838781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:19.847733 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-133a20ee-2f93-496e-b3bd-9b62f4b6616e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7/action" status: 202 len: 0 microversion: 2.1 time: 0.406733 Oct 31 15:19:19.848724 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 437/904] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:19 2022] POST /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:19:19.860065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:19.863950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.866545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.869798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.871307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.873713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.875122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.876579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:19.917987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.918605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.919440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.923441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:19.926013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:19.926682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:19.992135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "refresh_cache-a72b4f6b-9440-4133-86b7-51c220a045e8" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:19.994125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquired lock "refresh_cache-a72b4f6b-9440-4133-86b7-51c220a045e8" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:20.304263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:20.322756 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-970083ac-9237-4024-b20a-55ded1322d8f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1477 microversion: 2.1 time: 0.471624 Oct 31 15:19:20.323356 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 438/905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:19 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1477 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:20.329794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76021ae8-a798-4d1d-b3d8-a2082a954c25 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e171f310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:20.410981 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76021ae8-a798-4d1d-b3d8-a2082a954c25 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 0.083545 Oct 31 15:19:20.412889 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 439/906] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:20 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:20.441551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2f03448d-03db-4089-8e32-98dd28a10101 req-42459e17-5e87-49b5-a00a-83cd033ca73f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7bdeeb-cdce-44a1-929e-1d817a2b80ae", "tag": "2c55825a-fb54-4ab3-bbd2-1d30165b004b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:20.469381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f03448d-03db-4089-8e32-98dd28a10101 req-42459e17-5e87-49b5-a00a-83cd033ca73f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.470299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f03448d-03db-4089-8e32-98dd28a10101 req-42459e17-5e87-49b5-a00a-83cd033ca73f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.472588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f03448d-03db-4089-8e32-98dd28a10101 req-42459e17-5e87-49b5-a00a-83cd033ca73f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.505638 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2f03448d-03db-4089-8e32-98dd28a10101 req-42459e17-5e87-49b5-a00a-83cd033ca73f service nova] Creating event network-changed:2c55825a-fb54-4ab3-bbd2-1d30165b004b for instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae on n-h1-858384-17 Oct 31 15:19:20.518813 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2f03448d-03db-4089-8e32-98dd28a10101 req-42459e17-5e87-49b5-a00a-83cd033ca73f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091639 Oct 31 15:19:20.519871 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 440/907] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:20.531953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9f53b2e3-d825-4f65-8031-e869222c99d5 req-7e445fbe-8106-4821-9c74-9bad19f4f5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec22d439-86fc-48bc-a238-b9e3074d51fa", "name": "network-vif-plugged", "status": "completed", "tag": "af932539-7d08-4e92-83b1-db17d6e894a3"}, {"server_uuid": "0de28ff5-937b-433f-831c-c8c899fc3b79", "name": "network-vif-unplugged", "status": "completed", "tag": "c0a49432-5df0-4d35-9176-f53f1d0aa323"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:20.556806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9f53b2e3-d825-4f65-8031-e869222c99d5 req-7e445fbe-8106-4821-9c74-9bad19f4f5d2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.564471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9f53b2e3-d825-4f65-8031-e869222c99d5 req-7e445fbe-8106-4821-9c74-9bad19f4f5d2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.569929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9f53b2e3-d825-4f65-8031-e869222c99d5 req-7e445fbe-8106-4821-9c74-9bad19f4f5d2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.628232 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9f53b2e3-d825-4f65-8031-e869222c99d5 req-7e445fbe-8106-4821-9c74-9bad19f4f5d2 service nova] Creating event network-vif-plugged:af932539-7d08-4e92-83b1-db17d6e894a3 for instance ec22d439-86fc-48bc-a238-b9e3074d51fa on n-h2-858384-17 Oct 31 15:19:20.632481 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9f53b2e3-d825-4f65-8031-e869222c99d5 req-7e445fbe-8106-4821-9c74-9bad19f4f5d2 service nova] Creating event network-vif-unplugged:c0a49432-5df0-4d35-9176-f53f1d0aa323 for instance 0de28ff5-937b-433f-831c-c8c899fc3b79 on n-h2-858384-17 Oct 31 15:19:20.659732 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9f53b2e3-d825-4f65-8031-e869222c99d5 req-7e445fbe-8106-4821-9c74-9bad19f4f5d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.138101 Oct 31 15:19:20.661625 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 441/908] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:20.685219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:20.685953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:20.708152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.708644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.709081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:20.709832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:20.710289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:20.710714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.293042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:21.307906 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-05ee9cd1-8331-42d0-9df6-0216300be93d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1317 microversion: 2.1 time: 0.645198 Oct 31 15:19:21.313055 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 442/909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:20 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1317 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:21.318739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:21.321925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:21.341416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:21.348986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:21.349981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.352849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:21.353385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:21.353826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.372219 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 HTTP/1.1 Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:19:21.373933 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:19:21.375659 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '0de28ff5-937b-433f-831c-c8c899fc3b79'} Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:21.376604 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:19:21.378110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:21.380660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:21.381739 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2b544fc-4119-4a6f-8d87-fb08c2ebda51 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 404 len: 111 microversion: 2.1 time: 0.067243 Oct 31 15:19:21.382838 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 443/910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:21 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:21.388409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-54af58c1-ed63-4bf8-b3e0-79adabee0a55 req-1987cf06-3e30-472c-a5f3-482ddf0e1be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112e7afd-0280-4245-8d39-46c540af14e2", "tag": "716e0d1b-2fef-4c26-a4d6-5c354e43d8eb"}, {"server_uuid": "0de28ff5-937b-433f-831c-c8c899fc3b79", "name": "network-vif-deleted", "tag": "c0a49432-5df0-4d35-9176-f53f1d0aa323"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:21.404842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-54af58c1-ed63-4bf8-b3e0-79adabee0a55 req-1987cf06-3e30-472c-a5f3-482ddf0e1be0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:21.405623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-54af58c1-ed63-4bf8-b3e0-79adabee0a55 req-1987cf06-3e30-472c-a5f3-482ddf0e1be0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:21.406216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-54af58c1-ed63-4bf8-b3e0-79adabee0a55 req-1987cf06-3e30-472c-a5f3-482ddf0e1be0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.419480 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-54af58c1-ed63-4bf8-b3e0-79adabee0a55 req-1987cf06-3e30-472c-a5f3-482ddf0e1be0 service nova] Creating event network-changed:716e0d1b-2fef-4c26-a4d6-5c354e43d8eb for instance 112e7afd-0280-4245-8d39-46c540af14e2 on n-h2-858384-17 Oct 31 15:19:21.420248 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-54af58c1-ed63-4bf8-b3e0-79adabee0a55 req-1987cf06-3e30-472c-a5f3-482ddf0e1be0 service nova] Creating event network-vif-deleted:c0a49432-5df0-4d35-9176-f53f1d0aa323 for instance 0de28ff5-937b-433f-831c-c8c899fc3b79 on n-h2-858384-17 Oct 31 15:19:21.428249 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-54af58c1-ed63-4bf8-b3e0-79adabee0a55 req-1987cf06-3e30-472c-a5f3-482ddf0e1be0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043522 Oct 31 15:19:21.429383 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 444/911] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:21.436370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:21.437369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:21.444763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:21.446078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:21.446734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.447515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:21.448055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:21.448789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:21.794923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:21.803850 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d1aad7a9-0739-416e-979a-842022165c8d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1504 microversion: 2.1 time: 0.372429 Oct 31 15:19:21.837373 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 445/912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:21 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:22.171855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43df740f-4980-4281-ad39-e22cbdaedc57 tempest-FlavorsV261TestJSON-1404870671 tempest-FlavorsV261TestJSON-1404870671-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1637008240", "id": 914635804, "os-flavor-access:is_public": "True"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:22.214454 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43df740f-4980-4281-ad39-e22cbdaedc57 tempest-FlavorsV261TestJSON-1404870671 tempest-FlavorsV261TestJSON-1404870671-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.375803 Oct 31 15:19:22.215978 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 446/913] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:19:21 2022] POST /compute/v2.1/flavors => generated 465 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:19:22.222739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:22.223772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:22.232992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:22.234018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:22.234947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:22.237248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:22.237937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:22.238891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:22.851210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:22.872463 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60a1cceb-bdc7-4745-b765-11d53c9fe073 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1477 microversion: 2.1 time: 0.654846 Oct 31 15:19:22.874387 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 447/914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:22 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1477 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:22.881053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3307e5d4-c43e-43d0-a98c-3215737fdf48 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1462c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:22.941850 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3307e5d4-c43e-43d0-a98c-3215737fdf48 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 0.065792 Oct 31 15:19:22.942703 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 448/915] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:22 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:22.955317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1681930331", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:23.120713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] validate_networks() for [('b9ce60b0-eb78-46d2-9cec-4aebad5fe7ad', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:24.643423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:24.645337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:24.645975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:24.647212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:24.647692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:24.670203 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.network.neutron [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] re-assign floating IP 172.25.1.70 from instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae Oct 31 15:19:24.685164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:24.690874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:24.691392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:24.692202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:24.692671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:24.693095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:24.770105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Getting quotas for project 786fdf71bdb44504b15ae68b83e9dd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:24.782809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Getting quotas for user 748f45dc720144a49ca38e9e3b185410 and project 786fdf71bdb44504b15ae68b83e9dd41. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:24.814192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Building network info cache for instance {{(pid=120587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:24.819928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:24.827716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:25.010054 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0fbd12ef-ffda-4ad7-8320-d68be0da2507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.066396 Oct 31 15:19:25.010722 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 449/916] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:19:25.388712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60de7c1c-669f-40a0-9e73-c6ace3580da0 tempest-FlavorsV261TestJSON-1362879772 tempest-FlavorsV261TestJSON-1362879772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:25.410769 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60de7c1c-669f-40a0-9e73-c6ace3580da0 tempest-FlavorsV261TestJSON-1362879772 tempest-FlavorsV261TestJSON-1362879772-project] 10.222.0.20 "GET /compute/v2.1/flavors/914635804" status: 200 len: 465 microversion: 2.61 time: 0.398977 Oct 31 15:19:25.424257 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 450/917] 10.222.0.20 () {60 vars in 1196 bytes} [Mon Oct 31 15:19:25 2022] GET /compute/v2.1/flavors/914635804 => generated 465 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:19:25.449650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:25.451692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:25.462591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:25.463318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:25.463907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:25.464773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:25.465410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:25.466464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:26.057055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:26.067196 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eef34ac2-6cee-43c9-a434-faa5871c2532 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1317 microversion: 2.1 time: 0.641588 Oct 31 15:19:26.070843 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 451/918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:25 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:26.102223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:26.102843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:26.125611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.126134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.126577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:26.141591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.145494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.146138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:26.732250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:26.744076 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-049222de-65f4-4f1a-8c71-74ed54de6fbd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1504 microversion: 2.1 time: 0.672066 Oct 31 15:19:26.749096 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 452/919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:26 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1504 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:26.765298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:26.766375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:26.780784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.783797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.785054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:26.788372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:26.789598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:26.791972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.134422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:27.153351 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc2f82ce-c587-40e8-a16a-8694e0d9c630 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1463 microversion: 2.1 time: 0.402106 Oct 31 15:19:27.173179 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 453/920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:26 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1463 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:27.173179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2520f531-be29-41f5-a262-2563c2f5b642 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1ec0790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:27.283003 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2520f531-be29-41f5-a262-2563c2f5b642 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 0.122701 Oct 31 15:19:27.283825 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 454/921] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:27 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:27.307624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5e00cb06-d82d-40bb-aa8b-825c7e6f29a8 req-e5dce887-1ce8-4b04-ae7d-abfe0ac3af69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7bdeeb-cdce-44a1-929e-1d817a2b80ae", "tag": "2c55825a-fb54-4ab3-bbd2-1d30165b004b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:27.325003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5e00cb06-d82d-40bb-aa8b-825c7e6f29a8 req-e5dce887-1ce8-4b04-ae7d-abfe0ac3af69 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.325274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5e00cb06-d82d-40bb-aa8b-825c7e6f29a8 req-e5dce887-1ce8-4b04-ae7d-abfe0ac3af69 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.325712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5e00cb06-d82d-40bb-aa8b-825c7e6f29a8 req-e5dce887-1ce8-4b04-ae7d-abfe0ac3af69 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.360032 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5e00cb06-d82d-40bb-aa8b-825c7e6f29a8 req-e5dce887-1ce8-4b04-ae7d-abfe0ac3af69 service nova] Creating event network-changed:2c55825a-fb54-4ab3-bbd2-1d30165b004b for instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae on n-h1-858384-17 Oct 31 15:19:27.375010 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5e00cb06-d82d-40bb-aa8b-825c7e6f29a8 req-e5dce887-1ce8-4b04-ae7d-abfe0ac3af69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078853 Oct 31 15:19:27.375637 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 455/922] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:27.381006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:27.381560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:27.398726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.399758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.400510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.402692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.404557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.405287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.553003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:27.575370 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-69a81849-ef68-4739-8670-cbb17354d507 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1277 microversion: 2.1 time: 0.198360 Oct 31 15:19:27.587174 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 456/923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:27 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:27.603076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-74f7a3ca-cbb9-49a2-aafb-8eef2913f03d req-87e9318a-6012-45f1-91fb-6178caf8ea63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5", "name": "network-vif-plugged", "status": "completed", "tag": "c49966ed-57bd-47b7-a75e-48cdd441c845"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:27.628607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-74f7a3ca-cbb9-49a2-aafb-8eef2913f03d req-87e9318a-6012-45f1-91fb-6178caf8ea63 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.629056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-74f7a3ca-cbb9-49a2-aafb-8eef2913f03d req-87e9318a-6012-45f1-91fb-6178caf8ea63 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.631754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-74f7a3ca-cbb9-49a2-aafb-8eef2913f03d req-87e9318a-6012-45f1-91fb-6178caf8ea63 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.685511 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-74f7a3ca-cbb9-49a2-aafb-8eef2913f03d req-87e9318a-6012-45f1-91fb-6178caf8ea63 service nova] Creating event network-vif-plugged:c49966ed-57bd-47b7-a75e-48cdd441c845 for instance 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 on n-h2-858384-17 Oct 31 15:19:27.717552 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-74f7a3ca-cbb9-49a2-aafb-8eef2913f03d req-87e9318a-6012-45f1-91fb-6178caf8ea63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129008 Oct 31 15:19:27.731621 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 457/924] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:27.769816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d125b69-2731-4682-ba7a-99319e4be4c4 tempest-FlavorsV261TestJSON-1404870671 tempest-FlavorsV261TestJSON-1404870671-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:27.884174 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d125b69-2731-4682-ba7a-99319e4be4c4 tempest-FlavorsV261TestJSON-1404870671 tempest-FlavorsV261TestJSON-1404870671-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/914635804" status: 200 len: 466 microversion: 2.61 time: 0.149669 Oct 31 15:19:27.894755 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 458/925] 10.222.0.20 () {62 vars in 1216 bytes} [Mon Oct 31 15:19:27 2022] PUT /compute/v2.1/flavors/914635804 => generated 466 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:19:27.917074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:27.924307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:27.953023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.955600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.956251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:27.958555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:27.959312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:27.959942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.558959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:28.584348 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-55962169-57f3-4cf2-8048-bd450bf1f374 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1317 microversion: 2.1 time: 0.684365 Oct 31 15:19:28.599234 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 459/926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:27 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:28.612007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:28.612877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:28.621117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.621927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.622525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.623393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:28.624004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:28.624878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:28.799692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Updating instance_info_cache with network_info: [{"id": "2c55825a-fb54-4ab3-bbd2-1d30165b004b", "address": "fa:16:3e:99:d1:82", "network": {"id": "390a7fc2-64bf-4547-850c-d9842b2f402b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1729819416-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7742c88f9c1141b7aaadd8e3c855b075", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2c55825a-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:28.828961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Building network info cache for instance {{(pid=120587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:29.598687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:29.619268 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-603467b4-0bb4-4f0b-be3f-0b04c53dd285 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1463 microversion: 2.1 time: 1.018554 Oct 31 15:19:29.620191 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 460/927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:28 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1463 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:29.628666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:29.629283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:29.646444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:29.646869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:29.647275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:29.648123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:29.650722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:29.651172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:29.864525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:30.171587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:30.180596 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d1c83fab-39e8-43ba-848b-3ae3f2ad8eeb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1479 microversion: 2.1 time: 0.559042 Oct 31 15:19:30.196823 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 461/928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:29 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1479 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:30.215772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-931de043-82c2-4229-8c4d-7a06e71eb784 tempest-FlavorsV261TestJSON-1362879772 tempest-FlavorsV261TestJSON-1362879772-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:30.284844 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-931de043-82c2-4229-8c4d-7a06e71eb784 tempest-FlavorsV261TestJSON-1362879772 tempest-FlavorsV261TestJSON-1362879772-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.086766 Oct 31 15:19:30.294472 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 462/929] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 31 15:19:30 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:30.311707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5f96f20a-73df-4b7b-88c8-a3956c19aef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1462e50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:30.406127 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5f96f20a-73df-4b7b-88c8-a3956c19aef4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 0.110011 Oct 31 15:19:30.407091 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 463/930] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:30 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:30.428066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:30.440884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:30.454495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.454495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.454495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.454495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.454870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.454870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.625300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:30.635640 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3529011b-b998-4868-9cb7-9b6659a33fbe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1283 microversion: 2.1 time: 0.218301 Oct 31 15:19:30.637472 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 464/931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:30 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1283 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:30.642551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-894f4f31-786c-4f4d-b3bf-61c22aa77236 req-4b388981-a8d4-4a9a-bca4-16fdd9344e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72b4f6b-9440-4133-86b7-51c220a045e8", "tag": "846e803d-aa39-4944-9fc5-b4924f9abb1e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:30.669469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-894f4f31-786c-4f4d-b3bf-61c22aa77236 req-4b388981-a8d4-4a9a-bca4-16fdd9344e27 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.670250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-894f4f31-786c-4f4d-b3bf-61c22aa77236 req-4b388981-a8d4-4a9a-bca4-16fdd9344e27 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.673620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-894f4f31-786c-4f4d-b3bf-61c22aa77236 req-4b388981-a8d4-4a9a-bca4-16fdd9344e27 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.687545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Updating instance_info_cache with network_info: [{"id": "846e803d-aa39-4944-9fc5-b4924f9abb1e", "address": "fa:16:3e:7c:32:29", "network": {"id": "390a7fc2-64bf-4547-850c-d9842b2f402b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1729819416-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7742c88f9c1141b7aaadd8e3c855b075", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap846e803d-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:30.698067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-894f4f31-786c-4f4d-b3bf-61c22aa77236 req-4b388981-a8d4-4a9a-bca4-16fdd9344e27 service nova] Creating event network-changed:846e803d-aa39-4944-9fc5-b4924f9abb1e for instance a72b4f6b-9440-4133-86b7-51c220a045e8 on n-h1-858384-17 Oct 31 15:19:30.708380 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-894f4f31-786c-4f4d-b3bf-61c22aa77236 req-4b388981-a8d4-4a9a-bca4-16fdd9344e27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069476 Oct 31 15:19:30.712426 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 465/932] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:30.721571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:30.727776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:30.729733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Releasing lock "refresh_cache-a72b4f6b-9440-4133-86b7-51c220a045e8" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:19:30.730927 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-533f91ff-4cf9-4e15-963d-9a1518789931 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "POST /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8/action" status: 202 len: 0 microversion: 2.1 time: 10.912780 Oct 31 15:19:30.735100 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 468/933] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:19 2022] POST /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8/action => generated 0 bytes in 10919 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:19:30.738314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.742483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.743067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.746995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:30.747194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.747722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.748399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.758607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:30.767157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.768560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.770467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.775465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:30.776193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:30.776661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:30.778066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:30.909310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:30.910005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:30.910180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:30.910585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:30.910988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:31.125948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:31.137361 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1b21c086-7783-4e03-ad8b-f28b39475bb2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1466 microversion: 2.1 time: 0.423314 Oct 31 15:19:31.138656 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 466/934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:30 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1466 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:31.143713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-0a60249d-8f0a-4456-84c1-e4f8f6c1616f req-f14f1ecc-e057-4074-a2f6-cd1ecb8e1777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f21ec1-2fb0-4adc-a4fb-c3d41643dca7", "name": "network-vif-plugged", "status": "completed", "tag": "6c3880f7-29f4-4ecb-96f6-a91817391f10"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:31.166858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0a60249d-8f0a-4456-84c1-e4f8f6c1616f req-f14f1ecc-e057-4074-a2f6-cd1ecb8e1777 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.169732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0a60249d-8f0a-4456-84c1-e4f8f6c1616f req-f14f1ecc-e057-4074-a2f6-cd1ecb8e1777 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.169881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0a60249d-8f0a-4456-84c1-e4f8f6c1616f req-f14f1ecc-e057-4074-a2f6-cd1ecb8e1777 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.179827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:31.208069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.209894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.212440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.213723 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-0a60249d-8f0a-4456-84c1-e4f8f6c1616f req-f14f1ecc-e057-4074-a2f6-cd1ecb8e1777 service nova] Creating event network-vif-plugged:6c3880f7-29f4-4ecb-96f6-a91817391f10 for instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 on n-h1-858384-17 Oct 31 15:19:31.214966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.222862 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-0a60249d-8f0a-4456-84c1-e4f8f6c1616f req-f14f1ecc-e057-4074-a2f6-cd1ecb8e1777 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080907 Oct 31 15:19:31.223757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.224263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.228038 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 467/935] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:31.239394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-766ccde7-a350-4146-a1e2-48ce9399e1e4 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '.version_select at 0x7f16e13ba4c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:31.246895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-766ccde7-a350-4146-a1e2-48ce9399e1e4 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.250006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-766ccde7-a350-4146-a1e2-48ce9399e1e4 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.250752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-766ccde7-a350-4146-a1e2-48ce9399e1e4 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.285583 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0bdf6668-c559-4392-bede-b4e5c0534dd7 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action" status: 202 len: 1067 microversion: 2.1 time: 0.548463 Oct 31 15:19:31.314107 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 469/936] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:30 2022] POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action => generated 1067 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 15:19:31.314226 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-766ccde7-a350-4146-a1e2-48ce9399e1e4 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 792 microversion: 2.1 time: 0.063976 Oct 31 15:19:31.314226 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 468/937] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:19:31 2022] GET /compute/v2.1/os-migrations => generated 792 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:31.321598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Action: 'action', calling method: .version_select at 0x7f16e308b280>, body: {"removeFloatingIp": {"address": "172.25.1.70"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:31.342513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7fc6785c-54f8-443a-85c4-e25ae9959d70 tempest-FlavorsV261TestJSON-1362879772 tempest-FlavorsV261TestJSON-1362879772-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:31.378507 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7fc6785c-54f8-443a-85c4-e25ae9959d70 tempest-FlavorsV261TestJSON-1362879772 tempest-FlavorsV261TestJSON-1362879772-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.078199 Oct 31 15:19:31.381538 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 470/938] 10.222.0.20 () {60 vars in 1166 bytes} [Mon Oct 31 15:19:31 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:31.394954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-400f9ea8-e3db-4d2f-9402-fc90f5731c43 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:31.395526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-400f9ea8-e3db-4d2f-9402-fc90f5731c43 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:31.422217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f9ea8-e3db-4d2f-9402-fc90f5731c43 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.424461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f9ea8-e3db-4d2f-9402-fc90f5731c43 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.425212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f9ea8-e3db-4d2f-9402-fc90f5731c43 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.426157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f9ea8-e3db-4d2f-9402-fc90f5731c43 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.426631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f9ea8-e3db-4d2f-9402-fc90f5731c43 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.427114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f9ea8-e3db-4d2f-9402-fc90f5731c43 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.661733 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-400f9ea8-e3db-4d2f-9402-fc90f5731c43 tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1619 microversion: 2.1 time: 0.279188 Oct 31 15:19:31.664314 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 471/939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:31 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1619 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:31.677059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41b55a05-8d5c-41d8-933d-a554e9dcb708 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:31.677959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41b55a05-8d5c-41d8-933d-a554e9dcb708 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:31.699807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b55a05-8d5c-41d8-933d-a554e9dcb708 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.701802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b55a05-8d5c-41d8-933d-a554e9dcb708 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.705690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b55a05-8d5c-41d8-933d-a554e9dcb708 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:31.706904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b55a05-8d5c-41d8-933d-a554e9dcb708 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:31.707890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b55a05-8d5c-41d8-933d-a554e9dcb708 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:31.709651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b55a05-8d5c-41d8-933d-a554e9dcb708 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.111839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:32.123945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.125913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.126420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.127177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.133183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.133659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.268997 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41b55a05-8d5c-41d8-933d-a554e9dcb708 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1632 microversion: 2.1 time: 0.603470 Oct 31 15:19:32.270321 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 472/940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:31 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1632 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:32.279376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:32.280297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:32.293769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.294560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.296620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.299320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.300031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.301840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.528289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:32.541876 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2be4eaa9-f706-4213-9aef-84583049238b tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1472 microversion: 2.1 time: 0.270274 Oct 31 15:19:32.561156 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 473/941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:32 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1472 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:32.569044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17ab51be-b3f4-4821-978d-493ce7f670db tempest-FlavorsV261TestJSON-1404870671 tempest-FlavorsV261TestJSON-1404870671-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:32.619774 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17ab51be-b3f4-4821-978d-493ce7f670db tempest-FlavorsV261TestJSON-1404870671 tempest-FlavorsV261TestJSON-1404870671-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/914635804" status: 202 len: 0 microversion: 2.61 time: 0.070431 Oct 31 15:19:32.620526 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 474/942] 10.222.0.20 () {60 vars in 1199 bytes} [Mon Oct 31 15:19:32 2022] DELETE /compute/v2.1/flavors/914635804 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:32.628512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba42be38-4870-4d10-876b-8b4e118d1953 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1768310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:32.711353 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba42be38-4870-4d10-876b-8b4e118d1953 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 0.085710 Oct 31 15:19:32.720043 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 475/943] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:32 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:32.724296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:32.727004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:32.737480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.738254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.740071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:32.741049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:32.743192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:32.743853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:33.000382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:33.010334 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49688ab1-43a7-43ea-8ec0-63e8c6cf778b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1325 microversion: 2.1 time: 0.296860 Oct 31 15:19:33.013194 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 476/944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:32 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:33.025270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1102204114", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6f6d49c8-10cb-4bbd-a978-69db51f46d2b"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:33.125259 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] HTTP exception thrown: Floating IP 172.25.1.70 is not associated with instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae. Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Request method failure captured: Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae/action HTTP/1.1 Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 48 Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-dGQ6WyPc8aHl5OKiVJV6f3KCq_-6amtF9MerXnsDQCISLrY4nesbb4EGlr2ikpqex-6lJ47g4kkHILgQi4alLm9tX-PRWWXTkncsoBlHWcJHEzGheeRPE6MfefWXFQ2Xr3C8_sQ1RUOOAivUeqJWd7qgiHeDIda9jm598yb5RVF2U Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7742c88f9c1141b7aaadd8e3c855b075 Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:19:33.127062 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7742c88f9c1141b7aaadd8e3c855b075"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7742c88f9c1141b7aaadd8e3c855b075", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7742c88f9c1141b7aaadd8e3c855b075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7742c88f9c1141b7aaadd8e3c855b075"}]}] Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7742c88f9c1141b7aaadd8e3c855b075 Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FloatingIPsAssociationTestJSON-221970762-project Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 36899fc1a6f4463a85c9dc6fd2641095 Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-221970762-project Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: {"removeFloatingIp": {"address": "172.25.1.70"}} Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:19:33.128711 n-d-858384-17 devstack@n-api.service[120588]: exception: Floating IP 172.25.1.70 is not associated with instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae. Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '2a7bdeeb-cdce-44a1-929e-1d817a2b80ae', 'body': {'removeFloatingIp': {'address': '172.25.1.70'}}} Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.70 is not associated with instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae. Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:33.129770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:33.131267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:33.131267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:33.131267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:33.131267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:33.131267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.70 is not associated with instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae. Oct 31 15:19:33.131267 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:33.131267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Returning 409 to user: Floating IP 172.25.1.70 is not associated with instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:33.131267 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b6213fe-b942-4c9a-821f-2f88daa27986 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "POST /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae/action" status: 409 len: 145 microversion: 2.1 time: 1.815678 Oct 31 15:19:33.131267 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 469/945] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:31 2022] POST /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae/action => generated 145 bytes in 1818 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:19:33.137093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5134809a-53c1-4119-9952-d0b214a0abbf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Action: 'create', calling method: .version_select at 0x7f16e171fa60>, body: {"keypair": {"name": "tempest-keypair-1051704933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfLBwlf/t5t6w0fW8xM5c2WpWG3SIBR0s0BBvjoyFcdAiFUe0gAJgo0vHHhvCKYBsoaxMglivsJ12pKA9s/iey9drQrGPwkbaI/acmAPk/rAFGeAWnOSwGaXBL1lQcWWw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:33.155992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:33.179672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-5134809a-53c1-4119-9952-d0b214a0abbf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for project 330c65ee73534d8080c0ec2441c55f16. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:33.198190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-5134809a-53c1-4119-9952-d0b214a0abbf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for user 02e166a77a2c45ccab7a1f343e53542e and project 330c65ee73534d8080c0ec2441c55f16. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:33.256253 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5134809a-53c1-4119-9952-d0b214a0abbf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124766 Oct 31 15:19:33.258049 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 470/946] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:19:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:33.270852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cd1e891-d305-4a3b-affc-daf9dee07e23 tempest-FlavorsV261TestJSON-1404870671 tempest-FlavorsV261TestJSON-1404870671-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:33.318934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7cd1e891-d305-4a3b-affc-daf9dee07e23 tempest-FlavorsV261TestJSON-1404870671 tempest-FlavorsV261TestJSON-1404870671-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.059399 Oct 31 15:19:33.333155 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 471/947] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 31 15:19:33 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:19:33.333155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.70"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:33.676656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:33.678280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:33.679761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:33.682820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:33.684246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:33.685794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:33.687739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:33.688523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:33.689246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:33.690072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:33.690642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:33.691302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:33.710836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:33.722860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:33.723506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:33.724503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:33.726826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:33.727836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:33.800889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:33.849624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Getting quotas for user d4b632b1a3f84361b31a34dd81668ab5 and project f0b4e2ca54bb4af3a74d0f4d65b7b7bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:33.888632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:33.891153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:33.980620 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95aa1998-d8c3-4d7d-b86d-2d9a6783d0df tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965497 Oct 31 15:19:33.990281 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 477/948] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:19:34.047343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:34.049156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:34.077344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.078105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.080784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.082833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:34.083327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:34.088863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:34.500226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "refresh_cache-a72b4f6b-9440-4133-86b7-51c220a045e8" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:34.501490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquired lock "refresh_cache-a72b4f6b-9440-4133-86b7-51c220a045e8" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:34.721043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:35.180973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:35.192654 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1fedb7af-8d7f-40ac-9041-49348a83139c tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1472 microversion: 2.1 time: 1.198729 Oct 31 15:19:35.196862 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 478/949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:33 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1472 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:35.204903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-182ebaa5-3eaf-42aa-a406-75e0c49d9054 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1654e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:35.302918 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-182ebaa5-3eaf-42aa-a406-75e0c49d9054 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 0.104235 Oct 31 15:19:35.304666 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 479/950] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:35 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:35.322460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:35.326516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:35.347202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:35.348128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:35.349373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:35.350417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:35.352040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:35.352777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:35.556540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:35.577370 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34a11453-6fe2-453a-ae65-f2d6d0ce7e37 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1269 microversion: 2.1 time: 0.268910 Oct 31 15:19:35.580385 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 480/951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:35 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1269 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:35.600097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:35.601013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:35.618093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:35.619259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:35.620703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:35.623688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:35.627776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:35.629706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:36.107492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:36.158695 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e0f742c-ef11-42e1-a5f7-a0bede0c7eec tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1325 microversion: 2.1 time: 0.575970 Oct 31 15:19:36.160890 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 481/952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:35 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1325 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:36.173060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-51e6e56a-ff10-4a67-857e-5891563bc7e7 req-5989817a-7f14-4ccd-86c2-a8a6da1e6bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f355cce-ede6-4994-aa19-cd61fe08a88b", "tag": "7343b2a0-981d-428e-861f-81276107d0ee"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:36.249112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-51e6e56a-ff10-4a67-857e-5891563bc7e7 req-5989817a-7f14-4ccd-86c2-a8a6da1e6bc3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:36.249792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-51e6e56a-ff10-4a67-857e-5891563bc7e7 req-5989817a-7f14-4ccd-86c2-a8a6da1e6bc3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:36.260986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-51e6e56a-ff10-4a67-857e-5891563bc7e7 req-5989817a-7f14-4ccd-86c2-a8a6da1e6bc3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:36.315104 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-51e6e56a-ff10-4a67-857e-5891563bc7e7 req-5989817a-7f14-4ccd-86c2-a8a6da1e6bc3 service nova] Creating event network-changed:7343b2a0-981d-428e-861f-81276107d0ee for instance 0f355cce-ede6-4994-aa19-cd61fe08a88b on n-h1-858384-17 Oct 31 15:19:36.333018 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-51e6e56a-ff10-4a67-857e-5891563bc7e7 req-5989817a-7f14-4ccd-86c2-a8a6da1e6bc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169572 Oct 31 15:19:36.337991 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 482/953] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:36.359009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:36.363557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:36.390675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:36.398928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:36.400451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:36.403973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:36.406362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:36.413886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:37.224122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:37.237542 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-126dbe3a-dabb-4702-b678-0f7546d9cd28 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1472 microversion: 2.1 time: 0.890250 Oct 31 15:19:37.245487 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 483/954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:36 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1472 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:37.268030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b8df4933-7d89-40ca-8a8c-045d8d8b8d87 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e15cff70>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:39.163309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Building network info cache for instance {{(pid=120588) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:40.997622 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b8df4933-7d89-40ca-8a8c-045d8d8b8d87 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 3.750659 Oct 31 15:19:41.009414 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 484/955] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:37 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 3763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:41.027025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:41.032835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:41.045363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.062155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.062810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.063742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.064376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.064993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.130107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:41.488571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:41.501649 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce370aa2-d5e7-4453-863e-3f756e275462 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1317 microversion: 2.1 time: 0.487005 Oct 31 15:19:41.504368 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 485/956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:41 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:41.513082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:41.520379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:41.540906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.547419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.548161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.550181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.555547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.556187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.924700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:41.933987 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6c0227a-e9f7-4b20-8018-d634a1d95fba tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1325 microversion: 2.1 time: 0.428517 Oct 31 15:19:41.941690 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 486/957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:41 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1325 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:41.948757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:41.956801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:41.981855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.984628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.985295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:41.990993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:41.993012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:41.994712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.455906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:42.464121 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e0b6004-eac4-482b-a5df-4aa1f2ad58f6 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1472 microversion: 2.1 time: 0.521144 Oct 31 15:19:42.468067 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 487/958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:41 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:42.495225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-abad456e-6068-4102-bc7d-487bed5c719a req-ff8dc54b-5f79-4834-ab14-504a3b0c2c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72b4f6b-9440-4133-86b7-51c220a045e8", "tag": "846e803d-aa39-4944-9fc5-b4924f9abb1e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:42.525822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-abad456e-6068-4102-bc7d-487bed5c719a req-ff8dc54b-5f79-4834-ab14-504a3b0c2c6b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:42.532239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-abad456e-6068-4102-bc7d-487bed5c719a req-ff8dc54b-5f79-4834-ab14-504a3b0c2c6b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:42.537030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-abad456e-6068-4102-bc7d-487bed5c719a req-ff8dc54b-5f79-4834-ab14-504a3b0c2c6b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:42.596775 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-abad456e-6068-4102-bc7d-487bed5c719a req-ff8dc54b-5f79-4834-ab14-504a3b0c2c6b service nova] Creating event network-changed:846e803d-aa39-4944-9fc5-b4924f9abb1e for instance a72b4f6b-9440-4133-86b7-51c220a045e8 on n-h1-858384-17 Oct 31 15:19:42.613993 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-abad456e-6068-4102-bc7d-487bed5c719a req-ff8dc54b-5f79-4834-ab14-504a3b0c2c6b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135947 Oct 31 15:19:42.616642 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 488/959] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:42.633608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1683973489", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "21925cce-417c-497a-868e-676a18905b25"}], "security_groups": [{"name": "tempest-securitygroup--706522596"}], "key_name": "tempest-keypair-1051704933", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:43.215845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:43.240441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] validate_networks() for [('21925cce-417c-497a-868e-676a18905b25', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:43.687740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:43.751698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:43.865174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:44.355556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Updating instance_info_cache with network_info: [{"id": "846e803d-aa39-4944-9fc5-b4924f9abb1e", "address": "fa:16:3e:7c:32:29", "network": {"id": "390a7fc2-64bf-4547-850c-d9842b2f402b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1729819416-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7742c88f9c1141b7aaadd8e3c855b075", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap846e803d-aa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120588) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:44.384390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Releasing lock "refresh_cache-a72b4f6b-9440-4133-86b7-51c220a045e8" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:19:44.385632 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d6dc5ae-026b-4a6b-88d6-6aac4d7db42c tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "POST /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8/action" status: 202 len: 0 microversion: 2.1 time: 11.062179 Oct 31 15:19:44.392988 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 472/960] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:33 2022] POST /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8/action => generated 0 bytes in 11070 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:19:44.404312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a9327e8-cfc7-4571-bf6d-8859fa4bf687 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e13ba550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:44.490184 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8a9327e8-cfc7-4571-bf6d-8859fa4bf687 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 0.095798 Oct 31 15:19:44.491776 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 473/961] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:44 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:44.505546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:44.511977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:44.528193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.529063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.529943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.530884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.531552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.532188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.596730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:44.597075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:44.598021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:44.598739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:44.599333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:44.616489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.619408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.621639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.624429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.625109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.625995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.673966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for project 330c65ee73534d8080c0ec2441c55f16. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:44.691170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for user 02e166a77a2c45ccab7a1f343e53542e and project 330c65ee73534d8080c0ec2441c55f16. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:44.721088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:44.734037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:44.854451 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-50960208-7777-4508-bac4-b84cc2c7af69 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.231562 Oct 31 15:19:44.862626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 489/962] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:19:44.868908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:44.869927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:44.877904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.878820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.879527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:44.880480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:44.881387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:44.882173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.235439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:45.248533 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df118455-f009-49bf-b61e-714aa4695d37 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1325 microversion: 2.1 time: 0.384367 Oct 31 15:19:45.263461 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 490/963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:44 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1325 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:45.463650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:45.521110 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-48f0b3a8-1741-4398-95d1-534f47992085 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1317 microversion: 2.1 time: 1.026642 Oct 31 15:19:45.541306 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 474/964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:44 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1317 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:45.549833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:45.551845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:45.563298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.565723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.567091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.568115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.569231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.569888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.869428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f030336-4a57-42d1-ac6f-c517b9b691de tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Calling method '.version_select at 0x7f16e161d5e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:45.877539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f030336-4a57-42d1-ac6f-c517b9b691de tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.878911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f030336-4a57-42d1-ac6f-c517b9b691de tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.879531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f030336-4a57-42d1-ac6f-c517b9b691de tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.882577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f030336-4a57-42d1-ac6f-c517b9b691de tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.883276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f030336-4a57-42d1-ac6f-c517b9b691de tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.885032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f030336-4a57-42d1-ac6f-c517b9b691de tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.945629 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f030336-4a57-42d1-ac6f-c517b9b691de tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.680649 Oct 31 15:19:45.953511 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 491/965] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 31 15:19:45 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:45.963588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:45.970514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:45.982813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.984299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.986939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:45.987935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:45.989395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:45.990096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.035578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:46.050343 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77e0c881-46f1-4ea3-b0b5-647a6eafd129 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1472 microversion: 2.1 time: 0.506193 Oct 31 15:19:46.052454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:46.059199 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 475/966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:45 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1472 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:46.079480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:46.082049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:46.117773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.125609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.126479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.127371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.128810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.129237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.354373 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-efd8e525-83eb-4ee7-85c0-86fee5b8e841 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 204 len: 0 microversion: 2.1 time: 0.397427 Oct 31 15:19:46.356463 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 492/967] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:45 2022] DELETE /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:46.364578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f86e6a35-da8b-415f-8c45-3f76abd46fa3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1503550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:46.365121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:46.374295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-304ae6ca-de4f-41ed-a704-3bc6637e7b9f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1239 microversion: 2.1 time: 0.313973 Oct 31 15:19:46.382934 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 476/968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:46 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1239 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:46.476983 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f86e6a35-da8b-415f-8c45-3f76abd46fa3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 0.116578 Oct 31 15:19:46.488187 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 493/969] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:46 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:46.503137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-bbf3a463-2139-4882-a822-dd86a41e9cf9 req-d22aece0-b21e-4721-b0a2-b76491f14460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f12d716d-f599-4b33-8daa-92ba510492c7", "tag": "b3b58473-f7bc-4a28-90d6-972ad40c05fd"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:46.518819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bbf3a463-2139-4882-a822-dd86a41e9cf9 req-d22aece0-b21e-4721-b0a2-b76491f14460 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.519429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bbf3a463-2139-4882-a822-dd86a41e9cf9 req-d22aece0-b21e-4721-b0a2-b76491f14460 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.520850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bbf3a463-2139-4882-a822-dd86a41e9cf9 req-d22aece0-b21e-4721-b0a2-b76491f14460 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.545348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-bbf3a463-2139-4882-a822-dd86a41e9cf9 req-d22aece0-b21e-4721-b0a2-b76491f14460 service nova] Creating event network-changed:b3b58473-f7bc-4a28-90d6-972ad40c05fd for instance f12d716d-f599-4b33-8daa-92ba510492c7 on n-h1-858384-17 Oct 31 15:19:46.553985 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-bbf3a463-2139-4882-a822-dd86a41e9cf9 req-d22aece0-b21e-4721-b0a2-b76491f14460 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063449 Oct 31 15:19:46.554688 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 494/970] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:46.587360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:46.588087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:46.620117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.620534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.620977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.621735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.622180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.622603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.777241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-79a8dbc6-ebc5-414d-94a0-d5749682536c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Calling method '.version_select at 0x7f16e22f4e50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:46.789660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-79a8dbc6-ebc5-414d-94a0-d5749682536c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f024d3fb7fae4b968668a129dd9a3db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31049ac78de4d76a8cbac514b299c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-79a8dbc6-ebc5-414d-94a0-d5749682536c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Request method failure captured: Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-eNIMGhnbTlB0iziW2g4-5vmIIXRaS8pUFTPV2YAnrM-GmSnOGJSbkCt3OU0qhSC9cJVMc6NiCeYX7cJZ9CPXj4kAFY4D3zyX8BH7sU9pezG3-XTEzw9Xl5ZrDysKTTjBqq_I1vDwvbqFylcZV9KQmqfZiWgQg5NqSdkROzfIrIzV4 Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:19:46.799694 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f31049ac78de4d76a8cbac514b299c64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f31049ac78de4d76a8cbac514b299c64"}]}] Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: f024d3fb7fae4b968668a129dd9a3db9 Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: action_args: {} Oct 31 15:19:46.802205 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:19:46.803241 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 31 15:19:46.804960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:46.806213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-79a8dbc6-ebc5-414d-94a0-d5749682536c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:46.806213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-79a8dbc6-ebc5-414d-94a0-d5749682536c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.422519 Oct 31 15:19:46.806213 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 477/971] 10.222.0.20 () {58 vars in 1128 bytes} [Mon Oct 31 15:19:46 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:46.820308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Action: 'action', calling method: .version_select at 0x7f16e308b1f0>, body: {"addFloatingIp": {"address": "172.25.1.70"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:46.836805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:46.854557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.855060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.858257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.861159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:46.862705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:46.864255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:46.964619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "refresh_cache-2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:46.969097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquired lock "refresh_cache-2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:47.038818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:47.051407 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-456ed1ba-4044-440b-9a3d-f1f5805ba707 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1325 microversion: 2.1 time: 0.483574 Oct 31 15:19:47.066184 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 495/972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:46 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:47.078913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:47.083234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:47.101436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.102434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.103125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.104124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.104903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.105587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.363214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:47.376761 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f15cc4e-ae48-4f62-8d33-6886fa029418 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1317 microversion: 2.1 time: 0.307030 Oct 31 15:19:47.377785 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 496/973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:47 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:47.394214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6d217fc-10eb-4b33-a38b-64777dcf4815 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Calling method '.version_select at 0x7f16e1654e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:47.394214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b6d217fc-10eb-4b33-a38b-64777dcf4815 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f024d3fb7fae4b968668a129dd9a3db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31049ac78de4d76a8cbac514b299c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6d217fc-10eb-4b33-a38b-64777dcf4815 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Request method failure captured: Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hosts/n-d-858384-17/reboot HTTP/1.1 Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-eNIMGhnbTlB0iziW2g4-5vmIIXRaS8pUFTPV2YAnrM-GmSnOGJSbkCt3OU0qhSC9cJVMc6NiCeYX7cJZ9CPXj4kAFY4D3zyX8BH7sU9pezG3-XTEzw9Xl5ZrDysKTTjBqq_I1vDwvbqFylcZV9KQmqfZiWgQg5NqSdkROzfIrIzV4 Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:19:47.416748 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f31049ac78de4d76a8cbac514b299c64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f31049ac78de4d76a8cbac514b299c64"}]}] Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: f024d3fb7fae4b968668a129dd9a3db9 Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'n-d-858384-17'} Oct 31 15:19:47.418444 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:19:47.419418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 31 15:19:47.420767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:47.423496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6d217fc-10eb-4b33-a38b-64777dcf4815 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:47.426115 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6d217fc-10eb-4b33-a38b-64777dcf4815 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-858384-17/reboot" status: 403 len: 111 microversion: 2.1 time: 0.039925 Oct 31 15:19:47.431520 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 497/974] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Oct 31 15:19:47 2022] GET /compute/v2.1/os-hosts/n-d-858384-17/reboot => generated 111 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:47.453227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:47.463704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:47.491141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.493750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.496996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.497981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.498621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.499231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.939557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:47.948721 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-201452e2-f6f1-4d23-a987-b5765da66645 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1472 microversion: 2.1 time: 0.516047 Oct 31 15:19:47.953220 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 498/975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:47 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1472 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:47.963823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:47.967688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:47.976022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.976894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.977691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:47.978730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:47.988103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:47.988914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:48.162166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:48.182500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-747ce7e2-5600-4be5-93aa-57256659a955 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1287 microversion: 2.1 time: 0.223361 Oct 31 15:19:48.184967 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 499/976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:47 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1287 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:48.190852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e8ddbcd-0f95-49ae-b4f1-5f2a5a3c3a0b tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Calling method '.version_select at 0x7f16e21e69d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:48.227890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:48.250807 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-2e8ddbcd-0f95-49ae-b4f1-5f2a5a3c3a0b tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e8ddbcd-0f95-49ae-b4f1-5f2a5a3c3a0b tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Request method failure captured: Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-ePzNd5Y5Ca-vi254LE3clryBWZ5kZkds2wjkePhjJd12eMy6EV7fYE3yrt2keAdX88Kb2PBzgMAv28cXMJmOBwMvogCXep9_HDkFYhRjvU1w4rFh6VpirM9S9q0_DNdLxOA1dCXMo0LmVNOiMrh6EqgBPguip_mayy9lYP1PVraXk Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:19:48.255932 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bdf39d25dd44de6b95029f21ad298ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bdf39d25dd44de6b95029f21ad298ed"}]}] Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 089c136a5c93496898e40692316c3a12 Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'nonexistent_hostname'} Oct 31 15:19:48.258188 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:19:48.259098 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 31 15:19:48.262561 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:48.265186 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:48.269708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e8ddbcd-0f95-49ae-b4f1-5f2a5a3c3a0b tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:48.274357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e8ddbcd-0f95-49ae-b4f1-5f2a5a3c3a0b tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.087908 Oct 31 15:19:48.282936 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 500/977] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Oct 31 15:19:48 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:19:48.292573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6860df82-9b8d-4825-a6c3-cca8a4801b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e158bca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:48.437451 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6860df82-9b8d-4825-a6c3-cca8a4801b55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1413 microversion: 2.1 time: 0.152732 Oct 31 15:19:48.447017 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 501/978] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:48 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1413 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:48.447017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2de8946c-f591-46d5-bab5-c4fb8116816b req-9d854e13-6a3a-435c-8570-af748b861011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f355cce-ede6-4994-aa19-cd61fe08a88b", "name": "network-vif-plugged", "status": "completed", "tag": "7343b2a0-981d-428e-861f-81276107d0ee"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:48.481636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2de8946c-f591-46d5-bab5-c4fb8116816b req-9d854e13-6a3a-435c-8570-af748b861011 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:48.482692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2de8946c-f591-46d5-bab5-c4fb8116816b req-9d854e13-6a3a-435c-8570-af748b861011 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:48.497319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2de8946c-f591-46d5-bab5-c4fb8116816b req-9d854e13-6a3a-435c-8570-af748b861011 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:48.541927 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2de8946c-f591-46d5-bab5-c4fb8116816b req-9d854e13-6a3a-435c-8570-af748b861011 service nova] Creating event network-vif-plugged:7343b2a0-981d-428e-861f-81276107d0ee for instance 0f355cce-ede6-4994-aa19-cd61fe08a88b on n-h1-858384-17 Oct 31 15:19:48.564566 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2de8946c-f591-46d5-bab5-c4fb8116816b req-9d854e13-6a3a-435c-8570-af748b861011 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120939 Oct 31 15:19:48.586626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 502/979] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:48.605072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:48.605373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:48.628796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:48.630497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:48.630958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:48.635048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:48.635218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:48.635661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.111633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:49.133653 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5fb7a138-8919-4f39-a327-1988797b104b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1325 microversion: 2.1 time: 0.543120 Oct 31 15:19:49.134859 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 503/980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:48 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1325 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:49.151232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a20f748a-4918-4b78-94fb-11f78085248c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Calling method '.version_select at 0x7f16e1654e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:49.154388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a20f748a-4918-4b78-94fb-11f78085248c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f024d3fb7fae4b968668a129dd9a3db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31049ac78de4d76a8cbac514b299c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a20f748a-4918-4b78-94fb-11f78085248c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Request method failure captured: Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hosts/n-d-858384-17 HTTP/1.1 Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-eNIMGhnbTlB0iziW2g4-5vmIIXRaS8pUFTPV2YAnrM-GmSnOGJSbkCt3OU0qhSC9cJVMc6NiCeYX7cJZ9CPXj4kAFY4D3zyX8BH7sU9pezG3-XTEzw9Xl5ZrDysKTTjBqq_I1vDwvbqFylcZV9KQmqfZiWgQg5NqSdkROzfIrIzV4 Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:19:49.157236 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f31049ac78de4d76a8cbac514b299c64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f31049ac78de4d76a8cbac514b299c64"}]}] Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: f024d3fb7fae4b968668a129dd9a3db9 Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'n-d-858384-17'} Oct 31 15:19:49.158580 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:19:49.159509 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 31 15:19:49.160613 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:49.165001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a20f748a-4918-4b78-94fb-11f78085248c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:49.168274 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a20f748a-4918-4b78-94fb-11f78085248c tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-858384-17" status: 403 len: 109 microversion: 2.1 time: 0.031340 Oct 31 15:19:49.177084 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 504/981] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 31 15:19:49 2022] GET /compute/v2.1/os-hosts/n-d-858384-17 => generated 109 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:49.183770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:49.196557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:49.218041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.218930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.221708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.227130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.227995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.228680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.696173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:49.751770 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c12ca4f-be4f-489c-b505-81c9f084ccf8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1317 microversion: 2.1 time: 0.572612 Oct 31 15:19:49.753382 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 505/982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:49 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:49.867214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:49.867821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:49.883344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.883837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.884269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:49.884989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:49.885463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:49.885883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.149054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:50.157626 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4c8717b-8e6f-402b-888f-f33aac97e75f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1478 microversion: 2.1 time: 0.402573 Oct 31 15:19:50.173159 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 506/983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:49 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1478 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:50.173159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-11667a62-bcde-4b67-9eaa-b219331ee88a req-22bfea22-1aad-4f43-bcb2-5dbf97dcb572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72b4f6b-9440-4133-86b7-51c220a045e8", "name": "network-vif-deleted", "tag": "846e803d-aa39-4944-9fc5-b4924f9abb1e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:50.200123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-11667a62-bcde-4b67-9eaa-b219331ee88a req-22bfea22-1aad-4f43-bcb2-5dbf97dcb572 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:50.200612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-11667a62-bcde-4b67-9eaa-b219331ee88a req-22bfea22-1aad-4f43-bcb2-5dbf97dcb572 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:50.201260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-11667a62-bcde-4b67-9eaa-b219331ee88a req-22bfea22-1aad-4f43-bcb2-5dbf97dcb572 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.219981 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-11667a62-bcde-4b67-9eaa-b219331ee88a req-22bfea22-1aad-4f43-bcb2-5dbf97dcb572 service nova] Creating event network-vif-deleted:846e803d-aa39-4944-9fc5-b4924f9abb1e for instance a72b4f6b-9440-4133-86b7-51c220a045e8 on n-h1-858384-17 Oct 31 15:19:50.227445 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-11667a62-bcde-4b67-9eaa-b219331ee88a req-22bfea22-1aad-4f43-bcb2-5dbf97dcb572 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065626 Oct 31 15:19:50.253950 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 507/984] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:50.275523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01eed224-e4ea-42e1-8f1b-6c8c5201b584 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Calling method '.version_select at 0x7f16e1620e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:50.290278 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-01eed224-e4ea-42e1-8f1b-6c8c5201b584 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01eed224-e4ea-42e1-8f1b-6c8c5201b584 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Request method failure captured: Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-ePzNd5Y5Ca-vi254LE3clryBWZ5kZkds2wjkePhjJd12eMy6EV7fYE3yrt2keAdX88Kb2PBzgMAv28cXMJmOBwMvogCXep9_HDkFYhRjvU1w4rFh6VpirM9S9q0_DNdLxOA1dCXMo0LmVNOiMrh6EqgBPguip_mayy9lYP1PVraXk Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:19:50.292988 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bdf39d25dd44de6b95029f21ad298ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bdf39d25dd44de6b95029f21ad298ed"}]}] Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 089c136a5c93496898e40692316c3a12 Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'nonexistent_hostname'} Oct 31 15:19:50.296958 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:50.297812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:50.298994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:50.300134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01eed224-e4ea-42e1-8f1b-6c8c5201b584 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:50.300134 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01eed224-e4ea-42e1-8f1b-6c8c5201b584 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.036149 Oct 31 15:19:50.300134 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 508/985] 10.222.0.20 () {58 vars in 1191 bytes} [Mon Oct 31 15:19:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:19:50.301269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:50.303525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:50.313041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:50.313730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:50.314173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.315020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:50.315751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:50.316181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:50.410491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:50.421904 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9879c7e-6bd6-4ba6-bbc9-a2c106bed752 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1293 microversion: 2.1 time: 0.124876 Oct 31 15:19:50.423022 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 509/986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:50 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1293 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:50.428752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f3d88d4e-4b73-4cad-9285-5600b2fd011f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e161d5e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:51.298668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Building network info cache for instance {{(pid=120588) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:53.272650 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f3d88d4e-4b73-4cad-9285-5600b2fd011f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1422 microversion: 2.1 time: 2.847738 Oct 31 15:19:53.274177 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 510/987] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:50 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1422 bytes in 2851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:53.285426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:53.286043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:53.299667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.301311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.302020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.305794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.306543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.307153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.334983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:53.445427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Updating instance_info_cache with network_info: [{"id": "2c55825a-fb54-4ab3-bbd2-1d30165b004b", "address": "fa:16:3e:99:d1:82", "network": {"id": "390a7fc2-64bf-4547-850c-d9842b2f402b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1729819416-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7742c88f9c1141b7aaadd8e3c855b075", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2c55825a-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120588) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:53.461074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Releasing lock "refresh_cache-2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:19:53.462022 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09415782-aa84-44a4-8a89-5e85dc8ccf66 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "POST /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae/action" status: 202 len: 0 microversion: 2.1 time: 6.650868 Oct 31 15:19:53.462940 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 478/988] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:46 2022] POST /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae/action => generated 0 bytes in 6660 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:19:53.472796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:53.475314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e8d9b3c-af49-4c5b-9ad9-e21d315e1049 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Calling method '.version_select at 0x7f16e13f7dc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:53.477203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e8d9b3c-af49-4c5b-9ad9-e21d315e1049 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f024d3fb7fae4b968668a129dd9a3db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31049ac78de4d76a8cbac514b299c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e8d9b3c-af49-4c5b-9ad9-e21d315e1049 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Request method failure captured: Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-hosts/n-d-858384-17/shutdown HTTP/1.1 Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-eNIMGhnbTlB0iziW2g4-5vmIIXRaS8pUFTPV2YAnrM-GmSnOGJSbkCt3OU0qhSC9cJVMc6NiCeYX7cJZ9CPXj4kAFY4D3zyX8BH7sU9pezG3-XTEzw9Xl5ZrDysKTTjBqq_I1vDwvbqFylcZV9KQmqfZiWgQg5NqSdkROzfIrIzV4 Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:19:53.478838 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f31049ac78de4d76a8cbac514b299c64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f31049ac78de4d76a8cbac514b299c64"}]}] Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: f024d3fb7fae4b968668a129dd9a3db9 Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'n-d-858384-17'} Oct 31 15:19:53.480452 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:19:53.481375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 31 15:19:53.482548 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:53.483593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e8d9b3c-af49-4c5b-9ad9-e21d315e1049 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:53.483593 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e8d9b3c-af49-4c5b-9ad9-e21d315e1049 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-858384-17/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016242 Oct 31 15:19:53.483593 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 479/989] 10.222.0.20 () {58 vars in 1197 bytes} [Mon Oct 31 15:19:53 2022] GET /compute/v2.1/os-hosts/n-d-858384-17/shutdown => generated 113 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:53.483802 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-988a5d46-b097-49a7-aa64-d75ccc61991f tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1521 microversion: 2.1 time: 0.207136 Oct 31 15:19:53.488023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:53.488656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:53.491199 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 511/990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:53 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:53.497597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.499115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.499115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.499864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.500606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.501292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.504151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:53.510796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:53.530566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.531174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.531682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.532491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.533980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.534488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.718381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:53.730417 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d236c8c0-7297-447d-94ff-e147dddfca6f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1463 microversion: 2.1 time: 0.235055 Oct 31 15:19:53.731862 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 512/991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:53 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1463 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:53.737529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f5b63847-9688-42f0-9b5c-ba9e39938200 req-3b0bc1b8-5e24-4f80-bbff-44fff72771b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7bdeeb-cdce-44a1-929e-1d817a2b80ae", "tag": "2c55825a-fb54-4ab3-bbd2-1d30165b004b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:53.751325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f5b63847-9688-42f0-9b5c-ba9e39938200 req-3b0bc1b8-5e24-4f80-bbff-44fff72771b4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.752147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f5b63847-9688-42f0-9b5c-ba9e39938200 req-3b0bc1b8-5e24-4f80-bbff-44fff72771b4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.761431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f5b63847-9688-42f0-9b5c-ba9e39938200 req-3b0bc1b8-5e24-4f80-bbff-44fff72771b4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.785644 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f5b63847-9688-42f0-9b5c-ba9e39938200 req-3b0bc1b8-5e24-4f80-bbff-44fff72771b4 service nova] Creating event network-changed:2c55825a-fb54-4ab3-bbd2-1d30165b004b for instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae on n-h1-858384-17 Oct 31 15:19:53.791871 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f5b63847-9688-42f0-9b5c-ba9e39938200 req-3b0bc1b8-5e24-4f80-bbff-44fff72771b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058529 Oct 31 15:19:53.794334 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 513/992] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:53.800246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:53.801212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:53.809177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.809177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.809177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.810429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:53.810429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:53.810931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:53.989610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:53.992376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:53.999579 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78094338-8cdc-453a-8ed3-2e64cbd78799 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1360 microversion: 2.1 time: 0.203561 Oct 31 15:19:54.001325 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a062d2bc-3061-4277-ab73-bd40a149b8de tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1317 microversion: 2.1 time: 0.518951 Oct 31 15:19:54.003755 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 514/993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:53 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:54.010953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b16c232-eced-4101-8c30-0ee0ac7a58ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e161d5e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:54.016551 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 480/994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:53 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:54.026637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d17133a2-63bc-4fd7-9ae2-56184adc2d32 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '.version_select at 0x7f16e13941f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:54.082495 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b16c232-eced-4101-8c30-0ee0ac7a58ea tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 200 len: 1422 microversion: 2.1 time: 0.077322 Oct 31 15:19:54.083203 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 515/995] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:19:54 2022] GET /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:54.088919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fce17e5a-52b4-4733-8c60-affa478121a6 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Calling method '.version_select at 0x7f16e19588b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:54.101164 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-fce17e5a-52b4-4733-8c60-affa478121a6 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fce17e5a-52b4-4733-8c60-affa478121a6 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Request method failure captured: Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-ePzNd5Y5Ca-vi254LE3clryBWZ5kZkds2wjkePhjJd12eMy6EV7fYE3yrt2keAdX88Kb2PBzgMAv28cXMJmOBwMvogCXep9_HDkFYhRjvU1w4rFh6VpirM9S9q0_DNdLxOA1dCXMo0LmVNOiMrh6EqgBPguip_mayy9lYP1PVraXk Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:19:54.103323 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bdf39d25dd44de6b95029f21ad298ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bdf39d25dd44de6b95029f21ad298ed"}]}] Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 089c136a5c93496898e40692316c3a12 Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'nonexistent_hostname'} Oct 31 15:19:54.104642 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:19:54.105781 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 31 15:19:54.107062 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fce17e5a-52b4-4733-8c60-affa478121a6 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fce17e5a-52b4-4733-8c60-affa478121a6 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.020537 Oct 31 15:19:54.108461 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 516/996] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:19:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:19:54.116386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:54.117027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:54.126148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:54.126770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:54.127315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:54.128150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:54.128708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:54.129293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:54.188357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:54.338009 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-872393d6-7b6a-4a6d-aa5a-5977cab02681 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 204 len: 0 microversion: 2.1 time: 0.225367 Oct 31 15:19:54.339677 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 517/997] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:54 2022] DELETE /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:54.351032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52664a06-8a49-4d5f-976d-d5d8ac73567d tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:54.359019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52664a06-8a49-4d5f-976d-d5d8ac73567d tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:54.368442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52664a06-8a49-4d5f-976d-d5d8ac73567d tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:54.370025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52664a06-8a49-4d5f-976d-d5d8ac73567d tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:54.370563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52664a06-8a49-4d5f-976d-d5d8ac73567d tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:54.371386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52664a06-8a49-4d5f-976d-d5d8ac73567d tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:54.371993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52664a06-8a49-4d5f-976d-d5d8ac73567d tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:54.372490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52664a06-8a49-4d5f-976d-d5d8ac73567d tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:54.509936 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52664a06-8a49-4d5f-976d-d5d8ac73567d tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action" status: 202 len: 0 microversion: 2.1 time: 0.167905 Oct 31 15:19:54.511103 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 518/998] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:54 2022] POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:54.516273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0110fe93-b8f6-4bbb-9ed7-6f2ca4566459 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1528d30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:54.706011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:54.967948 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d17133a2-63bc-4fd7-9ae2-56184adc2d32 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/b528cf42-0b64-4703-be07-784b5e313c86" status: 200 len: 183 microversion: 2.1 time: 0.950091 Oct 31 15:19:54.968523 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 481/999] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:19:54 2022] GET /compute/v2.1/os-floating-ips/b528cf42-0b64-4703-be07-784b5e313c86 => generated 183 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:54.973434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97908a99-839e-422a-a1ca-f5bccc0c62a8 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Calling method '.version_select at 0x7f16e1394310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:54.976119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-97908a99-839e-422a-a1ca-f5bccc0c62a8 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f024d3fb7fae4b968668a129dd9a3db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31049ac78de4d76a8cbac514b299c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97908a99-839e-422a-a1ca-f5bccc0c62a8 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Request method failure captured: Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-hosts/n-d-858384-17/startup HTTP/1.1 Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-eNIMGhnbTlB0iziW2g4-5vmIIXRaS8pUFTPV2YAnrM-GmSnOGJSbkCt3OU0qhSC9cJVMc6NiCeYX7cJZ9CPXj4kAFY4D3zyX8BH7sU9pezG3-XTEzw9Xl5ZrDysKTTjBqq_I1vDwvbqFylcZV9KQmqfZiWgQg5NqSdkROzfIrIzV4 Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:19:54.981571 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f31049ac78de4d76a8cbac514b299c64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f31049ac78de4d76a8cbac514b299c64"}]}] Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: f024d3fb7fae4b968668a129dd9a3db9 Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'n-d-858384-17'} Oct 31 15:19:54.983106 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:19:54.984124 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 31 15:19:54.985571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:54.990829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97908a99-839e-422a-a1ca-f5bccc0c62a8 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:54.992278 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97908a99-839e-422a-a1ca-f5bccc0c62a8 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/n-d-858384-17/startup" status: 403 len: 110 microversion: 2.1 time: 0.022637 Oct 31 15:19:54.993066 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 482/1000] 10.222.0.20 () {58 vars in 1194 bytes} [Mon Oct 31 15:19:54 2022] GET /compute/v2.1/os-hosts/n-d-858384-17/startup => generated 110 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:55.004291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:55.005357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:55.023603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.027105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.027583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.028386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.028819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.032696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.276840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:55.287536 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16adfa71-a1f2-444b-9571-142fcaa49e42 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1527 microversion: 2.1 time: 0.291252 Oct 31 15:19:55.305444 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 483/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:54 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1527 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:55.311849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:55.313161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:55.322494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.323665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.325872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.328228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.330065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.330895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.395595 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0110fe93-b8f6-4bbb-9ed7-6f2ca4566459 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 204 len: 0 microversion: 2.1 time: 0.883266 Oct 31 15:19:55.397484 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 519/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:54 2022] DELETE /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 0 bytes in 886 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:55.404167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Action: 'action', calling method: .version_select at 0x7f16e308b280>, body: {"removeFloatingIp": {"address": "172.25.1.70"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:55.418362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.419389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.420757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.421462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lazy-loading 'fault' on Instance uuid ec22d439-86fc-48bc-a238-b9e3074d51fa {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:55.581645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:55.589154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.589825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.591611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.592386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.592863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.593327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.741353 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-add1f07a-e960-4e78-9662-05d5516d5b46 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1599 microversion: 2.1 time: 0.431431 Oct 31 15:19:55.744139 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 484/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:55 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1599 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:55.791052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef3867fc-0703-4972-943d-95f6c629abea tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Calling method '.version_select at 0x7f16e1394ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:55.809969 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-ef3867fc-0703-4972-943d-95f6c629abea tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef3867fc-0703-4972-943d-95f6c629abea tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Request method failure captured: Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-ePzNd5Y5Ca-vi254LE3clryBWZ5kZkds2wjkePhjJd12eMy6EV7fYE3yrt2keAdX88Kb2PBzgMAv28cXMJmOBwMvogCXep9_HDkFYhRjvU1w4rFh6VpirM9S9q0_DNdLxOA1dCXMo0LmVNOiMrh6EqgBPguip_mayy9lYP1PVraXk Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:19:55.813913 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bdf39d25dd44de6b95029f21ad298ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bdf39d25dd44de6b95029f21ad298ed"}]}] Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 089c136a5c93496898e40692316c3a12 Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'nonexistent_hostname'} Oct 31 15:19:55.815309 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:19:55.816225 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 31 15:19:55.817442 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:19:55.819732 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:55.835121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef3867fc-0703-4972-943d-95f6c629abea tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:55.841265 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef3867fc-0703-4972-943d-95f6c629abea tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.093586 Oct 31 15:19:55.843412 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 485/1004] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Oct 31 15:19:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:19:55.854103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:55.855055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:55.872168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.872864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.873505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.875337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:55.876788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:55.877966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:55.910042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:55.960159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "refresh_cache-2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:19:55.960762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquired lock "refresh_cache-2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:19:56.515847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:56.525102 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-af8b78be-26b2-4c7b-9ef8-4dd200c1377c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1360 microversion: 2.1 time: 0.680230 Oct 31 15:19:56.528539 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 486/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:55 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1360 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:56.533586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:56.538730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:56.560084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:56.560831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:56.562036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:56.562933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:56.563554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:56.564160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:56.895892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:56.913773 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3fa509a5-eba1-4edd-b964-5fc5d26fa62e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1317 microversion: 2.1 time: 0.381334 Oct 31 15:19:56.915183 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 487/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:56 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:56.924475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:56.925751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:56.936306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:56.937186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:56.937978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:56.938996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:56.939678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:56.940564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.058543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:57.320124 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4bd96ba8-0869-4409-8b68-6a574f53ba59 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 204 len: 0 microversion: 2.1 time: 0.401512 Oct 31 15:19:57.321756 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 488/1007] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:56 2022] DELETE /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:57.352559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c1bc2c5-922e-452f-a1c2-f24602efd3d0 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:57.355798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c1bc2c5-922e-452f-a1c2-f24602efd3d0 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:57.364620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1bc2c5-922e-452f-a1c2-f24602efd3d0 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.369829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1bc2c5-922e-452f-a1c2-f24602efd3d0 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.371951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1bc2c5-922e-452f-a1c2-f24602efd3d0 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.376042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1bc2c5-922e-452f-a1c2-f24602efd3d0 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.376734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1bc2c5-922e-452f-a1c2-f24602efd3d0 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.377401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1bc2c5-922e-452f-a1c2-f24602efd3d0 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.388946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:19:57.528544 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c1bc2c5-922e-452f-a1c2-f24602efd3d0 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action" status: 202 len: 0 microversion: 2.1 time: 0.204429 Oct 31 15:19:57.534843 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 489/1008] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:57 2022] POST /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:19:57.541443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6e16587b-38a0-4b6d-9209-30b26c1d2a32 req-201c7495-a422-4497-b987-2f3f7bb1281b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3848bfc-68ef-48e5-8d45-4a700c478f0a", "tag": "a2841d16-87c1-4e48-935e-723891a9ad43"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:57.552482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6e16587b-38a0-4b6d-9209-30b26c1d2a32 req-201c7495-a422-4497-b987-2f3f7bb1281b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.553831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6e16587b-38a0-4b6d-9209-30b26c1d2a32 req-201c7495-a422-4497-b987-2f3f7bb1281b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.554532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6e16587b-38a0-4b6d-9209-30b26c1d2a32 req-201c7495-a422-4497-b987-2f3f7bb1281b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.568629 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6e16587b-38a0-4b6d-9209-30b26c1d2a32 req-201c7495-a422-4497-b987-2f3f7bb1281b service nova] Creating event network-changed:a2841d16-87c1-4e48-935e-723891a9ad43 for instance f3848bfc-68ef-48e5-8d45-4a700c478f0a on n-h2-858384-17 Oct 31 15:19:57.583636 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6e16587b-38a0-4b6d-9209-30b26c1d2a32 req-201c7495-a422-4497-b987-2f3f7bb1281b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047142 Oct 31 15:19:57.589490 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 490/1009] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:57.596110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aedae2a1-f35d-4efd-9d14-9489c3d9905c tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Action: 'update', calling method: .version_select at 0x7f16e13f7d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aedae2a1-f35d-4efd-9d14-9489c3d9905c tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Request method failure captured: Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: request: PUT /compute/v2.1/os-hosts/n-d-858384-17 HTTP/1.1 Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 51 Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-ePzNd5Y5Ca-vi254LE3clryBWZ5kZkds2wjkePhjJd12eMy6EV7fYE3yrt2keAdX88Kb2PBzgMAv28cXMJmOBwMvogCXep9_HDkFYhRjvU1w4rFh6VpirM9S9q0_DNdLxOA1dCXMo0LmVNOiMrh6EqgBPguip_mayy9lYP1PVraXk Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:19:57.600979 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bdf39d25dd44de6b95029f21ad298ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bdf39d25dd44de6b95029f21ad298ed"}]}] Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 089c136a5c93496898e40692316c3a12 Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: {"status": "enable", "maintenance_mode": "invalid"} Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:19:57.602481 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'n-d-858384-17', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'disable', Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'Enable', Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'Disable', Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance: Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:57.603299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:57.604798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:57.605977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:57.605977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:19:57.605977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:19:57.605977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:19:57.605977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:57.605977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aedae2a1-f35d-4efd-9d14-9489c3d9905c tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:57.605977 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aedae2a1-f35d-4efd-9d14-9489c3d9905c tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-858384-17" status: 400 len: 199 microversion: 2.1 time: 0.012053 Oct 31 15:19:57.605977 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 491/1010] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 31 15:19:57 2022] PUT /compute/v2.1/os-hosts/n-d-858384-17 => generated 199 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:19:57.613906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d869033d-e8d6-440e-b07f-461418cdedbd req-11533391-ae60-45ca-98bb-b98941cd77e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec22d439-86fc-48bc-a238-b9e3074d51fa", "name": "network-vif-plugged", "status": "completed", "tag": "af932539-7d08-4e92-83b1-db17d6e894a3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:57.624775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Building network info cache for instance {{(pid=120587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:19:57.626852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d869033d-e8d6-440e-b07f-461418cdedbd req-11533391-ae60-45ca-98bb-b98941cd77e6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.628604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d869033d-e8d6-440e-b07f-461418cdedbd req-11533391-ae60-45ca-98bb-b98941cd77e6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.629430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d869033d-e8d6-440e-b07f-461418cdedbd req-11533391-ae60-45ca-98bb-b98941cd77e6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.644315 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d869033d-e8d6-440e-b07f-461418cdedbd req-11533391-ae60-45ca-98bb-b98941cd77e6 service nova] Creating event network-vif-plugged:af932539-7d08-4e92-83b1-db17d6e894a3 for instance ec22d439-86fc-48bc-a238-b9e3074d51fa on n-h2-858384-17 Oct 31 15:19:57.651215 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d869033d-e8d6-440e-b07f-461418cdedbd req-11533391-ae60-45ca-98bb-b98941cd77e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042279 Oct 31 15:19:57.652454 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 492/1011] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:57.658005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:57.658713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:57.666063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.666557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.667001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.667706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.668214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.668641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.706526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:57.715261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:57.715639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:57.716426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lazy-loading 'fault' on Instance uuid 0f355cce-ede6-4994-aa19-cd61fe08a88b {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:57.773296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:57.783688 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f799d62-f5d7-4615-94bf-6cf5dedc7550 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1315 microversion: 2.1 time: 0.129988 Oct 31 15:19:57.798947 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 493/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:57 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:57.807809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1442952686", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fae45c93-5c66-4e3d-908c-bfaf50cd6c4a"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:57.882167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] validate_networks() for [('fae45c93-5c66-4e3d-908c-bfaf50cd6c4a', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:19:58.222256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Updating instance_info_cache with network_info: [{"id": "2c55825a-fb54-4ab3-bbd2-1d30165b004b", "address": "fa:16:3e:99:d1:82", "network": {"id": "390a7fc2-64bf-4547-850c-d9842b2f402b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1729819416-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7742c88f9c1141b7aaadd8e3c855b075", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap2c55825a-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:19:58.239294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Releasing lock "refresh_cache-2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:19:58.241526 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dba18988-4e55-4690-92d1-5fcd1159edc1 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "POST /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae/action" status: 202 len: 0 microversion: 2.1 time: 2.841541 Oct 31 15:19:58.242848 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 520/1013] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:19:55 2022] POST /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae/action => generated 0 bytes in 2844 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:19:58.248573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1702646e-4a88-4ddb-8148-db9cb6b5e683 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:58.250071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1702646e-4a88-4ddb-8148-db9cb6b5e683 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:58.257990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1702646e-4a88-4ddb-8148-db9cb6b5e683 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.258688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1702646e-4a88-4ddb-8148-db9cb6b5e683 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.259275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1702646e-4a88-4ddb-8148-db9cb6b5e683 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.260840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1702646e-4a88-4ddb-8148-db9cb6b5e683 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.261543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1702646e-4a88-4ddb-8148-db9cb6b5e683 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.263190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1702646e-4a88-4ddb-8148-db9cb6b5e683 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.434541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:19:58.435151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:19:58.435632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:19:58.436046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:19:58.436532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:19:58.447343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.447614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.448032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.448776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.449263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.450949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.472357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:19:58.479113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for user cd661f82522f4d5ab5f54d9fcdb81232 and project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:19:58.493710 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1702646e-4a88-4ddb-8148-db9cb6b5e683 tempest-ServersAdminTestJSON-1223376932 tempest-ServersAdminTestJSON-1223376932-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1616 microversion: 2.1 time: 0.242390 Oct 31 15:19:58.494975 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 521/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:58 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1616 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:58.507676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:58.508828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:58.509613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:19:58.519363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:19:58.525160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.526521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.527892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.529803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.530938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.532336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.583050 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-effb859b-0013-4357-b197-141d6f0596f9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782376 Oct 31 15:19:58.584806 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 494/1015] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:19:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:19:58.590920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37f49efd-d7ab-4555-8835-37420773c441 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Action: 'update', calling method: .version_select at 0x7f16e1394ee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37f49efd-d7ab-4555-8835-37420773c441 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Request method failure captured: Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: request: PUT /compute/v2.1/os-hosts/n-d-858384-17 HTTP/1.1 Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 51 Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-ePzNd5Y5Ca-vi254LE3clryBWZ5kZkds2wjkePhjJd12eMy6EV7fYE3yrt2keAdX88Kb2PBzgMAv28cXMJmOBwMvogCXep9_HDkFYhRjvU1w4rFh6VpirM9S9q0_DNdLxOA1dCXMo0LmVNOiMrh6EqgBPguip_mayy9lYP1PVraXk Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:19:58.595259 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bdf39d25dd44de6b95029f21ad298ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bdf39d25dd44de6b95029f21ad298ed"}]}] Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 089c136a5c93496898e40692316c3a12 Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: {"status": "invalid", "maintenance_mode": "enable"} Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:19:58.596688 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'n-d-858384-17', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'disable', Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'Enable', Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'Disable', Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance: Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:58.597547 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:58.599009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:58.601532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:58.601532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:19:58.601532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:19:58.601532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 31 15:19:58.601532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:58.601532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37f49efd-d7ab-4555-8835-37420773c441 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:58.601532 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-37f49efd-d7ab-4555-8835-37420773c441 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-858384-17" status: 400 len: 189 microversion: 2.1 time: 0.011087 Oct 31 15:19:58.602849 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 495/1016] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 31 15:19:58 2022] PUT /compute/v2.1/os-hosts/n-d-858384-17 => generated 189 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:19:58.607876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8bfaf9c4-657f-4101-8c74-2edd6c4820bd req-ac69d3e3-9056-45f8-bbd2-61591c775da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a7bdeeb-cdce-44a1-929e-1d817a2b80ae", "tag": "2c55825a-fb54-4ab3-bbd2-1d30165b004b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:58.624215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8bfaf9c4-657f-4101-8c74-2edd6c4820bd req-ac69d3e3-9056-45f8-bbd2-61591c775da0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.624765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8bfaf9c4-657f-4101-8c74-2edd6c4820bd req-ac69d3e3-9056-45f8-bbd2-61591c775da0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.625279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8bfaf9c4-657f-4101-8c74-2edd6c4820bd req-ac69d3e3-9056-45f8-bbd2-61591c775da0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.641723 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8bfaf9c4-657f-4101-8c74-2edd6c4820bd req-ac69d3e3-9056-45f8-bbd2-61591c775da0 service nova] Creating event network-changed:2c55825a-fb54-4ab3-bbd2-1d30165b004b for instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae on n-h1-858384-17 Oct 31 15:19:58.648457 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8bfaf9c4-657f-4101-8c74-2edd6c4820bd req-ac69d3e3-9056-45f8-bbd2-61591c775da0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044219 Oct 31 15:19:58.649469 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 496/1017] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:19:58.655716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:58.656432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:58.681397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.682905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.683529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:58.684469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:58.689743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:58.690523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.071352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:59.096075 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-331556ab-15d0-447c-9dae-adf88cc14d03 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1360 microversion: 2.1 time: 0.599656 Oct 31 15:19:59.099056 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 522/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:58 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1360 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:59.119717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:59.120333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:59.142692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.143828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.145376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.150615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.151207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.151727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.212314 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] HTTP exception thrown: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Request method failure captured: Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 HTTP/1.1 Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-dGQ6WyPc8aHl5OKiVJV6f3KCq_-6amtF9MerXnsDQCISLrY4nesbb4EGlr2ikpqex-6lJ47g4kkHILgQi4alLm9tX-PRWWXTkncsoBlHWcJHEzGheeRPE6MfefWXFQ2Xr3C8_sQ1RUOOAivUeqJWd7qgiHeDIda9jm598yb5RVF2U Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7742c88f9c1141b7aaadd8e3c855b075 Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:19:59.214069 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7742c88f9c1141b7aaadd8e3c855b075"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7742c88f9c1141b7aaadd8e3c855b075", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7742c88f9c1141b7aaadd8e3c855b075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7742c88f9c1141b7aaadd8e3c855b075"}]}] Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7742c88f9c1141b7aaadd8e3c855b075 Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FloatingIPsAssociationTestJSON-221970762-project Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 36899fc1a6f4463a85c9dc6fd2641095 Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-221970762-project Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.215499 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'a72b4f6b-9440-4133-86b7-51c220a045e8'} Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:59.216515 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.217965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.220645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Returning 404 to user: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:59.220645 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3eabfb69-ee28-4e0a-8b63-3e82992bf702 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 404 len: 111 microversion: 2.1 time: 0.112212 Oct 31 15:19:59.226050 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 523/1019] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:59 2022] DELETE /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:59.233994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:59.234508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:59.269951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.270459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.270905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.283759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.284468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.289735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.406958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:19:59.504198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:59.531770 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a15e8435-4b62-4007-b6d8-b02f0cd95baf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1317 microversion: 2.1 time: 0.880692 Oct 31 15:19:59.540856 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 497/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:58 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1317 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:59.546568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:59.547273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:59.553983 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0238ab4-5fe8-4903-9251-fb76bdf6a5c1 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 204 len: 0 microversion: 2.1 time: 0.324783 Oct 31 15:19:59.554686 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 524/1021] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:19:59 2022] DELETE /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:19:59.573730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.579990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.582780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5024f1b-c542-4fdd-ab94-24d8d4f43793 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Action: 'update', calling method: .version_select at 0x7f16e1768820>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:59.583034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.583812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.584509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.584805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.597027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5024f1b-c542-4fdd-ab94-24d8d4f43793 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f024d3fb7fae4b968668a129dd9a3db9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f31049ac78de4d76a8cbac514b299c64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5024f1b-c542-4fdd-ab94-24d8d4f43793 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Request method failure captured: Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/os-hosts/n-d-858384-17 HTTP/1.1 Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 50 Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-eNIMGhnbTlB0iziW2g4-5vmIIXRaS8pUFTPV2YAnrM-GmSnOGJSbkCt3OU0qhSC9cJVMc6NiCeYX7cJZ9CPXj4kAFY4D3zyX8BH7sU9pezG3-XTEzw9Xl5ZrDysKTTjBqq_I1vDwvbqFylcZV9KQmqfZiWgQg5NqSdkROzfIrIzV4 Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:19:59.602878 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f31049ac78de4d76a8cbac514b299c64", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f31049ac78de4d76a8cbac514b299c64"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f31049ac78de4d76a8cbac514b299c64"}]}] Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f31049ac78de4d76a8cbac514b299c64 Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2024618445 Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: f024d3fb7fae4b968668a129dd9a3db9 Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2024618445-project Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: {"status": "enable", "maintenance_mode": "enable"} Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 31 15:19:59.604356 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'n-d-858384-17', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:19:59.605278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 31 15:19:59.606464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.607605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5024f1b-c542-4fdd-ab94-24d8d4f43793 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:59.607605 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5024f1b-c542-4fdd-ab94-24d8d4f43793 tempest-HostsAdminNegativeTestJSON-2024618445 tempest-HostsAdminNegativeTestJSON-2024618445-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-858384-17" status: 403 len: 111 microversion: 2.1 time: 0.051505 Oct 31 15:19:59.615897 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 525/1022] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 31 15:19:59 2022] PUT /compute/v2.1/os-hosts/n-d-858384-17 => generated 111 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:59.621882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:59.623516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:59.634566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.635454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.637080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.638184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.639075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.639719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.691503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.692311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.694132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.694940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lazy-loading 'fault' on Instance uuid 0f355cce-ede6-4994-aa19-cd61fe08a88b {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:19:59.816320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748f45dc720144a49ca38e9e3b185410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '786fdf71bdb44504b15ae68b83e9dd41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:59.828827 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac6ee482-c245-45e8-93a8-282560878b3e tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 200 len: 1315 microversion: 2.1 time: 0.209503 Oct 31 15:19:59.830305 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 526/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:59 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:59.843621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:59.846456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: a72b4f6b-9440-4133-86b7-51c220a045e8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:59.865685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.866692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.867387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.868425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.876166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.881584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:19:59.924864 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] HTTP exception thrown: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.928948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Request method failure captured: Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 HTTP/1.1 Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-dGQ6WyPc8aHl5OKiVJV6f3KCq_-6amtF9MerXnsDQCISLrY4nesbb4EGlr2ikpqex-6lJ47g4kkHILgQi4alLm9tX-PRWWXTkncsoBlHWcJHEzGheeRPE6MfefWXFQ2Xr3C8_sQ1RUOOAivUeqJWd7qgiHeDIda9jm598yb5RVF2U Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7742c88f9c1141b7aaadd8e3c855b075 Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:19:59.930819 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7742c88f9c1141b7aaadd8e3c855b075"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7742c88f9c1141b7aaadd8e3c855b075", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7742c88f9c1141b7aaadd8e3c855b075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7742c88f9c1141b7aaadd8e3c855b075"}]}] Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7742c88f9c1141b7aaadd8e3c855b075 Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FloatingIPsAssociationTestJSON-221970762-project Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 36899fc1a6f4463a85c9dc6fd2641095 Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-221970762-project Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.932157 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'a72b4f6b-9440-4133-86b7-51c220a045e8'} Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:59.932991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. Oct 31 15:19:59.934232 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.935303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Returning 404 to user: Instance a72b4f6b-9440-4133-86b7-51c220a045e8 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:59.935303 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca982c55-494c-4b48-82b9-245e8fd124db tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8" status: 404 len: 111 microversion: 2.1 time: 0.101080 Oct 31 15:19:59.937352 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 527/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:59 2022] GET /compute/v2.1/servers/a72b4f6b-9440-4133-86b7-51c220a045e8 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:19:59.945372 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0aefe3bf-6662-4fc6-855b-4ad5c09267d2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1212 microversion: 2.1 time: 0.402688 Oct 31 15:19:59.946075 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 498/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:59 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1212 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:19:59.950489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6a3833c-d886-414b-ba57-69351cc4354d tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Action: 'update', calling method: .version_select at 0x7f16e171f310>, body: {"status": null, "maintenance_mode": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:59.952401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:19:59.954366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6a3833c-d886-414b-ba57-69351cc4354d tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Request method failure captured: Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: request: PUT /compute/v2.1/os-hosts/n-d-858384-17 HTTP/1.1 Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 42 Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-ePzNd5Y5Ca-vi254LE3clryBWZ5kZkds2wjkePhjJd12eMy6EV7fYE3yrt2keAdX88Kb2PBzgMAv28cXMJmOBwMvogCXep9_HDkFYhRjvU1w4rFh6VpirM9S9q0_DNdLxOA1dCXMo0LmVNOiMrh6EqgBPguip_mayy9lYP1PVraXk Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:19:59.962893 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bdf39d25dd44de6b95029f21ad298ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bdf39d25dd44de6b95029f21ad298ed"}]}] Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 089c136a5c93496898e40692316c3a12 Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: {"status": null, "maintenance_mode": null} Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 31 15:19:59.964244 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'n-d-858384-17', 'body': {'status': None, 'maintenance_mode': None}} Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'disable', Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'Enable', Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'Disable', Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance: Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi None Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:59.965074 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:19:59.966909 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:19:59.968021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:19:59.968021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:19:59.968021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 31 15:19:59.968021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:19:59.968021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6a3833c-d886-414b-ba57-69351cc4354d tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:19:59.968021 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6a3833c-d886-414b-ba57-69351cc4354d tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/n-d-858384-17" status: 400 len: 127 microversion: 2.1 time: 0.017594 Oct 31 15:19:59.970917 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 499/1026] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Oct 31 15:19:59 2022] PUT /compute/v2.1/os-hosts/n-d-858384-17 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:19:59.988737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-22301cae-2020-4b11-bd88-a3536cb7865a req-964ad9b9-f3f1-430d-b037-f1388b190ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f355cce-ede6-4994-aa19-cd61fe08a88b", "name": "network-vif-deleted", "tag": "7343b2a0-981d-428e-861f-81276107d0ee"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:19:59.994431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:19:59.996896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:19:59.998356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.000065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.003272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.004152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.017107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22301cae-2020-4b11-bd88-a3536cb7865a req-964ad9b9-f3f1-430d-b037-f1388b190ac7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.017682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22301cae-2020-4b11-bd88-a3536cb7865a req-964ad9b9-f3f1-430d-b037-f1388b190ac7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.018130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22301cae-2020-4b11-bd88-a3536cb7865a req-964ad9b9-f3f1-430d-b037-f1388b190ac7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.046702 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-22301cae-2020-4b11-bd88-a3536cb7865a req-964ad9b9-f3f1-430d-b037-f1388b190ac7 service nova] Creating event network-vif-deleted:7343b2a0-981d-428e-861f-81276107d0ee for instance 0f355cce-ede6-4994-aa19-cd61fe08a88b on n-h1-858384-17 Oct 31 15:20:00.056262 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-22301cae-2020-4b11-bd88-a3536cb7865a req-964ad9b9-f3f1-430d-b037-f1388b190ac7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083919 Oct 31 15:20:00.056509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:00.057208 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 500/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:00.073061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-76377d6c-2b29-40fa-b431-8ec4cba13897 req-e5b8ee08-538f-4d46-859e-842fc4cbca47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12d716d-f599-4b33-8daa-92ba510492c7", "name": "network-vif-plugged", "status": "completed", "tag": "b3b58473-f7bc-4a28-90d6-972ad40c05fd"}, {"server_uuid": "20f21ec1-2fb0-4adc-a4fb-c3d41643dca7", "name": "network-vif-unplugged", "status": "completed", "tag": "6c3880f7-29f4-4ecb-96f6-a91817391f10"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:00.104524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-76377d6c-2b29-40fa-b431-8ec4cba13897 req-e5b8ee08-538f-4d46-859e-842fc4cbca47 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.105044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-76377d6c-2b29-40fa-b431-8ec4cba13897 req-e5b8ee08-538f-4d46-859e-842fc4cbca47 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.105563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-76377d6c-2b29-40fa-b431-8ec4cba13897 req-e5b8ee08-538f-4d46-859e-842fc4cbca47 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.145409 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-76377d6c-2b29-40fa-b431-8ec4cba13897 req-e5b8ee08-538f-4d46-859e-842fc4cbca47 service nova] Creating event network-vif-plugged:b3b58473-f7bc-4a28-90d6-972ad40c05fd for instance f12d716d-f599-4b33-8daa-92ba510492c7 on n-h1-858384-17 Oct 31 15:20:00.145965 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-76377d6c-2b29-40fa-b431-8ec4cba13897 req-e5b8ee08-538f-4d46-859e-842fc4cbca47 service nova] Creating event network-vif-unplugged:6c3880f7-29f4-4ecb-96f6-a91817391f10 for instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 on n-h1-858384-17 Oct 31 15:20:00.166897 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-76377d6c-2b29-40fa-b431-8ec4cba13897 req-e5b8ee08-538f-4d46-859e-842fc4cbca47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.107576 Oct 31 15:20:00.167642 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 501/1028] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:00.177730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-707f9c9f-3861-4488-92a2-6388f722f9f3 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '.version_select at 0x7f16e13779d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:00.308509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:00.320278 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a26674ee-a207-49ab-8922-587e07fe9428 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1470 microversion: 2.1 time: 0.380540 Oct 31 15:20:00.321013 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 528/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:19:59 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1470 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:00.326901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35ceb881-d10f-44a6-ab0d-4c6811d9fad0 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Action: 'update', calling method: .version_select at 0x7f16e1768d30>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:00.330961 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.hosts [None req-35ceb881-d10f-44a6-ab0d-4c6811d9fad0 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Enabling host nonexistent_hostname. Oct 31 15:20:00.342332 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-35ceb881-d10f-44a6-ab0d-4c6811d9fad0 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35ceb881-d10f-44a6-ab0d-4c6811d9fad0 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Request method failure captured: Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 50 Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-ePzNd5Y5Ca-vi254LE3clryBWZ5kZkds2wjkePhjJd12eMy6EV7fYE3yrt2keAdX88Kb2PBzgMAv28cXMJmOBwMvogCXep9_HDkFYhRjvU1w4rFh6VpirM9S9q0_DNdLxOA1dCXMo0LmVNOiMrh6EqgBPguip_mayy9lYP1PVraXk Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:20:00.350808 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bdf39d25dd44de6b95029f21ad298ed", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bdf39d25dd44de6b95029f21ad298ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bdf39d25dd44de6b95029f21ad298ed"}]}] Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5bdf39d25dd44de6b95029f21ad298ed Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-298956075 Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 089c136a5c93496898e40692316c3a12 Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-HostsAdminNegativeTestJSON-298956075-project-admin Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: {"status": "enable", "maintenance_mode": "enable"} Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:20:00.352556 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5992, in targeted Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 31 15:20:00.353435 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:20:00.354533 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:00.355705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35ceb881-d10f-44a6-ab0d-4c6811d9fad0 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:00.356593 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35ceb881-d10f-44a6-ab0d-4c6811d9fad0 tempest-HostsAdminNegativeTestJSON-298956075 tempest-HostsAdminNegativeTestJSON-298956075-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.033449 Oct 31 15:20:00.365640 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 529/1030] 10.222.0.20 () {60 vars in 1211 bytes} [Mon Oct 31 15:20:00 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:20:00.376668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:00.377580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:00.406966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.410231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.413256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.415261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.418052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.420675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.764958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:00.780959 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89d59bc6-6b4b-4baf-ba94-5f0e50a6ce95 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1360 microversion: 2.1 time: 0.408823 Oct 31 15:20:00.782216 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 530/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:00 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1360 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:00.798989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:00.800279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:00.815232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.816045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.817044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:00.824391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:00.825142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:00.825778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.148875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:01.166967 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1de40921-40a0-47f7-96a7-a10a13f51f02 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1317 microversion: 2.1 time: 0.382442 Oct 31 15:20:01.190773 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 531/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:00 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:01.203692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:01.204994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0f355cce-ede6-4994-aa19-cd61fe08a88b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:01.228693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.229706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.230210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.230970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.231429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.231950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.251133 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Instance 0f355cce-ede6-4994-aa19-cd61fe08a88b could not be found. Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b HTTP/1.1 Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:20:01.252884 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 0f355cce-ede6-4994-aa19-cd61fe08a88b could not be found. Oct 31 15:20:01.255929 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '0f355cce-ede6-4994-aa19-cd61fe08a88b'} Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f355cce-ede6-4994-aa19-cd61fe08a88b could not be found. Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:01.260773 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f355cce-ede6-4994-aa19-cd61fe08a88b could not be found. Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f355cce-ede6-4994-aa19-cd61fe08a88b could not be found. Oct 31 15:20:01.263887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.267207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Instance 0f355cce-ede6-4994-aa19-cd61fe08a88b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:01.267207 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-98974214-8fbd-4408-913c-62917947261b tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b" status: 404 len: 111 microversion: 2.1 time: 0.063107 Oct 31 15:20:01.267207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 532/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:01 2022] GET /compute/v2.1/servers/0f355cce-ede6-4994-aa19-cd61fe08a88b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:01.268466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:01.273710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:01.287730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.288628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.288628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.289404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.289865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.290640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.448350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:01.471935 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a896b606-ae42-41f9-bac9-5555b5c85eac tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1260 microversion: 2.1 time: 0.213280 Oct 31 15:20:01.472861 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 533/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:01 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:01.478221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28f99044-d88b-431c-aec5-eeaab9785a15 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '.version_select at 0x7f16e1620280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:01.520195 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-28f99044-d88b-431c-aec5-eeaab9785a15 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Image not found. Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28f99044-d88b-431c-aec5-eeaab9785a15 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/images/df4dbcd5-e6d8-4af8-860c-9736080c05dc HTTP/1.1 Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:20:01.523383 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: exception: Image not found. Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'df4dbcd5-e6d8-4af8-860c-9736080c05dc'} Oct 31 15:20:01.524633 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image df4dbcd5-e6d8-4af8-860c-9736080c05dc to delete Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:01.525726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image df4dbcd5-e6d8-4af8-860c-9736080c05dc could not be found. Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:01.526898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28f99044-d88b-431c-aec5-eeaab9785a15 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Image not found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:01.528134 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-28f99044-d88b-431c-aec5-eeaab9785a15 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/images/df4dbcd5-e6d8-4af8-860c-9736080c05dc" status: 404 len: 62 microversion: 2.1 time: 0.051977 Oct 31 15:20:01.530450 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 534/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:01 2022] DELETE /compute/v2.1/images/df4dbcd5-e6d8-4af8-860c-9736080c05dc => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:20:01.536075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:01.537246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:01.547344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.547845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.548338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:01.549055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:01.549604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:01.550348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.329902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:02.345136 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9b4a5ee-cec5-44bc-ab71-da967a956c86 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1470 microversion: 2.1 time: 0.811201 Oct 31 15:20:02.345961 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 535/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:01 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1470 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:02.359801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:02.373699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:02.388972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.390283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.390962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.391977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.392867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.393546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.426996 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 HTTP/1.1 Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:20:02.429784 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:02.431223 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '0de28ff5-937b-433f-831c-c8c899fc3b79'} Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:02.431956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:02.433460 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:02.434933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:02.434933 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-18c72592-1818-4cee-a68f-8022b0fe9f16 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 404 len: 111 microversion: 2.1 time: 0.083629 Oct 31 15:20:02.434933 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 536/1037] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:02 2022] DELETE /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:02.438718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:02.439486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:02.448015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.448707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.450286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.451340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:02.452057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:02.452773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:02.945473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:02.972285 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-523cb0fb-086b-4727-80f9-080b471ee25b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1360 microversion: 2.1 time: 0.539299 Oct 31 15:20:02.974412 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 537/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:02 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1360 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:02.991155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:02.991865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:03.003348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.006163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.006835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.007680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.010476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.010999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.410609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:03.421066 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e14a3d0c-cc53-4032-bf79-c2241e3b355f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1467 microversion: 2.1 time: 0.442883 Oct 31 15:20:03.424854 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 538/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:02 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1467 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:03.434913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a63739c6-872e-4c61-ab4c-dc2762743617 req-3630a49d-8757-4984-a4ce-f7577977e08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3848bfc-68ef-48e5-8d45-4a700c478f0a", "name": "network-vif-plugged", "status": "completed", "tag": "a2841d16-87c1-4e48-935e-723891a9ad43"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:03.484573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a63739c6-872e-4c61-ab4c-dc2762743617 req-3630a49d-8757-4984-a4ce-f7577977e08c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.488168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a63739c6-872e-4c61-ab4c-dc2762743617 req-3630a49d-8757-4984-a4ce-f7577977e08c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.488405 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-707f9c9f-3861-4488-92a2-6388f722f9f3 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/b528cf42-0b64-4703-be07-784b5e313c86" status: 202 len: 0 microversion: 2.1 time: 3.319696 Oct 31 15:20:03.490908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a63739c6-872e-4c61-ab4c-dc2762743617 req-3630a49d-8757-4984-a4ce-f7577977e08c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.491687 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 502/1040] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:20:00 2022] DELETE /compute/v2.1/os-floating-ips/b528cf42-0b64-4703-be07-784b5e313c86 => generated 0 bytes in 3323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:03.506166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:03.510528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: 0de28ff5-937b-433f-831c-c8c899fc3b79] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:03.529510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.534519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.535301 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a63739c6-872e-4c61-ab4c-dc2762743617 req-3630a49d-8757-4984-a4ce-f7577977e08c service nova] Creating event network-vif-plugged:a2841d16-87c1-4e48-935e-723891a9ad43 for instance f3848bfc-68ef-48e5-8d45-4a700c478f0a on n-h2-858384-17 Oct 31 15:20:03.535881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.537628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.541532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.542250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.557551 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a63739c6-872e-4c61-ab4c-dc2762743617 req-3630a49d-8757-4984-a4ce-f7577977e08c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126370 Oct 31 15:20:03.559297 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 539/1041] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:03.583000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:03.592132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:03.597861 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:03.612037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 HTTP/1.1 Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:03.613625 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:03.615929 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '0de28ff5-937b-433f-831c-c8c899fc3b79'} Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:03.616923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. Oct 31 15:20:03.619021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:03.620316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.620316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.620316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.620316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.620619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.622043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Instance 0de28ff5-937b-433f-831c-c8c899fc3b79 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:03.625352 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87510092-b5d6-48ee-a0fb-0b8d1c1f9efe tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79" status: 404 len: 111 microversion: 2.1 time: 0.132357 Oct 31 15:20:03.629506 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 503/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:03 2022] GET /compute/v2.1/servers/0de28ff5-937b-433f-831c-c8c899fc3b79 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:03.644398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d06b53c1-0854-476e-998f-ca345a55b3d6 req-b58198da-f8f1-445d-a10f-aa2c1ad7fbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20f21ec1-2fb0-4adc-a4fb-c3d41643dca7", "name": "network-vif-deleted", "tag": "6c3880f7-29f4-4ecb-96f6-a91817391f10"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:03.657590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d06b53c1-0854-476e-998f-ca345a55b3d6 req-b58198da-f8f1-445d-a10f-aa2c1ad7fbb5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.659262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d06b53c1-0854-476e-998f-ca345a55b3d6 req-b58198da-f8f1-445d-a10f-aa2c1ad7fbb5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.659908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d06b53c1-0854-476e-998f-ca345a55b3d6 req-b58198da-f8f1-445d-a10f-aa2c1ad7fbb5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.676698 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d06b53c1-0854-476e-998f-ca345a55b3d6 req-b58198da-f8f1-445d-a10f-aa2c1ad7fbb5 service nova] Creating event network-vif-deleted:6c3880f7-29f4-4ecb-96f6-a91817391f10 for instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 on n-h1-858384-17 Oct 31 15:20:03.684032 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d06b53c1-0854-476e-998f-ca345a55b3d6 req-b58198da-f8f1-445d-a10f-aa2c1ad7fbb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052174 Oct 31 15:20:03.684826 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 504/1043] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:03.692510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:03.693708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:03.703841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.705021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.708746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.712471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.713259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.713879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.810248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:03.811712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:03.812401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:03.813256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lazy-loading 'fault' on Instance uuid 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:03.951163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:03.961286 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fbac6955-d1c3-4d64-941e-c52e5ab8037a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1304 microversion: 2.1 time: 0.274225 Oct 31 15:20:03.983967 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 505/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:03 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1304 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:03.997779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2310093f-1226-4c72-93f8-fba1c167d069 req-06765f85-f784-4b74-a394-c385f24187b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8e70ba-60c3-4268-92f5-c91ce4e6e572", "name": "network-vif-deleted", "tag": "cae26543-73d8-43db-bcb0-0b345da586e5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:04.012464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2310093f-1226-4c72-93f8-fba1c167d069 req-06765f85-f784-4b74-a394-c385f24187b3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.013820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2310093f-1226-4c72-93f8-fba1c167d069 req-06765f85-f784-4b74-a394-c385f24187b3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.014448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2310093f-1226-4c72-93f8-fba1c167d069 req-06765f85-f784-4b74-a394-c385f24187b3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.032988 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2310093f-1226-4c72-93f8-fba1c167d069 req-06765f85-f784-4b74-a394-c385f24187b3 service nova] Creating event network-vif-deleted:cae26543-73d8-43db-bcb0-0b345da586e5 for instance 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 on n-h2-858384-17 Oct 31 15:20:04.045556 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2310093f-1226-4c72-93f8-fba1c167d069 req-06765f85-f784-4b74-a394-c385f24187b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058684 Oct 31 15:20:04.046895 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 506/1045] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:04.055883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdf37611-465d-4f72-a62f-c8e3a67657ef tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:04.056923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cdf37611-465d-4f72-a62f-c8e3a67657ef tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:04.065070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdf37611-465d-4f72-a62f-c8e3a67657ef tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.065872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdf37611-465d-4f72-a62f-c8e3a67657ef tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.066696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdf37611-465d-4f72-a62f-c8e3a67657ef tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.075084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdf37611-465d-4f72-a62f-c8e3a67657ef tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.075981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdf37611-465d-4f72-a62f-c8e3a67657ef tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.076585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdf37611-465d-4f72-a62f-c8e3a67657ef tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.209717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:04.223491 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e266e6b-ded7-4aae-9b21-ce5ea7235bef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1266 microversion: 2.1 time: 0.660032 Oct 31 15:20:04.233646 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 540/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:03 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1266 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:04.238440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:04.239143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:04.252920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.253683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.254274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.255803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.256529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.257422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.305290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:04.326277 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdf37611-465d-4f72-a62f-c8e3a67657ef tempest-ServersOnMultiNodesTest-1665607258 tempest-ServersOnMultiNodesTest-1665607258-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1620 microversion: 2.1 time: 0.277593 Oct 31 15:20:04.327462 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 507/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:04 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1620 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:04.347941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-daeebc5b-1056-4c01-8685-30dac2d25209 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '.version_select at 0x7f16e141ac10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:04.390243 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-daeebc5b-1056-4c01-8685-30dac2d25209 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844556852" status: 202 len: 0 microversion: 2.1 time: 0.061016 Oct 31 15:20:04.391596 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 508/1048] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 15:20:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844556852 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:04.399260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:04.399870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:04.406163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.406887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.407473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.408322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.408930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.409520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.490984 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4b70f6a-e0c6-44a4-af50-7f154fb515c2 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 204 len: 0 microversion: 2.1 time: 0.254542 Oct 31 15:20:04.493534 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 541/1049] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:04 2022] DELETE /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:04.500557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:04.501283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:04.508892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.509406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.509838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.510540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.511005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.511453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.546346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:04.785718 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b6d2d43-f84f-42a5-82bc-81e2e9f4595e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 204 len: 0 microversion: 2.1 time: 0.290529 Oct 31 15:20:04.791103 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 542/1050] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:04 2022] DELETE /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:04.796738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:04.816610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:04.837219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.837860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.840028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.842033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.842871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.843422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.923488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:04.951663 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d85e24bd-c7bf-46a1-ad29-f7c62ed048ef tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1360 microversion: 2.1 time: 0.550582 Oct 31 15:20:04.967352 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 509/1051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:04 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1360 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:04.977704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:04.978599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:04.985371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.986615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.987770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:04.988662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:04.989315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:04.990194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.042945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:05.058500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99c575a7-2431-41cf-9f9c-e84627811e1e tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1526 microversion: 2.1 time: 0.265609 Oct 31 15:20:05.070866 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 543/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:04 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1526 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:05.081624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:05.082238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:05.095254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:05.102987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:05.103791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:05.104753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.105650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:05.106233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:05.106784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.160054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:05.160714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:05.161474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.162256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lazy-loading 'fault' on Instance uuid 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:05.212585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:05.224991 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5eaea44a-54c8-422f-b229-70efc48958a0 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 200 len: 1304 microversion: 2.1 time: 0.150597 Oct 31 15:20:05.226959 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 544/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:05 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:05.259450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:05.260058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:05.266065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:05.266766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:05.268308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.269314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:05.269946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:05.270520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:05.293438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:05.370505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:05.385428 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b8b8c062-313a-430d-aa1f-098b2ddaa810 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1473 microversion: 2.1 time: 0.416649 Oct 31 15:20:05.391578 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 510/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:04 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1473 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:05.820515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:05.832832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b3e29394-4922-45c6-a638-4f443c7ce33c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1308 microversion: 2.1 time: 0.578575 Oct 31 15:20:05.839356 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 545/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:05 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1308 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:05.971089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6dea8b0c-d781-4271-8fce-b0fa16b5ff13 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '.version_select at 0x7f16e13f31f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:05.985903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:05.989629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.004673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.006103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.006745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.007475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.007925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.009495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.033379 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-6dea8b0c-d781-4271-8fce-b0fa16b5ff13 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Image not found. Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6dea8b0c-d781-4271-8fce-b0fa16b5ff13 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/images/aa39e1be-c3dd-4214-8651-e0ac20def10c HTTP/1.1 Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:06.040121 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'aa39e1be-c3dd-4214-8651-e0ac20def10c'} Oct 31 15:20:06.041755 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aa39e1be-c3dd-4214-8651-e0ac20def10c to delete Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:06.042715 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa39e1be-c3dd-4214-8651-e0ac20def10c could not be found. Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:06.044063 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:20:06.048262 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.050251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6dea8b0c-d781-4271-8fce-b0fa16b5ff13 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:06.051774 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6dea8b0c-d781-4271-8fce-b0fa16b5ff13 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/images/aa39e1be-c3dd-4214-8651-e0ac20def10c" status: 404 len: 62 microversion: 2.1 time: 0.086060 Oct 31 15:20:06.055933 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 511/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:05 2022] DELETE /compute/v2.1/images/aa39e1be-c3dd-4214-8651-e0ac20def10c => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:20:06.067319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:06.073967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.105731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.109335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.110000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.110897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.111525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.112126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.130135 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 HTTP/1.1 Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:06.132628 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.134529 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'e98382f3-c2cd-4289-964b-8ddab6df3f83'} Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:06.135429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.136951 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.140487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:06.141624 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7677aca2-3779-4fda-9114-52b2580b1b68 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 404 len: 111 microversion: 2.1 time: 0.082014 Oct 31 15:20:06.142697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 512/1057] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:06 2022] DELETE /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:20:06.148014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:06.149088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.158441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.159495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.160280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.161288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.161944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.162567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.412147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:06.424197 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d393f0f0-520e-4b8e-93a6-7c89fc34aafc tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1526 microversion: 2.1 time: 0.278241 Oct 31 15:20:06.424983 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 513/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:06 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1526 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:06.436244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:06.440767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] [instance: e98382f3-c2cd-4289-964b-8ddab6df3f83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.459511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.461117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.461887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.463221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.464007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.464650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.465962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:06.476102 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-018a94b9-6dfb-4041-bc3c-c6ec39944675 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1543 microversion: 2.1 time: 0.500844 Oct 31 15:20:06.485953 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] HTTP exception thrown: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Request method failure captured: Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 HTTP/1.1 Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cogupvD5z7RNNXt0UlM_eO13wPiHtuQESujaNY10l4BaKh5A8CY_OCnXb82mYA2zb9Vmh1fGkrBG2CToRM--1D0x7CkTyG3cdbPT7aFpTUpn1bzSFy9MBVboeK-pfngCdqW9ZxxbUDi2X5LRpwlptj5TavP3dJNn1vW34LHhdqH5o Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:06.488099 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_786fdf71bdb44504b15ae68b83e9dd41", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/786fdf71bdb44504b15ae68b83e9dd41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/786fdf71bdb44504b15ae68b83e9dd41"}]}] Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 786fdf71bdb44504b15ae68b83e9dd41 Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950 Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 748f45dc720144a49ca38e9e3b185410 Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2065275950-project Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.490636 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'e98382f3-c2cd-4289-964b-8ddab6df3f83'} Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:06.491532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. Oct 31 15:20:06.492954 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.494265 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 546/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:05 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1543 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:06.496034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] Returning 404 to user: Instance e98382f3-c2cd-4289-964b-8ddab6df3f83 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:06.497177 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c03d53e5-5174-4c10-b06d-15f77bc553d5 tempest-ImagesOneServerNegativeTestJSON-2065275950 tempest-ImagesOneServerNegativeTestJSON-2065275950-project] 10.222.0.20 "GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83" status: 404 len: 111 microversion: 2.1 time: 0.071020 Oct 31 15:20:06.501523 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 514/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:06 2022] GET /compute/v2.1/servers/e98382f3-c2cd-4289-964b-8ddab6df3f83 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:06.507361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:06.508637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.513521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:06.514566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 7c8e70ba-60c3-4268-92f5-c91ce4e6e572] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.516385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.516883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.517676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.518580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.519199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.519778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.527387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.527886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.528320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.529033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.534587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.535476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.582061 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] HTTP exception thrown: Instance 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 could not be found. Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Request method failure captured: Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 HTTP/1.1 Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cr7wYP2Hjbhe9sFI-1GhC93NGx4M-1I2M1LEJ7P0QoXsu0lqbec7M8SKGYNzj9R4SZX3aVkyAaqxbTzBWwBZILUJvc29gK9K3CgnxPovMDZhT1CEW4JH_noCvwj9Mg2l5_vkSX7_ne69gdS0Aku-bHSJB3yguzZq7jj3dW5Q0gR1g Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: ac787024261942edb9505c9d989aeff2 Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersAdminTestJSON-1691778597 Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:20:06.585153 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac787024261942edb9505c9d989aeff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac787024261942edb9505c9d989aeff2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac787024261942edb9505c9d989aeff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac787024261942edb9505c9d989aeff2"}]}] Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersAdminTestJSON-1691778597 Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: ac787024261942edb9505c9d989aeff2 Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersAdminTestJSON-1691778597 Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersAdminTestJSON-1691778597-project Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: bd109e04ce664c468fd5a2a19d840c7c Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersAdminTestJSON-1691778597-project Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 could not be found. Oct 31 15:20:06.586768 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '7c8e70ba-60c3-4268-92f5-c91ce4e6e572'} Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 could not be found. Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:06.587658 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 could not be found. Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 could not be found. Oct 31 15:20:06.589104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:06.593496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Returning 404 to user: Instance 7c8e70ba-60c3-4268-92f5-c91ce4e6e572 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:06.595404 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bfcd00a-4673-467f-b3e1-39a3e2525ac4 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572" status: 404 len: 111 microversion: 2.1 time: 0.100829 Oct 31 15:20:06.598338 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 547/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:06 2022] GET /compute/v2.1/servers/7c8e70ba-60c3-4268-92f5-c91ce4e6e572 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:06.606256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0a753c9-d701-48bf-bf6f-08d21bd037de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:06.607003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0a753c9-d701-48bf-bf6f-08d21bd037de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.615118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a753c9-d701-48bf-bf6f-08d21bd037de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.615845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a753c9-d701-48bf-bf6f-08d21bd037de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.616438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a753c9-d701-48bf-bf6f-08d21bd037de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.617794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a753c9-d701-48bf-bf6f-08d21bd037de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.618418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a753c9-d701-48bf-bf6f-08d21bd037de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.619195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a753c9-d701-48bf-bf6f-08d21bd037de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.861746 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0a753c9-d701-48bf-bf6f-08d21bd037de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.259915 Oct 31 15:20:06.863798 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 548/1062] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:20:06 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-interface => generated 285 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:06.879147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:06.882218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:06.897450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.898764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.900027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.900926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:06.901580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:06.903075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:06.947582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:07.006285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:07.019847 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0976899-b627-41e7-93f0-574d27eb3874 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1473 microversion: 2.1 time: 0.514463 Oct 31 15:20:07.023112 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 515/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:06 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1473 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:07.057681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:07.059034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:07.098731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.101673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.104530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.105605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.106329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.107911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.180109 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdad3c90-1614-4329-abf9-691b3cfe6c59 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 204 len: 0 microversion: 2.1 time: 0.313488 Oct 31 15:20:07.180861 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 549/1064] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:06 2022] DELETE /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:07.191061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a3044b07-d19c-443d-a56e-6e93e8b5ba21 req-afb9a82a-7759-40c1-9857-cf0a140af2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "874038fc-9845-4416-ae6b-1186e8c6c1f0", "tag": "cc3e033d-674f-43ec-84d1-e699a211f053"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:07.204358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a3044b07-d19c-443d-a56e-6e93e8b5ba21 req-afb9a82a-7759-40c1-9857-cf0a140af2da service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.205063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a3044b07-d19c-443d-a56e-6e93e8b5ba21 req-afb9a82a-7759-40c1-9857-cf0a140af2da service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.205737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a3044b07-d19c-443d-a56e-6e93e8b5ba21 req-afb9a82a-7759-40c1-9857-cf0a140af2da service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.223116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a3044b07-d19c-443d-a56e-6e93e8b5ba21 req-afb9a82a-7759-40c1-9857-cf0a140af2da service nova] Creating event network-changed:cc3e033d-674f-43ec-84d1-e699a211f053 for instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 on n-h1-858384-17 Oct 31 15:20:07.231377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a3044b07-d19c-443d-a56e-6e93e8b5ba21 req-afb9a82a-7759-40c1-9857-cf0a140af2da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048832 Oct 31 15:20:07.232234 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 550/1065] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:07.238298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:07.240044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:07.247502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.248885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.248885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.249466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.249923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.250345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.800975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:07.817010 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6eb4efef-a895-4627-915e-add91d0754ad tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1470 microversion: 2.1 time: 0.583565 Oct 31 15:20:07.818570 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 551/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:07 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1470 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:07.823346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:07.828526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:07.844750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.845672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.846378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:07.847327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:07.848009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:07.848724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.217485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.227732 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd7325e3-34a4-4f95-b10e-6503f1d04600 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1526 microversion: 2.1 time: 0.405669 Oct 31 15:20:08.228560 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 552/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:07 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1526 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:08.259725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:08.260345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:08.276448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.276949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.277551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.278300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.278752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.279165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.462179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:08.490801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:08.569667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.577492 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b83ca572-fddd-4cf4-9fab-bec395688936 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1473 microversion: 2.1 time: 0.323132 Oct 31 15:20:08.587421 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 553/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:08 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1473 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:08.640471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:08.663607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:08.701083 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40bce4f4-59a2-4421-9139-b8209f4d61fc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1308 microversion: 2.1 time: 1.671414 Oct 31 15:20:08.721698 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 516/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:07 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1308 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:08.841821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:08.842349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:08.851278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.852646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.853315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:08.854284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:08.855132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:08.856565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.126113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c10ec7cb-09e6-40da-968e-83871814fc92 req-c9539487-75e3-484c-be45-aa447c5438ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f12d716d-f599-4b33-8daa-92ba510492c7", "name": "network-vif-deleted", "tag": "b3b58473-f7bc-4a28-90d6-972ad40c05fd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:09.148235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c10ec7cb-09e6-40da-968e-83871814fc92 req-c9539487-75e3-484c-be45-aa447c5438ce service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.149094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c10ec7cb-09e6-40da-968e-83871814fc92 req-c9539487-75e3-484c-be45-aa447c5438ce service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.150392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c10ec7cb-09e6-40da-968e-83871814fc92 req-c9539487-75e3-484c-be45-aa447c5438ce service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.178335 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c10ec7cb-09e6-40da-968e-83871814fc92 req-c9539487-75e3-484c-be45-aa447c5438ce service nova] Creating event network-vif-deleted:b3b58473-f7bc-4a28-90d6-972ad40c05fd for instance f12d716d-f599-4b33-8daa-92ba510492c7 on n-h1-858384-17 Oct 31 15:20:09.206922 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c10ec7cb-09e6-40da-968e-83871814fc92 req-c9539487-75e3-484c-be45-aa447c5438ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087506 Oct 31 15:20:09.222109 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 517/1070] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 31 15:20:09.258142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:09.277085 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1ec456d-4d91-43b8-979a-aebbaefa98f3 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1470 microversion: 2.1 time: 0.440253 Oct 31 15:20:09.279259 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 554/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:08 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1470 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:09.291236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:09.293062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:09.306278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.307373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.310106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.316946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.317890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.318559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.522023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-555c1bd3-c33b-4c30-b51a-10f1ffe67d9b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Action: 'create', calling method: .version_select at 0x7f16e1a5ea60>, body: {"keypair": {"name": "tempest-keypair-540377468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+1lDWUAVjqk3KNbnq9vl5mWyI63+JdkUmIM0EVxe99Qqt1O4QQ5EytEMiOFXNFOZOGcz1h7qGN6Uw5q9xlS0XGFxa/y7RT0ol03SmeYTCq89YqLgYVf0Jz+zMyN78SLQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:09.532672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:09.546758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-555c1bd3-c33b-4c30-b51a-10f1ffe67d9b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Getting quotas for project a2783823cac14b27b795276d990b4e08. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:09.564362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-555c1bd3-c33b-4c30-b51a-10f1ffe67d9b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Getting quotas for user da22dd5d34fb43d2a8da0473ee0fb959 and project a2783823cac14b27b795276d990b4e08. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:09.626026 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-555c1bd3-c33b-4c30-b51a-10f1ffe67d9b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.378924 Oct 31 15:20:09.635988 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 518/1072] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:20:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:20:09.659488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:09.662084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:09.671299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.671936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.672576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.673548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.674769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.675385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.825099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:09.833789 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff6522e9-1ec3-4070-8128-59c98b3df41f tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1526 microversion: 2.1 time: 0.548967 Oct 31 15:20:09.839652 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 555/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:09 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1526 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:09.856687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:09.857590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:09.873867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.874627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.875222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:09.876127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:09.878064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:09.881256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.055839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.076440 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f1cebaf-339f-4f0d-ae01-08ae323a9925 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 200 len: 1302 microversion: 2.1 time: 0.434458 Oct 31 15:20:10.091388 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 519/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:09 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 1302 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:10.288364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.299277 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-06cc870b-a037-4523-9db3-880a7cb9d2cc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1308 microversion: 2.1 time: 0.457909 Oct 31 15:20:10.314189 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 556/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:09 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:10.323718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:10.325018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:10.334433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.335029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.336254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.337261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.337921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.338931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.504674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4c784e53-4b9c-40d1-8549-75ec0d95594d req-e9f84a51-b9fc-4ca5-bf29-9b1e8b737553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eae2e09-a74e-44d0-9ff9-966d56fa7a90", "name": "network-vif-deleted", "tag": "dd87d55d-0615-4caa-842d-f124433f3410"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:10.530737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4c784e53-4b9c-40d1-8549-75ec0d95594d req-e9f84a51-b9fc-4ca5-bf29-9b1e8b737553 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.533913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4c784e53-4b9c-40d1-8549-75ec0d95594d req-e9f84a51-b9fc-4ca5-bf29-9b1e8b737553 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.534829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4c784e53-4b9c-40d1-8549-75ec0d95594d req-e9f84a51-b9fc-4ca5-bf29-9b1e8b737553 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.569112 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4c784e53-4b9c-40d1-8549-75ec0d95594d req-e9f84a51-b9fc-4ca5-bf29-9b1e8b737553 service nova] Creating event network-vif-deleted:dd87d55d-0615-4caa-842d-f124433f3410 for instance 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 on n-h2-858384-17 Oct 31 15:20:10.580950 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4c784e53-4b9c-40d1-8549-75ec0d95594d req-e9f84a51-b9fc-4ca5-bf29-9b1e8b737553 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077605 Oct 31 15:20:10.582310 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 557/1076] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:10.721596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:10.732984 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f00f527e-1b3f-450b-a3e5-b8526abfe5ca tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1428 microversion: 2.1 time: 0.413569 Oct 31 15:20:10.760151 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 520/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:10 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1428 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:10.869299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:10.870075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:10.884009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.884526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.886839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.887575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.891444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.892243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.976129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:10.978033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:10.982447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:10.985515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lazy-loading 'fault' on Instance uuid 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:11.104798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:11.105418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: f12d716d-f599-4b33-8daa-92ba510492c7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:11.115285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.115760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.118227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.119312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.120286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.120945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.155766 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] HTTP exception thrown: Instance f12d716d-f599-4b33-8daa-92ba510492c7 could not be found. Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Request method failure captured: Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 HTTP/1.1 Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cDXxtQCK0RyybVnp7wo3iGWjepQldfToqH7fBH-h02CVM11c-57qQazs4gGeJCwWbIGrMR2VOBxIaHZhiv990fwPdP8UvVVbQAa35pYX0EO-GA0rTJHtYSkMmsLDh0VqL-e0doWlG2JMwlkeOvl6D-X8RSgwBcUnPNbU8DcOxS--s Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:11.158568 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0b4e2ca54bb4af3a74d0f4d65b7b7bc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}] Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d4b632b1a3f84361b31a34dd81668ab5 Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f12d716d-f599-4b33-8daa-92ba510492c7 could not be found. Oct 31 15:20:11.159900 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f12d716d-f599-4b33-8daa-92ba510492c7'} Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f12d716d-f599-4b33-8daa-92ba510492c7 could not be found. Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:11.160678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f12d716d-f599-4b33-8daa-92ba510492c7 could not be found. Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f12d716d-f599-4b33-8daa-92ba510492c7 could not be found. Oct 31 15:20:11.163785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:11.165023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36899fc1a6f4463a85c9dc6fd2641095', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7742c88f9c1141b7aaadd8e3c855b075', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:11.169004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Returning 404 to user: Instance f12d716d-f599-4b33-8daa-92ba510492c7 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:11.171030 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b775848b-8cd2-4efa-bee2-95afc892fcc6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7" status: 404 len: 111 microversion: 2.1 time: 0.070985 Oct 31 15:20:11.171879 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 521/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:11 2022] GET /compute/v2.1/servers/f12d716d-f599-4b33-8daa-92ba510492c7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:20:11.175457 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ced20e5-92ad-4cf6-bca3-85cdb224f2fe tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 200 len: 1314 microversion: 2.1 time: 0.312044 Oct 31 15:20:11.176050 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 558/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:10 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:11.196443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:11.197073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:11.212651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.213349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.215005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.217730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.219247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.219855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.239463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6cd8c43b-c9ff-4cb6-9e41-aab583de72d7 req-93590584-fa89-4318-b7b3-0527af964657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a7bdeeb-cdce-44a1-929e-1d817a2b80ae", "name": "network-vif-deleted", "tag": "2c55825a-fb54-4ab3-bbd2-1d30165b004b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:11.254611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6cd8c43b-c9ff-4cb6-9e41-aab583de72d7 req-93590584-fa89-4318-b7b3-0527af964657 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.255947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6cd8c43b-c9ff-4cb6-9e41-aab583de72d7 req-93590584-fa89-4318-b7b3-0527af964657 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.260417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6cd8c43b-c9ff-4cb6-9e41-aab583de72d7 req-93590584-fa89-4318-b7b3-0527af964657 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.269016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:11.292347 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6cd8c43b-c9ff-4cb6-9e41-aab583de72d7 req-93590584-fa89-4318-b7b3-0527af964657 service nova] Creating event network-vif-deleted:2c55825a-fb54-4ab3-bbd2-1d30165b004b for instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae on n-h1-858384-17 Oct 31 15:20:11.304206 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6cd8c43b-c9ff-4cb6-9e41-aab583de72d7 req-93590584-fa89-4318-b7b3-0527af964657 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068540 Oct 31 15:20:11.305422 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 559/1080] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:20:11.327484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:11.328313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:11.342584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.344410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.345280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.347802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.349380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.351201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.433551 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b1884a8e-7415-47bd-a949-9ffe61c53824 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 204 len: 0 microversion: 2.1 time: 0.256748 Oct 31 15:20:11.436249 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 522/1081] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:11 2022] DELETE /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:20:11.449667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:11.450823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:11.472470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.473145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.474450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.475825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.476655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.477371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.829404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:11.846848 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b9cfd5e-b793-4314-a3f8-e21095a42cc7 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1472 microversion: 2.1 time: 0.405849 Oct 31 15:20:11.847451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 523/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:11 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1472 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:11.871800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:11.872428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:11.886960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.889518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.890157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.890897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.891367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.891796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.982856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:11.983534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:11.983999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:11.984461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lazy-loading 'fault' on Instance uuid 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:12.062220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:12.071461 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6becfdec-7224-4b42-8536-913ed9933467 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 200 len: 1304 microversion: 2.1 time: 0.209786 Oct 31 15:20:12.085597 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 524/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:11 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 1304 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:12.201740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:12.202423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] [instance: 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:12.213580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:12.214132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:12.214573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:12.215585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:12.216560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:12.217250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:12.248320 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] HTTP exception thrown: Instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae could not be found. Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Request method failure captured: Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae HTTP/1.1 Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-dGQ6WyPc8aHl5OKiVJV6f3KCq_-6amtF9MerXnsDQCISLrY4nesbb4EGlr2ikpqex-6lJ47g4kkHILgQi4alLm9tX-PRWWXTkncsoBlHWcJHEzGheeRPE6MfefWXFQ2Xr3C8_sQ1RUOOAivUeqJWd7qgiHeDIda9jm598yb5RVF2U Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7742c88f9c1141b7aaadd8e3c855b075 Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:12.255629 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7742c88f9c1141b7aaadd8e3c855b075"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7742c88f9c1141b7aaadd8e3c855b075", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7742c88f9c1141b7aaadd8e3c855b075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7742c88f9c1141b7aaadd8e3c855b075"}]}] Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7742c88f9c1141b7aaadd8e3c855b075 Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-221970762 Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FloatingIPsAssociationTestJSON-221970762-project Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 36899fc1a6f4463a85c9dc6fd2641095 Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-221970762-project Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae could not be found. Oct 31 15:20:12.257307 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '2a7bdeeb-cdce-44a1-929e-1d817a2b80ae'} Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae could not be found. Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:12.258183 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae could not be found. Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae could not be found. Oct 31 15:20:12.259516 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:12.261614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] Returning 404 to user: Instance 2a7bdeeb-cdce-44a1-929e-1d817a2b80ae could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:12.262644 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8be26fff-3c86-4732-a13b-4e4d2db76552 tempest-FloatingIPsAssociationTestJSON-221970762 tempest-FloatingIPsAssociationTestJSON-221970762-project] 10.222.0.20 "GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae" status: 404 len: 111 microversion: 2.1 time: 0.064832 Oct 31 15:20:12.265944 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 525/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:12 2022] GET /compute/v2.1/servers/2a7bdeeb-cdce-44a1-929e-1d817a2b80ae => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:12.316706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:12.327229 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-248224ac-916b-414d-a7cd-ef1b037ee8c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1308 microversion: 2.1 time: 1.004370 Oct 31 15:20:12.330467 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 560/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:11 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1308 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:12.874910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:12.875692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:12.886407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:12.887277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:12.887961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:12.889037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:12.889722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:12.890379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.095996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:13.096983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: 8eae2e09-a74e-44d0-9ff9-966d56fa7a90] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:13.103991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:13.104697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:13.105360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.106249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:13.106986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:13.107566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.123199 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] HTTP exception thrown: Instance 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 could not be found. Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Request method failure captured: Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 HTTP/1.1 Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cr7wYP2Hjbhe9sFI-1GhC93NGx4M-1I2M1LEJ7P0QoXsu0lqbec7M8SKGYNzj9R4SZX3aVkyAaqxbTzBWwBZILUJvc29gK9K3CgnxPovMDZhT1CEW4JH_noCvwj9Mg2l5_vkSX7_ne69gdS0Aku-bHSJB3yguzZq7jj3dW5Q0gR1g Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: ac787024261942edb9505c9d989aeff2 Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersAdminTestJSON-1691778597 Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:20:13.125151 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac787024261942edb9505c9d989aeff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac787024261942edb9505c9d989aeff2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac787024261942edb9505c9d989aeff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac787024261942edb9505c9d989aeff2"}]}] Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersAdminTestJSON-1691778597 Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: ac787024261942edb9505c9d989aeff2 Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersAdminTestJSON-1691778597 Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersAdminTestJSON-1691778597-project Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: bd109e04ce664c468fd5a2a19d840c7c Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersAdminTestJSON-1691778597-project Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 could not be found. Oct 31 15:20:13.126824 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8eae2e09-a74e-44d0-9ff9-966d56fa7a90'} Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 could not be found. Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:13.127686 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 could not be found. Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 could not be found. Oct 31 15:20:13.129116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:13.134047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Returning 404 to user: Instance 8eae2e09-a74e-44d0-9ff9-966d56fa7a90 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:13.134455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:13.135661 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-40eaeb35-6585-4613-af62-a32154feeae9 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90" status: 404 len: 111 microversion: 2.1 time: 0.043545 Oct 31 15:20:13.136703 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 561/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:13 2022] GET /compute/v2.1/servers/8eae2e09-a74e-44d0-9ff9-966d56fa7a90 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:20:13.143117 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73365c30-7ebb-4d36-a95d-e8e2983edcce tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1472 microversion: 2.1 time: 0.272061 Oct 31 15:20:13.146353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:13.146752 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 526/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:12 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:13.147643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:13.155148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:13.155864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:13.156285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.156986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:13.157590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:13.158188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.187506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:13.226327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:13.303647 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-979f2efe-c2c8-41e5-8bf1-b256ed2edb62 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 204 len: 0 microversion: 2.1 time: 0.162197 Oct 31 15:20:13.304268 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 562/1088] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:13 2022] DELETE /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:13.313010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:13.314128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:13.323917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:13.324703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:13.325433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.327129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:13.327954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:13.328587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.342419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ff40983a-b369-4f7f-8601-9ce5edab0d76 req-be7f16c3-38c9-4522-98c2-978df3bf7d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3848bfc-68ef-48e5-8d45-4a700c478f0a", "tag": "a2841d16-87c1-4e48-935e-723891a9ad43"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:13.356957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ff40983a-b369-4f7f-8601-9ce5edab0d76 req-be7f16c3-38c9-4522-98c2-978df3bf7d5e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:13.357732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ff40983a-b369-4f7f-8601-9ce5edab0d76 req-be7f16c3-38c9-4522-98c2-978df3bf7d5e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:13.358322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ff40983a-b369-4f7f-8601-9ce5edab0d76 req-be7f16c3-38c9-4522-98c2-978df3bf7d5e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.374331 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ff40983a-b369-4f7f-8601-9ce5edab0d76 req-be7f16c3-38c9-4522-98c2-978df3bf7d5e service nova] Creating event network-changed:a2841d16-87c1-4e48-935e-723891a9ad43 for instance f3848bfc-68ef-48e5-8d45-4a700c478f0a on n-h2-858384-17 Oct 31 15:20:13.381265 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ff40983a-b369-4f7f-8601-9ce5edab0d76 req-be7f16c3-38c9-4522-98c2-978df3bf7d5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047894 Oct 31 15:20:13.382444 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 563/1089] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:13.389487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:13.390527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:13.399871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:13.400649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:13.401366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.402402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:13.403122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:13.403900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:13.605894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:13.617006 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-722482a5-22c0-4875-9679-672ffc76d8c8 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1469 microversion: 2.1 time: 0.308488 Oct 31 15:20:13.619644 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 527/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:13 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1469 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:13.646692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-221614451", "imageRef": "9845d4d7-776c-4296-8a5a-9e90b946af41", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "32e234c8-b57b-4937-b660-ffa39878c67f"}], "security_groups": [{"name": "tempest-securitygroup--1948503833"}], "key_name": "tempest-keypair-540377468", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:13.798964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] validate_networks() for [('32e234c8-b57b-4937-b660-ffa39878c67f', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:20:14.031330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:14.039888 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-267ca77e-ad26-4605-ad88-a714496cc015 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1308 microversion: 2.1 time: 0.655850 Oct 31 15:20:14.040919 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 564/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:13 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1308 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:14.172891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:14.173768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:14.180546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:14.181043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:14.181509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:14.182413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:14.182882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:14.183301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:14.293508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:20:14.294081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:20:14.294552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:20:14.295024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:20:14.295501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:20:14.306907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:14.307390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:14.307843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:14.308562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:14.309162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:14.309611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:14.356081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Getting quotas for project a2783823cac14b27b795276d990b4e08. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:14.368053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Getting quotas for user da22dd5d34fb43d2a8da0473ee0fb959 and project a2783823cac14b27b795276d990b4e08. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:14.387325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:20:14.390215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9845d4d7-776c-4296-8a5a-9e90b946af41',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:20:14.463346 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4948688-b845-4602-afbc-a692697218b1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.820626 Oct 31 15:20:14.470675 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 528/1092] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:20:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:20:14.477507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-314a6996-e289-4750-ab7e-4eb02bd6a836 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:14.478391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-314a6996-e289-4750-ab7e-4eb02bd6a836 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:14.552893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-314a6996-e289-4750-ab7e-4eb02bd6a836 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:14.561957 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-314a6996-e289-4750-ab7e-4eb02bd6a836 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1244 microversion: 2.1 time: 0.089231 Oct 31 15:20:14.563365 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 529/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:14 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:14.647066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:14.649440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:14.662133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:14.662892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:14.663239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:14.666986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:14.667707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:14.668836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:15.105718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:15.117268 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-235dcb1d-7ac6-4648-9a2d-cf49ad9cb362 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 200 len: 1472 microversion: 2.1 time: 0.947576 Oct 31 15:20:15.133466 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 565/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:14 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 1472 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:15.145775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:15.146476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:15.160173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:15.161655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:15.162346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:15.165508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:15.166093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:15.166632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:15.319527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:15.351641 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb2d4be0-a57c-4a7e-b8f4-99f36de7e22f tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1469 microversion: 2.1 time: 0.707115 Oct 31 15:20:15.365698 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 530/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:14 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1469 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:15.397744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-65f682a0-4957-4a3a-88d0-9b7cf8511857 req-32383877-2fbf-4c79-bce5-1026e74b20cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5", "name": "network-vif-deleted", "tag": "c49966ed-57bd-47b7-a75e-48cdd441c845"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:15.417099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-65f682a0-4957-4a3a-88d0-9b7cf8511857 req-32383877-2fbf-4c79-bce5-1026e74b20cb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:15.417600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-65f682a0-4957-4a3a-88d0-9b7cf8511857 req-32383877-2fbf-4c79-bce5-1026e74b20cb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:15.418246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-65f682a0-4957-4a3a-88d0-9b7cf8511857 req-32383877-2fbf-4c79-bce5-1026e74b20cb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:15.445303 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-65f682a0-4957-4a3a-88d0-9b7cf8511857 req-32383877-2fbf-4c79-bce5-1026e74b20cb service nova] Creating event network-vif-deleted:c49966ed-57bd-47b7-a75e-48cdd441c845 for instance 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 on n-h2-858384-17 Oct 31 15:20:15.456428 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-65f682a0-4957-4a3a-88d0-9b7cf8511857 req-32383877-2fbf-4c79-bce5-1026e74b20cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088570 Oct 31 15:20:15.457762 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 531/1096] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:15.589029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:15.590279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:15.596988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:15.598690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:15.599296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:15.600346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:15.601319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:15.602174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:15.717325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:15.732686 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a24f4d0c-a086-497e-8d6a-3cc5af4548ef tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1240 microversion: 2.1 time: 0.149480 Oct 31 15:20:15.745165 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 532/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:15 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1240 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:15.862719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:15.872333 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-761fe036-d85b-4533-9c63-0bd2c674ea96 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1308 microversion: 2.1 time: 0.737618 Oct 31 15:20:15.873587 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 566/1098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:15 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1308 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:16.150953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:16.151622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:16.158514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.159052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.159887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.160485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.162767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.172521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.242150 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] HTTP exception thrown: Instance 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 could not be found. Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Request method failure captured: Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 HTTP/1.1 Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cDXxtQCK0RyybVnp7wo3iGWjepQldfToqH7fBH-h02CVM11c-57qQazs4gGeJCwWbIGrMR2VOBxIaHZhiv990fwPdP8UvVVbQAa35pYX0EO-GA0rTJHtYSkMmsLDh0VqL-e0doWlG2JMwlkeOvl6D-X8RSgwBcUnPNbU8DcOxS--s Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:16.246312 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0b4e2ca54bb4af3a74d0f4d65b7b7bc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}] Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d4b632b1a3f84361b31a34dd81668ab5 Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 could not be found. Oct 31 15:20:16.247969 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5'} Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 could not be found. Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:16.248856 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 could not be found. Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 could not be found. Oct 31 15:20:16.250358 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:16.252771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Returning 404 to user: Instance 4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:16.257185 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60ca3076-62e2-4794-9796-5d02f1284c79 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5" status: 404 len: 111 microversion: 2.1 time: 0.112905 Oct 31 15:20:16.259973 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 533/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:16 2022] GET /compute/v2.1/servers/4def7ef3-e3e7-40d6-bfc1-9127a6fc14c5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:16.281747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:16.282500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:16.298459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.298987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.299433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.300162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.300634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.301085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.391766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:16.393094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:16.394104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:16.404216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.409001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.409637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.410946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.412247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.413801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.540881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:16.555795 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e96ee685-b790-49f4-a8ea-6c3dde31e7cf tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 204 len: 0 microversion: 2.1 time: 0.289450 Oct 31 15:20:16.557541 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f41b257f-8872-40c9-bcd1-730c30e71986 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1298 microversion: 2.1 time: 0.167688 Oct 31 15:20:16.562639 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 567/1101] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:16 2022] DELETE /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:16.563929 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 534/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:16 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1298 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:16.580802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8c44a763-fae2-4d89-8248-4bd83d9c21bd req-57cf66a0-b152-4997-baa3-f3f15d9a7b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec22d439-86fc-48bc-a238-b9e3074d51fa", "name": "network-vif-deleted", "tag": "af932539-7d08-4e92-83b1-db17d6e894a3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:16.581441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:16.583872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:16.591803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.592294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.593394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.594110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.594563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.595593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.598163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8c44a763-fae2-4d89-8248-4bd83d9c21bd req-57cf66a0-b152-4997-baa3-f3f15d9a7b0d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.599179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8c44a763-fae2-4d89-8248-4bd83d9c21bd req-57cf66a0-b152-4997-baa3-f3f15d9a7b0d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.600012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8c44a763-fae2-4d89-8248-4bd83d9c21bd req-57cf66a0-b152-4997-baa3-f3f15d9a7b0d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.613511 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8c44a763-fae2-4d89-8248-4bd83d9c21bd req-57cf66a0-b152-4997-baa3-f3f15d9a7b0d service nova] Creating event network-vif-deleted:af932539-7d08-4e92-83b1-db17d6e894a3 for instance ec22d439-86fc-48bc-a238-b9e3074d51fa on n-h2-858384-17 Oct 31 15:20:16.620727 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8c44a763-fae2-4d89-8248-4bd83d9c21bd req-57cf66a0-b152-4997-baa3-f3f15d9a7b0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056302 Oct 31 15:20:16.621771 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 568/1102] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:16.762758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:16.763745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:16.780114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.781347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.782151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.785067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.793095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.796413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.893699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:16.905214 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3736498-ea2e-4242-9608-82b3ddb3c849 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1473 microversion: 2.1 time: 0.339612 Oct 31 15:20:16.906345 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 535/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:16 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1473 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:16.935525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b6a6a785-7116-4ef6-af1e-4fab92711681 req-54ddd0cf-f152-4b74-b07a-63253928e004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874038fc-9845-4416-ae6b-1186e8c6c1f0", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e033d-674f-43ec-84d1-e699a211f053"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:16.946867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b6a6a785-7116-4ef6-af1e-4fab92711681 req-54ddd0cf-f152-4b74-b07a-63253928e004 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:16.947350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b6a6a785-7116-4ef6-af1e-4fab92711681 req-54ddd0cf-f152-4b74-b07a-63253928e004 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:16.947775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b6a6a785-7116-4ef6-af1e-4fab92711681 req-54ddd0cf-f152-4b74-b07a-63253928e004 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:16.965438 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b6a6a785-7116-4ef6-af1e-4fab92711681 req-54ddd0cf-f152-4b74-b07a-63253928e004 service nova] Creating event network-vif-plugged:cc3e033d-674f-43ec-84d1-e699a211f053 for instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 on n-h1-858384-17 Oct 31 15:20:16.978157 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b6a6a785-7116-4ef6-af1e-4fab92711681 req-54ddd0cf-f152-4b74-b07a-63253928e004 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070292 Oct 31 15:20:16.979694 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 536/1104] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:16.985753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:16.986739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:17.005908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:17.006936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:17.007562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:17.008488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:17.009206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:17.010273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:17.201645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:17.214565 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b7036b6-bce6-41dd-b4e0-6a3d7b629f52 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1296 microversion: 2.1 time: 0.457351 Oct 31 15:20:17.219571 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 569/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:16 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1296 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:17.392042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:17.404039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86b46a5c-2ad6-4cc7-8f0c-f20e111ece26 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1308 microversion: 2.1 time: 0.422637 Oct 31 15:20:17.404629 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 537/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:16 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:17.587445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:17.588118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:17.603769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:17.604813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:17.605282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:17.606974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:17.607436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:17.607860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:17.668883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:17.669556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:17.674509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:17.676806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lazy-loading 'fault' on Instance uuid ec22d439-86fc-48bc-a238-b9e3074d51fa {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:17.739580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd109e04ce664c468fd5a2a19d840c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac787024261942edb9505c9d989aeff2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:17.755083 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85a4ce50-460e-4fad-9d7e-e4303171da9a tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 200 len: 1303 microversion: 2.1 time: 0.170463 Oct 31 15:20:17.755428 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 570/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:17 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:17.931680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:17.934221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:17.951250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:17.955650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:17.959144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:17.962566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:17.965493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:17.968693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:17.987464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:18.248497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:18.252676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:18.272016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:18.272607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:18.273060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:18.273820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:18.274874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:18.275991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:18.823200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:18.838573 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f10cf3f-c175-4570-8972-64f6f9e91121 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1302 microversion: 2.1 time: 0.597970 Oct 31 15:20:18.839182 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 571/1108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:18 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1302 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:18.849242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:18.862558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:18.870456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:18.871207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:18.871794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:18.872659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:18.873294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:18.874037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:19.266825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:19.280243 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b0073977-aca3-4af4-bc44-733cf67153e8 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1473 microversion: 2.1 time: 1.352319 Oct 31 15:20:19.283612 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 538/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:17 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1473 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:19.297046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:19.306830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] [instance: ec22d439-86fc-48bc-a238-b9e3074d51fa] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:19.334284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:19.341936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:19.342715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:19.343784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:19.344469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:19.345515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:19.374060 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] HTTP exception thrown: Instance ec22d439-86fc-48bc-a238-b9e3074d51fa could not be found. Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Request method failure captured: Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa HTTP/1.1 Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cr7wYP2Hjbhe9sFI-1GhC93NGx4M-1I2M1LEJ7P0QoXsu0lqbec7M8SKGYNzj9R4SZX3aVkyAaqxbTzBWwBZILUJvc29gK9K3CgnxPovMDZhT1CEW4JH_noCvwj9Mg2l5_vkSX7_ne69gdS0Aku-bHSJB3yguzZq7jj3dW5Q0gR1g Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: ac787024261942edb9505c9d989aeff2 Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersAdminTestJSON-1691778597 Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:19.376089 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac787024261942edb9505c9d989aeff2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ac787024261942edb9505c9d989aeff2", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ac787024261942edb9505c9d989aeff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ac787024261942edb9505c9d989aeff2"}]}] Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersAdminTestJSON-1691778597 Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: ac787024261942edb9505c9d989aeff2 Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersAdminTestJSON-1691778597 Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersAdminTestJSON-1691778597-project Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: bd109e04ce664c468fd5a2a19d840c7c Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersAdminTestJSON-1691778597-project Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance ec22d439-86fc-48bc-a238-b9e3074d51fa could not be found. Oct 31 15:20:19.377499 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'ec22d439-86fc-48bc-a238-b9e3074d51fa'} Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec22d439-86fc-48bc-a238-b9e3074d51fa could not be found. Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:19.378272 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec22d439-86fc-48bc-a238-b9e3074d51fa could not be found. Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec22d439-86fc-48bc-a238-b9e3074d51fa could not be found. Oct 31 15:20:19.380739 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:19.383353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] Returning 404 to user: Instance ec22d439-86fc-48bc-a238-b9e3074d51fa could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:19.384471 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3801c327-c4a0-4632-aa2a-6e4c491ae792 tempest-ServersAdminTestJSON-1691778597 tempest-ServersAdminTestJSON-1691778597-project] 10.222.0.20 "GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa" status: 404 len: 111 microversion: 2.1 time: 0.095675 Oct 31 15:20:19.385799 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 539/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:19 2022] GET /compute/v2.1/servers/ec22d439-86fc-48bc-a238-b9e3074d51fa => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:19.431569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:19.447200 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccf6e85b-8501-4e97-8928-21b3a5531b67 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1488 microversion: 2.1 time: 0.605966 Oct 31 15:20:19.452929 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 572/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:18 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1488 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:19.479678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:19.485519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:19.497455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:19.501770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:19.502458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:19.506592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:19.507386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:19.510701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:19.616191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lazy-loading 'flavor' on Instance uuid 874038fc-9845-4416-ae6b-1186e8c6c1f0 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:19.869875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:19.871222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:19.888945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:19.892490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:19.899558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:19.900674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:19.906095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:19.907015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:20.041575 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5adcb19f-8232-4ea7-a6a4-dbed190dc023 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0/action" status: 202 len: 0 microversion: 2.1 time: 0.542973 Oct 31 15:20:20.052281 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 540/1112] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:20:19 2022] POST /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:20.066917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:20.072681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:20.093638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:20.097451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:20.100898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:20.104322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:20.105344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:20.106452 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec014510-31ea-4a4e-b5d3-8e7b0402900b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1302 microversion: 2.1 time: 0.240825 Oct 31 15:20:20.107113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:20.114666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:20.118596 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 573/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:19 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1302 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:20.310783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:20.311748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:20.329320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:20.329850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:20.337393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:20.338587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:20.339188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:20.339879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:21.076723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:21.131202 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8594fab8-b623-4934-a4dc-ab92ad5fe93a tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1473 microversion: 2.1 time: 0.816590 Oct 31 15:20:21.134060 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 574/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:20 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1473 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:21.186737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:21.187410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:21.210462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:21.212861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:21.215981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:21.226832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:21.230246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:21.231720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:21.518664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:21.527816 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e148bf3-2dcd-404b-842c-60412f39e3dc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1302 microversion: 2.1 time: 0.384963 Oct 31 15:20:21.528568 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 575/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:21 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1302 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:21.844291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:21.859848 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61bda9a2-460b-440f-803b-4fc9c19422d8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1496 microversion: 2.1 time: 1.804230 Oct 31 15:20:21.860790 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 541/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:20 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1496 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:22.003984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-175e39b0-6be1-4bfe-8fbc-7cf6c028826b req-7da2d3ac-8e8c-4bc6-b65f-90456c16e7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba359d8-3cd9-44f1-83e3-9994bc8baae6", "name": "network-vif-deleted", "tag": "6d732725-2cca-4497-bb96-95c374f7d00e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:22.024402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-175e39b0-6be1-4bfe-8fbc-7cf6c028826b req-7da2d3ac-8e8c-4bc6-b65f-90456c16e7a1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.024981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-175e39b0-6be1-4bfe-8fbc-7cf6c028826b req-7da2d3ac-8e8c-4bc6-b65f-90456c16e7a1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.025442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-175e39b0-6be1-4bfe-8fbc-7cf6c028826b req-7da2d3ac-8e8c-4bc6-b65f-90456c16e7a1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.088428 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-175e39b0-6be1-4bfe-8fbc-7cf6c028826b req-7da2d3ac-8e8c-4bc6-b65f-90456c16e7a1 service nova] Creating event network-vif-deleted:6d732725-2cca-4497-bb96-95c374f7d00e for instance 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 on n-h2-858384-17 Oct 31 15:20:22.118377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-175e39b0-6be1-4bfe-8fbc-7cf6c028826b req-7da2d3ac-8e8c-4bc6-b65f-90456c16e7a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123284 Oct 31 15:20:22.129949 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 576/1117] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:22.167004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:22.168491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:22.187956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.192431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.198990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.200220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.201710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.206309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.288731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.289557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.290158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.290876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lazy-loading 'fault' on Instance uuid 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:22.553017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:22.554036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:22.584242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.588803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.593073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.594094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.600863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.601548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.852659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:22.873482 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45c811ae-4a90-44ec-b9eb-72cb641beb8b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1302 microversion: 2.1 time: 0.324951 Oct 31 15:20:22.879792 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 577/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:22 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1302 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:22.882769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:22.889597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:22.892171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:22.896801 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9150649d-18d0-45d9-b65f-bb2654fc6067 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 200 len: 1307 microversion: 2.1 time: 0.741957 Oct 31 15:20:22.919438 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 542/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:22 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 1307 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:22.922778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.928103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.928740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.931691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:22.933308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:22.934741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:22.996571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:23.727258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:23.740197 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0f5d5da3-c8ba-4aff-9f59-b9f2a025ed4e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 200 len: 1479 microversion: 2.1 time: 0.855796 Oct 31 15:20:23.753708 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 578/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:22 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 1479 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:23.767799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0c87c53f-c995-4261-af80-82c5454f9447 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1240304796"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:23.771376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0c87c53f-c995-4261-af80-82c5454f9447 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:23.778810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c87c53f-c995-4261-af80-82c5454f9447 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:23.779812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c87c53f-c995-4261-af80-82c5454f9447 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:23.780512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c87c53f-c995-4261-af80-82c5454f9447 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:23.781692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c87c53f-c995-4261-af80-82c5454f9447 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:23.782386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c87c53f-c995-4261-af80-82c5454f9447 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:23.783373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c87c53f-c995-4261-af80-82c5454f9447 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:23.900540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:23.901524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:23.929171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:23.933094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:23.935120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:23.940464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:23.943059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:23.945107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:24.325701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:24.359187 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0c87c53f-c995-4261-af80-82c5454f9447 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0/action" status: 202 len: 0 microversion: 2.1 time: 0.595118 Oct 31 15:20:24.359868 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 543/1121] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:20:23 2022] POST /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:20:24.383166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:24.386064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 1ba359d8-3cd9-44f1-83e3-9994bc8baae6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:24.405612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:24.409199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:24.409923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:24.414154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:24.414919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:24.415601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:24.456157 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] HTTP exception thrown: Instance 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 could not be found. Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Request method failure captured: Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 HTTP/1.1 Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cDXxtQCK0RyybVnp7wo3iGWjepQldfToqH7fBH-h02CVM11c-57qQazs4gGeJCwWbIGrMR2VOBxIaHZhiv990fwPdP8UvVVbQAa35pYX0EO-GA0rTJHtYSkMmsLDh0VqL-e0doWlG2JMwlkeOvl6D-X8RSgwBcUnPNbU8DcOxS--s Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:24.460682 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0b4e2ca54bb4af3a74d0f4d65b7b7bc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}] Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d4b632b1a3f84361b31a34dd81668ab5 Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 could not be found. Oct 31 15:20:24.466336 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '1ba359d8-3cd9-44f1-83e3-9994bc8baae6'} Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 could not be found. Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:24.467278 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 could not be found. Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 could not be found. Oct 31 15:20:24.468824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:24.470342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Returning 404 to user: Instance 1ba359d8-3cd9-44f1-83e3-9994bc8baae6 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:24.471593 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be1cf30f-c02b-47d0-b22e-d047ad2cc419 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6" status: 404 len: 111 microversion: 2.1 time: 0.100918 Oct 31 15:20:24.471593 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 544/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:24 2022] GET /compute/v2.1/servers/1ba359d8-3cd9-44f1-83e3-9994bc8baae6 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:24.483554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4157fb1-5a0b-4eae-821c-cf1bdfa30fa4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1395c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:24.560684 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4157fb1-5a0b-4eae-821c-cf1bdfa30fa4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.087627 Oct 31 15:20:24.562734 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 545/1123] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:24 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:24.568750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:24.569528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 152b38e0-09fd-4cb1-b1b6-0be97849d1b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:24.576079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:24.580521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:24.581331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:24.582716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:24.583977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:24.584635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:24.585255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:24.619209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 152b38e0-09fd-4cb1-b1b6-0be97849d1b1] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:24.869714 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ccc61ea0-b4a9-437b-ace2-a09e10f4c38d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1" status: 204 len: 0 microversion: 2.1 time: 0.305168 Oct 31 15:20:24.869874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:24.871613 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 546/1124] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:24 2022] DELETE /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:24.896180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:24.896876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:24.903644 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-864230a4-745d-4e44-a6ab-fbbec718006f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 1.008994 Oct 31 15:20:24.917248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:24.922019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:24.922251 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 579/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:23 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:24.926944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:24.927988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:24.932959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:24.934618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:24.935352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:25.022987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:25.204127 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-157b6a48-3342-41af-bd70-2e6c13f8750c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 204 len: 0 microversion: 2.1 time: 0.326849 Oct 31 15:20:25.209108 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 547/1126] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:24 2022] DELETE /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:25.214180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:25.215075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 152b38e0-09fd-4cb1-b1b6-0be97849d1b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:25.232638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:25.234390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:25.234751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:25.239700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:25.240458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:25.240907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:25.579395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3867bff-47f8-416b-ba7d-79a7a5bc7641 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1395430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:25.622281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:25.636528 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a743519-d995-4b87-b5af-f39e9f5dc231 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1" status: 200 len: 1473 microversion: 2.1 time: 0.426276 Oct 31 15:20:25.637745 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 580/1127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:25 2022] GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1 => generated 1473 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:25.677265 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3867bff-47f8-416b-ba7d-79a7a5bc7641 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.102165 Oct 31 15:20:25.686562 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 548/1128] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:25 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:25.930382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:25.931135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:25.945893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:25.946499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:25.948844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:25.952761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:25.953296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:25.953884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:26.367975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:26.385115 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd806ab6-5725-4071-acde-24cc0bed6716 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 0.456053 Oct 31 15:20:26.403173 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 581/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:25 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:26.663624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:26.664366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 152b38e0-09fd-4cb1-b1b6-0be97849d1b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:26.675657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:26.683390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:26.683826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:26.684586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:26.685052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:26.685561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:26.694251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6152f22-ac44-47db-8a0a-7b0e599b65bc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1561a60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:26.785298 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6152f22-ac44-47db-8a0a-7b0e599b65bc tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.094116 Oct 31 15:20:26.787536 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 582/1130] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:26 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:27.384809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dfdeaa50-ec9e-4ed5-981e-f351dd1f5984 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Action: 'create', calling method: .version_select at 0x7f16e14bfa60>, body: {"keypair": {"name": "tempest-keypair-486276631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/StOwf8oOitmlXPsiPUMaJbPItnbLY4IGOYdmeK8EbnbVqybNw61HikmwOxO/C3wZmBcM1vrgU65qPhIhUORQVmSlHXeU92uKV6ZM1bpaAyPaO3uZCKlHIhafl3eipjA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:27.405434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:27.430986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-dfdeaa50-ec9e-4ed5-981e-f351dd1f5984 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:27.451049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-dfdeaa50-ec9e-4ed5-981e-f351dd1f5984 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for user f6ecdf2727244593b0cd020bcea44d8a and project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:27.511354 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dfdeaa50-ec9e-4ed5-981e-f351dd1f5984 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.700513 Oct 31 15:20:27.513034 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 583/1131] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:20:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:20:27.526412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:27.533752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:27.559962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:27.561906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:27.567883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:27.568887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:27.569986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:27.571591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:27.656697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:27.677349 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d84356c0-57d3-4710-a8b7-866979e26ffa tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1" status: 200 len: 1473 microversion: 2.1 time: 1.009341 Oct 31 15:20:27.697527 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 549/1132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:26 2022] GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1 => generated 1473 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:27.707942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f55e7447-cac5-49a3-a193-e3b218f270d3 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Calling method '.version_select at 0x7f16e1395430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:27.733885 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f55e7447-cac5-49a3-a193-e3b218f270d3 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-486276631" status: 200 len: 496 microversion: 2.1 time: 0.034711 Oct 31 15:20:27.736430 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 550/1133] 10.222.0.20 () {58 vars in 1215 bytes} [Mon Oct 31 15:20:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-486276631 => generated 496 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:27.749633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae7b2263-cf02-4272-abaf-f9b0701cc488 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Calling method '.version_select at 0x7f16e1245670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:27.786431 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae7b2263-cf02-4272-abaf-f9b0701cc488 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-486276631" status: 202 len: 0 microversion: 2.1 time: 0.041987 Oct 31 15:20:27.787751 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 551/1134] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:20:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-486276631 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:20:27.824018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b470a3a-0f40-4a76-8e9d-6bc9b1cbbcd9 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Action: 'create', calling method: .version_select at 0x7f16e1253d30>, body: {"keypair": {"name": "tempest-keypair-629892571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPAefdCDN1jN8bhrpxQqdrjtgWhQAn1EtvpMJov5sTRuUwN6DPnHV/vBySLdGheqri08JCRyrr2BACdvZHbPmUto8uQfZxqiIEKSMjk2IJ6rymiig2waPgxEHIDkXxcHw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:27.890132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2b470a3a-0f40-4a76-8e9d-6bc9b1cbbcd9 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:27.901695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:27.914120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2b470a3a-0f40-4a76-8e9d-6bc9b1cbbcd9 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for user f6ecdf2727244593b0cd020bcea44d8a and project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:27.920304 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de7a2cd9-2140-4ac9-8308-aa2cd916c2d9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 0.403917 Oct 31 15:20:27.924635 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 584/1135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:27 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:27.935873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a1c2831-c745-434c-9670-b2d83e873b7a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e14a0ca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:27.993909 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2b470a3a-0f40-4a76-8e9d-6bc9b1cbbcd9 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.195426 Oct 31 15:20:27.995495 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 552/1136] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:20:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:28.014341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-106a20c8-6a30-4824-b1e5-7f261d5cab36 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Calling method '.version_select at 0x7f16e1253af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:28.070388 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-106a20c8-6a30-4824-b1e5-7f261d5cab36 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-629892571" status: 202 len: 0 microversion: 2.1 time: 0.066899 Oct 31 15:20:28.073610 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 553/1137] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-629892571 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:20:28.097037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-10ceb597-028a-4303-9793-0e2d3b1de461 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Action: 'create', calling method: .version_select at 0x7f16e1289310>, body: {"keypair": {"name": "tempest-keypair-1606717058", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:28.145680 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6a1c2831-c745-434c-9670-b2d83e873b7a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.219645 Oct 31 15:20:28.146280 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 585/1138] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:27 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:28.163534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-10ceb597-028a-4303-9793-0e2d3b1de461 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:28.197686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-10ceb597-028a-4303-9793-0e2d3b1de461 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for user f6ecdf2727244593b0cd020bcea44d8a and project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:28.282391 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-10ceb597-028a-4303-9793-0e2d3b1de461 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.203302 Oct 31 15:20:28.289298 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 554/1139] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:20:28 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:20:28.297689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe4e1cec-33c8-411f-9447-1758b9ea74e9 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Calling method '.version_select at 0x7f16e576edc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:28.334345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-136b9108-2431-4233-acea-1ea6b23dd6e1 req-082c1d1e-ecdb-454b-9241-bebdd5881dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874038fc-9845-4416-ae6b-1186e8c6c1f0", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e033d-674f-43ec-84d1-e699a211f053"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:28.369398 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe4e1cec-33c8-411f-9447-1758b9ea74e9 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606717058" status: 202 len: 0 microversion: 2.1 time: 0.076090 Oct 31 15:20:28.370678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-136b9108-2431-4233-acea-1ea6b23dd6e1 req-082c1d1e-ecdb-454b-9241-bebdd5881dff service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.374244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-136b9108-2431-4233-acea-1ea6b23dd6e1 req-082c1d1e-ecdb-454b-9241-bebdd5881dff service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.374992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-136b9108-2431-4233-acea-1ea6b23dd6e1 req-082c1d1e-ecdb-454b-9241-bebdd5881dff service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.375396 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 586/1140] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 15:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606717058 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:28.391520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8384fee9-8c4a-4d1b-8caf-a78ddf9481dc tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Action: 'create', calling method: .version_select at 0x7f16e577eee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-70631023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUFYzajm4RyzwkL2ATB17Tn7lZY9hWxl3qimqqPSjZIpyXO49O69bv6TraTi3z93wSy+xE8gd5a5BzS9iPwGS63ETM/wBnMHxCkXwtQGxtEp5kUzY9+buu5x3MebVrynQ=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:28.419147 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-136b9108-2431-4233-acea-1ea6b23dd6e1 req-082c1d1e-ecdb-454b-9241-bebdd5881dff service nova] Creating event network-vif-plugged:cc3e033d-674f-43ec-84d1-e699a211f053 for instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 on n-h1-858384-17 Oct 31 15:20:28.435077 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-136b9108-2431-4233-acea-1ea6b23dd6e1 req-082c1d1e-ecdb-454b-9241-bebdd5881dff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115629 Oct 31 15:20:28.449068 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 555/1141] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:28.459627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-8384fee9-8c4a-4d1b-8caf-a78ddf9481dc tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:28.477038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-8384fee9-8c4a-4d1b-8caf-a78ddf9481dc tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for user f6ecdf2727244593b0cd020bcea44d8a and project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:28.539924 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8384fee9-8c4a-4d1b-8caf-a78ddf9481dc tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.155584 Oct 31 15:20:28.542458 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 587/1142] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:20:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:28.561974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9e17396-284a-4481-9c9e-e95222d8984c tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Action: 'create', calling method: .version_select at 0x7f16e13950d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1422437075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7Lj6kOTOmBl2bEXK5xi/ztdAPtGBc7lrRcAs3rIBK6nh4ZWtp6wuQGhwvlVjTu3boJmUTtMj0Wk1XhZ8jgWe4UnGt4frqkDG6PWqw/9/vXRUGI2bN+OuvO7VSoKoYkEg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:28.640373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f9e17396-284a-4481-9c9e-e95222d8984c tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:28.649617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f9e17396-284a-4481-9c9e-e95222d8984c tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for user f6ecdf2727244593b0cd020bcea44d8a and project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:28.710597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:28.711438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 152b38e0-09fd-4cb1-b1b6-0be97849d1b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:28.726034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.735929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.737066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.740929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.741558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.742293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.760185 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9e17396-284a-4481-9c9e-e95222d8984c tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.203199 Oct 31 15:20:28.778916 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 556/1143] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:20:28 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:28.788095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a7b5225-23b7-4a85-baa3-a2caabb2e756 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Action: 'create', calling method: .version_select at 0x7f16e130fdc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-460066548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyRSUOucEfDeYrWvO1/KylJnHy2IdnIalEvogkcmvl2whui+czCnqA1MCdVDsA0pjkjwH3gqVFGIKkfc0iYrX1lba1DlowP3UyPcEFYEe3/atT2Ap0qJBNi3IpEpqImlQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:28.830085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-7a7b5225-23b7-4a85-baa3-a2caabb2e756 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:28.840118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-7a7b5225-23b7-4a85-baa3-a2caabb2e756 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Getting quotas for user f6ecdf2727244593b0cd020bcea44d8a and project e9b8928d800f4499a534d37fc708bbb5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:28.898284 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a7b5225-23b7-4a85-baa3-a2caabb2e756 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.117977 Oct 31 15:20:28.907909 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 557/1144] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:20:28 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:28.928068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b1a363f-83b1-4c92-a82f-83fe47322d9c tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Calling method '.version_select at 0x7f16e13c9dc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:28.934902 n-d-858384-17 devstack@n-api.service[120588]: WARNING oslo_db.sqlalchemy.utils [None req-7b1a363f-83b1-4c92-a82f-83fe47322d9c tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:20:28.952972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b1a363f-83b1-4c92-a82f-83fe47322d9c tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.043893 Oct 31 15:20:28.964151 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 558/1145] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:20:28 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:28.979710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:28.980642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:28.994883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.995378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.995810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:28.996526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:28.996978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:28.997456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:29.206130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:29.217120 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d74230b7-1c86-45b8-9b63-c27e20699a93 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1" status: 200 len: 1473 microversion: 2.1 time: 0.511594 Oct 31 15:20:29.217837 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 588/1146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:28 2022] GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1 => generated 1473 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:29.224324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7407794-a88c-47d3-b9da-956cd53b238f tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Calling method '.version_select at 0x7f16e14d7a60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:29.292631 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7407794-a88c-47d3-b9da-956cd53b238f tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-460066548" status: 202 len: 0 microversion: 2.1 time: 0.072430 Oct 31 15:20:29.299161 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 589/1147] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-460066548 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:29.317906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f891818-e27c-4efc-be73-6dae847a2bec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e577e550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:29.547348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:29.556653 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c464a7c-f567-4fc7-938d-0ace4da79908 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 0.588754 Oct 31 15:20:29.580650 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 559/1148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:28 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:29.619536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4010ce5-6e83-4521-b604-dd822d76dd41 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Calling method '.version_select at 0x7f16e1366040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:29.678460 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4010ce5-6e83-4521-b604-dd822d76dd41 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1422437075" status: 202 len: 0 microversion: 2.1 time: 0.095414 Oct 31 15:20:29.679614 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 560/1149] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Oct 31 15:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1422437075 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:29.701460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b373ac91-2a5a-4265-9bfd-ac3847a4c586 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] Calling method '.version_select at 0x7f16e1245790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:29.755494 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b373ac91-2a5a-4265-9bfd-ac3847a4c586 tempest-KeyPairsV2TestJSON-591056453 tempest-KeyPairsV2TestJSON-591056453-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-70631023" status: 202 len: 0 microversion: 2.1 time: 0.066499 Oct 31 15:20:29.759383 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 561/1150] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:20:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-70631023 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:20:30.736230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1096246640", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:35.803938 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f891818-e27c-4efc-be73-6dae847a2bec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 6.503564 Oct 31 15:20:35.805394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:20:35.810673 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 590/1151] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:29 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 6511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:35.834288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fff0fd2b-252a-4916-abb6-4522fd4f70e8 req-4576f6fc-123c-4174-87e8-31df50f15aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01374025-1d71-467c-9d2d-ddf7719fa8d1", "tag": "4aba674c-14c2-4953-a5fe-7f18b3e2fc7e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:35.859145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fff0fd2b-252a-4916-abb6-4522fd4f70e8 req-4576f6fc-123c-4174-87e8-31df50f15aac service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:35.859926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fff0fd2b-252a-4916-abb6-4522fd4f70e8 req-4576f6fc-123c-4174-87e8-31df50f15aac service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:35.860642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fff0fd2b-252a-4916-abb6-4522fd4f70e8 req-4576f6fc-123c-4174-87e8-31df50f15aac service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:35.875368 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fff0fd2b-252a-4916-abb6-4522fd4f70e8 req-4576f6fc-123c-4174-87e8-31df50f15aac service nova] Creating event network-changed:4aba674c-14c2-4953-a5fe-7f18b3e2fc7e for instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 on n-h2-858384-17 Oct 31 15:20:35.884320 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fff0fd2b-252a-4916-abb6-4522fd4f70e8 req-4576f6fc-123c-4174-87e8-31df50f15aac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071890 Oct 31 15:20:35.886473 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 591/1152] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:35.899176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:35.900237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 152b38e0-09fd-4cb1-b1b6-0be97849d1b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:35.911399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:35.912284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:35.912930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:35.915193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:35.915920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:35.916859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:35.953523 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] HTTP exception thrown: Instance 152b38e0-09fd-4cb1-b1b6-0be97849d1b1 could not be found. Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Request method failure captured: Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1 HTTP/1.1 Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cDXxtQCK0RyybVnp7wo3iGWjepQldfToqH7fBH-h02CVM11c-57qQazs4gGeJCwWbIGrMR2VOBxIaHZhiv990fwPdP8UvVVbQAa35pYX0EO-GA0rTJHtYSkMmsLDh0VqL-e0doWlG2JMwlkeOvl6D-X8RSgwBcUnPNbU8DcOxS--s Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:20:35.957953 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0b4e2ca54bb4af3a74d0f4d65b7b7bc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}] Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d4b632b1a3f84361b31a34dd81668ab5 Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 152b38e0-09fd-4cb1-b1b6-0be97849d1b1 could not be found. Oct 31 15:20:35.959769 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '152b38e0-09fd-4cb1-b1b6-0be97849d1b1'} Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 152b38e0-09fd-4cb1-b1b6-0be97849d1b1 could not be found. Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:35.960831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 152b38e0-09fd-4cb1-b1b6-0be97849d1b1 could not be found. Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 152b38e0-09fd-4cb1-b1b6-0be97849d1b1 could not be found. Oct 31 15:20:35.962429 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:35.965354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Returning 404 to user: Instance 152b38e0-09fd-4cb1-b1b6-0be97849d1b1 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:35.966721 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eba590c8-6731-4637-ba33-fe408f2d9778 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1" status: 404 len: 111 microversion: 2.1 time: 0.078797 Oct 31 15:20:35.967863 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 592/1153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:35 2022] GET /compute/v2.1/servers/152b38e0-09fd-4cb1-b1b6-0be97849d1b1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:35.983139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:35.985028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:35.999514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.000368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.001103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.002227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.002913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.004072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.690998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:20:36.692618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:20:36.693788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:20:36.694547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:20:36.695172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:20:36.720241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.725471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.726225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.728328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:36.730239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:36.732087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:36.759481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:36.806153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Getting quotas for project f50db02b685949eda543ab1c8d075fd0. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:36.816891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Getting quotas for user 27f37855c20d48058241cf1f5e886ecb and project f50db02b685949eda543ab1c8d075fd0. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:36.846510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:20:36.854723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:20:36.981229 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b06ecdcf-c267-4ad9-9fd2-29b68c154632 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.901926 Oct 31 15:20:36.984497 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 562/1154] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:20:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 6907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:20:37.000627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:37.005732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 266056a8-99ee-4881-a541-2dc01f75be2e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:37.017825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.018322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.022670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.024544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.024840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.025318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.055215 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] HTTP exception thrown: Instance 266056a8-99ee-4881-a541-2dc01f75be2e could not be found. Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Request method failure captured: Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e HTTP/1.1 Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cDXxtQCK0RyybVnp7wo3iGWjepQldfToqH7fBH-h02CVM11c-57qQazs4gGeJCwWbIGrMR2VOBxIaHZhiv990fwPdP8UvVVbQAa35pYX0EO-GA0rTJHtYSkMmsLDh0VqL-e0doWlG2JMwlkeOvl6D-X8RSgwBcUnPNbU8DcOxS--s Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:20:37.057828 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0b4e2ca54bb4af3a74d0f4d65b7b7bc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}] Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d4b632b1a3f84361b31a34dd81668ab5 Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 266056a8-99ee-4881-a541-2dc01f75be2e could not be found. Oct 31 15:20:37.059415 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '266056a8-99ee-4881-a541-2dc01f75be2e'} Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 266056a8-99ee-4881-a541-2dc01f75be2e could not be found. Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:37.060214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 266056a8-99ee-4881-a541-2dc01f75be2e could not be found. Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 266056a8-99ee-4881-a541-2dc01f75be2e could not be found. Oct 31 15:20:37.061678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:20:37.064659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Returning 404 to user: Instance 266056a8-99ee-4881-a541-2dc01f75be2e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:37.065754 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f539308d-1411-4167-9bdd-d8adb171072d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e" status: 404 len: 111 microversion: 2.1 time: 0.072652 Oct 31 15:20:37.066973 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 563/1155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:36 2022] GET /compute/v2.1/servers/266056a8-99ee-4881-a541-2dc01f75be2e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:37.080369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51ca1795-80ab-431d-ae25-a0871c720f2a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e12d63a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:37.193648 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51ca1795-80ab-431d-ae25-a0871c720f2a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.125241 Oct 31 15:20:37.194950 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 564/1156] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:37 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:37.203183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1685455-cb79-4527-84a6-6286391b8280 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:37.204083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1685455-cb79-4527-84a6-6286391b8280 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:37.212327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:37.291967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:37.310393 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5e4de02a-29a7-43ce-9663-c6c35af111eb tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 1.338703 Oct 31 15:20:37.328514 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 593/1157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:35 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:37.354044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe4c7d2a-db3a-475f-b241-f94da168f927 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:37.480735 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe4c7d2a-db3a-475f-b241-f94da168f927 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/da6f21db-a59f-4888-8e2c-a1d21190c934" status: 204 len: 0 microversion: 2.1 time: 0.140805 Oct 31 15:20:37.481726 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 594/1158] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:20:37 2022] DELETE /compute/v2.1/os-server-groups/da6f21db-a59f-4888-8e2c-a1d21190c934 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:37.529556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:37.529556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:37.536330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.577373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.578172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.582537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.587587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.588487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.611643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1685455-cb79-4527-84a6-6286391b8280 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:37.630377 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1685455-cb79-4527-84a6-6286391b8280 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1214 microversion: 2.1 time: 0.429998 Oct 31 15:20:37.649822 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 565/1159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:37 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1214 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:37.667877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:37.898363 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7645b29c-cda2-4ea6-8431-c70ad5dad10f tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32" status: 204 len: 0 microversion: 2.1 time: 0.411266 Oct 31 15:20:37.899069 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 595/1160] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:37 2022] DELETE /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:37.907350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:37.908161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:37.929288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.929829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.932449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.934616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.935112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.937721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:37.941059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5bb1c150-200e-4f53-9ad4-2461bc71895c req-c0e23f1f-4b5b-4cd4-ab89-69672fdbea35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "152b38e0-09fd-4cb1-b1b6-0be97849d1b1", "name": "network-vif-deleted", "tag": "6bbdfe4c-560c-4c43-a6c2-cb72160fdd05"}, {"server_uuid": "266056a8-99ee-4881-a541-2dc01f75be2e", "name": "network-vif-deleted", "tag": "835f9778-f56f-4bda-91b0-0876dc11a5b3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:37.967141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5bb1c150-200e-4f53-9ad4-2461bc71895c req-c0e23f1f-4b5b-4cd4-ab89-69672fdbea35 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:37.970142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5bb1c150-200e-4f53-9ad4-2461bc71895c req-c0e23f1f-4b5b-4cd4-ab89-69672fdbea35 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:37.976141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5bb1c150-200e-4f53-9ad4-2461bc71895c req-c0e23f1f-4b5b-4cd4-ab89-69672fdbea35 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.017874 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5bb1c150-200e-4f53-9ad4-2461bc71895c req-c0e23f1f-4b5b-4cd4-ab89-69672fdbea35 service nova] Creating event network-vif-deleted:6bbdfe4c-560c-4c43-a6c2-cb72160fdd05 for instance 152b38e0-09fd-4cb1-b1b6-0be97849d1b1 on n-h2-858384-17 Oct 31 15:20:38.021381 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5bb1c150-200e-4f53-9ad4-2461bc71895c req-c0e23f1f-4b5b-4cd4-ab89-69672fdbea35 service nova] Creating event network-vif-deleted:835f9778-f56f-4bda-91b0-0876dc11a5b3 for instance 266056a8-99ee-4881-a541-2dc01f75be2e on n-h1-858384-17 Oct 31 15:20:38.043076 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5bb1c150-200e-4f53-9ad4-2461bc71895c req-c0e23f1f-4b5b-4cd4-ab89-69672fdbea35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.107786 Oct 31 15:20:38.045749 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 596/1161] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:20:38.046769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:38.216831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdb81f34-0191-449c-8154-dc81149c46fe tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e14d7550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:38.349843 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdb81f34-0191-449c-8154-dc81149c46fe tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.142297 Oct 31 15:20:38.361954 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 597/1162] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:38 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:38.373639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:38.374825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:38.380897 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c63efe73-cd63-4cdb-9c7d-e3f0e94391e2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 204 len: 0 microversion: 2.1 time: 0.477106 Oct 31 15:20:38.388305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.388542 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 566/1163] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:37 2022] DELETE /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:20:38.389359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.390173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.391146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.391937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.392552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.394488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:38.395497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:38.422183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.422749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.426314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.430695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:38.432429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:38.435569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:38.493303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:39.022438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.033214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.037107 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-896ed70d-09e8-4eb0-a585-7c2566314e3d tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 0.667527 Oct 31 15:20:39.038659 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 598/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:38 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:39.042643 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c47bff9d-042a-44bd-b014-7a064b573aca tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32" status: 200 len: 1475 microversion: 2.1 time: 0.652907 Oct 31 15:20:39.046476 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 567/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:38 2022] GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32 => generated 1475 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:39.050338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.053116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:39.069518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.070453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.071036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.071919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:39.072551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:39.074837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:39.308431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:39.325930 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aec9a4ef-60e7-4084-8153-76c278a9be1a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1266 microversion: 2.1 time: 0.278539 Oct 31 15:20:39.327836 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 599/1166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:39 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:39.369994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5c6eb17-b218-4b71-b304-e3b1e1cdda8b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e130fd30>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:39.498384 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c5c6eb17-b218-4b71-b304-e3b1e1cdda8b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.131952 Oct 31 15:20:39.501981 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 568/1167] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:39 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:40.060132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:40.061080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:40.074954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:40.075640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:40.087147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.090484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.091375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.093683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.094409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.095327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.095933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.098052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.098735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.100254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.100676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.103529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.774891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:40.788869 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30741f67-7522-40e9-8675-40c0735a5ece tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 0.732707 Oct 31 15:20:40.810763 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 600/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:40 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:40.824167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:40.825112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:40.844306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.845192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.848648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.849730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:40.850630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:40.852325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:40.999227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:41.014624 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1adfac18-2ef3-4265-a3fc-adbf0dccfd0c tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32" status: 200 len: 1475 microversion: 2.1 time: 0.942280 Oct 31 15:20:41.015886 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 569/1169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:40 2022] GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32 => generated 1475 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:41.033415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6338c615-0c01-4571-8d81-52170d2a680a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e130f4c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:41.146267 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6338c615-0c01-4571-8d81-52170d2a680a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.124876 Oct 31 15:20:41.164737 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 570/1170] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:41 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:41.166438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:41.183114 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f73db59d-6de4-413d-907a-f7d7b5e8bb31 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1272 microversion: 2.1 time: 0.363918 Oct 31 15:20:41.184333 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 601/1171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:40 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:41.816755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:41.817522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:41.818051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0418a6ef-5704-4168-8ca9-787cac34ae71 req-d7e86606-c355-4037-9fa5-9a1ff3162366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d6d090-f0e9-4b70-a5e0-473827cc478e", "name": "network-vif-deleted", "tag": "496315b9-ac9a-4aba-93e6-98d916bc927e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:41.835995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0418a6ef-5704-4168-8ca9-787cac34ae71 req-d7e86606-c355-4037-9fa5-9a1ff3162366 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.836475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0418a6ef-5704-4168-8ca9-787cac34ae71 req-d7e86606-c355-4037-9fa5-9a1ff3162366 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.836902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0418a6ef-5704-4168-8ca9-787cac34ae71 req-d7e86606-c355-4037-9fa5-9a1ff3162366 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.846721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.848245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.848703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.851983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:41.852467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:41.856908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:41.875089 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0418a6ef-5704-4168-8ca9-787cac34ae71 req-d7e86606-c355-4037-9fa5-9a1ff3162366 service nova] Creating event network-vif-deleted:496315b9-ac9a-4aba-93e6-98d916bc927e for instance 60d6d090-f0e9-4b70-a5e0-473827cc478e on n-h1-858384-17 Oct 31 15:20:41.883474 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0418a6ef-5704-4168-8ca9-787cac34ae71 req-d7e86606-c355-4037-9fa5-9a1ff3162366 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070006 Oct 31 15:20:41.887489 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 602/1172] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:20:42.046432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:42.047385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:42.058678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.059536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.062789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.063850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.064624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.066976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.626335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:42.642661 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-451fdf60-0055-4f2c-af31-499d74fb3e44 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32" status: 200 len: 1475 microversion: 2.1 time: 0.601698 Oct 31 15:20:42.647873 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 603/1173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:42 2022] GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32 => generated 1475 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:42.659867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b70f5339-9b3e-40eb-ab09-15f19dd3b3c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e577e940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:42.773449 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b70f5339-9b3e-40eb-ab09-15f19dd3b3c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.123471 Oct 31 15:20:42.775345 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 604/1174] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:42 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:42.802227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:42.804379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:42.824080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.826257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.827074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:42.830526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:42.832936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:42.833713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:43.137047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:43.157084 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c61d584b-e537-4465-91ac-4f7676ae519a tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 1.345520 Oct 31 15:20:43.186175 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 571/1175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:41 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:43.235430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:43.252138 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13222505-6b84-4747-92e6-4a0ce829331a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 0.474433 Oct 31 15:20:43.258479 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 605/1176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:42 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:43.681530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:43.682306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:43.704626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:43.707236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:43.707802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:43.708690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:43.711575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:43.712151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:43.792764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c6d5ea4-1451-4690-9588-f61f17218f9b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e577e310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:43.878370 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c6d5ea4-1451-4690-9588-f61f17218f9b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.090876 Oct 31 15:20:43.879645 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 606/1177] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:43 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:44.119966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:44.132652 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3cde75da-9cc2-46e1-b578-c945ef9fe918 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32" status: 200 len: 1433 microversion: 2.1 time: 0.459093 Oct 31 15:20:44.133213 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 572/1178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:43 2022] GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32 => generated 1433 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:44.197168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:44.198083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:44.216769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.221040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.222458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.224718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.225695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.226969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.287530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:44.288968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:44.308694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.326777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.330393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.340286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:44.341648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:44.347973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:44.452246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:46.130403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:46.161878 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e41adf9-df83-4d2e-88c8-2a87ac7f88fc tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 1.975328 Oct 31 15:20:46.171408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 607/1179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:44 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:46.185769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6ac8318c-0753-43e5-a0e9-348981b66d35 req-1733b5ee-c2ee-46df-946d-762bd61c3bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa830667-cb8a-4f7c-a15a-5f191694da32", "name": "network-vif-deleted", "tag": "6ffa79ad-bfce-4f75-aeaa-0bd193bac0cf"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:46.242765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6ac8318c-0753-43e5-a0e9-348981b66d35 req-1733b5ee-c2ee-46df-946d-762bd61c3bd0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.247306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6ac8318c-0753-43e5-a0e9-348981b66d35 req-1733b5ee-c2ee-46df-946d-762bd61c3bd0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.248073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6ac8318c-0753-43e5-a0e9-348981b66d35 req-1733b5ee-c2ee-46df-946d-762bd61c3bd0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.285708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:46.295468 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ffb742d5-1e33-4734-829b-b17b8c8d9e06 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 2.013190 Oct 31 15:20:46.296077 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 573/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:44 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:46.307064 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6ac8318c-0753-43e5-a0e9-348981b66d35 req-1733b5ee-c2ee-46df-946d-762bd61c3bd0 service nova] Creating event network-vif-deleted:6ffa79ad-bfce-4f75-aeaa-0bd193bac0cf for instance aa830667-cb8a-4f7c-a15a-5f191694da32 on n-h1-858384-17 Oct 31 15:20:46.324173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e1cfe1a-fbad-4a46-be81-984869168d8f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e12c0040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:46.334349 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6ac8318c-0753-43e5-a0e9-348981b66d35 req-1733b5ee-c2ee-46df-946d-762bd61c3bd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160805 Oct 31 15:20:46.348671 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 608/1181] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:46.376602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:46.391833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: aa830667-cb8a-4f7c-a15a-5f191694da32] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:46.429551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.434087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.434548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.435298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.435757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.436184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.470637 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e1cfe1a-fbad-4a46-be81-984869168d8f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.168113 Oct 31 15:20:46.473852 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 574/1182] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:46 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:46.494068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-065941b8-18d9-4706-88bf-994afc7751df tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:46.500848 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] HTTP exception thrown: Instance aa830667-cb8a-4f7c-a15a-5f191694da32 could not be found. Oct 31 15:20:46.508612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-065941b8-18d9-4706-88bf-994afc7751df tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Request method failure captured: Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32 HTTP/1.1 Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cDXxtQCK0RyybVnp7wo3iGWjepQldfToqH7fBH-h02CVM11c-57qQazs4gGeJCwWbIGrMR2VOBxIaHZhiv990fwPdP8UvVVbQAa35pYX0EO-GA0rTJHtYSkMmsLDh0VqL-e0doWlG2JMwlkeOvl6D-X8RSgwBcUnPNbU8DcOxS--s Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:20:46.514617 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0b4e2ca54bb4af3a74d0f4d65b7b7bc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}] Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d4b632b1a3f84361b31a34dd81668ab5 Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance aa830667-cb8a-4f7c-a15a-5f191694da32 could not be found. Oct 31 15:20:46.516444 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'aa830667-cb8a-4f7c-a15a-5f191694da32'} Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa830667-cb8a-4f7c-a15a-5f191694da32 could not be found. Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:46.517404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa830667-cb8a-4f7c-a15a-5f191694da32 could not be found. Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa830667-cb8a-4f7c-a15a-5f191694da32 could not be found. Oct 31 15:20:46.519521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.521485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Returning 404 to user: Instance aa830667-cb8a-4f7c-a15a-5f191694da32 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:46.523322 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a5fd257-7a4a-45b9-a991-5d5aa7ba528d tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32" status: 404 len: 111 microversion: 2.1 time: 0.170970 Oct 31 15:20:46.532849 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 609/1183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:46 2022] GET /compute/v2.1/servers/aa830667-cb8a-4f7c-a15a-5f191694da32 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:46.536376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-065941b8-18d9-4706-88bf-994afc7751df tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.540671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-065941b8-18d9-4706-88bf-994afc7751df tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.542113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-065941b8-18d9-4706-88bf-994afc7751df tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.543949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-065941b8-18d9-4706-88bf-994afc7751df tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.545016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-065941b8-18d9-4706-88bf-994afc7751df tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.545367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:46.550124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 60d6d090-f0e9-4b70-a5e0-473827cc478e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:46.551003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-065941b8-18d9-4706-88bf-994afc7751df tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.582033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.582655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.583230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.584068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.584637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.585180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.618387 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] HTTP exception thrown: Instance 60d6d090-f0e9-4b70-a5e0-473827cc478e could not be found. Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Request method failure captured: Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e HTTP/1.1 Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cDXxtQCK0RyybVnp7wo3iGWjepQldfToqH7fBH-h02CVM11c-57qQazs4gGeJCwWbIGrMR2VOBxIaHZhiv990fwPdP8UvVVbQAa35pYX0EO-GA0rTJHtYSkMmsLDh0VqL-e0doWlG2JMwlkeOvl6D-X8RSgwBcUnPNbU8DcOxS--s Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:20:46.620114 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0b4e2ca54bb4af3a74d0f4d65b7b7bc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}] Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d4b632b1a3f84361b31a34dd81668ab5 Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 60d6d090-f0e9-4b70-a5e0-473827cc478e could not be found. Oct 31 15:20:46.621842 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '60d6d090-f0e9-4b70-a5e0-473827cc478e'} Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d6d090-f0e9-4b70-a5e0-473827cc478e could not be found. Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:46.622755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d6d090-f0e9-4b70-a5e0-473827cc478e could not be found. Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d6d090-f0e9-4b70-a5e0-473827cc478e could not be found. Oct 31 15:20:46.624211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:46.634922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Returning 404 to user: Instance 60d6d090-f0e9-4b70-a5e0-473827cc478e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:46.641982 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76c7567d-8ba5-4a88-b54a-1df694c04ea2 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e" status: 404 len: 111 microversion: 2.1 time: 0.104242 Oct 31 15:20:46.643087 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 610/1184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:46 2022] GET /compute/v2.1/servers/60d6d090-f0e9-4b70-a5e0-473827cc478e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:46.651984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-167ace84-cfa8-4562-9e9e-b0088938cef5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:46.718508 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-167ace84-cfa8-4562-9e9e-b0088938cef5 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/54d02968-5863-4b5c-bfec-7539ced58c00" status: 204 len: 0 microversion: 2.1 time: 0.069999 Oct 31 15:20:46.719391 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 611/1185] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:20:46 2022] DELETE /compute/v2.1/os-server-groups/54d02968-5863-4b5c-bfec-7539ced58c00 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:20:46.727507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:46.728200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:46.746696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.755559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.756198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.757060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:46.757658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:46.758186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:46.760357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:46.818777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:20:47.021765 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec52ba97-245f-4ebd-92bd-6f5dd135d145 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 204 len: 0 microversion: 2.1 time: 0.297631 Oct 31 15:20:47.027682 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 612/1186] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:20:46 2022] DELETE /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:20:47.039250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:47.042898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:47.064100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.066532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.074989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.078101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.078860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.087653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.533462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:47.547170 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-512cc994-8be0-4e88-a854-456dd479d5e6 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1472 microversion: 2.1 time: 0.514863 Oct 31 15:20:47.557552 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 613/1187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:47 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:20:47.563549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:47.571623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:47.589443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2,nova_api:DELETE=8,nova_api:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:47.591333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.592180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.592839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.593831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.598214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.606214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.634549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=24 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:47.667230 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-065941b8-18d9-4706-88bf-994afc7751df tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1815 microversion: 2.1 time: 1.176802 Oct 31 15:20:47.668366 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 575/1188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:46 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1815 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:47.677554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:47.678471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:47.684752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.685531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.692626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:47.696266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:47.699352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:47.700051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.113264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:48.122276 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22481152-9e90-45de-b7bb-432b9c135e98 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 0.563101 Oct 31 15:20:48.147768 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 614/1189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:47 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:48.158381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e9893104-aafb-45c7-ac43-16cdf6aa1a6c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e14a4dc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:48.363767 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e9893104-aafb-45c7-ac43-16cdf6aa1a6c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.212468 Oct 31 15:20:48.368590 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 615/1190] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:48 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:48.385472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-92f3df8c-49fb-4770-82c8-ae3ce0feac27 req-5f0f3e8a-3001-4dbe-9d75-cba9909d297c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01374025-1d71-467c-9d2d-ddf7719fa8d1", "name": "network-vif-plugged", "status": "completed", "tag": "4aba674c-14c2-4953-a5fe-7f18b3e2fc7e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:48.416018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-92f3df8c-49fb-4770-82c8-ae3ce0feac27 req-5f0f3e8a-3001-4dbe-9d75-cba9909d297c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.418240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-92f3df8c-49fb-4770-82c8-ae3ce0feac27 req-5f0f3e8a-3001-4dbe-9d75-cba9909d297c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.420312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-92f3df8c-49fb-4770-82c8-ae3ce0feac27 req-5f0f3e8a-3001-4dbe-9d75-cba9909d297c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.454550 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-92f3df8c-49fb-4770-82c8-ae3ce0feac27 req-5f0f3e8a-3001-4dbe-9d75-cba9909d297c service nova] Creating event network-vif-plugged:4aba674c-14c2-4953-a5fe-7f18b3e2fc7e for instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 on n-h2-858384-17 Oct 31 15:20:48.466066 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-92f3df8c-49fb-4770-82c8-ae3ce0feac27 req-5f0f3e8a-3001-4dbe-9d75-cba9909d297c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093467 Oct 31 15:20:48.472181 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 616/1191] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:48.492285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d6c0c5c1-5ce8-4042-9b17-673551fe28d9 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:48.498356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6c0c5c1-5ce8-4042-9b17-673551fe28d9 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.500680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6c0c5c1-5ce8-4042-9b17-673551fe28d9 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.502644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6c0c5c1-5ce8-4042-9b17-673551fe28d9 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.504679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6c0c5c1-5ce8-4042-9b17-673551fe28d9 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.506000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6c0c5c1-5ce8-4042-9b17-673551fe28d9 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.510964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6c0c5c1-5ce8-4042-9b17-673551fe28d9 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.582751 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d6c0c5c1-5ce8-4042-9b17-673551fe28d9 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.104186 Oct 31 15:20:48.584807 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 617/1192] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 31 15:20:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:48.854723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:48.873289 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b5e3460-eb77-45d3-9274-0533bbc589a4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 1.203270 Oct 31 15:20:48.874177 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 576/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:47 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:48.884871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:48.889080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:48.899820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba7bbe8d-f696-4d55-94b9-eaaaf756b6be tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e14cb0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1752348890", "description": "tempest-description-290237960"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:48.907167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.907660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.908099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:48.909922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:48.910382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:48.910804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.487107 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba7bbe8d-f696-4d55-94b9-eaaaf756b6be tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.900821 Oct 31 15:20:49.496793 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 618/1194] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:20:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:49.496793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:49.496793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:49.514164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.525188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.525188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.537273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:49.538362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:49.541922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:49.925639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:49.946028 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e283ffb1-7da5-4cbd-8a70-768e908105e9 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 0.455686 Oct 31 15:20:49.952588 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 619/1195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:49 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:49.969002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd2d3728-f646-4636-b593-6c62d34f9001 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1503a60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:49.982104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:49.991220 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb63d10d-b5af-4790-88d2-5ae78677c641 tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1472 microversion: 2.1 time: 1.114086 Oct 31 15:20:50.005408 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 577/1196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:48 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1472 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:50.010114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0aa15bb1-6530-44a6-9fd1-fe11a54c015e tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e13c59d0>, body: {"security_group_rule": {"parent_group_id": "2c91a1a0-a105-4a52-b6c5-fbf724aad823", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:50.092750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd2d3728-f646-4636-b593-6c62d34f9001 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.138716 Oct 31 15:20:50.098876 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 620/1197] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:49 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:50.254909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-242633536", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "bf5d2157-6069-42f8-b335-fc42f2652c58"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:50.373190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] validate_networks() for [('bf5d2157-6069-42f8-b335-fc42f2652c58', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:20:51.341405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:20:51.341965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:20:51.342456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:20:51.342872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:20:51.343369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:20:51.360737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.362323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.363330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.365434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.365941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.367853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.434149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:20:51.448041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for user 676d4f2214e848c0aa654f0863b9f4a4 and project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:20:51.502927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:20:51.513732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:20:51.694732 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ceabd1e-244d-4eb0-99b7-e10f9225e8e2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.594397 Oct 31 15:20:51.708666 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 621/1198] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:20:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:20:51.722625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:51.735115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:51.791726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.793898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.794369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:51.800394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:51.804802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:51.811020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.076795 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0aa15bb1-6530-44a6-9fd1-fe11a54c015e tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.079828 Oct 31 15:20:52.077645 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 578/1199] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:20:49 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:52.095171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:52.098308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:52.123117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.123613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.147236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.150925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.154023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.158035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.436007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:52.448784 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-210685b2-8ccc-4aed-8014-829042a0bf48 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 0.736186 Oct 31 15:20:52.451688 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 622/1200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:51 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:52.468268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:52.469170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:52.484956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.487838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.489110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.491086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.493026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.494577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.593064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.593064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.597408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.598516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lazy-loading 'fault' on Instance uuid 6f6d49c8-10cb-4bbd-a978-69db51f46d2b {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:20:52.696465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4b632b1a3f84361b31a34dd81668ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b4e2ca54bb4af3a74d0f4d65b7b7bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:52.714876 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-902eaa91-e39d-462f-8d6f-bb648bf081ee tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 200 len: 1306 microversion: 2.1 time: 0.256816 Oct 31 15:20:52.715519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 623/1201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:52 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 1306 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:52.734039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7bc5fed-50a1-460a-a064-6af670468ba8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e577ee50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:52.837166 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7bc5fed-50a1-460a-a064-6af670468ba8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.117690 Oct 31 15:20:52.839273 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 624/1202] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:52 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:52.850857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-79980ac5-b4f1-4cf3-8d47-3f4d37273857 req-5da5a962-19bb-4d20-aa3c-d87a79d0109e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6d49c8-10cb-4bbd-a978-69db51f46d2b", "name": "network-vif-deleted", "tag": "5237a460-78b7-40d3-82f0-828b6401c0e0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:52.880488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-79980ac5-b4f1-4cf3-8d47-3f4d37273857 req-5da5a962-19bb-4d20-aa3c-d87a79d0109e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:52.882894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-79980ac5-b4f1-4cf3-8d47-3f4d37273857 req-5da5a962-19bb-4d20-aa3c-d87a79d0109e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:52.884853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-79980ac5-b4f1-4cf3-8d47-3f4d37273857 req-5da5a962-19bb-4d20-aa3c-d87a79d0109e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:52.920124 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-79980ac5-b4f1-4cf3-8d47-3f4d37273857 req-5da5a962-19bb-4d20-aa3c-d87a79d0109e service nova] Creating event network-vif-deleted:5237a460-78b7-40d3-82f0-828b6401c0e0 for instance 6f6d49c8-10cb-4bbd-a978-69db51f46d2b on n-h1-858384-17 Oct 31 15:20:52.926898 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-79980ac5-b4f1-4cf3-8d47-3f4d37273857 req-5da5a962-19bb-4d20-aa3c-d87a79d0109e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084666 Oct 31 15:20:52.928282 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 625/1203] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:52.940956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2a5a1ee-7803-4afc-b8c6-ff24b0baadac tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:52.943484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2a5a1ee-7803-4afc-b8c6-ff24b0baadac tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:53.097067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2a5a1ee-7803-4afc-b8c6-ff24b0baadac tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:53.119357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2a5a1ee-7803-4afc-b8c6-ff24b0baadac tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:53.124447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2a5a1ee-7803-4afc-b8c6-ff24b0baadac tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:53.126340 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2a5a1ee-7803-4afc-b8c6-ff24b0baadac tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1261 microversion: 2.25 time: 0.196708 Oct 31 15:20:53.137317 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 626/1204] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:52 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:53.162040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6baf2a1-bc88-4152-9c4e-7924034bb5de tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e148fd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-453169133", "description": "tempest-description-4364862"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:53.719739 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6baf2a1-bc88-4152-9c4e-7924034bb5de tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.579473 Oct 31 15:20:53.722512 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 627/1205] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:20:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:53.735369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:53.736142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:53.786732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:53.787285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:53.791887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:53.804193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:53.805748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:53.806200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:54.291162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:54.305594 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41dd49b0-0a99-4d16-9156-47a8a75437a0 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 0.573814 Oct 31 15:20:54.307539 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 628/1206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:53 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:54.315847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4af8f410-7025-45e6-a71a-16ddc9b6e02b tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e577eaf0>, body: {"security_group_rule": {"parent_group_id": "0ad5e700-ef69-4032-8a17-b97ca371f059", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:54.746581 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4af8f410-7025-45e6-a71a-16ddc9b6e02b tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.437957 Oct 31 15:20:54.747979 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 629/1207] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:20:54 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:54.758190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:54.760184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] [instance: 6f6d49c8-10cb-4bbd-a978-69db51f46d2b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:54.774341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:54.789226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:54.791762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:54.793814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:54.794573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:54.795849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:54.856792 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] HTTP exception thrown: Instance 6f6d49c8-10cb-4bbd-a978-69db51f46d2b could not be found. Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Request method failure captured: Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b HTTP/1.1 Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cDXxtQCK0RyybVnp7wo3iGWjepQldfToqH7fBH-h02CVM11c-57qQazs4gGeJCwWbIGrMR2VOBxIaHZhiv990fwPdP8UvVVbQAa35pYX0EO-GA0rTJHtYSkMmsLDh0VqL-e0doWlG2JMwlkeOvl6D-X8RSgwBcUnPNbU8DcOxS--s Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:20:54.869353 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f0b4e2ca54bb4af3a74d0f4d65b7b7bc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f0b4e2ca54bb4af3a74d0f4d65b7b7bc"}]}] Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f0b4e2ca54bb4af3a74d0f4d65b7b7bc Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1088787913 Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d4b632b1a3f84361b31a34dd81668ab5 Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersOnMultiNodesTest-1088787913-project Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 6f6d49c8-10cb-4bbd-a978-69db51f46d2b could not be found. Oct 31 15:20:54.871015 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '6f6d49c8-10cb-4bbd-a978-69db51f46d2b'} Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6d49c8-10cb-4bbd-a978-69db51f46d2b could not be found. Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:20:54.871911 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6d49c8-10cb-4bbd-a978-69db51f46d2b could not be found. Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6d49c8-10cb-4bbd-a978-69db51f46d2b could not be found. Oct 31 15:20:54.873276 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:20:54.876517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] Returning 404 to user: Instance 6f6d49c8-10cb-4bbd-a978-69db51f46d2b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:20:54.879117 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4ae09974-8afb-4047-a39d-9fabce96a64e tempest-ServersOnMultiNodesTest-1088787913 tempest-ServersOnMultiNodesTest-1088787913-project] 10.222.0.20 "GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b" status: 404 len: 111 microversion: 2.1 time: 0.129652 Oct 31 15:20:54.881240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 630/1208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:54 2022] GET /compute/v2.1/servers/6f6d49c8-10cb-4bbd-a978-69db51f46d2b => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:20:54.894955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7470582-9886-4a3e-9d42-b2af198e177d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1503a60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:55.008845 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7470582-9886-4a3e-9d42-b2af198e177d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.123931 Oct 31 15:20:55.010924 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 631/1209] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:54 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:55.022595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:55.023457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:55.040714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.041911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.043394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.049734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.051473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.052597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.186986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:55.196277 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d83433ee-e1a4-4927-905c-067a15665398 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1370 microversion: 2.1 time: 3.117172 Oct 31 15:20:55.196881 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 579/1210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:52 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1370 bytes in 3119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:55.228733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dacd7f22-e118-4550-ba52-87f327e7ad8c tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e1245f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1995682597", "description": "tempest-description-746618659"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:55.324980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:55.342403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:55.348943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:55.352352 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aa61d175-2f4a-40bf-a7a3-1a05b773c57a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1331 microversion: 2.25 time: 0.340287 Oct 31 15:20:55.357571 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 632/1211] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:55 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1331 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:55.365872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cca3ada0-9579-483f-b08d-5f87779824bc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a535416-e1d2-4f56-ae49-e33363b2cf54", "device": "/dev/xvdb"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:55.382333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cca3ada0-9579-483f-b08d-5f87779824bc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:55.414434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cca3ada0-9579-483f-b08d-5f87779824bc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.417776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cca3ada0-9579-483f-b08d-5f87779824bc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.420078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cca3ada0-9579-483f-b08d-5f87779824bc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:55.420890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cca3ada0-9579-483f-b08d-5f87779824bc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:55.421572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cca3ada0-9579-483f-b08d-5f87779824bc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:55.422106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cca3ada0-9579-483f-b08d-5f87779824bc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.079532 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cca3ada0-9579-483f-b08d-5f87779824bc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "POST /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.717515 Oct 31 15:20:56.097306 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 633/1212] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:20:55 2022] POST /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:56.121922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:56.122697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:56.138366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.138760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.139201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.145407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.146394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.147007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.411048 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dacd7f22-e118-4550-ba52-87f327e7ad8c tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.213043 Oct 31 15:20:56.415103 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 580/1213] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:20:55 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:56.434437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-eeab51b0-faaa-4bd1-8d64-71285416d761 req-2dd4d58c-8433-45e9-8cdf-1e35be01949f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb", "tag": "b0ae8b69-0230-4088-9230-9fab8d203c88"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:56.436834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.451292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:20:56.455820 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f2b2ade1-9112-4282-899d-406eb9adfc6d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 0.351169 Oct 31 15:20:56.461775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-eeab51b0-faaa-4bd1-8d64-71285416d761 req-2dd4d58c-8433-45e9-8cdf-1e35be01949f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.474810 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 634/1214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:56 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:56.479544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-eeab51b0-faaa-4bd1-8d64-71285416d761 req-2dd4d58c-8433-45e9-8cdf-1e35be01949f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.481258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-eeab51b0-faaa-4bd1-8d64-71285416d761 req-2dd4d58c-8433-45e9-8cdf-1e35be01949f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.481496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b4c1dd1-2268-49d2-8ebc-dabc8d32f318 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e574e820>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:56.510135 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-eeab51b0-faaa-4bd1-8d64-71285416d761 req-2dd4d58c-8433-45e9-8cdf-1e35be01949f service nova] Creating event network-changed:b0ae8b69-0230-4088-9230-9fab8d203c88 for instance 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb on n-h2-858384-17 Oct 31 15:20:56.528613 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-eeab51b0-faaa-4bd1-8d64-71285416d761 req-2dd4d58c-8433-45e9-8cdf-1e35be01949f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100885 Oct 31 15:20:56.531893 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 581/1215] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:56.542092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:56.547516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:56.566031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.568208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.568983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.574183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.575278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.576556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.602081 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b4c1dd1-2268-49d2-8ebc-dabc8d32f318 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.125875 Oct 31 15:20:56.610249 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 635/1216] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:56 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:56.634035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:56.634895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:56.650538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.651025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.651469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.671297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:56.672161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:56.676990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:56.791406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.807480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.811100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:56.814115 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b493f0d-187f-4844-a6c0-eeaf6accd69e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1319 microversion: 2.25 time: 0.193963 Oct 31 15:20:56.819455 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 636/1217] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:56 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:56.843601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e849e129-fdc5-428f-ade7-cb1c3e6aa2d6 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e5707b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-245704405", "description": "tempest-description-1148671915"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:57.232044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e849e129-fdc5-428f-ade7-cb1c3e6aa2d6 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.410208 Oct 31 15:20:57.233867 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 637/1218] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:20:56 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:57.247284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87072ef3-3c72-4764-b0f9-78048d32250c tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e56f4a60>, body: {"security_group_rule": {"parent_group_id": "5776e5a4-11ab-4207-b86d-91407d4025c4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "cad5e86a-8ea5-4658-88d2-ee981677cc97"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:57.666552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:57.681783 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b78d207-a06e-4e86-9860-1f732d4dbaf4 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1556 microversion: 2.1 time: 1.148396 Oct 31 15:20:57.686580 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 582/1219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:56 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1556 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:57.706725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:57.707592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:57.726287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.732485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.733342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:57.734478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:57.737590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:57.738307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:58.127837 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87072ef3-3c72-4764-b0f9-78048d32250c tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.883477 Oct 31 15:20:58.129307 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 638/1220] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:20:57 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:20:58.138155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ddc44f19-7853-4e83-87cb-649af5188c5c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e575db80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:58.241181 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ddc44f19-7853-4e83-87cb-649af5188c5c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.110544 Oct 31 15:20:58.250518 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 639/1221] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:58 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:58.256663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e25471c-b6cc-4d12-8920-bb2dd798ffea tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:58.258929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e25471c-b6cc-4d12-8920-bb2dd798ffea tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:58.269217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e25471c-b6cc-4d12-8920-bb2dd798ffea tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:58.269217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e25471c-b6cc-4d12-8920-bb2dd798ffea tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:58.269676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e25471c-b6cc-4d12-8920-bb2dd798ffea tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:58.271169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e25471c-b6cc-4d12-8920-bb2dd798ffea tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:58.271757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e25471c-b6cc-4d12-8920-bb2dd798ffea tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:58.272288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e25471c-b6cc-4d12-8920-bb2dd798ffea tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:58.407333 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e25471c-b6cc-4d12-8920-bb2dd798ffea tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155367 Oct 31 15:20:58.408322 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 640/1222] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:20:58 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:20:58.421148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:58.422003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:20:58.444563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:58.446528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:58.447243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:58.448892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:20:58.451615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:20:58.453397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:20:59.066639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.090179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.091831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.093010 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f1381b38-6794-40a9-a82f-0b810293aa07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1361 microversion: 2.25 time: 0.683544 Oct 31 15:20:59.116006 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 641/1223] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:20:58 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1361 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:20:59.130556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ceb587d9-a01b-4685-8c74-bcba55bbd992 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e56f48b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2089783131", "description": "tempest-description-331221953"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:20:59.628084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:20:59.652869 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3022a415-f941-4c3d-8101-02b69860b125 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 1.964975 Oct 31 15:20:59.678017 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 583/1224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:20:57 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:20:59.686788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0988f699-8e4f-4048-a2d7-5568c765a27d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e12d6670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:20:59.792908 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0988f699-8e4f-4048-a2d7-5568c765a27d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1440 microversion: 2.1 time: 0.113336 Oct 31 15:20:59.801739 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 584/1225] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:20:59 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1440 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:00.090439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57df8018-da6c-4988-a057-26099f5b6251 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:00.105854 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57df8018-da6c-4988-a057-26099f5b6251 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.310073 Oct 31 15:21:00.120998 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 585/1226] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:20:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:00.143006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:00.152472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:00.168505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.171879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.172678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.178926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:00.179776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:00.180428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:00.667765 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ceb587d9-a01b-4685-8c74-bcba55bbd992 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.550555 Oct 31 15:21:00.677795 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 642/1227] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:20:59 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:00.685372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f37ca11e-8f74-44bd-8afd-d4a12ed4362d tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:00.763201 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f37ca11e-8f74-44bd-8afd-d4a12ed4362d tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.082016 Oct 31 15:21:00.769879 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 643/1228] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:21:00 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:00.777239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7801714-cbdc-48a5-a347-81577bff6c0c tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e14a0c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-31751076", "description": "tempest-description-913366830"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:01.107464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:01.117652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:01.122507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:01.134658 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d430a56-ee53-4090-a594-82aaaeca43a3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1361 microversion: 2.25 time: 1.011984 Oct 31 15:21:01.135937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 586/1229] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:00 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1361 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:01.141966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:01.143326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:01.162670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:01.163386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:01.163827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:01.164573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:01.165002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:01.165508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:01.396698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:01.605260 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7801714-cbdc-48a5-a347-81577bff6c0c tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.832906 Oct 31 15:21:01.605987 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 644/1230] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:00 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:01.619817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-243595d5-3af2-4111-9762-444ff7b40094 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:01.652571 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-243595d5-3af2-4111-9762-444ff7b40094 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.045231 Oct 31 15:21:01.667056 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 645/1231] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:21:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:01.682048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d80c07c1-982a-4103-90b2-6e7c92cbaa70 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e56f4c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:01.760190 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d80c07c1-982a-4103-90b2-6e7c92cbaa70 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1449 microversion: 2.1 time: 0.091458 Oct 31 15:21:01.761282 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 646/1232] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:01 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1449 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:01.766843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a8e8cee-2919-4686-bab1-bb3c06ac0432 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e14a0b80>, body: {"security_group_rule": {"parent_group_id": "0d015db9-bae1-4b42-bac3-f22200dc9823", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a4c26890-45b2-4dc0-a955-6277ce144c7c"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:02.087523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.101808 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5005262-eb6c-427c-a2b5-dc6db1f30cf1 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 0.961427 Oct 31 15:21:02.103691 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 587/1233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:01 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:02.114068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0542976b-8b3d-4de8-bcfd-08631a0f11e6 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:02.143209 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0542976b-8b3d-4de8-bcfd-08631a0f11e6 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037447 Oct 31 15:21:02.165559 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 588/1234] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:21:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:02.173061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-97752ef6-f15a-49dd-9d26-d7a6eec6ba72 req-9d2d2af2-6833-44b6-a540-563cf5f35935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01374025-1d71-467c-9d2d-ddf7719fa8d1", "tag": "4aba674c-14c2-4953-a5fe-7f18b3e2fc7e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:02.223724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-97752ef6-f15a-49dd-9d26-d7a6eec6ba72 req-9d2d2af2-6833-44b6-a540-563cf5f35935 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.224329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-97752ef6-f15a-49dd-9d26-d7a6eec6ba72 req-9d2d2af2-6833-44b6-a540-563cf5f35935 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.224979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-97752ef6-f15a-49dd-9d26-d7a6eec6ba72 req-9d2d2af2-6833-44b6-a540-563cf5f35935 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.254027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:02.258419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-97752ef6-f15a-49dd-9d26-d7a6eec6ba72 req-9d2d2af2-6833-44b6-a540-563cf5f35935 service nova] Creating event network-changed:4aba674c-14c2-4953-a5fe-7f18b3e2fc7e for instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 on n-h2-858384-17 Oct 31 15:21:02.269519 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-97752ef6-f15a-49dd-9d26-d7a6eec6ba72 req-9d2d2af2-6833-44b6-a540-563cf5f35935 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101789 Oct 31 15:21:02.274563 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 589/1235] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:02.301490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fc42241-8d10-4787-b33b-771a59608cd8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e128e550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:02.406802 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a8e8cee-2919-4686-bab1-bb3c06ac0432 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.643193 Oct 31 15:21:02.407437 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 647/1236] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:01 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:02.421500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:02.426627 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2fc42241-8d10-4787-b33b-771a59608cd8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 200 len: 1449 microversion: 2.1 time: 0.139420 Oct 31 15:21:02.428305 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 590/1237] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:02 2022] GET /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 1449 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:02.433278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d2cd08f-2ef5-4ffd-be87-697c8fdc8470 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:02.437251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:02.448964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.449736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.450363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.452791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:02.453450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:02.454039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:02.491974 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d2cd08f-2ef5-4ffd-be87-697c8fdc8470 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.062313 Oct 31 15:21:02.509741 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 591/1238] 10.222.0.20 () {58 vars in 1165 bytes} [Mon Oct 31 15:21:02 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:02.617271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5d2eaa5-b4b9-4d4e-a5ad-99d48082df63 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e11e7430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-433152307", "description": "tempest-description-2063912117"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:02.711846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.722548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.724216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:02.725550 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b80a273-c74a-4589-b86a-af23b3974def tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1361 microversion: 2.25 time: 0.314910 Oct 31 15:21:02.726735 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 648/1239] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:02 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:02.732469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b99a260-6ac6-4634-b714-4a9121c6d427 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e14a0c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:03.107609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:03.172679 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b99a260-6ac6-4634-b714-4a9121c6d427 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a4c26890-45b2-4dc0-a955-6277ce144c7c" status: 202 len: 0 microversion: 2.1 time: 0.444638 Oct 31 15:21:03.173453 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 649/1240] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:02 2022] DELETE /compute/v2.1/os-security-groups/a4c26890-45b2-4dc0-a955-6277ce144c7c => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:03.178398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db703bd6-08e3-46f2-9df9-54034a6ce3c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e5723b80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:03.342603 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5d2eaa5-b4b9-4d4e-a5ad-99d48082df63 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.831531 Oct 31 15:21:03.343357 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 592/1241] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:02 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:03.348978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc156e58-1d4c-4c83-b1d9-5644a81bfb99 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:03.377580 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc156e58-1d4c-4c83-b1d9-5644a81bfb99 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032125 Oct 31 15:21:03.378185 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 593/1242] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:21:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:03.405749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:03.405749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:03.424444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.424952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.425585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.426210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:03.426664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:03.434510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:03.830333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:03.873698 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd2799ec-3bae-4de4-a931-c2a0fd24ea2a tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 0.474084 Oct 31 15:21:03.894821 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 594/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:03 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:03.904655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd766c93-11d6-4132-9f24-084ec90ff5ba tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e13950d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:04.157462 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db703bd6-08e3-46f2-9df9-54034a6ce3c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 204 len: 0 microversion: 2.1 time: 0.982593 Oct 31 15:21:04.159624 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 650/1244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:03 2022] DELETE /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 0 bytes in 985 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:04.165015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c375b3b-e0c4-4f9e-8328-1348a3e72be9 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e5729e50>, body: {"security_group_rule": {"parent_group_id": "2bddade7-f898-42d8-81a6-791bbfeb2ca1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:04.216018 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd766c93-11d6-4132-9f24-084ec90ff5ba tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/0d015db9-bae1-4b42-bac3-f22200dc9823" status: 200 len: 247 microversion: 2.1 time: 0.319725 Oct 31 15:21:04.217260 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 595/1245] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:21:03 2022] GET /compute/v2.1/os-security-groups/0d015db9-bae1-4b42-bac3-f22200dc9823 => generated 247 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:04.228645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d86441f4-51f2-4ee0-9361-2a5a518aff7e tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:04.279611 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d86441f4-51f2-4ee0-9361-2a5a518aff7e tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.060365 Oct 31 15:21:04.280416 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 596/1246] 10.222.0.20 () {58 vars in 1169 bytes} [Mon Oct 31 15:21:04 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:04.287316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f1f17991-9e04-44e1-b7d8-cf7f12f2560a req-c5474f5d-9b6a-468b-b923-0b4ef8b27060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d93bc1-c14b-4889-975f-5e624ce57027", "tag": "f27357e6-9586-4e9f-a712-a69e2f60a83d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:04.300009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f1f17991-9e04-44e1-b7d8-cf7f12f2560a req-c5474f5d-9b6a-468b-b923-0b4ef8b27060 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:04.300785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f1f17991-9e04-44e1-b7d8-cf7f12f2560a req-c5474f5d-9b6a-468b-b923-0b4ef8b27060 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:04.301423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f1f17991-9e04-44e1-b7d8-cf7f12f2560a req-c5474f5d-9b6a-468b-b923-0b4ef8b27060 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:04.322279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f1f17991-9e04-44e1-b7d8-cf7f12f2560a req-c5474f5d-9b6a-468b-b923-0b4ef8b27060 service nova] Creating event network-changed:f27357e6-9586-4e9f-a712-a69e2f60a83d for instance e8d93bc1-c14b-4889-975f-5e624ce57027 on n-h1-858384-17 Oct 31 15:21:04.339515 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f1f17991-9e04-44e1-b7d8-cf7f12f2560a req-c5474f5d-9b6a-468b-b923-0b4ef8b27060 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057622 Oct 31 15:21:04.340305 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 597/1247] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:04.354366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:04.357434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:04.369796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:04.370294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:04.370739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:04.371455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:04.371909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:04.377549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:04.570208 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c375b3b-e0c4-4f9e-8328-1348a3e72be9 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.409271 Oct 31 15:21:04.572032 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 651/1248] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:04 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:04.589880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-46557510-af79-47e2-bb17-b57b27dec9d2 req-9885f10a-51bb-4543-8ddb-7c20fae8be14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb", "name": "network-vif-plugged", "status": "completed", "tag": "b0ae8b69-0230-4088-9230-9fab8d203c88"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:04.616931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-46557510-af79-47e2-bb17-b57b27dec9d2 req-9885f10a-51bb-4543-8ddb-7c20fae8be14 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:04.617723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-46557510-af79-47e2-bb17-b57b27dec9d2 req-9885f10a-51bb-4543-8ddb-7c20fae8be14 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:04.618344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-46557510-af79-47e2-bb17-b57b27dec9d2 req-9885f10a-51bb-4543-8ddb-7c20fae8be14 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:04.634637 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-46557510-af79-47e2-bb17-b57b27dec9d2 req-9885f10a-51bb-4543-8ddb-7c20fae8be14 service nova] Creating event network-vif-plugged:b0ae8b69-0230-4088-9230-9fab8d203c88 for instance 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb on n-h2-858384-17 Oct 31 15:21:04.641478 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-46557510-af79-47e2-bb17-b57b27dec9d2 req-9885f10a-51bb-4543-8ddb-7c20fae8be14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067479 Oct 31 15:21:04.643730 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 652/1249] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:04.649927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:04.650742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:04.681073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:04.683156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:04.683604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:04.684323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:04.684791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:04.685241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:04.719000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:04.727912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:04.745694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:04.747321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:04.748490 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7bcd4032-2321-43d3-bc5c-46825094f20b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1361 microversion: 2.25 time: 0.404147 Oct 31 15:21:04.758405 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 598/1250] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:04 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1361 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:04.766403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c20265a-f0f5-4545-acd4-5b4145136154 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e11e7670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1496936638", "description": "tempest-description-495475754"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:04.848276 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-444c2bd7-af96-4d63-8be0-8d0397673c73 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 204 len: 0 microversion: 2.1 time: 0.201945 Oct 31 15:21:04.850387 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 653/1251] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:04 2022] DELETE /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:04.858685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cf4c8034-6926-4356-9515-1e90808605a4 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:04.904901 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cf4c8034-6926-4356-9515-1e90808605a4 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.052652 Oct 31 15:21:04.909062 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 654/1252] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:21:04 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:04.922992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b343df6-b890-4b91-b10e-0371c99153f3 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e5723550>, body: {"security_group_rule": {"parent_group_id": "2bddade7-f898-42d8-81a6-791bbfeb2ca1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:05.027049 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-1b343df6-b890-4b91-b10e-0371c99153f3 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] HTTP exception thrown: This rule already exists in group 2bddade7-f898-42d8-81a6-791bbfeb2ca1 Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b343df6-b890-4b91-b10e-0371c99153f3 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Request method failure captured: Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 138 Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-fexwPmUAVTTB1y7mGEcu4AoMRemk3t8EMmVrgZXs4GqYSjXtyEeS0XrS4_0ZqGdJyMmaj_GJVbpz1BjwsMxlRyK14z5V7jPK_tebjH4HV1Hfas27z0POalKV5Pb5vedCyMsIdhcSxkMh18rVpLL_vm_mA8slKmfiCvYk6EdBHB_cw Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:05.049913 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a61f6c203a443c89c919604379ca35f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a61f6c203a443c89c919604379ca35f"}]}] Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1364bf6041f84b88a3cf92827b5ce1eb Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: {"security_group_rule": {"parent_group_id": "2bddade7-f898-42d8-81a6-791bbfeb2ca1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 31 15:21:05.051815 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: exception: This rule already exists in group 2bddade7-f898-42d8-81a6-791bbfeb2ca1 Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2bddade7-f898-42d8-81a6-791bbfeb2ca1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 2bddade7-f898-42d8-81a6-791bbfeb2ca1 Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:05.052982 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 2bddade7-f898-42d8-81a6-791bbfeb2ca1 Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 2bddade7-f898-42d8-81a6-791bbfeb2ca1 Oct 31 15:21:05.056029 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:05.059010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b343df6-b890-4b91-b10e-0371c99153f3 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Returning 400 to user: This rule already exists in group 2bddade7-f898-42d8-81a6-791bbfeb2ca1 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:05.060762 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b343df6-b890-4b91-b10e-0371c99153f3 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.150174 Oct 31 15:21:05.065559 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 655/1253] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:04 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:21:05.078144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:05.081354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:05.093718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:05.094290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:05.094864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:05.096278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:05.096932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:05.097415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:05.098273 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c20265a-f0f5-4545-acd4-5b4145136154 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.348121 Oct 31 15:21:05.099049 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 599/1254] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:04 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:05.113900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-550505a0-fc46-46fe-a666-103d48911dd2 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:05.127880 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-550505a0-fc46-46fe-a666-103d48911dd2 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018400 Oct 31 15:21:05.134197 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 600/1255] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:21:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:05.140867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-83767825", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fae45c93-5c66-4e3d-908c-bfaf50cd6c4a"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:05.213186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] validate_networks() for [('fae45c93-5c66-4e3d-908c-bfaf50cd6c4a', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:05.263672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:05.273167 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-18df5b13-ba39-48f1-b19b-1f38400fe27b tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1314 microversion: 2.1 time: 0.205568 Oct 31 15:21:05.285784 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 656/1256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:05 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:05.295015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e76df7e6-0204-4e47-bac5-f7d0dfae9e20 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Calling method '.version_select at 0x7f16e5723160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:05.522674 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e76df7e6-0204-4e47-bac5-f7d0dfae9e20 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/5df703e4-a4cb-4efa-8093-065da135fbe7" status: 202 len: 0 microversion: 2.1 time: 0.235511 Oct 31 15:21:05.527374 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 657/1257] 10.222.0.20 () {58 vars in 1287 bytes} [Mon Oct 31 15:21:05 2022] DELETE /compute/v2.1/os-security-group-rules/5df703e4-a4cb-4efa-8093-065da135fbe7 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:05.542729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7953577-13c1-44aa-8b08-7a3c81c9bd3e tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e1503a60>, body: {"security_group_rule": {"parent_group_id": "e16c9014-9ebb-4db4-a6f5-268ca2bdaacb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:05.857064 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7953577-13c1-44aa-8b08-7a3c81c9bd3e tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.332027 Oct 31 15:21:05.857961 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 658/1258] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:05 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:05.863888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48975bc7-889d-41e8-9bd0-6afd930861c8 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:05.927457 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48975bc7-889d-41e8-9bd0-6afd930861c8 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.068096 Oct 31 15:21:05.941633 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 659/1259] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 31 15:21:05 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:05.946748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5000aaa1-475e-4d7c-bcfa-f5fc27874c93 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e574eca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1282313472", "description": "tempest-description-2083848460"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:06.061667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:21:06.062247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:21:06.062848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:21:06.063267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:21:06.064330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:21:06.093270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:06.093801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:06.094221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:06.095384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:06.097882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:06.101052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:06.132767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:06.138676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for user cd661f82522f4d5ab5f54d9fcdb81232 and project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:06.154494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:21:06.158004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:21:06.203808 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5000aaa1-475e-4d7c-bcfa-f5fc27874c93 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.260128 Oct 31 15:21:06.204575 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 660/1260] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:05 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:06.217935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:06.218555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:06.234983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:06.236709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:06.237665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:06.239067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:06.239800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:06.240893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:06.245445 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b26c901a-4fba-4c6c-a15e-833b778b6612 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108547 Oct 31 15:21:06.247795 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 601/1261] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:21:06.257957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-baec77cb-4aee-4639-a4f4-0b846966ade1 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Action: 'create', calling method: .version_select at 0x7f16e125a3a0>, body: {"security_group_rule": {"parent_group_id": "e16c9014-9ebb-4db4-a6f5-268ca2bdaacb", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:06.452383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:06.470510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:06.473015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:06.478376 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c971c081-a81a-42b5-8eda-c3cff84fbb69 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1361 microversion: 2.25 time: 0.264448 Oct 31 15:21:06.488917 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 661/1262] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:06 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:06.497254 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-baec77cb-4aee-4639-a4f4-0b846966ade1 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.244584 Oct 31 15:21:06.497254 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 602/1263] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:06 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:06.497464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b9cf8c3-47fe-44dd-90c2-6684db034f2d tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:06.506016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42c326b3-c0dd-43a5-b812-c987a39300df tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e13668b0>, body: {"security_group_rule": {"parent_group_id": "08eabc32-6009-4c19-a98a-8b8d1073b78a", "ip_protocol": "tcp", "from_port": 235177733, "to_port": 22}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:06.506543 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b9cf8c3-47fe-44dd-90c2-6684db034f2d tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016227 Oct 31 15:21:06.513940 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 662/1264] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:21:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:06.519569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dfe55808-f795-49c3-bc58-cdde74d107e2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:06.520284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dfe55808-f795-49c3-bc58-cdde74d107e2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:06.596090 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-42c326b3-c0dd-43a5-b812-c987a39300df tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] HTTP exception thrown: Invalid port range 235177733:22. Former value cannot be greater than the later Oct 31 15:21:06.599770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dfe55808-f795-49c3-bc58-cdde74d107e2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42c326b3-c0dd-43a5-b812-c987a39300df tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Request method failure captured: Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 145 Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-fexwPmUAVTTB1y7mGEcu4AoMRemk3t8EMmVrgZXs4GqYSjXtyEeS0XrS4_0ZqGdJyMmaj_GJVbpz1BjwsMxlRyK14z5V7jPK_tebjH4HV1Hfas27z0POalKV5Pb5vedCyMsIdhcSxkMh18rVpLL_vm_mA8slKmfiCvYk6EdBHB_cw Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:21:06.603580 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a61f6c203a443c89c919604379ca35f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a61f6c203a443c89c919604379ca35f"}]}] Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 1364bf6041f84b88a3cf92827b5ce1eb Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: {"security_group_rule": {"parent_group_id": "08eabc32-6009-4c19-a98a-8b8d1073b78a", "ip_protocol": "tcp", "from_port": 235177733, "to_port": 22}} Oct 31 15:21:06.605439 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid port range 235177733:22. Former value cannot be greater than the later Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'security_group_rule': {'parent_group_id': '08eabc32-6009-4c19-a98a-8b8d1073b78a', 'ip_protocol': 'tcp', 'from_port': 235177733, 'to_port': 22}}} Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 235177733:22. Former value cannot be greater than the later Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:06.606222 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 235177733:22. Former value cannot be greater than the later Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 235177733:22. Former value cannot be greater than the later Oct 31 15:21:06.607431 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.609407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42c326b3-c0dd-43a5-b812-c987a39300df tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Returning 400 to user: Invalid port range 235177733:22. Former value cannot be greater than the later {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:06.609407 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-42c326b3-c0dd-43a5-b812-c987a39300df tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.103084 Oct 31 15:21:06.614545 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 603/1265] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:06 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:21:06.622742 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dfe55808-f795-49c3-bc58-cdde74d107e2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1206 microversion: 2.1 time: 0.113874 Oct 31 15:21:06.624869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:06.650361 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 663/1266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:06 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1206 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:06.654264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:06.655712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6704577a-d685-493a-be66-50ecce849b25 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e57231f0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:06.660858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:06.661399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:06.661895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:06.662603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:06.663058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:06.663505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:06.726696 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6704577a-d685-493a-be66-50ecce849b25 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/e16c9014-9ebb-4db4-a6f5-268ca2bdaacb" status: 200 len: 664 microversion: 2.1 time: 0.074777 Oct 31 15:21:06.733291 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 664/1267] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:21:06 2022] GET /compute/v2.1/os-security-groups/e16c9014-9ebb-4db4-a6f5-268ca2bdaacb => generated 664 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:06.739030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78d15436-1fdc-4da4-8595-fd71d2e9686f tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:06.773977 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78d15436-1fdc-4da4-8595-fd71d2e9686f tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.039825 Oct 31 15:21:06.773977 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 665/1268] 10.222.0.20 () {58 vars in 1144 bytes} [Mon Oct 31 15:21:06 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:06.783722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-15165a85-0ffe-4a48-96c6-fb9cd70a3056 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e5707ee0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-255158807", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:06.787464 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-15165a85-0ffe-4a48-96c6-fb9cd70a3056 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] HTTP exception thrown: Security group id should be uuid Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-15165a85-0ffe-4a48-96c6-fb9cd70a3056 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Request method failure captured: Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 130 Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-fexwPmUAVTTB1y7mGEcu4AoMRemk3t8EMmVrgZXs4GqYSjXtyEeS0XrS4_0ZqGdJyMmaj_GJVbpz1BjwsMxlRyK14z5V7jPK_tebjH4HV1Hfas27z0POalKV5Pb5vedCyMsIdhcSxkMh18rVpLL_vm_mA8slKmfiCvYk6EdBHB_cw Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:06.790171 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a61f6c203a443c89c919604379ca35f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a61f6c203a443c89c919604379ca35f"}]}] Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1364bf6041f84b88a3cf92827b5ce1eb Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-255158807", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:06.793249 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group id should be uuid Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-255158807', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:06.794961 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-15165a85-0ffe-4a48-96c6-fb9cd70a3056 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Returning 400 to user: Security group id should be uuid {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:06.804930 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-15165a85-0ffe-4a48-96c6-fb9cd70a3056 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028486 Oct 31 15:21:06.806889 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 666/1269] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:06 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:21:06.812401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e5f8a6b5-fffc-4d0a-b237-a62b70131d3c req-cbb1bcaa-15b9-4d79-9675-f305bfd179f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874038fc-9845-4416-ae6b-1186e8c6c1f0", "name": "network-vif-unplugged", "status": "completed", "tag": "cc3e033d-674f-43ec-84d1-e699a211f053"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:06.828495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e5f8a6b5-fffc-4d0a-b237-a62b70131d3c req-cbb1bcaa-15b9-4d79-9675-f305bfd179f9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:06.828967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e5f8a6b5-fffc-4d0a-b237-a62b70131d3c req-cbb1bcaa-15b9-4d79-9675-f305bfd179f9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:06.830399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e5f8a6b5-fffc-4d0a-b237-a62b70131d3c req-cbb1bcaa-15b9-4d79-9675-f305bfd179f9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:06.846228 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e5f8a6b5-fffc-4d0a-b237-a62b70131d3c req-cbb1bcaa-15b9-4d79-9675-f305bfd179f9 service nova] Creating event network-vif-unplugged:cc3e033d-674f-43ec-84d1-e699a211f053 for instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 on n-h1-858384-17 Oct 31 15:21:06.853456 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e5f8a6b5-fffc-4d0a-b237-a62b70131d3c req-cbb1bcaa-15b9-4d79-9675-f305bfd179f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044712 Oct 31 15:21:06.854069 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 667/1270] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:06.861370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:06.872426 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1f2c643-5e5c-4c71-9386-0c58f3a40050 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1464 microversion: 2.1 time: 0.256648 Oct 31 15:21:06.873085 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 604/1271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:06 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1464 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:06.881435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a84b4e48-9b4b-41c3-bae6-b957eb8d34ca tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:06.884291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc467906-13fb-4021-a97b-1b66c795e4ab tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e5723550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:06.902321 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a84b4e48-9b4b-41c3-bae6-b957eb8d34ca tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027990 Oct 31 15:21:06.902939 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 605/1272] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:21:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:06.909268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4697a31d-1c65-49b4-9753-36a40fcd9b8a tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e1366040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1110105406", "description": "tempest-description-1665164487"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:07.115451 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc467906-13fb-4021-a97b-1b66c795e4ab tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/bed7b6f8-aa5c-419e-b597-29706b3fb1fe" status: 202 len: 0 microversion: 2.1 time: 0.249121 Oct 31 15:21:07.116284 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 668/1273] 10.222.0.20 () {58 vars in 1287 bytes} [Mon Oct 31 15:21:06 2022] DELETE /compute/v2.1/os-security-group-rules/bed7b6f8-aa5c-419e-b597-29706b3fb1fe => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:07.120212 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4697a31d-1c65-49b4-9753-36a40fcd9b8a tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.216123 Oct 31 15:21:07.132535 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 606/1274] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:06 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:07.137731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5a2fabd2-915c-4ab8-b39a-b7a060c1c996 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.160519 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5a2fabd2-915c-4ab8-b39a-b7a060c1c996 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.026601 Oct 31 15:21:07.161562 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 607/1275] 10.222.0.20 () {58 vars in 1148 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:07.167168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33a54b3e-c979-43f4-9fc6-dab87c6cac4f tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e1289c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.326211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65a1a4be-a12b-46b2-9b52-78a081d3a3af tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Calling method '.version_select at 0x7f16e56f4040>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.340839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a1a4be-a12b-46b2-9b52-78a081d3a3af tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.341371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a1a4be-a12b-46b2-9b52-78a081d3a3af tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.341811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a1a4be-a12b-46b2-9b52-78a081d3a3af tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.359693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a1a4be-a12b-46b2-9b52-78a081d3a3af tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.360447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a1a4be-a12b-46b2-9b52-78a081d3a3af tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.360879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a1a4be-a12b-46b2-9b52-78a081d3a3af tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.382312 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65a1a4be-a12b-46b2-9b52-78a081d3a3af tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/f50db02b685949eda543ab1c8d075fd0?start=2022-10-30T15%3A21%3A06.889411&end=2022-11-01T15%3A21%3A06.889411" status: 200 len: 695 microversion: 2.1 time: 0.264924 Oct 31 15:21:07.383302 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 669/1276] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/os-simple-tenant-usage/f50db02b685949eda543ab1c8d075fd0?start=2022-10-30T15%3A21%3A06.889411&end=2022-11-01T15%3A21%3A06.889411 => generated 695 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:07.388065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a51af0c-5090-4065-92b2-804930a459a8 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e1600700>, body: {"security_group_rule": {"parent_group_id": "b9448ccc-520a-4a10-9f27-439851ec3bf1", "ip_protocol": "tempest-999-1218580401", "from_port": 22, "to_port": 22}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:07.451855 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-0a51af0c-5090-4065-92b2-804930a459a8 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] HTTP exception thrown: Invalid IP protocol tempest-999-1218580401. Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a51af0c-5090-4065-92b2-804930a459a8 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Request method failure captured: Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 157 Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-fexwPmUAVTTB1y7mGEcu4AoMRemk3t8EMmVrgZXs4GqYSjXtyEeS0XrS4_0ZqGdJyMmaj_GJVbpz1BjwsMxlRyK14z5V7jPK_tebjH4HV1Hfas27z0POalKV5Pb5vedCyMsIdhcSxkMh18rVpLL_vm_mA8slKmfiCvYk6EdBHB_cw Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:07.454231 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a61f6c203a443c89c919604379ca35f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a61f6c203a443c89c919604379ca35f"}]}] Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1364bf6041f84b88a3cf92827b5ce1eb Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: {"security_group_rule": {"parent_group_id": "b9448ccc-520a-4a10-9f27-439851ec3bf1", "ip_protocol": "tempest-999-1218580401", "from_port": 22, "to_port": 22}} Oct 31 15:21:07.456869 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid IP protocol tempest-999-1218580401. Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b9448ccc-520a-4a10-9f27-439851ec3bf1', 'ip_protocol': 'tempest-999-1218580401', 'from_port': 22, 'to_port': 22}}} Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1218580401. Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:07.457969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1218580401. Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1218580401. Oct 31 15:21:07.459416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:07.463443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a51af0c-5090-4065-92b2-804930a459a8 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Returning 400 to user: Invalid IP protocol tempest-999-1218580401. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:07.464314 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a51af0c-5090-4065-92b2-804930a459a8 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.080017 Oct 31 15:21:07.464900 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 670/1277] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:07 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:21:07.469912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f8ece4c-80ee-4f63-b1a4-00293f7d6787 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.483850 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f8ece4c-80ee-4f63-b1a4-00293f7d6787 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017812 Oct 31 15:21:07.484524 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 671/1278] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:07.489189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a38a8a75-85f2-4e60-bf02-b911ffa1629d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '.version_select at 0x7f16e56f4160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.498998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38a8a75-85f2-4e60-bf02-b911ffa1629d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.499557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38a8a75-85f2-4e60-bf02-b911ffa1629d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.500062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38a8a75-85f2-4e60-bf02-b911ffa1629d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.510062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38a8a75-85f2-4e60-bf02-b911ffa1629d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.510737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38a8a75-85f2-4e60-bf02-b911ffa1629d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.511178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38a8a75-85f2-4e60-bf02-b911ffa1629d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.522660 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a38a8a75-85f2-4e60-bf02-b911ffa1629d tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/f50db02b685949eda543ab1c8d075fd0?start=2022-10-30T15%3A21%3A06.889411&end=2022-11-01T15%3A21%3A06.889411" status: 200 len: 695 microversion: 2.1 time: 0.037073 Oct 31 15:21:07.523237 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 672/1279] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/os-simple-tenant-usage/f50db02b685949eda543ab1c8d075fd0?start=2022-10-30T15%3A21%3A06.889411&end=2022-11-01T15%3A21%3A06.889411 => generated 695 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:07.527925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41c41ff9-4102-4f5a-81c9-a78cc99b52bc tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e5729d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1229509207", "description": "tempest-description-2120496343"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:07.681731 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41c41ff9-4102-4f5a-81c9-a78cc99b52bc tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.157276 Oct 31 15:21:07.682329 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 673/1280] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:07 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:07.686865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b26b3c4c-b0c9-43eb-82b1-0aef7cf12e38 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.702481 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b26b3c4c-b0c9-43eb-82b1-0aef7cf12e38 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018200 Oct 31 15:21:07.713927 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 674/1281] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:07.721583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.723819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:07.739172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.740759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.742071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.749665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.751903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.752790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.754935 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33a54b3e-c979-43f4-9fc6-dab87c6cac4f tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e16c9014-9ebb-4db4-a6f5-268ca2bdaacb" status: 202 len: 0 microversion: 2.1 time: 0.591285 Oct 31 15:21:07.756679 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 608/1282] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:07 2022] DELETE /compute/v2.1/os-security-groups/e16c9014-9ebb-4db4-a6f5-268ca2bdaacb => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:07.763986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb33233c-8328-4c03-ab5d-0e3301247503 tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Calling method '.version_select at 0x7f16e130f5e0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.781352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:07.784293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb33233c-8328-4c03-ab5d-0e3301247503 tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.784968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb33233c-8328-4c03-ab5d-0e3301247503 tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.803031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb33233c-8328-4c03-ab5d-0e3301247503 tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.825469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb33233c-8328-4c03-ab5d-0e3301247503 tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.826293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb33233c-8328-4c03-ab5d-0e3301247503 tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.826908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb33233c-8328-4c03-ab5d-0e3301247503 tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.917273 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb33233c-8328-4c03-ab5d-0e3301247503 tempest-TenantUsagesTestJSON-1937850259 tempest-TenantUsagesTestJSON-1937850259-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A21%3A06.889411&end=2022-11-01T15%3A21%3A06.889411&detailed=1" status: 200 len: 16043 microversion: 2.1 time: 0.158752 Oct 31 15:21:07.939033 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 609/1283] 10.222.0.20 () {58 vars in 1335 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A21%3A06.889411&end=2022-11-01T15%3A21%3A06.889411&detailed=1 => generated 16043 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:21:07.949632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:07.951578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:07.960113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.960882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.961514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:07.962643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:07.963284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:07.963873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:08.013911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:08.024614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:08.026072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:08.027441 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e9aaf5c-d9a0-49dd-bbdb-1a53cb08cd44 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1361 microversion: 2.25 time: 0.312458 Oct 31 15:21:08.028225 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 675/1284] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:08.034195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3bcb2c4-b03f-483b-b6b7-d7f56b74504a tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e5756160>, body: {"security_group_rule": {"parent_group_id": "210aace4-556a-48aa-9137-85a8b3d4ac84", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:08.085813 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d3bcb2c4-b03f-483b-b6b7-d7f56b74504a tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3bcb2c4-b03f-483b-b6b7-d7f56b74504a tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Request method failure captured: Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 138 Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-fexwPmUAVTTB1y7mGEcu4AoMRemk3t8EMmVrgZXs4GqYSjXtyEeS0XrS4_0ZqGdJyMmaj_GJVbpz1BjwsMxlRyK14z5V7jPK_tebjH4HV1Hfas27z0POalKV5Pb5vedCyMsIdhcSxkMh18rVpLL_vm_mA8slKmfiCvYk6EdBHB_cw Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:08.088274 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a61f6c203a443c89c919604379ca35f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a61f6c203a443c89c919604379ca35f"}]}] Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1364bf6041f84b88a3cf92827b5ce1eb Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: {"security_group_rule": {"parent_group_id": "210aace4-556a-48aa-9137-85a8b3d4ac84", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 31 15:21:08.090118 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'security_group_rule': {'parent_group_id': '210aace4-556a-48aa-9137-85a8b3d4ac84', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:08.091075 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 31 15:21:08.092449 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.095642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3bcb2c4-b03f-483b-b6b7-d7f56b74504a tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:08.097408 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3bcb2c4-b03f-483b-b6b7-d7f56b74504a tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.067590 Oct 31 15:21:08.097897 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 676/1285] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:08 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:21:08.108109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52ad3a6a-ed47-4037-a345-504b7f19352d tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:08.120539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:08.138527 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52ad3a6a-ed47-4037-a345-504b7f19352d tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.036072 Oct 31 15:21:08.139624 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 677/1286] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:21:08 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:08.146043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc169265-7f76-4075-aae1-0bd89d560264 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e56f4b80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:08.174674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:08.178644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-fc169265-7f76-4075-aae1-0bd89d560264 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a4c26890-45b2-4dc0-a955-6277ce144c7c does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:21:08.179348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-fc169265-7f76-4075-aae1-0bd89d560264 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Neutron security group a4c26890-45b2-4dc0-a955-6277ce144c7c not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:21:08.179995 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-fc169265-7f76-4075-aae1-0bd89d560264 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] HTTP exception thrown: Security group a4c26890-45b2-4dc0-a955-6277ce144c7c does not exist Oct 31 15:21:08.179995 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-9d5c882b-2e95-428f-94bc-b996168ddb21'] Oct 31 15:21:08.186981 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64548060-680c-4df0-a041-5c4bb663ef5e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1266 microversion: 2.1 time: 0.246695 Oct 31 15:21:08.187788 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 610/1287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:07 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc169265-7f76-4075-aae1-0bd89d560264 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Request method failure captured: Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-security-groups/a4c26890-45b2-4dc0-a955-6277ce144c7c HTTP/1.1 Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-fPzZ-_8dXi345EHZqC9oZxlU93JdGh0d_C8l5YoM3cKzkpDM8YtTm8fdx5-siiPWz7ssgwisqNqzdJS9Am0NJwJDM6fXDvJh4Rb_kFe7ggf8JtfhEy_KAwvdccjTC0zx8xPUQpndsVc3n-Kug2XpWYPZVrR6RXhCeGw175ovEsr30 Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 22fe69e87590422b99c120c385a2c943 Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-656352274 Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:08.203970 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22fe69e87590422b99c120c385a2c943"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_22fe69e87590422b99c120c385a2c943", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/22fe69e87590422b99c120c385a2c943"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/22fe69e87590422b99c120c385a2c943"}]}] Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupRulesTestJSON-656352274 Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 22fe69e87590422b99c120c385a2c943 Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-656352274 Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupRulesTestJSON-656352274-project Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 933bf36e01754de79649cb0fd337a766 Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupRulesTestJSON-656352274-project Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group a4c26890-45b2-4dc0-a955-6277ce144c7c does not exist Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-9d5c882b-2e95-428f-94bc-b996168ddb21'] Oct 31 15:21:08.206196 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'a4c26890-45b2-4dc0-a955-6277ce144c7c'} Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:08.207292 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a4c26890-45b2-4dc0-a955-6277ce144c7c does not exist Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d5c882b-2e95-428f-94bc-b996168ddb21'] Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:21:08.209352 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a4c26890-45b2-4dc0-a955-6277ce144c7c does not exist Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d5c882b-2e95-428f-94bc-b996168ddb21'] Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a4c26890-45b2-4dc0-a955-6277ce144c7c does not exist Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d5c882b-2e95-428f-94bc-b996168ddb21'] Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.211566 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a4c26890-45b2-4dc0-a955-6277ce144c7c does not exist Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d5c882b-2e95-428f-94bc-b996168ddb21'] Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc169265-7f76-4075-aae1-0bd89d560264 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Returning 404 to user: Security group a4c26890-45b2-4dc0-a955-6277ce144c7c does not exist Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-9d5c882b-2e95-428f-94bc-b996168ddb21'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc169265-7f76-4075-aae1-0bd89d560264 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a4c26890-45b2-4dc0-a955-6277ce144c7c" status: 404 len: 194 microversion: 2.1 time: 0.073786 Oct 31 15:21:08.219618 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 678/1288] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:08 2022] DELETE /compute/v2.1/os-security-groups/a4c26890-45b2-4dc0-a955-6277ce144c7c => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:08.222686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:08.222686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:08.225415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:08.225960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:08.226401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:08.227110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:08.227569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:08.227993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:08.231547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96c15254-d596-4b89-b1ba-f66906536061 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e55d3700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-776069271", "description": "tempest-description-568434488"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:08.275285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:21:08.400684 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d93d5346-5c2b-47a3-a661-28f74ba1dacf tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "DELETE /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 204 len: 0 microversion: 2.1 time: 0.188459 Oct 31 15:21:08.402875 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 611/1289] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:21:08 2022] DELETE /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:08.417828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b68c677-e4af-46d3-bf55-c34f9852a495 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:08.429897 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96c15254-d596-4b89-b1ba-f66906536061 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.212672 Oct 31 15:21:08.430862 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 679/1290] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:21:08 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:08.436451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4066268b-63c3-4544-b566-b74037ecac9b tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e55d3940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:08.456967 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b68c677-e4af-46d3-bf55-c34f9852a495 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051300 Oct 31 15:21:08.458646 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 612/1291] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:21:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:08.479412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:08.493967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:08.509822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:08.517167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:08.518091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:08.519889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:08.521771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:08.522219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:08.776560 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4066268b-63c3-4544-b566-b74037ecac9b tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/0d015db9-bae1-4b42-bac3-f22200dc9823" status: 202 len: 0 microversion: 2.1 time: 0.343758 Oct 31 15:21:08.778595 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 680/1292] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:08 2022] DELETE /compute/v2.1/os-security-groups/0d015db9-bae1-4b42-bac3-f22200dc9823 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:08.787944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-264fa249-7e04-406d-8383-8dcde5cd1919 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e56f40d0>, body: {"security_group_rule": {"parent_group_id": "4ecc9e7e-22c2-4824-85ad-23be3f5d572a", "ip_protocol": "tcp", "from_port": 22, "to_port": 1284862503}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:08.874037 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-264fa249-7e04-406d-8383-8dcde5cd1919 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] HTTP exception thrown: Invalid port range 22:1284862503. Valid TCP ports should be between 1-65535 Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-264fa249-7e04-406d-8383-8dcde5cd1919 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Request method failure captured: Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 146 Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-fexwPmUAVTTB1y7mGEcu4AoMRemk3t8EMmVrgZXs4GqYSjXtyEeS0XrS4_0ZqGdJyMmaj_GJVbpz1BjwsMxlRyK14z5V7jPK_tebjH4HV1Hfas27z0POalKV5Pb5vedCyMsIdhcSxkMh18rVpLL_vm_mA8slKmfiCvYk6EdBHB_cw Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:08.876276 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a61f6c203a443c89c919604379ca35f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a61f6c203a443c89c919604379ca35f"}]}] Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1364bf6041f84b88a3cf92827b5ce1eb Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: {"security_group_rule": {"parent_group_id": "4ecc9e7e-22c2-4824-85ad-23be3f5d572a", "ip_protocol": "tcp", "from_port": 22, "to_port": 1284862503}} Oct 31 15:21:08.877891 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid port range 22:1284862503. Valid TCP ports should be between 1-65535 Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4ecc9e7e-22c2-4824-85ad-23be3f5d572a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1284862503}}} Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1284862503. Valid TCP ports should be between 1-65535 Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:08.878787 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1284862503. Valid TCP ports should be between 1-65535 Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1284862503. Valid TCP ports should be between 1-65535 Oct 31 15:21:08.880925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:08.883305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-264fa249-7e04-406d-8383-8dcde5cd1919 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Returning 400 to user: Invalid port range 22:1284862503. Valid TCP ports should be between 1-65535 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:08.883305 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-264fa249-7e04-406d-8383-8dcde5cd1919 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.096629 Oct 31 15:21:08.883305 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 681/1293] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:08 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:21:08.889656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ea31374-a2f3-4166-86a0-96bd7713d987 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:08.899832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ea31374-a2f3-4166-86a0-96bd7713d987 tempest-FlavorsV2TestJSON-1248819199 tempest-FlavorsV2TestJSON-1248819199-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020317 Oct 31 15:21:08.906767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:08.910886 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 682/1294] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:21:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:08.915524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7fccd263-aabc-4456-8572-8a1805642e88 req-85659c11-adeb-4563-aa79-a32bef7b1919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "874038fc-9845-4416-ae6b-1186e8c6c1f0", "name": "network-vif-deleted", "tag": "cc3e033d-674f-43ec-84d1-e699a211f053"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:08.925747 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-186d7f1c-a775-4ebe-a051-39e4acd4bb02 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1470 microversion: 2.1 time: 0.464661 Oct 31 15:21:08.930829 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 613/1295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:08 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:08.945657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-536d9bda-8494-4887-a398-3128481e7ba8 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e128eb80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:08.957781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7fccd263-aabc-4456-8572-8a1805642e88 req-85659c11-adeb-4563-aa79-a32bef7b1919 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:08.958263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7fccd263-aabc-4456-8572-8a1805642e88 req-85659c11-adeb-4563-aa79-a32bef7b1919 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:08.958963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7fccd263-aabc-4456-8572-8a1805642e88 req-85659c11-adeb-4563-aa79-a32bef7b1919 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:08.977377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7fccd263-aabc-4456-8572-8a1805642e88 req-85659c11-adeb-4563-aa79-a32bef7b1919 service nova] Creating event network-vif-deleted:cc3e033d-674f-43ec-84d1-e699a211f053 for instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 on n-h1-858384-17 Oct 31 15:21:08.983709 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7fccd263-aabc-4456-8572-8a1805642e88 req-85659c11-adeb-4563-aa79-a32bef7b1919 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071170 Oct 31 15:21:08.984839 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 683/1296] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:08.994305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eecc4cb0-0ad7-47bc-9719-33d90f2ec98c tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Action: 'create', calling method: .version_select at 0x7f16e55d3940>, body: {"security_group_rule": {"parent_group_id": "686deab6-bd6a-472a-bb26-52ab398bfa80", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:09.022224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-eecc4cb0-0ad7-47bc-9719-33d90f2ec98c tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 686deab6-bd6a-472a-bb26-52ab398bfa80 does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:21:09.022897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-eecc4cb0-0ad7-47bc-9719-33d90f2ec98c tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Neutron security group 686deab6-bd6a-472a-bb26-52ab398bfa80 not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:21:09.023424 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-eecc4cb0-0ad7-47bc-9719-33d90f2ec98c tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] HTTP exception thrown: Security group 686deab6-bd6a-472a-bb26-52ab398bfa80 does not exist Oct 31 15:21:09.023424 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-7b3b1a7d-645f-4035-944d-2d4f745f12b7'] Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eecc4cb0-0ad7-47bc-9719-33d90f2ec98c tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Request method failure captured: Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 138 Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-fexwPmUAVTTB1y7mGEcu4AoMRemk3t8EMmVrgZXs4GqYSjXtyEeS0XrS4_0ZqGdJyMmaj_GJVbpz1BjwsMxlRyK14z5V7jPK_tebjH4HV1Hfas27z0POalKV5Pb5vedCyMsIdhcSxkMh18rVpLL_vm_mA8slKmfiCvYk6EdBHB_cw Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:09.027425 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a61f6c203a443c89c919604379ca35f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a61f6c203a443c89c919604379ca35f"}]}] Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1364bf6041f84b88a3cf92827b5ce1eb Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: {"security_group_rule": {"parent_group_id": "686deab6-bd6a-472a-bb26-52ab398bfa80", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 31 15:21:09.028846 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group 686deab6-bd6a-472a-bb26-52ab398bfa80 does not exist Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-7b3b1a7d-645f-4035-944d-2d4f745f12b7'] Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'security_group_rule': {'parent_group_id': '686deab6-bd6a-472a-bb26-52ab398bfa80', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:21:09.030267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 686deab6-bd6a-472a-bb26-52ab398bfa80 does not exist Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b3b1a7d-645f-4035-944d-2d4f745f12b7'] Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 31 15:21:09.032053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 686deab6-bd6a-472a-bb26-52ab398bfa80 does not exist Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b3b1a7d-645f-4035-944d-2d4f745f12b7'] Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 686deab6-bd6a-472a-bb26-52ab398bfa80 does not exist Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b3b1a7d-645f-4035-944d-2d4f745f12b7'] Oct 31 15:21:09.034079 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 686deab6-bd6a-472a-bb26-52ab398bfa80 does not exist Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b3b1a7d-645f-4035-944d-2d4f745f12b7'] Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eecc4cb0-0ad7-47bc-9719-33d90f2ec98c tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Returning 404 to user: Security group 686deab6-bd6a-472a-bb26-52ab398bfa80 does not exist Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-7b3b1a7d-645f-4035-944d-2d4f745f12b7'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:09.035705 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eecc4cb0-0ad7-47bc-9719-33d90f2ec98c tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.042444 Oct 31 15:21:09.036792 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 684/1297] 10.222.0.20 () {60 vars in 1195 bytes} [Mon Oct 31 15:21:08 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:09.043562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0086af55-d2f6-4d49-b56b-2ba199618937 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Calling method '.version_select at 0x7f16e55e1c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.076776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-0086af55-d2f6-4d49-b56b-2ba199618937 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:21:09.077409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-0086af55-d2f6-4d49-b56b-2ba199618937 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Neutron security group rule 1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc not found {{(pid=120587) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 31 15:21:09.078263 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-0086af55-d2f6-4d49-b56b-2ba199618937 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] HTTP exception thrown: Security group rule 1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc does not exist Oct 31 15:21:09.078263 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-683c9226-936f-4def-8e56-45b070c7a6f9'] Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0086af55-d2f6-4d49-b56b-2ba199618937 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Request method failure captured: Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-security-group-rules/1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc HTTP/1.1 Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-fexwPmUAVTTB1y7mGEcu4AoMRemk3t8EMmVrgZXs4GqYSjXtyEeS0XrS4_0ZqGdJyMmaj_GJVbpz1BjwsMxlRyK14z5V7jPK_tebjH4HV1Hfas27z0POalKV5Pb5vedCyMsIdhcSxkMh18rVpLL_vm_mA8slKmfiCvYk6EdBHB_cw Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:09.082623 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8a61f6c203a443c89c919604379ca35f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8a61f6c203a443c89c919604379ca35f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8a61f6c203a443c89c919604379ca35f"}]}] Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 8a61f6c203a443c89c919604379ca35f Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789 Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1364bf6041f84b88a3cf92827b5ce1eb Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group rule 1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc does not exist Oct 31 15:21:09.084231 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-683c9226-936f-4def-8e56-45b070c7a6f9'] Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc'} Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.085076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc does not exist Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-683c9226-936f-4def-8e56-45b070c7a6f9'] Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 31 15:21:09.086565 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc does not exist Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-683c9226-936f-4def-8e56-45b070c7a6f9'] Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc does not exist Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-683c9226-936f-4def-8e56-45b070c7a6f9'] Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.089403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc does not exist Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-683c9226-936f-4def-8e56-45b070c7a6f9'] Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0086af55-d2f6-4d49-b56b-2ba199618937 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Returning 404 to user: Security group rule 1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc does not exist Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-683c9226-936f-4def-8e56-45b070c7a6f9'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:09.091100 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0086af55-d2f6-4d49-b56b-2ba199618937 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc" status: 404 len: 199 microversion: 2.1 time: 0.050478 Oct 31 15:21:09.092907 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 685/1298] 10.222.0.20 () {58 vars in 1287 bytes} [Mon Oct 31 15:21:09 2022] DELETE /compute/v2.1/os-security-group-rules/1185f2a1-5ba0-45f0-a82d-7ae36cfb42bc => generated 199 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:09.098387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.099606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:09.106339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.107148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.107921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.108990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.109638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.110934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.281553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.295613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.297078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.298242 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a8b8be70-b638-4903-ad84-22b7bce32506 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1361 microversion: 2.25 time: 0.205371 Oct 31 15:21:09.298814 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 686/1299] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:09 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:09.305939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb880a9f-4479-4c61-88ff-c7ee1d1d839e tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Calling method '.version_select at 0x7f16e55d3c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.454609 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-536d9bda-8494-4887-a398-3128481e7ba8 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cad5e86a-8ea5-4658-88d2-ee981677cc97" status: 202 len: 0 microversion: 2.1 time: 0.522446 Oct 31 15:21:09.456156 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 614/1300] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:08 2022] DELETE /compute/v2.1/os-security-groups/cad5e86a-8ea5-4658-88d2-ee981677cc97 => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:09.464515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.465457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:09.474685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.475590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.476242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.477920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:09.478394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:09.480090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:09.557116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cb880a9f-4479-4c61-88ff-c7ee1d1d839e tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4ecc9e7e-22c2-4824-85ad-23be3f5d572a" status: 202 len: 0 microversion: 2.1 time: 0.255586 Oct 31 15:21:09.560556 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 687/1301] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:09 2022] DELETE /compute/v2.1/os-security-groups/4ecc9e7e-22c2-4824-85ad-23be3f5d572a => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:09.564723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c8d02c6-810b-425c-97ce-274082f85155 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e557ee50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.717115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:09.727145 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f6baa09-72a7-4c60-8d4d-19ea5c388133 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1306 microversion: 2.1 time: 0.269383 Oct 31 15:21:09.727739 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 615/1302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:09 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1306 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:09.732532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d993e7a3-f52b-485a-bf30-d1d4872f6e9f tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Calling method '.version_select at 0x7f16e12c0280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:09.886085 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c8d02c6-810b-425c-97ce-274082f85155 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5776e5a4-11ab-4207-b86d-91407d4025c4" status: 202 len: 0 microversion: 2.1 time: 0.326561 Oct 31 15:21:09.887043 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 688/1303] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:09 2022] DELETE /compute/v2.1/os-security-groups/5776e5a4-11ab-4207-b86d-91407d4025c4 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:09.896209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1475b162-70e0-452b-9960-d5332a788132 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e5571430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:10.114113 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1475b162-70e0-452b-9960-d5332a788132 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/0ad5e700-ef69-4032-8a17-b97ca371f059" status: 202 len: 0 microversion: 2.1 time: 0.222599 Oct 31 15:21:10.118036 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 689/1304] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:09 2022] DELETE /compute/v2.1/os-security-groups/0ad5e700-ef69-4032-8a17-b97ca371f059 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:10.124235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:10.129911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:10.139069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.139816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.140420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.141216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.141664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.142094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.278561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:10.290315 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-790ee302-491e-4254-a491-e7aeec4b490f tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1470 microversion: 2.1 time: 0.170805 Oct 31 15:21:10.306080 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 690/1305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:10 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:10.311400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db6d188c-c4ed-424b-9497-4a9fbc249d60 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] Calling method '.version_select at 0x7f16e5571dc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:10.578773 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db6d188c-c4ed-424b-9497-4a9fbc249d60 tempest-SecurityGroupRulesTestJSON-656352274 tempest-SecurityGroupRulesTestJSON-656352274-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2c91a1a0-a105-4a52-b6c5-fbf724aad823" status: 202 len: 0 microversion: 2.1 time: 0.271252 Oct 31 15:21:10.579890 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 691/1306] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:10 2022] DELETE /compute/v2.1/os-security-groups/2c91a1a0-a105-4a52-b6c5-fbf724aad823 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:10.585575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:10.586196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:10.586383 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d993e7a3-f52b-485a-bf30-d1d4872f6e9f tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/210aace4-556a-48aa-9137-85a8b3d4ac84" status: 202 len: 0 microversion: 2.1 time: 0.857314 Oct 31 15:21:10.592169 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 616/1307] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:09 2022] DELETE /compute/v2.1/os-security-groups/210aace4-556a-48aa-9137-85a8b3d4ac84 => generated 0 bytes in 863 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:10.599350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-0a761d5d-6591-490f-b810-674ff99cda0d req-fc223275-3939-40bc-9db0-30d8159db4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d93bc1-c14b-4889-975f-5e624ce57027", "name": "network-vif-plugged", "status": "completed", "tag": "f27357e6-9586-4e9f-a712-a69e2f60a83d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:10.606972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.607477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.611857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0a761d5d-6591-490f-b810-674ff99cda0d req-fc223275-3939-40bc-9db0-30d8159db4f0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.612181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.612834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0a761d5d-6591-490f-b810-674ff99cda0d req-fc223275-3939-40bc-9db0-30d8159db4f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.613615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0a761d5d-6591-490f-b810-674ff99cda0d req-fc223275-3939-40bc-9db0-30d8159db4f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.616450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:10.617031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:10.617666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:10.630984 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-0a761d5d-6591-490f-b810-674ff99cda0d req-fc223275-3939-40bc-9db0-30d8159db4f0 service nova] Creating event network-vif-plugged:f27357e6-9586-4e9f-a712-a69e2f60a83d for instance e8d93bc1-c14b-4889-975f-5e624ce57027 on n-h1-858384-17 Oct 31 15:21:10.638440 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-0a761d5d-6591-490f-b810-674ff99cda0d req-fc223275-3939-40bc-9db0-30d8159db4f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043727 Oct 31 15:21:10.640161 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 617/1308] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:10.650726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e04271f9-4a8c-4e19-960e-5ed2fd4f6319 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Calling method '.version_select at 0x7f16e1289d30>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:11.045423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.062717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.067511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.069304 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4517b3ed-a614-47e0-8cda-9dd0b85eda20 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1361 microversion: 2.25 time: 0.488403 Oct 31 15:21:11.070236 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 692/1309] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:10 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1361 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:11.078091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:11.079126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:11.088567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.089447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.090295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.091255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.092427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.093093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.348357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.359943 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9ec57183-869f-43e1-9a58-08bfd162b153 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1306 microversion: 2.1 time: 0.288414 Oct 31 15:21:11.375734 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 693/1310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:11 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1306 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:11.381418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:11.382328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:11.388576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.389405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.389939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.390857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.392129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.392843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.624139 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e04271f9-4a8c-4e19-960e-5ed2fd4f6319 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b9448ccc-520a-4a10-9f27-439851ec3bf1" status: 202 len: 0 microversion: 2.1 time: 0.982118 Oct 31 15:21:11.626612 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 618/1311] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:10 2022] DELETE /compute/v2.1/os-security-groups/b9448ccc-520a-4a10-9f27-439851ec3bf1 => generated 0 bytes in 986 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:11.633612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a153090f-a430-4244-ae60-3e5727ae7255 req-ad7c7a3d-a3aa-4029-a02b-9cb9ec83a4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb", "name": "network-vif-deleted", "tag": "b0ae8b69-0230-4088-9230-9fab8d203c88"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:11.679221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a153090f-a430-4244-ae60-3e5727ae7255 req-ad7c7a3d-a3aa-4029-a02b-9cb9ec83a4a9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:11.681895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a153090f-a430-4244-ae60-3e5727ae7255 req-ad7c7a3d-a3aa-4029-a02b-9cb9ec83a4a9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:11.685543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a153090f-a430-4244-ae60-3e5727ae7255 req-ad7c7a3d-a3aa-4029-a02b-9cb9ec83a4a9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:11.713095 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a153090f-a430-4244-ae60-3e5727ae7255 req-ad7c7a3d-a3aa-4029-a02b-9cb9ec83a4a9 service nova] Creating event network-vif-deleted:b0ae8b69-0230-4088-9230-9fab8d203c88 for instance 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb on n-h2-858384-17 Oct 31 15:21:11.723722 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a153090f-a430-4244-ae60-3e5727ae7255 req-ad7c7a3d-a3aa-4029-a02b-9cb9ec83a4a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095344 Oct 31 15:21:11.724352 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 619/1312] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:11.730827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c050b42b-8c2b-4af4-bf2d-7046d0c0e6ff tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Calling method '.version_select at 0x7f16e130f820>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:11.869167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:11.878379 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9fead2c2-ba1c-4177-94d1-b100174edff4 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1428 microversion: 2.1 time: 0.500683 Oct 31 15:21:11.893276 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 694/1313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:11 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1428 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:12.103396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:12.105076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:12.116464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.117278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.118008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.119158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.119774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.120352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.164341 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c050b42b-8c2b-4af4-bf2d-7046d0c0e6ff tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/08eabc32-6009-4c19-a98a-8b8d1073b78a" status: 202 len: 0 microversion: 2.1 time: 0.432512 Oct 31 15:21:12.166901 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 620/1314] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:11 2022] DELETE /compute/v2.1/os-security-groups/08eabc32-6009-4c19-a98a-8b8d1073b78a => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:12.174258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49299a16-f08a-4acb-942a-9f4b9aeb20b3 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] Calling method '.version_select at 0x7f16e11e9a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:12.194943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:12.539307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:12.552981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:12.555203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:12.557244 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b25355d-9596-47d9-8c7d-7fd19d2b99de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1361 microversion: 2.25 time: 0.460617 Oct 31 15:21:12.570105 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 695/1315] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:12 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1361 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:12.582700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:12.583333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:12.591274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.591779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.592232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.592971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.593469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.593896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.694277 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49299a16-f08a-4acb-942a-9f4b9aeb20b3 tempest-SecurityGroupRulesNegativeTestJSON-2010553789 tempest-SecurityGroupRulesNegativeTestJSON-2010553789-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2bddade7-f898-42d8-81a6-791bbfeb2ca1" status: 202 len: 0 microversion: 2.1 time: 0.524475 Oct 31 15:21:12.695970 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 621/1316] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:12 2022] DELETE /compute/v2.1/os-security-groups/2bddade7-f898-42d8-81a6-791bbfeb2ca1 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:12.904847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:12.906236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:12.932951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.934426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.935918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:12.941526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:12.944169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:12.945669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.050096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:13.066889 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5157b2a8-971a-48da-8e9d-69a82cc3ecab tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1306 microversion: 2.1 time: 0.495363 Oct 31 15:21:13.067779 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 696/1317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:12 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1306 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:13.428465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27f37855c20d48058241cf1f5e886ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f50db02b685949eda543ab1c8d075fd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:13.443269 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd0648d1-c63c-43f1-afd1-98134c7b9efc tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 200 len: 1299 microversion: 2.1 time: 0.543467 Oct 31 15:21:13.448391 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 622/1318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:12 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 1299 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:13.513995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ec14ebc-e951-47d5-a9fb-bfeed3c0a009 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:13.514588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ec14ebc-e951-47d5-a9fb-bfeed3c0a009 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:13.523546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec14ebc-e951-47d5-a9fb-bfeed3c0a009 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.524342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec14ebc-e951-47d5-a9fb-bfeed3c0a009 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.524939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec14ebc-e951-47d5-a9fb-bfeed3c0a009 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.525847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec14ebc-e951-47d5-a9fb-bfeed3c0a009 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.526461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec14ebc-e951-47d5-a9fb-bfeed3c0a009 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.527183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec14ebc-e951-47d5-a9fb-bfeed3c0a009 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.586637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:13.587872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:13.596204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.596961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.597696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.598769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.599628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.603344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.833555 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ec14ebc-e951-47d5-a9fb-bfeed3c0a009 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1861 microversion: 2.1 time: 0.322698 Oct 31 15:21:13.835975 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 697/1319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:13 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1861 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:13.845313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-17accab9-167e-4e74-b659-0dd86c8748b9 req-2cab7ef0-8f59-4b6c-8f94-cf5da30e229f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34017fcd-17ac-42cc-b924-4c2519a21f0c", "tag": "d4e2d90d-8190-4cbd-a7bf-d295ce2c356e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:13.881694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-17accab9-167e-4e74-b659-0dd86c8748b9 req-2cab7ef0-8f59-4b6c-8f94-cf5da30e229f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.882236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-17accab9-167e-4e74-b659-0dd86c8748b9 req-2cab7ef0-8f59-4b6c-8f94-cf5da30e229f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.882747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-17accab9-167e-4e74-b659-0dd86c8748b9 req-2cab7ef0-8f59-4b6c-8f94-cf5da30e229f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.898045 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-17accab9-167e-4e74-b659-0dd86c8748b9 req-2cab7ef0-8f59-4b6c-8f94-cf5da30e229f service nova] Creating event network-changed:d4e2d90d-8190-4cbd-a7bf-d295ce2c356e for instance 34017fcd-17ac-42cc-b924-4c2519a21f0c on n-h2-858384-17 Oct 31 15:21:13.904217 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-17accab9-167e-4e74-b659-0dd86c8748b9 req-2cab7ef0-8f59-4b6c-8f94-cf5da30e229f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066975 Oct 31 15:21:13.905931 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 698/1320] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:13.912873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-17", "block_migration": true, "disk_over_commit": false}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:13.916146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:13.924952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.925821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.926452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.927399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:13.928017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:13.928601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:13.964057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lazy-loading 'flavor' on Instance uuid f3848bfc-68ef-48e5-8d45-4a700c478f0a {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:21:13.981965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Going to try to live migrate instance to n-h1-858384-17 {{(pid=120587) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:21:14.468882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:14.482701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:14.484330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:14.497202 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ffe0a3a-c12c-47dd-b36e-c0724a236fa7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1558 microversion: 2.25 time: 0.909370 Oct 31 15:21:14.499102 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 623/1321] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:13 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1558 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:14.504486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:14.512979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:14.521078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:14.521790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:14.530131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:14.531232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:14.531918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:14.533449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.034417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:15.046927 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23e4d453-5de3-46d7-9178-17c2e6916bb8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1306 microversion: 2.1 time: 0.546515 Oct 31 15:21:15.063098 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 624/1322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:14 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1306 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:15.081746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:15.083631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] [instance: 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:15.091314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.092339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.093617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.095057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.096073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.096684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.114900 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] HTTP exception thrown: Instance 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb could not be found. Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Request method failure captured: Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb HTTP/1.1 Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-e7nHhpjhFxIat9Ryq6WaldlJAHtT-tJoSSdPapa4Bp6lhkjypxWAbXJMOnet9LHUSPy6o0gSebCbKjSkMAuiyZXyQGAFhMwplIhSAsP-Hn0r2QqnGez4d4Qb4f8jNeUIxSW-aHdWPBWfCJuES5l9VGJcoeqIHzvQJJLthUBbBfOPY Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f50db02b685949eda543ab1c8d075fd0 Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TenantUsagesTestJSON-1557153353 Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:21:15.117186 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50db02b685949eda543ab1c8d075fd0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f50db02b685949eda543ab1c8d075fd0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f50db02b685949eda543ab1c8d075fd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f50db02b685949eda543ab1c8d075fd0"}]}] Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TenantUsagesTestJSON-1557153353 Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f50db02b685949eda543ab1c8d075fd0 Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1557153353 Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TenantUsagesTestJSON-1557153353-project Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 27f37855c20d48058241cf1f5e886ecb Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TenantUsagesTestJSON-1557153353-project Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb could not be found. Oct 31 15:21:15.118621 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb'} Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb could not be found. Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:15.119448 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb could not be found. Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb could not be found. Oct 31 15:21:15.120819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:15.123616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] Returning 404 to user: Instance 51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:15.123616 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a44e7d7f-7a05-4649-af4e-37dc233fb841 tempest-TenantUsagesTestJSON-1557153353 tempest-TenantUsagesTestJSON-1557153353-project] 10.222.0.20 "GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb" status: 404 len: 111 microversion: 2.1 time: 0.053146 Oct 31 15:21:15.123616 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 625/1323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:15 2022] GET /compute/v2.1/servers/51ee55e0-8113-48bb-bb6a-5f9fd71ba1cb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:15.381695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:15.382339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:15.396798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.404821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.411685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:15.415252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:15.417882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:15.418998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:16.151867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:16.464350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid e8d93bc1-c14b-4889-975f-5e624ce57027 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:21:16.488093 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-617f3307-faf6-4f3c-8d86-28767c6ee927 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 2052 microversion: 2.25 time: 1.366691 Oct 31 15:21:16.489409 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 626/1324] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:15 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 2052 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:16.510540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:16.511597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:16.527881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:16.529408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:16.529850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:16.531030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:16.531495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:16.531989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:16.607806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:17.376851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:17.388444 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2933bc9f-2e36-45f1-92ea-2832c38f43ef tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1306 microversion: 2.1 time: 0.897701 Oct 31 15:21:17.418508 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 627/1325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:16 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1306 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:17.424286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:17.424862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:17.448530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:17.449345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:17.449781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:17.450699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:17.451156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:17.451578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:17.504921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:17.506215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:17.819937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:18.398307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid e8d93bc1-c14b-4889-975f-5e624ce57027 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:21:18.421938 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b57864a5-d86e-49c8-b4bb-48a413fd9960 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 2052 microversion: 2.25 time: 1.002156 Oct 31 15:21:18.423086 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 628/1326] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:17 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 2052 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:18.437571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:18.438765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:18.457465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:18.458197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:18.458965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:18.459854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:18.460311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:18.460925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.087566 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9e46c5e-be5f-4b0f-8bfd-0acabcff637d tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/action" status: 202 len: 0 microversion: 2.1 time: 5.179562 Oct 31 15:21:19.089490 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 699/1327] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:21:13 2022] POST /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/action => generated 0 bytes in 5182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:21:19.100945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b44d9fb-3c65-4a85-a590-cc63b0a3ae5d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:19.141039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b44d9fb-3c65-4a85-a590-cc63b0a3ae5d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.141692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b44d9fb-3c65-4a85-a590-cc63b0a3ae5d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.142201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b44d9fb-3c65-4a85-a590-cc63b0a3ae5d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.143182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b44d9fb-3c65-4a85-a590-cc63b0a3ae5d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.143667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b44d9fb-3c65-4a85-a590-cc63b0a3ae5d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.144083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b44d9fb-3c65-4a85-a590-cc63b0a3ae5d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.212968 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6b44d9fb-3c65-4a85-a590-cc63b0a3ae5d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.121652 Oct 31 15:21:19.218290 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 700/1328] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 31 15:21:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:21:19.235978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:19.236592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:19.259172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.259929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.261001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.261924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.262555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.263297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.379078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:19.393150 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4f337d00-1862-4285-9d3f-8954c47c0db3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1306 microversion: 2.1 time: 0.963247 Oct 31 15:21:19.394959 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 629/1329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:18 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1306 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:19.399768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-17", "block_migration": "auto"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:19.413830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:19.433628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.435492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.436183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.437234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:19.437963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:19.438657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:19.589495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'flavor' on Instance uuid e8d93bc1-c14b-4889-975f-5e624ce57027 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:21:19.671972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Going to try to live migrate instance to n-h2-858384-17 {{(pid=120588) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:21:20.129990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:20.146785 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73f2c2bd-ab24-415e-9bd6-4feefe1cb3e5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.922649 Oct 31 15:21:20.148209 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 701/1330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:19 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:20.155237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-738911ea-6eba-45c4-b560-71bb84022e37 req-083b0c00-94b9-4069-abd2-1d8c90f38f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34017fcd-17ac-42cc-b924-4c2519a21f0c", "name": "network-vif-plugged", "status": "completed", "tag": "d4e2d90d-8190-4cbd-a7bf-d295ce2c356e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:20.167413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-738911ea-6eba-45c4-b560-71bb84022e37 req-083b0c00-94b9-4069-abd2-1d8c90f38f4f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:20.168549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-738911ea-6eba-45c4-b560-71bb84022e37 req-083b0c00-94b9-4069-abd2-1d8c90f38f4f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:20.169313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-738911ea-6eba-45c4-b560-71bb84022e37 req-083b0c00-94b9-4069-abd2-1d8c90f38f4f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:20.186850 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-738911ea-6eba-45c4-b560-71bb84022e37 req-083b0c00-94b9-4069-abd2-1d8c90f38f4f service nova] Creating event network-vif-plugged:d4e2d90d-8190-4cbd-a7bf-d295ce2c356e for instance 34017fcd-17ac-42cc-b924-4c2519a21f0c on n-h2-858384-17 Oct 31 15:21:20.196029 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-738911ea-6eba-45c4-b560-71bb84022e37 req-083b0c00-94b9-4069-abd2-1d8c90f38f4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044295 Oct 31 15:21:20.197942 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 702/1331] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:20.421771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:20.423520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:20.432515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:20.433383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:20.434028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:20.435161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:20.435816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:20.436406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:20.705652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:20.717461 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-594642f0-b43c-45e6-b5fa-ccbeba4a60ec tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1306 microversion: 2.1 time: 0.301363 Oct 31 15:21:20.730906 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 703/1332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:20 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1306 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:21.180345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:21.180962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:21.201241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.201784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.202425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:21.203159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.203664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.204095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:21.741674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:21.761929 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-469a644c-0e16-4262-ae10-8e21ba2b2ad3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.584566 Oct 31 15:21:21.764956 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 704/1333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:21 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:21.784250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:21.787574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:21.803535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.804319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.805535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:21.806841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.807924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.808634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:21.931315 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e35cef3-5c09-4540-bd9b-9e7bf538a034 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027/action" status: 202 len: 0 microversion: 2.25 time: 2.534989 Oct 31 15:21:21.933154 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 630/1334] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:21:19 2022] POST /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027/action => generated 0 bytes in 2538 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:21:21.945386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:21.946293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:21.964070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.971007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.971454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:21.976325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:21.976905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:21.985979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:22.217468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:22.232178 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-798f2afa-9154-47be-baeb-a56c127d2696 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1306 microversion: 2.1 time: 0.464481 Oct 31 15:21:22.233583 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 705/1335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:21 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1306 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:22.239172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:22.248411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:22.262027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:22.264022 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-abed3165-7ba0-46a9-afb9-b68a1ccb4aca tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 0.326100 Oct 31 15:21:22.265622 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 631/1336] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:21 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:22.528533 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-258111e5-5a41-4f61-aceb-8018c5a7a8af tempest-TenantUsagesNegativeTestJSON-1529850801 tempest-TenantUsagesNegativeTestJSON-1529850801-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-30T15%3A21%3A21.980540&end=2022-11-01T15%3A21%3A21.980540" status: 404 len: 112 microversion: - time: 0.293700 Oct 31 15:21:22.529839 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 706/1337] 10.222.0.20 () {58 vars in 1316 bytes} [Mon Oct 31 15:21:22 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-30T15%3A21%3A21.980540&end=2022-11-01T15%3A21%3A21.980540 => generated 112 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:21:22.541054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb401c47-672e-4c79-b426-e67de3564833 tempest-TenantUsagesNegativeTestJSON-1529850801 tempest-TenantUsagesNegativeTestJSON-1529850801-project-admin] Calling method '.version_select at 0x7f16e1193820>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:22.545996 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-bb401c47-672e-4c79-b426-e67de3564833 tempest-TenantUsagesNegativeTestJSON-1529850801 tempest-TenantUsagesNegativeTestJSON-1529850801-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb401c47-672e-4c79-b426-e67de3564833 tempest-TenantUsagesNegativeTestJSON-1529850801 tempest-TenantUsagesNegativeTestJSON-1529850801-project-admin] Request method failure captured: Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-simple-tenant-usage/29f1ada1de794464ae7fb4d0f1f69490?start=2022-11-01T15%3A21%3A21.980540&end=2022-10-30T15%3A21%3A21.980540 HTTP/1.1 Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-fxvT_KK9Rk-yS8YUzAvdnPi1A-Ny1xVGnkTrTyKUKYgIBuWV2Qiwu2FQuppH0s0MSSJ3H3Ogrc32WYjggsJuSNGh21Yei7LwlJvjj2HQd0dwKU6we6rXqieBrE21oQFzhzk-79zlIjHpM0PJVWhBTmcjy-AItcJU94e2Kzs5jHO8s Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7f31102848e7492f9b2488f83086e197 Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1529850801 Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:21:22.550797 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f31102848e7492f9b2488f83086e197"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7f31102848e7492f9b2488f83086e197", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7f31102848e7492f9b2488f83086e197"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7f31102848e7492f9b2488f83086e197"}]}] Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1529850801 Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7f31102848e7492f9b2488f83086e197 Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1529850801 Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TenantUsagesNegativeTestJSON-1529850801-project-admin Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e82319f2582a46b2b13caf4bee4ee431 Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1529850801-project-admin Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid start time. The start time cannot occur after the end time. Oct 31 15:21:22.552288 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '29f1ada1de794464ae7fb4d0f1f69490'} Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 15:21:22.553670 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 31 15:21:22.554921 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:22.557531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb401c47-672e-4c79-b426-e67de3564833 tempest-TenantUsagesNegativeTestJSON-1529850801 tempest-TenantUsagesNegativeTestJSON-1529850801-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:22.559284 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb401c47-672e-4c79-b426-e67de3564833 tempest-TenantUsagesNegativeTestJSON-1529850801 tempest-TenantUsagesNegativeTestJSON-1529850801-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/29f1ada1de794464ae7fb4d0f1f69490?start=2022-11-01T15%3A21%3A21.980540&end=2022-10-30T15%3A21%3A21.980540" status: 400 len: 111 microversion: 2.1 time: 0.022972 Oct 31 15:21:22.560091 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 632/1338] 10.222.0.20 () {58 vars in 1412 bytes} [Mon Oct 31 15:21:22 2022] GET /compute/v2.1/os-simple-tenant-usage/29f1ada1de794464ae7fb4d0f1f69490?start=2022-11-01T15%3A21%3A21.980540&end=2022-10-30T15%3A21%3A21.980540 => generated 111 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:21:22.795088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:22.801345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a246a74c-c0ab-4735-99a1-f31ece3c44e6 tempest-TenantUsagesNegativeTestJSON-614446320 tempest-TenantUsagesNegativeTestJSON-614446320-project] Calling method '.version_select at 0x7f16e55a1700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:22.803367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:22.807341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a246a74c-c0ab-4735-99a1-f31ece3c44e6 tempest-TenantUsagesNegativeTestJSON-614446320 tempest-TenantUsagesNegativeTestJSON-614446320-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '66ec477d3d0a45cdb95d13483c69b5a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f1ada1de794464ae7fb4d0f1f69490', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a246a74c-c0ab-4735-99a1-f31ece3c44e6 tempest-TenantUsagesNegativeTestJSON-614446320 tempest-TenantUsagesNegativeTestJSON-614446320-project] Request method failure captured: Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A21%3A21.980540&end=2022-11-01T15%3A21%3A21.980540&detailed=1 HTTP/1.1 Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-fwE5Yzk0bxrNJa209jT77e7BmcqesAKQr1gbNZEKsLN82B5DRS6bXFtGvZwFG2n8oDuQTy7eDAQtbROJV14TAjlZ6-BamcTqfw0sNHiEO61IoRC8j0uq4cyEpvJpGkBoMdWrMMAVpO9VH7SUhcQEAA72LgtK4ExrH3bjnPYu07XOs Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 29f1ada1de794464ae7fb4d0f1f69490 Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-614446320 Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:22.815456 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29f1ada1de794464ae7fb4d0f1f69490"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29f1ada1de794464ae7fb4d0f1f69490", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29f1ada1de794464ae7fb4d0f1f69490"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29f1ada1de794464ae7fb4d0f1f69490"}]}] Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-614446320 Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 29f1ada1de794464ae7fb4d0f1f69490 Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-614446320 Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TenantUsagesNegativeTestJSON-614446320-project Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 66ec477d3d0a45cdb95d13483c69b5a0 Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-614446320-project Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:21:22.817043 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:21:22.818160 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:21:22.819571 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:21:22.820861 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 31 15:21:22.820861 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:22.822552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a246a74c-c0ab-4735-99a1-f31ece3c44e6 tempest-TenantUsagesNegativeTestJSON-614446320 tempest-TenantUsagesNegativeTestJSON-614446320-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:22.825558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:22.826884 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a246a74c-c0ab-4735-99a1-f31ece3c44e6 tempest-TenantUsagesNegativeTestJSON-614446320 tempest-TenantUsagesNegativeTestJSON-614446320-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A21%3A21.980540&end=2022-11-01T15%3A21%3A21.980540&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.260548 Oct 31 15:21:22.828096 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 707/1339] 10.222.0.20 () {58 vars in 1335 bytes} [Mon Oct 31 15:21:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-30T15%3A21%3A21.980540&end=2022-11-01T15%3A21%3A21.980540&detailed=1 => generated 123 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:22.829719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:22.830429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:22.833386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:22.834356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:22.835144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:23.257565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:23.259266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:23.270679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:23.271180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:23.271620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:23.272340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:23.272798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:23.273148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:23.286939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:23.291234 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd3b358d-044b-49df-a26f-93b204a1dd8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.505909 Oct 31 15:21:23.292655 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 633/1340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:22 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:23.302402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:23.303300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:23.322600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:23.324324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:23.325669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:23.326804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:23.327286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:23.330824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:23.973577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:23.993348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:23.995002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:23.996338 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04c4fda5-62b6-4117-82b0-2f71e514a926 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 0.702016 Oct 31 15:21:23.997072 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 634/1341] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:23 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:24.115735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:24.128591 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5fd100b7-264a-4c36-996b-90188b17e5a4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 200 len: 1487 microversion: 2.1 time: 0.874968 Oct 31 15:21:24.138119 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 708/1342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:23 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 1487 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:24.162851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f46589ca-1e09-4b01-944c-9a56459d8c99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1671808122"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:24.165678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f46589ca-1e09-4b01-944c-9a56459d8c99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:24.172571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f46589ca-1e09-4b01-944c-9a56459d8c99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:24.173753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f46589ca-1e09-4b01-944c-9a56459d8c99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:24.174416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f46589ca-1e09-4b01-944c-9a56459d8c99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:24.175340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f46589ca-1e09-4b01-944c-9a56459d8c99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:24.177600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f46589ca-1e09-4b01-944c-9a56459d8c99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:24.178280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f46589ca-1e09-4b01-944c-9a56459d8c99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:24.319873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:24.320445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:24.332887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:24.333731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:24.334976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:24.335872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:24.337785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:24.338412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:24.630502 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f46589ca-1e09-4b01-944c-9a56459d8c99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c/action" status: 202 len: 0 microversion: 2.1 time: 0.468692 Oct 31 15:21:24.632062 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 635/1343] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:21:24 2022] POST /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:21:24.650174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7ac8148-6750-4cae-a07c-8a92fdc3245a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e125a9d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:24.742092 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7ac8148-6750-4cae-a07c-8a92fdc3245a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.102804 Oct 31 15:21:24.746070 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 636/1344] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:24 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:25.084610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:25.106239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b0c84bc-d40e-473b-b897-36f135ce3b0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.791160 Oct 31 15:21:25.109408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 709/1345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:24 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:25.119189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:25.123736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:25.138342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:25.138846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:25.140415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:25.141765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:25.142239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:25.148343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:25.256542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3c84faa0-859a-4cee-a2c2-a9518facb726 req-a5ea7dd4-7211-4397-b154-d8b9d32e3b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d93bc1-c14b-4889-975f-5e624ce57027", "name": "network-vif-unplugged", "status": "completed", "tag": "f27357e6-9586-4e9f-a712-a69e2f60a83d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:25.278937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3c84faa0-859a-4cee-a2c2-a9518facb726 req-a5ea7dd4-7211-4397-b154-d8b9d32e3b5b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:25.279956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3c84faa0-859a-4cee-a2c2-a9518facb726 req-a5ea7dd4-7211-4397-b154-d8b9d32e3b5b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:25.280579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3c84faa0-859a-4cee-a2c2-a9518facb726 req-a5ea7dd4-7211-4397-b154-d8b9d32e3b5b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:25.305214 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3c84faa0-859a-4cee-a2c2-a9518facb726 req-a5ea7dd4-7211-4397-b154-d8b9d32e3b5b service nova] Creating event network-vif-unplugged:f27357e6-9586-4e9f-a712-a69e2f60a83d for instance e8d93bc1-c14b-4889-975f-5e624ce57027 on n-h1-858384-17 Oct 31 15:21:25.316371 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3c84faa0-859a-4cee-a2c2-a9518facb726 req-a5ea7dd4-7211-4397-b154-d8b9d32e3b5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.316073 Oct 31 15:21:25.316992 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 637/1346] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:25.761609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-38203c97-cfc7-4cb1-9b39-6fc8c9b344e5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e10ca1f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:25.855051 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-38203c97-cfc7-4cb1-9b39-6fc8c9b344e5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.098110 Oct 31 15:21:25.855666 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 638/1347] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:25 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:26.149100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:26.150077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:26.170791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:26.171306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:26.171778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:26.180033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:26.180789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:26.185036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:26.256204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:26.274856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:26.276452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:26.280102 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46ebce88-e56b-466f-a178-e2f8dc6d2721 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 1.169193 Oct 31 15:21:26.281721 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 710/1348] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:25 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:26.540552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:26.552552 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eff8cee4-e992-4957-b011-78e2ea131cfe tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.415591 Oct 31 15:21:26.553888 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 639/1349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:26 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:26.872586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4a185f7-7b79-43f5-bce6-2c4964b217c2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e55a7e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:26.985849 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4a185f7-7b79-43f5-bce6-2c4964b217c2 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.117711 Oct 31 15:21:26.988324 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 711/1350] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:26 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:27.306772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:27.307440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:27.316336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:27.316910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:27.329858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:27.332669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:27.338294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:27.339043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:27.656584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f4721d54-70eb-4434-b966-bf82752ba539 tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] Calling method '.version_select at 0x7f16e10ca280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:27.847241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:27.860184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:27.886892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:27.888100 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29631971-5573-4e6a-ac4a-0f461912d01c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 0.585189 Oct 31 15:21:27.894279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f4721d54-70eb-4434-b966-bf82752ba539 tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.837242 Oct 31 15:21:27.898412 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 640/1351] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:21:27 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:21:27.907261 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 712/1352] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:27 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:27.909627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a88ff933-0d67-4f27-9835-07ddb34a1697 req-a68d406b-de29-44bc-b76f-b3a9be054d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d93bc1-c14b-4889-975f-5e624ce57027", "tag": "f27357e6-9586-4e9f-a712-a69e2f60a83d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:27.933311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:27.936209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a88ff933-0d67-4f27-9835-07ddb34a1697 req-a68d406b-de29-44bc-b76f-b3a9be054d32 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:27.936424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:27.936694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a88ff933-0d67-4f27-9835-07ddb34a1697 req-a68d406b-de29-44bc-b76f-b3a9be054d32 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:27.939622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a88ff933-0d67-4f27-9835-07ddb34a1697 req-a68d406b-de29-44bc-b76f-b3a9be054d32 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:27.959387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:27.960106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:27.961700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:27.962654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:27.963338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:27.963936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:27.987978 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a88ff933-0d67-4f27-9835-07ddb34a1697 req-a68d406b-de29-44bc-b76f-b3a9be054d32 service nova] Creating event network-changed:f27357e6-9586-4e9f-a712-a69e2f60a83d for instance e8d93bc1-c14b-4889-975f-5e624ce57027 on n-h1-858384-17 Oct 31 15:21:28.002238 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a88ff933-0d67-4f27-9835-07ddb34a1697 req-a68d406b-de29-44bc-b76f-b3a9be054d32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098936 Oct 31 15:21:28.018222 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 641/1353] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:28.044956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c88b857-2d57-4655-9c89-864331e3e5b2 tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] Action: 'create', calling method: .version_select at 0x7f16e11cbaf0>, body: {"pool": "non_exist_pool"} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:28.198272 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-5c88b857-2d57-4655-9c89-864331e3e5b2 tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] HTTP exception thrown: Floating IP pool not found. Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c88b857-2d57-4655-9c89-864331e3e5b2 tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] Request method failure captured: Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 26 Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-f2JPr_YzrJGlqCGPj5hHYmH4PPEufhRBQSkePwwO0AWR0tXUVx-uhfYUXxYhLTWDAWM2_CqMVi7eLQDd3_FgruPxS-6i9TT5MrldBKBnZPnn3a3zAkADQzHIgIRaXPBHsYUtsi0AxCTloyDsVZXnTeQNXxmfKUx3JhsTET5j4JuDU Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 0b5c7763b021404db4aacbaed7b4fe00 Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1541823379 Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:21:28.202097 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b5c7763b021404db4aacbaed7b4fe00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b5c7763b021404db4aacbaed7b4fe00", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b5c7763b021404db4aacbaed7b4fe00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b5c7763b021404db4aacbaed7b4fe00"}]}] Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1541823379 Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 0b5c7763b021404db4aacbaed7b4fe00 Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1541823379 Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FloatingIPsNegativeTestJSON-1541823379-project Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: fc70c9eb63c14d59878da72a3da49819 Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1541823379-project Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: {"pool": "non_exist_pool"} Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: exception: Floating IP pool not found. Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 31 15:21:28.204397 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:28.205565 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 31 15:21:28.207069 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.208974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c88b857-2d57-4655-9c89-864331e3e5b2 tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] Returning 404 to user: Floating IP pool not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:28.210062 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c88b857-2d57-4655-9c89-864331e3e5b2 tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.190362 Oct 31 15:21:28.210936 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 642/1354] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:21:28 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:21:28.223223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c62cefa2-90a8-4ebe-b9dd-13f13d5c5e4b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e10f64c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:28.308280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:28.315367 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c62cefa2-90a8-4ebe-b9dd-13f13d5c5e4b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.102869 Oct 31 15:21:28.316240 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 643/1355] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:28 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:28.324889 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-afc6b076-3054-4285-b75c-254e13755298 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.415377 Oct 31 15:21:28.328544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4f344301-294c-49fc-b65c-5d67e345522a tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] Calling method '.version_select at 0x7f16e11cb040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:28.332035 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 713/1356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:27 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:28.791486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG neutronclient.v2_0.client [None req-4f344301-294c-49fc-b65c-5d67e345522a tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f7c67219-8a28-44a6-b527-4df0d589176e could not be found", "detail": ""}} {{(pid=120588) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:21:28.792745 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-4f344301-294c-49fc-b65c-5d67e345522a tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] HTTP exception thrown: Floating IP not found for ID f7c67219-8a28-44a6-b527-4df0d589176e Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4f344301-294c-49fc-b65c-5d67e345522a tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] Request method failure captured: Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-floating-ips/f7c67219-8a28-44a6-b527-4df0d589176e HTTP/1.1 Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-f2JPr_YzrJGlqCGPj5hHYmH4PPEufhRBQSkePwwO0AWR0tXUVx-uhfYUXxYhLTWDAWM2_CqMVi7eLQDd3_FgruPxS-6i9TT5MrldBKBnZPnn3a3zAkADQzHIgIRaXPBHsYUtsi0AxCTloyDsVZXnTeQNXxmfKUx3JhsTET5j4JuDU Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 0b5c7763b021404db4aacbaed7b4fe00 Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1541823379 Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:21:28.795880 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b5c7763b021404db4aacbaed7b4fe00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b5c7763b021404db4aacbaed7b4fe00", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b5c7763b021404db4aacbaed7b4fe00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b5c7763b021404db4aacbaed7b4fe00"}]}] Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1541823379 Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 0b5c7763b021404db4aacbaed7b4fe00 Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1541823379 Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FloatingIPsNegativeTestJSON-1541823379-project Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: fc70c9eb63c14d59878da72a3da49819 Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1541823379-project Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: exception: Floating IP not found for ID f7c67219-8a28-44a6-b527-4df0d589176e Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f7c67219-8a28-44a6-b527-4df0d589176e'} Oct 31 15:21:28.797910 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:21:28.798861 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f7c67219-8a28-44a6-b527-4df0d589176e could not be found Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c3667b6-affa-4ad6-b255-01f465f086c2'] Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f7c67219-8a28-44a6-b527-4df0d589176e. Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:28.800075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f7c67219-8a28-44a6-b527-4df0d589176e Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:28.801399 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:28.802635 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f7c67219-8a28-44a6-b527-4df0d589176e Oct 31 15:21:28.802635 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:21:28.804798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4f344301-294c-49fc-b65c-5d67e345522a tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] Returning 404 to user: Floating IP not found for ID f7c67219-8a28-44a6-b527-4df0d589176e {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:28.805904 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4f344301-294c-49fc-b65c-5d67e345522a tempest-FloatingIPsNegativeTestJSON-1541823379 tempest-FloatingIPsNegativeTestJSON-1541823379-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/f7c67219-8a28-44a6-b527-4df0d589176e" status: 404 len: 111 microversion: 2.1 time: 0.487835 Oct 31 15:21:28.806882 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 644/1357] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:21:28 2022] DELETE /compute/v2.1/os-floating-ips/f7c67219-8a28-44a6-b527-4df0d589176e => generated 111 bytes in 489 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:28.939522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:28.940420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:28.956505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:28.956998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:28.957431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:28.962930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:28.963623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:28.964229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:29.172208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:29.333387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-504fd2d0-39f7-4e7c-b0ab-b48489ed9039 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e0ff3040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:29.427386 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-504fd2d0-39f7-4e7c-b0ab-b48489ed9039 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.091139 Oct 31 15:21:29.431548 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 645/1358] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:29 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:29.436544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:29.442080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:29.457653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:29.458443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:29.459175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:29.460052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:29.460726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:29.461734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:29.545687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:29.555241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:29.556673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:29.567225 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23a0170b-8a6b-4ba0-818d-f6adbece36be tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 0.632324 Oct 31 15:21:29.568660 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 714/1359] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:28 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:30.445223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e26cc16f-dbfb-4b0d-894b-a855409069a5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e559a310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:30.559309 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e26cc16f-dbfb-4b0d-894b-a855409069a5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.117890 Oct 31 15:21:30.559973 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 715/1360] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:30 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:30.598770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:30.599424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:30.620527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:30.622721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:30.623381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:30.626200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:30.629363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:30.630029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:30.729889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:31.070658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.134417 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1f54c797-15be-4edb-8ab6-4f3b691123a8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 1.698495 Oct 31 15:21:31.156513 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 646/1361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:29 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:31.577080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.582206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2ce11c8-9adc-486a-9a63-c7a235694de3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e11cb3a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:31.615819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.617551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:31.618937 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1953d90c-96d5-4cfc-b534-b2d93b7491cc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 1.025702 Oct 31 15:21:31.619688 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 716/1362] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:30 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:21:31.704209 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2ce11c8-9adc-486a-9a63-c7a235694de3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.131864 Oct 31 15:21:31.705097 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 647/1363] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:31 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:32.167926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:32.168542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:32.180560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:32.181046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:32.181553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:32.182257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:32.182706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:32.183123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:32.534210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:32.543532 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55942131-7c63-4233-9235-fa6d22b19e44 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.380173 Oct 31 15:21:32.543532 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 717/1364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:32 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:32.648053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:32.649347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:32.662181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:32.665325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:32.667257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:32.669658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:32.675043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:32.675767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:32.727048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9b55c50-787f-42e8-bb2a-0cf4eea409e1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e55a1e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:32.858556 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9b55c50-787f-42e8-bb2a-0cf4eea409e1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.142356 Oct 31 15:21:32.860767 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 718/1365] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:32 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:33.566576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:33.567469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:33.590437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:33.591184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:33.591781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:33.592666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:33.594663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:33.595634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:34.016851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:34.051504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:34.054243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:34.057465 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-88782074-2f3c-499e-ad90-5f47d9e02c07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 1.414240 Oct 31 15:21:34.082485 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 648/1366] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:32 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:34.096907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1fba458f-de48-4402-b1a3-0fb03c73288e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1012820>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:34.134856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:34.159318 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29be78b9-fabb-48a4-8aab-c069cc572ccf tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.596883 Oct 31 15:21:34.165578 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 719/1367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:33 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:34.180877 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1fba458f-de48-4402-b1a3-0fb03c73288e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.096809 Oct 31 15:21:34.181977 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 649/1368] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:34 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:34.952155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-163145bd-07a0-4a0f-8698-84e660cc2eb7 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Calling method '.version_select at 0x7f16e554a700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:35.031236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-163145bd-07a0-4a0f-8698-84e660cc2eb7 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 93a97178-9aec-4178-b679-8d8ee1faddda does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:21:35.031858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-163145bd-07a0-4a0f-8698-84e660cc2eb7 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Neutron security group 93a97178-9aec-4178-b679-8d8ee1faddda not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:21:35.032518 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-163145bd-07a0-4a0f-8698-84e660cc2eb7 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] HTTP exception thrown: Security group 93a97178-9aec-4178-b679-8d8ee1faddda does not exist Oct 31 15:21:35.032518 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-c19a3b3b-5991-43a4-9af0-0338be8345f0'] Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-163145bd-07a0-4a0f-8698-84e660cc2eb7 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Request method failure captured: Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-security-groups/93a97178-9aec-4178-b679-8d8ee1faddda HTTP/1.1 Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-f-UwDjSGq0DqnGpBLCiT4SSU6AVwpsDCl2r_qbtWceMge_tM3tqsTUP11aL4usaBnR1trNyv5guj2EKW4uzMCtupA6q8Y8BMh-Q5fDbbXUmRrCWqEEqL5YMH82YCso0op3JeJpzGjkek9NlBmyTNvq8-IfrKmjttx4tQP8Y0rydHs Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 3ced2dacc8774c4c96335c3cc00c6124 Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:35.034318 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ced2dacc8774c4c96335c3cc00c6124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ced2dacc8774c4c96335c3cc00c6124", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ced2dacc8774c4c96335c3cc00c6124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ced2dacc8774c4c96335c3cc00c6124"}]}] Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 3ced2dacc8774c4c96335c3cc00c6124 Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsNegativeTestJSON-1257004880-project Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ff20b989bb4a49c79bf0e0afb417311c Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880-project Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group 93a97178-9aec-4178-b679-8d8ee1faddda does not exist Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-c19a3b3b-5991-43a4-9af0-0338be8345f0'] Oct 31 15:21:35.035760 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '93a97178-9aec-4178-b679-8d8ee1faddda'} Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:35.036650 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 93a97178-9aec-4178-b679-8d8ee1faddda does not exist Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19a3b3b-5991-43a4-9af0-0338be8345f0'] Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:21:35.037985 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 93a97178-9aec-4178-b679-8d8ee1faddda does not exist Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19a3b3b-5991-43a4-9af0-0338be8345f0'] Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 93a97178-9aec-4178-b679-8d8ee1faddda does not exist Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19a3b3b-5991-43a4-9af0-0338be8345f0'] Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:35.040969 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 93a97178-9aec-4178-b679-8d8ee1faddda does not exist Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c19a3b3b-5991-43a4-9af0-0338be8345f0'] Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-163145bd-07a0-4a0f-8698-84e660cc2eb7 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Returning 404 to user: Security group 93a97178-9aec-4178-b679-8d8ee1faddda does not exist Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-c19a3b3b-5991-43a4-9af0-0338be8345f0'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-163145bd-07a0-4a0f-8698-84e660cc2eb7 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/93a97178-9aec-4178-b679-8d8ee1faddda" status: 404 len: 194 microversion: 2.1 time: 0.417777 Oct 31 15:21:35.043903 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 720/1369] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:34 2022] DELETE /compute/v2.1/os-security-groups/93a97178-9aec-4178-b679-8d8ee1faddda => generated 194 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:35.048398 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c5eaae6-0a41-4af4-b7f4-ba8c5e75c8df tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005076 Oct 31 15:21:35.048995 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 650/1370] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Oct 31 15:21:35 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:21:35.058572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3524f49-f810-4f7e-a6fa-81682dc70a60 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Calling method '.version_select at 0x7f16e5571c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:35.088390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:35.089004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:35.113495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.113984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.124062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.129565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.130283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.134170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.428497 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3524f49-f810-4f7e-a6fa-81682dc70a60 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.374422 Oct 31 15:21:35.429302 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 721/1371] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:21:35 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:35.434878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:35.435598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:35.452526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.453089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.453807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:35.454557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:35.467828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:35.468449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:36.225390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:36.234958 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5e4af7e-78ab-4f23-8f31-4f1f252c1099 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.804373 Oct 31 15:21:36.253874 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 722/1372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:35 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:36.275729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7ce53f0-4ccd-4340-879b-a6322b1d83cf tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e5556ca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:36.416666 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7ce53f0-4ccd-4340-879b-a6322b1d83cf tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.161513 Oct 31 15:21:36.418114 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 723/1373] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:36 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:36.440137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22fd7680-6bf4-4fba-ae44-ee43abfb5652 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Calling method '.version_select at 0x7f16e5556430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:36.775569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:36.800192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:36.806689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:36.810406 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-970d69b1-a631-4309-a182-e85003943463 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 1.726526 Oct 31 15:21:36.839885 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 651/1374] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:35 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:37.114923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-055dc2f9-7a30-4f1f-be43-6f2c5622ea83 req-7d27b835-b957-4dbe-a503-539fa924fcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34017fcd-17ac-42cc-b924-4c2519a21f0c", "name": "network-vif-plugged", "status": "completed", "tag": "d4e2d90d-8190-4cbd-a7bf-d295ce2c356e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:37.135340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-055dc2f9-7a30-4f1f-be43-6f2c5622ea83 req-7d27b835-b957-4dbe-a503-539fa924fcb2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:37.138135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-055dc2f9-7a30-4f1f-be43-6f2c5622ea83 req-7d27b835-b957-4dbe-a503-539fa924fcb2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:37.138858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-055dc2f9-7a30-4f1f-be43-6f2c5622ea83 req-7d27b835-b957-4dbe-a503-539fa924fcb2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:37.886665 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-055dc2f9-7a30-4f1f-be43-6f2c5622ea83 req-7d27b835-b957-4dbe-a503-539fa924fcb2 service nova] Creating event network-vif-plugged:d4e2d90d-8190-4cbd-a7bf-d295ce2c356e for instance 34017fcd-17ac-42cc-b924-4c2519a21f0c on n-h2-858384-17 Oct 31 15:21:37.914321 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-055dc2f9-7a30-4f1f-be43-6f2c5622ea83 req-7d27b835-b957-4dbe-a503-539fa924fcb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.068183 Oct 31 15:21:37.918813 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 652/1375] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:37.940326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:37.942410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:37.964333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:37.965163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:37.965818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:37.966722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:37.967350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:37.967976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:38.323625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-22fd7680-6bf4-4fba-ae44-ee43abfb5652 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:21:38.324728 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-22fd7680-6bf4-4fba-ae44-ee43abfb5652 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 31 15:21:38.324728 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-422979f9-f574-4798-9153-3b51f22dfccf'] Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22fd7680-6bf4-4fba-ae44-ee43abfb5652 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Request method failure captured: Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-security-groups/a130ddc4-232a-47a4-b066-fc3ad3033cee HTTP/1.1 Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-f-UwDjSGq0DqnGpBLCiT4SSU6AVwpsDCl2r_qbtWceMge_tM3tqsTUP11aL4usaBnR1trNyv5guj2EKW4uzMCtupA6q8Y8BMh-Q5fDbbXUmRrCWqEEqL5YMH82YCso0op3JeJpzGjkek9NlBmyTNvq8-IfrKmjttx4tQP8Y0rydHs Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 3ced2dacc8774c4c96335c3cc00c6124 Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:38.327341 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ced2dacc8774c4c96335c3cc00c6124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ced2dacc8774c4c96335c3cc00c6124", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ced2dacc8774c4c96335c3cc00c6124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ced2dacc8774c4c96335c3cc00c6124"}]}] Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 3ced2dacc8774c4c96335c3cc00c6124 Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsNegativeTestJSON-1257004880-project Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ff20b989bb4a49c79bf0e0afb417311c Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880-project Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: exception: Insufficient rights for removing default security group. Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-422979f9-f574-4798-9153-3b51f22dfccf'] Oct 31 15:21:38.329651 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'a130ddc4-232a-47a4-b066-fc3ad3033cee'} Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:38.330715 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-422979f9-f574-4798-9153-3b51f22dfccf'] Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 31 15:21:38.332264 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-422979f9-f574-4798-9153-3b51f22dfccf'] Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-422979f9-f574-4798-9153-3b51f22dfccf'] Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:38.333965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:38.335570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:38.335570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:38.335570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:38.335570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 31 15:21:38.335570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-422979f9-f574-4798-9153-3b51f22dfccf'] Oct 31 15:21:38.335570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:38.335570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22fd7680-6bf4-4fba-ae44-ee43abfb5652 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 31 15:21:38.335570 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-422979f9-f574-4798-9153-3b51f22dfccf'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:38.337155 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22fd7680-6bf4-4fba-ae44-ee43abfb5652 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/a130ddc4-232a-47a4-b066-fc3ad3033cee" status: 400 len: 182 microversion: 2.1 time: 1.917264 Oct 31 15:21:38.337749 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 724/1376] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:21:36 2022] DELETE /compute/v2.1/os-security-groups/a130ddc4-232a-47a4-b066-fc3ad3033cee => generated 182 bytes in 1919 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:21:38.358002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af3b5f78-5acd-45f9-8f03-8b385e874f5b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e575d0d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:38.439109 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af3b5f78-5acd-45f9-8f03-8b385e874f5b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.092962 Oct 31 15:21:38.444817 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 725/1377] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:38 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:38.451678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:38.457473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:38.463352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=62 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:38.480561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:38.482762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:38.488408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:38.489530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:38.491419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:38.492746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:38.750636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:38.760451 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1364b6ac-0d35-4de4-88dd-aaae89ce6c2b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.838924 Oct 31 15:21:38.760451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 653/1378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:37 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:38.785453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e816f62-1705-4d10-8fa3-d1cba694de10 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c853aa9d-1c5f-4604-834d-71919f8bf7ca"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:38.800708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e816f62-1705-4d10-8fa3-d1cba694de10 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:38.814973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:38.829443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e816f62-1705-4d10-8fa3-d1cba694de10 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:38.834049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e816f62-1705-4d10-8fa3-d1cba694de10 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:38.834761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e816f62-1705-4d10-8fa3-d1cba694de10 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:38.839156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e816f62-1705-4d10-8fa3-d1cba694de10 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:38.849805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e816f62-1705-4d10-8fa3-d1cba694de10 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:38.850262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e816f62-1705-4d10-8fa3-d1cba694de10 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:38.917055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:21:39.459972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:39.491473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:39.495078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:39.501390 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ace16160-a9b8-43ab-85ee-bcb87acf0e41 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 1.053245 Oct 31 15:21:39.503780 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 726/1379] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:38 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:39.517854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-842f9b71-0d91-4fea-89d6-582237a1d968 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Calling method '.version_select at 0x7f16e55565e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:39.662791 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e816f62-1705-4d10-8fa3-d1cba694de10 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "POST /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.900385 Oct 31 15:21:39.663938 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 654/1380] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:21:38 2022] POST /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:39.673558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dddeab0-4e85-4541-b16e-124f9aab1012 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1462f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:39.719492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-842f9b71-0d91-4fea-89d6-582237a1d968 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 17a7cd2a-4696-4475-88f9-a23844ddae41 does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:21:39.720538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-842f9b71-0d91-4fea-89d6-582237a1d968 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Neutron security group 17a7cd2a-4696-4475-88f9-a23844ddae41 not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:21:39.721483 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-842f9b71-0d91-4fea-89d6-582237a1d968 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] HTTP exception thrown: Security group 17a7cd2a-4696-4475-88f9-a23844ddae41 does not exist Oct 31 15:21:39.721483 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-558519ab-49c5-4508-9924-d9f9bb9963c7'] Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-842f9b71-0d91-4fea-89d6-582237a1d968 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Request method failure captured: Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-security-groups/17a7cd2a-4696-4475-88f9-a23844ddae41 HTTP/1.1 Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-f-UwDjSGq0DqnGpBLCiT4SSU6AVwpsDCl2r_qbtWceMge_tM3tqsTUP11aL4usaBnR1trNyv5guj2EKW4uzMCtupA6q8Y8BMh-Q5fDbbXUmRrCWqEEqL5YMH82YCso0op3JeJpzGjkek9NlBmyTNvq8-IfrKmjttx4tQP8Y0rydHs Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 3ced2dacc8774c4c96335c3cc00c6124 Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:39.723881 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ced2dacc8774c4c96335c3cc00c6124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ced2dacc8774c4c96335c3cc00c6124", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ced2dacc8774c4c96335c3cc00c6124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ced2dacc8774c4c96335c3cc00c6124"}]}] Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 3ced2dacc8774c4c96335c3cc00c6124 Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsNegativeTestJSON-1257004880-project Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ff20b989bb4a49c79bf0e0afb417311c Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880-project Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group 17a7cd2a-4696-4475-88f9-a23844ddae41 does not exist Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-558519ab-49c5-4508-9924-d9f9bb9963c7'] Oct 31 15:21:39.725471 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '17a7cd2a-4696-4475-88f9-a23844ddae41'} Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:39.727308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 17a7cd2a-4696-4475-88f9-a23844ddae41 does not exist Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-558519ab-49c5-4508-9924-d9f9bb9963c7'] Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:21:39.729579 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 17a7cd2a-4696-4475-88f9-a23844ddae41 does not exist Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-558519ab-49c5-4508-9924-d9f9bb9963c7'] Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 17a7cd2a-4696-4475-88f9-a23844ddae41 does not exist Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-558519ab-49c5-4508-9924-d9f9bb9963c7'] Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:39.730943 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:39.735050 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:39.735050 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:39.735050 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:39.735050 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:39.735050 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 17a7cd2a-4696-4475-88f9-a23844ddae41 does not exist Oct 31 15:21:39.735050 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-558519ab-49c5-4508-9924-d9f9bb9963c7'] Oct 31 15:21:39.735050 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:39.740283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-842f9b71-0d91-4fea-89d6-582237a1d968 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Returning 404 to user: Security group 17a7cd2a-4696-4475-88f9-a23844ddae41 does not exist Oct 31 15:21:39.740283 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-558519ab-49c5-4508-9924-d9f9bb9963c7'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:39.741975 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-842f9b71-0d91-4fea-89d6-582237a1d968 tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/17a7cd2a-4696-4475-88f9-a23844ddae41" status: 404 len: 194 microversion: 2.1 time: 0.236160 Oct 31 15:21:39.742793 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 727/1381] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:21:39 2022] GET /compute/v2.1/os-security-groups/17a7cd2a-4696-4475-88f9-a23844ddae41 => generated 194 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:39.757515 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dddeab0-4e85-4541-b16e-124f9aab1012 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.091748 Oct 31 15:21:39.770832 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 655/1382] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:39 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:39.774798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-37ddd499-67b3-48f2-94f5-94717ca4a3ef tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Action: 'update', calling method: .version_select at 0x7f16e575d0d0>, body: {"security_group": {"name": "tempest-sg-1794483020", "description": "tempest-description-1844642943"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:39.794382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:39.795335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:39.822070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:39.822603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:39.823811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:39.824563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:39.825013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:39.841053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.408808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-37ddd499-67b3-48f2-94f5-94717ca4a3ef tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9da9e146-29b2-4192-831f-fbc5987a1e40 does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:21:40.409457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-37ddd499-67b3-48f2-94f5-94717ca4a3ef tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Neutron security group 9da9e146-29b2-4192-831f-fbc5987a1e40 not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:21:40.409975 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-37ddd499-67b3-48f2-94f5-94717ca4a3ef tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] HTTP exception thrown: Security group 9da9e146-29b2-4192-831f-fbc5987a1e40 does not exist Oct 31 15:21:40.409975 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-0650c6ae-c504-4609-adc3-02af48a6107d'] Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-37ddd499-67b3-48f2-94f5-94717ca4a3ef tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Request method failure captured: Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/os-security-groups/9da9e146-29b2-4192-831f-fbc5987a1e40 HTTP/1.1 Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 102 Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-f-UwDjSGq0DqnGpBLCiT4SSU6AVwpsDCl2r_qbtWceMge_tM3tqsTUP11aL4usaBnR1trNyv5guj2EKW4uzMCtupA6q8Y8BMh-Q5fDbbXUmRrCWqEEqL5YMH82YCso0op3JeJpzGjkek9NlBmyTNvq8-IfrKmjttx4tQP8Y0rydHs Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 3ced2dacc8774c4c96335c3cc00c6124 Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:21:40.411830 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ced2dacc8774c4c96335c3cc00c6124"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3ced2dacc8774c4c96335c3cc00c6124", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3ced2dacc8774c4c96335c3cc00c6124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3ced2dacc8774c4c96335c3cc00c6124"}]}] Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 3ced2dacc8774c4c96335c3cc00c6124 Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880 Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsNegativeTestJSON-1257004880-project Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ff20b989bb4a49c79bf0e0afb417311c Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1257004880-project Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: {"security_group": {"name": "tempest-sg-1794483020", "description": "tempest-description-1844642943"}} Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:21:40.413461 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group 9da9e146-29b2-4192-831f-fbc5987a1e40 does not exist Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-0650c6ae-c504-4609-adc3-02af48a6107d'] Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '9da9e146-29b2-4192-831f-fbc5987a1e40', 'body': {'security_group': {'name': 'tempest-sg-1794483020', 'description': 'tempest-description-1844642943'}}} Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:21:40.414297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9da9e146-29b2-4192-831f-fbc5987a1e40 does not exist Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0650c6ae-c504-4609-adc3-02af48a6107d'] Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:21:40.415476 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9da9e146-29b2-4192-831f-fbc5987a1e40 does not exist Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0650c6ae-c504-4609-adc3-02af48a6107d'] Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9da9e146-29b2-4192-831f-fbc5987a1e40 does not exist Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0650c6ae-c504-4609-adc3-02af48a6107d'] Oct 31 15:21:40.416666 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9da9e146-29b2-4192-831f-fbc5987a1e40 does not exist Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0650c6ae-c504-4609-adc3-02af48a6107d'] Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-37ddd499-67b3-48f2-94f5-94717ca4a3ef tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] Returning 404 to user: Security group 9da9e146-29b2-4192-831f-fbc5987a1e40 does not exist Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-0650c6ae-c504-4609-adc3-02af48a6107d'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:21:40.417970 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-37ddd499-67b3-48f2-94f5-94717ca4a3ef tempest-SecurityGroupsNegativeTestJSON-1257004880 tempest-SecurityGroupsNegativeTestJSON-1257004880-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/9da9e146-29b2-4192-831f-fbc5987a1e40" status: 404 len: 194 microversion: 2.1 time: 0.661457 Oct 31 15:21:40.418808 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 728/1383] 10.222.0.20 () {60 vars in 1290 bytes} [Mon Oct 31 15:21:39 2022] PUT /compute/v2.1/os-security-groups/9da9e146-29b2-4192-831f-fbc5987a1e40 => generated 194 bytes in 663 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:21:40.532782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:40.533509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:40.541319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.541813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.542247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.542958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:40.543414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:40.543838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:40.804068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:40.813389 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c81d4e40-3a00-4a03-ae2f-07b7139221ea tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 1.028159 Oct 31 15:21:40.813949 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 656/1384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:39 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:40.860965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a144952-c672-4fc2-8cc8-154c5cae1daa tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1aa1e50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:41.006683 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a144952-c672-4fc2-8cc8-154c5cae1daa tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.156301 Oct 31 15:21:41.007524 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 657/1385] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:40 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:41.842092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:41.843168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:41.870947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:41.872674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:41.885726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:41.886933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:41.888355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:41.889265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:42.102563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:42.120025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:42.130794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:42.142401 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9144f152-e472-414e-a65e-649777d3f984 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 1.613279 Oct 31 15:21:42.148519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 729/1386] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:40 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:21:42.165399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-33fe0c6e-67a4-4bab-bd90-cc9f7a15d5c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e55330d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:42.337876 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-33fe0c6e-67a4-4bab-bd90-cc9f7a15d5c3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.187694 Oct 31 15:21:42.338812 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 730/1387] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:42 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:43.175146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:43.177144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:43.194790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:43.200194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:43.201661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:43.203843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:43.208645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:43.209369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:44.504790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:44.528315 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a78d1af-3761-4557-861c-b6d81ec6d813 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 2.691087 Oct 31 15:21:44.535937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 658/1388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:41 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 2699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:44.557162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:44.563027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-afb4edd3-32ef-4554-aa64-19b224393b14 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e14629d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:44.580513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:44.582470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:44.585214 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f244b4d-3995-4b3c-b2f1-a0cbe78e74ad tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1568 microversion: 2.25 time: 1.416837 Oct 31 15:21:44.590209 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 731/1389] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:43 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1568 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:44.602508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-49b9ca10-b8cb-49da-bf2d-0c1a295a2b5f req-9c849eb7-99da-47ef-b1f9-a3ae9688699d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3848bfc-68ef-48e5-8d45-4a700c478f0a", "name": "network-vif-unplugged", "status": "completed", "tag": "a2841d16-87c1-4e48-935e-723891a9ad43"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:44.657945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-49b9ca10-b8cb-49da-bf2d-0c1a295a2b5f req-9c849eb7-99da-47ef-b1f9-a3ae9688699d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:44.659809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-49b9ca10-b8cb-49da-bf2d-0c1a295a2b5f req-9c849eb7-99da-47ef-b1f9-a3ae9688699d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:44.674711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-49b9ca10-b8cb-49da-bf2d-0c1a295a2b5f req-9c849eb7-99da-47ef-b1f9-a3ae9688699d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:44.715109 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-afb4edd3-32ef-4554-aa64-19b224393b14 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.175107 Oct 31 15:21:44.720213 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-49b9ca10-b8cb-49da-bf2d-0c1a295a2b5f req-9c849eb7-99da-47ef-b1f9-a3ae9688699d service nova] Creating event network-vif-unplugged:a2841d16-87c1-4e48-935e-723891a9ad43 for instance f3848bfc-68ef-48e5-8d45-4a700c478f0a on n-h2-858384-17 Oct 31 15:21:44.727715 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 659/1390] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:44 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:44.745380 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-49b9ca10-b8cb-49da-bf2d-0c1a295a2b5f req-9c849eb7-99da-47ef-b1f9-a3ae9688699d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153537 Oct 31 15:21:44.762847 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 732/1391] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:45.569491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:45.570684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:45.598716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:45.601857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:45.602566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:45.603934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:45.605738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:45.608274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:45.621953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:45.623234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:45.645367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:45.653729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:45.654415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:45.663081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:45.663931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:45.666530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:46.516191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:46.558418 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07c74aa3-0e61-45eb-87b2-5a21f14136c3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 1.002498 Oct 31 15:21:46.559044 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 660/1392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:45 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:46.602257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6793bbe-e3d3-4ff9-98b8-fbe2015e383d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e14624c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:46.820306 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6793bbe-e3d3-4ff9-98b8-fbe2015e383d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.251350 Oct 31 15:21:46.821487 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 661/1393] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:46 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:47.404437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:47.431723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:47.435580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:47.440764 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41242f51-1375-4e18-92f9-9433e8d3b1ff tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1558 microversion: 2.25 time: 1.822867 Oct 31 15:21:47.464933 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 733/1394] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:45 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1558 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:21:47.471357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b9871a0-20e6-4e6d-b691-87848debe342 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '.version_select at 0x7f16e1aa1820>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:47.476023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b9871a0-20e6-4e6d-b691-87848debe342 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.476465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b9871a0-20e6-4e6d-b691-87848debe342 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.476912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b9871a0-20e6-4e6d-b691-87848debe342 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.511032 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b9871a0-20e6-4e6d-b691-87848debe342 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2202 microversion: 2.25 time: 0.043836 Oct 31 15:21:47.523037 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 662/1395] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Oct 31 15:21:47 2022] GET /compute/v2.1/os-migrations => generated 2202 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:47.532355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:47.532987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:47.544485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.544999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.547346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.548050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.548583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.550857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.584386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:47.585184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:47.597449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.598366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.599408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:47.601523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:47.603491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:47.605294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:48.345596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid e8d93bc1-c14b-4889-975f-5e624ce57027 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:21:48.404095 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-64cdf6dc-1e3a-4682-92e1-cdb76357cdec tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 2052 microversion: 2.25 time: 0.879155 Oct 31 15:21:48.404728 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 734/1396] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:47 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 2052 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:48.432110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4bc7b32a-3c66-438f-9114-f742af91f4a3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e55658b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:48.579170 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4bc7b32a-3c66-438f-9114-f742af91f4a3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.172529 Oct 31 15:21:48.588405 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 735/1397] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:48 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:48.606252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-77678c59-6be2-4087-9fc4-b67b0718f640 req-8688b758-3143-45c8-88bd-d28f59e0fda3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3848bfc-68ef-48e5-8d45-4a700c478f0a", "tag": "a2841d16-87c1-4e48-935e-723891a9ad43"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:48.655209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-77678c59-6be2-4087-9fc4-b67b0718f640 req-8688b758-3143-45c8-88bd-d28f59e0fda3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:48.655724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-77678c59-6be2-4087-9fc4-b67b0718f640 req-8688b758-3143-45c8-88bd-d28f59e0fda3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:48.656153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-77678c59-6be2-4087-9fc4-b67b0718f640 req-8688b758-3143-45c8-88bd-d28f59e0fda3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:48.674125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:48.683822 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7ec47d9-6d3c-4dde-a939-731bdf10f270 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 1.104397 Oct 31 15:21:48.690449 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 663/1398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:47 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:48.739448 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-77678c59-6be2-4087-9fc4-b67b0718f640 req-8688b758-3143-45c8-88bd-d28f59e0fda3 service nova] Creating event network-changed:a2841d16-87c1-4e48-935e-723891a9ad43 for instance f3848bfc-68ef-48e5-8d45-4a700c478f0a on n-h2-858384-17 Oct 31 15:21:48.757429 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-77678c59-6be2-4087-9fc4-b67b0718f640 req-8688b758-3143-45c8-88bd-d28f59e0fda3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162497 Oct 31 15:21:48.761169 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 736/1399] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:48.859252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2043350016", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "bf5d2157-6069-42f8-b335-fc42f2652c58"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:49.007197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] validate_networks() for [('bf5d2157-6069-42f8-b335-fc42f2652c58', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:21:49.598566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66fa4bcd-c80d-4f47-86e5-0ff7d2ab146e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e55658b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:49.701111 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66fa4bcd-c80d-4f47-86e5-0ff7d2ab146e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.109089 Oct 31 15:21:49.702423 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 737/1400] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:49 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:49.718904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:49.728066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:49.766128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:49.772638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:49.773313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:49.775194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:49.777247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:49.780957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:50.557509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:21:50.558069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:21:50.558908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:21:50.559412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:21:50.559945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:21:50.604129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:50.625395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:50.628445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:50.629322 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff37373f-4213-4198-8a28-d44b92a155a1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.916903 Oct 31 15:21:50.629900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:50.633962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:50.634902 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 738/1401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:49 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:50.638704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:50.643982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:50.718969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff73c186-3682-43c2-9a51-51652eae366a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e55609d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:50.761059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:21:50.784585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for user 676d4f2214e848c0aa654f0863b9f4a4 and project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:21:50.815057 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff73c186-3682-43c2-9a51-51652eae366a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.100482 Oct 31 15:21:50.816561 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 739/1402] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:50 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:50.839629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:21:50.850539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:21:51.013725 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99c88f32-46b1-4102-857e-11f0df3c6d7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.159243 Oct 31 15:21:51.014338 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 664/1403] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:21:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:21:51.025992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee9e486e-88ba-43ef-93ee-1e311161a5d4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:51.026866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee9e486e-88ba-43ef-93ee-1e311161a5d4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:51.639682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee9e486e-88ba-43ef-93ee-1e311161a5d4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:51.649015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee9e486e-88ba-43ef-93ee-1e311161a5d4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:51.654240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee9e486e-88ba-43ef-93ee-1e311161a5d4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:51.664198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:51.665697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:51.666915 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee9e486e-88ba-43ef-93ee-1e311161a5d4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1262 microversion: 2.25 time: 0.645265 Oct 31 15:21:51.667546 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 740/1404] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:51 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1262 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:51.693623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:51.698342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:51.698873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:51.699641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:51.700119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:51.700544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:51.831474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93598a6e-bd4f-4a69-a847-e8567762f16f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e5560c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:51.920008 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-93598a6e-bd4f-4a69-a847-e8567762f16f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.093104 Oct 31 15:21:51.920650 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 741/1405] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:51 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:52.700486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-abc5f3cf-1297-4ede-860b-c2d4b9367864 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:52.701101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-abc5f3cf-1297-4ede-860b-c2d4b9367864 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:53.014761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-abc5f3cf-1297-4ede-860b-c2d4b9367864 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:53.032367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-abc5f3cf-1297-4ede-860b-c2d4b9367864 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:53.038228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-abc5f3cf-1297-4ede-860b-c2d4b9367864 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:53.044762 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-abc5f3cf-1297-4ede-860b-c2d4b9367864 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1262 microversion: 2.25 time: 0.345918 Oct 31 15:21:53.068560 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 742/1406] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:52 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1262 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:21:53.089578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9027f5ea-9c1c-4163-898b-0448e6d5a8ed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e55d3430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:53.199883 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9027f5ea-9c1c-4163-898b-0448e6d5a8ed tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.129926 Oct 31 15:21:53.200479 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 743/1407] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:53 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:53.938778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:53.980294 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6721bf6-ce89-4b9a-a28d-980f0ef3f8b3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 2.320567 Oct 31 15:21:54.001270 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 665/1408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:51 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:21:54.077882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:54.079141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:54.110925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.115178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.117664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.120082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:54.125033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:54.126757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:54.327652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.347919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.351493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:54.354764 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa7b6639-c66a-475b-bbf8-520e68eb97f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1314 microversion: 2.25 time: 0.283010 Oct 31 15:21:54.369877 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 744/1409] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:54 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:54.387665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff1c908f-a47b-4d6a-a350-d892483b181e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e55d3ca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:54.524454 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff1c908f-a47b-4d6a-a350-d892483b181e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.151186 Oct 31 15:21:54.525454 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 745/1410] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:54 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:54.641673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ff77b5a0-3166-4474-8edc-2fddd037a479 tempest-ListImagesTestJSON-1946631885 tempest-ListImagesTestJSON-1946631885-project] Calling method '.version_select at 0x7f16e13c9af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:54.744762 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ff77b5a0-3166-4474-8edc-2fddd037a479 tempest-ListImagesTestJSON-1946631885 tempest-ListImagesTestJSON-1946631885-project] 10.222.0.20 "GET /compute/v2.1/images/524d630e-d0c9-4d4c-9057-837f830c46f6" status: 200 len: 784 microversion: 2.1 time: 0.630482 Oct 31 15:21:54.752317 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 666/1411] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:54 2022] GET /compute/v2.1/images/524d630e-d0c9-4d4c-9057-837f830c46f6 => generated 784 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:54.773449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a55069f-f2d4-480e-a60d-f11c9035c3d9 tempest-ListImagesTestJSON-1946631885 tempest-ListImagesTestJSON-1946631885-project] Calling method '.version_select at 0x7f16e1462550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:54.792138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b42e7cd-ad30-4aa8-a887-900f063098a5 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Action: 'create', calling method: .version_select at 0x7f16e56f4430>, body: {"pool": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:21:55.021787 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a55069f-f2d4-480e-a60d-f11c9035c3d9 tempest-ListImagesTestJSON-1946631885 tempest-ListImagesTestJSON-1946631885-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.264025 Oct 31 15:21:55.041943 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 667/1412] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 31 15:21:54 2022] GET /compute/v2.1/images => generated 871 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:21:55.063723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:55.067147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:55.090255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:55.103574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:55.104233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:55.108966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:55.112362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:55.117566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.014795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.033867 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-514ac500-9374-42dd-abc1-89b1428b9e3b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.987461 Oct 31 15:21:56.059761 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 668/1413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:55 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:56.086480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c26bfca4-5abd-4cbb-b540-38b227890e3c tempest-ListImagesTestJSON-1946631885 tempest-ListImagesTestJSON-1946631885-project] Calling method '.version_select at 0x7f16e11e7790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:56.197592 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c26bfca4-5abd-4cbb-b540-38b227890e3c tempest-ListImagesTestJSON-1946631885 tempest-ListImagesTestJSON-1946631885-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.135950 Oct 31 15:21:56.208856 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 669/1414] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:21:56 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:56.238489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:56.239358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:56.246818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.247561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.248222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.249110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:56.249749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:56.250800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:56.563725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.587710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.592670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:56.599427 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9332d1a9-6af0-40a9-b30e-0dfa1fcf3f0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1320 microversion: 2.25 time: 0.366635 Oct 31 15:21:56.600576 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 670/1415] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:56 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1320 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:56.606821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-273138fc-84ca-44dd-8421-7bbc4c358d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e11e7790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:56.737554 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-273138fc-84ca-44dd-8421-7bbc4c358d8d tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.134194 Oct 31 15:21:56.738166 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 671/1416] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:56 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:57.080504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:57.081185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:57.106587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.107224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.114739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:57.115940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:57.129325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:57.130265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:58.201373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:58.218053 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2425375-6539-4a7e-bb17-1fd1ca4e6415 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 1.153217 Oct 31 15:21:58.218663 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 672/1417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:57 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:58.229332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:58.229951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:58.245162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:58.245785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:58.246223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:58.246945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:58.247398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:58.254030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.174773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:59.185061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:59.207438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:21:59.208843 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2406ccaa-1430-40f7-b495-fc4c5fe875f8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1362 microversion: 2.25 time: 0.989222 Oct 31 15:21:59.209881 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 673/1418] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:21:58 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1362 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:21:59.225858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-861b0c14-8550-4c4f-8740-450ce688a4e7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1c07310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:59.327383 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-861b0c14-8550-4c4f-8740-450ce688a4e7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.115093 Oct 31 15:21:59.332098 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 674/1419] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:21:59 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:21:59.347463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:21:59.353755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:21:59.383679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.384185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.384630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:21:59.385383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:21:59.385847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:21:59.386279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:00.163069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:00.186095 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6fb76551-6d8b-4833-8987-9609800bd126 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.841038 Oct 31 15:22:00.205979 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 675/1420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:21:59 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:00.235685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1039608834", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "d6baf92d-abf1-4954-a027-cc8bb2450975"}, {"uuid": "b4f23caa-731b-4ea6-b8a6-cba3e029f740"}, {"uuid": "d6baf92d-abf1-4954-a027-cc8bb2450975"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:00.458487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] validate_networks() for [('d6baf92d-abf1-4954-a027-cc8bb2450975', None, None, None, None, None), ('b4f23caa-731b-4ea6-b8a6-cba3e029f740', None, None, None, None, None), ('d6baf92d-abf1-4954-a027-cc8bb2450975', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:22:00.687578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:00.817418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:02.514825 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b42e7cd-ad30-4aa8-a887-900f063098a5 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.981621 Oct 31 15:22:02.516083 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 746/1421] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:21:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:02.522744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:02.523773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:02.550254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.551896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.552422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.553170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:02.554168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:02.554462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:02.559808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=71 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:02.905861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:02.921294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:02.923228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:02.924938 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4bba4362-0cb7-4181-89c8-377f78d0e033 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1362 microversion: 2.25 time: 0.407601 Oct 31 15:22:02.927327 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 747/1422] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:02 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:02.992910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ebae9d5f-793b-43b7-8834-6b67e2ebff09 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e55a14c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:03.030861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:03.105206 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ebae9d5f-793b-43b7-8834-6b67e2ebff09 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1414 microversion: 2.1 time: 0.147224 Oct 31 15:22:03.106156 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 748/1423] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:02 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1414 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:03.112198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:03.112854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:03.122408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:03.123892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:03.124404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:03.125154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:03.125616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:03.126544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:03.596940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:03.619007 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51473f1b-7f5e-4c52-a7a5-08b24ee26536 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.508586 Oct 31 15:22:03.635907 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 749/1424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:03 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:03.645893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a99065c0-f432-43a1-8605-4c917853e7a3 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:03.650653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a99065c0-f432-43a1-8605-4c917853e7a3 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:03.668147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a99065c0-f432-43a1-8605-4c917853e7a3 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:03.668654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a99065c0-f432-43a1-8605-4c917853e7a3 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:03.673096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a99065c0-f432-43a1-8605-4c917853e7a3 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:03.673940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a99065c0-f432-43a1-8605-4c917853e7a3 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:03.674423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a99065c0-f432-43a1-8605-4c917853e7a3 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:03.674864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a99065c0-f432-43a1-8605-4c917853e7a3 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:03.757556 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a99065c0-f432-43a1-8605-4c917853e7a3 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127739 Oct 31 15:22:03.758209 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 750/1425] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:22:03 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:03.787193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d453abbb-fef8-4c19-8700-eb7f0504c4f6 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Calling method '.version_select at 0x7f16e55891f0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:04.430162 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d453abbb-fef8-4c19-8700-eb7f0504c4f6 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/cd2978d3-7fd2-4b48-95cc-23371aedd507" status: 200 len: 142 microversion: 2.1 time: 0.663091 Oct 31 15:22:04.431347 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 751/1426] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:22:03 2022] GET /compute/v2.1/os-floating-ips/cd2978d3-7fd2-4b48-95cc-23371aedd507 => generated 142 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:04.440025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:04.440830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:04.451318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:04.452566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:04.453314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:04.460317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:04.461169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:04.461869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:04.869097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lazy-loading 'services' on Instance uuid 01374025-1d71-467c-9d2d-ddf7719fa8d1 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:05.121878 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdf534a7-8fd0-4ad6-85d7-296adbf21ecd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments/c853aa9d-1c5f-4604-834d-71919f8bf7ca" status: 202 len: 0 microversion: 2.1 time: 0.688940 Oct 31 15:22:05.124202 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 752/1427] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:22:04 2022] DELETE /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments/c853aa9d-1c5f-4604-834d-71919f8bf7ca => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:05.131859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:05.134933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:05.150249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:05.152661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:05.153446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:05.156314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:05.157630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:05.158412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:05.547711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:05.574052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:05.575679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:05.582404 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df9d87db-8a4b-420a-b242-2eb95419ea0c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1362 microversion: 2.25 time: 0.456603 Oct 31 15:22:05.583222 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 753/1428] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:05 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:05.605852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b7b6ed1-5858-4e6c-93ce-ff26f7866f0f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e5533940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:05.677371 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b7b6ed1-5858-4e6c-93ce-ff26f7866f0f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1423 microversion: 2.1 time: 0.092895 Oct 31 15:22:05.678251 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 754/1429] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:05 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1423 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:05.691187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0616883b-ed8a-40e6-9876-bb2c846327e0 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Calling method '.version_select at 0x7f16e5533f70>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:06.724826 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0616883b-ed8a-40e6-9876-bb2c846327e0 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 1.042418 Oct 31 15:22:06.725823 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 755/1430] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:22:05 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:06.730709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:06.731518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:06.750403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.754493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.755320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.756261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.757958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.759717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.821258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:06.822918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:06.823600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:06.824181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:06.824803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:06.846950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.847449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.847892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.848631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:06.849082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:06.849567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:06.892589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Getting quotas for project 684abec7b7d6434bba2ef0e09aa1f5b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:06.908701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Getting quotas for user c2d979b14bbf4bb38564f46273334271 and project 684abec7b7d6434bba2ef0e09aa1f5b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:06.946511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:22:06.953427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:22:07.043887 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e577335e-5048-40c5-95f3-8ffda41f452c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.832346 Oct 31 15:22:07.061780 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 676/1431] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:22:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 6855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:22:07.084294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fe48f245-abaf-4540-9117-3413f733f3be req-c2735043-80ae-4eb5-91e0-15193fa0ec77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb133a9d-fd24-477f-bfd0-31c7e301802d", "tag": "830ca30e-3090-4f40-8f89-0c31ab02a113"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:07.127227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fe48f245-abaf-4540-9117-3413f733f3be req-c2735043-80ae-4eb5-91e0-15193fa0ec77 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.128504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fe48f245-abaf-4540-9117-3413f733f3be req-c2735043-80ae-4eb5-91e0-15193fa0ec77 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.130744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fe48f245-abaf-4540-9117-3413f733f3be req-c2735043-80ae-4eb5-91e0-15193fa0ec77 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.148299 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fe48f245-abaf-4540-9117-3413f733f3be req-c2735043-80ae-4eb5-91e0-15193fa0ec77 service nova] Creating event network-changed:830ca30e-3090-4f40-8f89-0c31ab02a113 for instance cb133a9d-fd24-477f-bfd0-31c7e301802d on n-h1-858384-17 Oct 31 15:22:07.156595 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fe48f245-abaf-4540-9117-3413f733f3be req-c2735043-80ae-4eb5-91e0-15193fa0ec77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092810 Oct 31 15:22:07.162720 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 677/1432] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:07.170922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb09202d-2ae8-4634-9567-d2f419e3bc5f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e17dedc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.211185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:07.220505 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-974e3a97-8507-43a9-9d17-403685bfec13 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1718 microversion: 2.1 time: 0.493600 Oct 31 15:22:07.221092 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 756/1433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:06 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1718 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:07.256862 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb09202d-2ae8-4634-9567-d2f419e3bc5f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 200 len: 1423 microversion: 2.1 time: 0.092486 Oct 31 15:22:07.258162 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 678/1434] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:22:07 2022] GET /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:07.283775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:07.285593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:07.293842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.295625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.296334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.297900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.298666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.299325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.456679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1330315494", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": "none"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:07.626844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:07.629626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:07.634641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:07.635285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:07.636112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:07.652523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.654529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.655728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.656868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:07.657767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:07.659329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:07.686234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Getting quotas for project 9e6e81875eff46a6ac82ea6de2bc10f8. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:07.695605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Getting quotas for user cc2d938c2ab240a3964b956f1b4144aa and project 9e6e81875eff46a6ac82ea6de2bc10f8. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:07.714734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:22:07.718088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:22:07.777578 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75df187e-f9c7-41d2-add7-e617bdcc6072 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.551087 Oct 31 15:22:07.780165 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 757/1435] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:22:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:22:07.786435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-defb468c-26ce-40a7-ae8c-e606e4407f21 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Calling method '.version_select at 0x7f16e554a310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:09.076335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.083461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:09.087644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.101777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.108984 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6716fba1-631d-47ea-a8bc-397b2c1ae825 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1362 microversion: 2.25 time: 1.832528 Oct 31 15:22:09.110496 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 679/1436] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:07 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1362 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:09.119166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:09.123756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:09.126590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:09.144709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.145241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.145680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.146387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:09.146842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:09.147319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:09.447957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:09.459923 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-267ce61f-951c-4d75-b6e9-0d5ab2cae962 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1265 microversion: 2.1 time: 0.343407 Oct 31 15:22:09.465539 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 680/1437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:09 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:09.590379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-529236702", "imageRef": "d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac", "flavorRef": "452", "networks": [{"uuid": "fae45c93-5c66-4e3d-908c-bfaf50cd6c4a"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:09.693451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] validate_networks() for [('fae45c93-5c66-4e3d-908c-bfaf50cd6c4a', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:22:10.846770 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-defb468c-26ce-40a7-ae8c-e606e4407f21 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/cd2978d3-7fd2-4b48-95cc-23371aedd507" status: 202 len: 0 microversion: 2.1 time: 3.065238 Oct 31 15:22:10.847584 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 758/1438] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:22:07 2022] DELETE /compute/v2.1/os-floating-ips/cd2978d3-7fd2-4b48-95cc-23371aedd507 => generated 0 bytes in 3067 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:10.855090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:10.855837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:10.863123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:10.877967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.880394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.880983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:10.881891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:10.885012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:10.885637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.300807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:11.301402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:11.301732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:11.302195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:11.302605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:11.332828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.334052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.335653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.336770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.337475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.339299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.392090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:11.408151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for user cd661f82522f4d5ab5f54d9fcdb81232 and project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:11.452498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:22:11.459186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:22:11.488627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:11.504830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:11.506907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:11.508591 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f452de5a-d755-4d4b-ae52-63013f8d8eae tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] 10.222.0.20 "GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999" status: 200 len: 1339 microversion: 2.47 time: 0.659576 Oct 31 15:22:11.509524 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 759/1439] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:10 2022] GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999 => generated 1339 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:11.535978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:11.538387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:11.612164 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3876e008-b4ef-45bf-a8d6-f87fcc8e9a7e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.144996 Oct 31 15:22:11.619144 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 681/1440] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:22:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:22:11.631774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5176e3a4-ff23-4a46-a06d-605ef383abc8 req-58c819e0-7a9d-4fdb-b801-aada60f23e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34017fcd-17ac-42cc-b924-4c2519a21f0c", "name": "network-vif-unplugged", "status": "completed", "tag": "d4e2d90d-8190-4cbd-a7bf-d295ce2c356e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:11.635893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.640346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.640931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.645954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.647718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.648268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.653507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5176e3a4-ff23-4a46-a06d-605ef383abc8 req-58c819e0-7a9d-4fdb-b801-aada60f23e20 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.655499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5176e3a4-ff23-4a46-a06d-605ef383abc8 req-58c819e0-7a9d-4fdb-b801-aada60f23e20 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.656275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5176e3a4-ff23-4a46-a06d-605ef383abc8 req-58c819e0-7a9d-4fdb-b801-aada60f23e20 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.672848 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5176e3a4-ff23-4a46-a06d-605ef383abc8 req-58c819e0-7a9d-4fdb-b801-aada60f23e20 service nova] Creating event network-vif-unplugged:d4e2d90d-8190-4cbd-a7bf-d295ce2c356e for instance 34017fcd-17ac-42cc-b924-4c2519a21f0c on n-h2-858384-17 Oct 31 15:22:11.680110 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5176e3a4-ff23-4a46-a06d-605ef383abc8 req-58c819e0-7a9d-4fdb-b801-aada60f23e20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063592 Oct 31 15:22:11.681060 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 682/1441] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:11.689887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:11.690975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:11.727526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.728035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.728476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:11.729216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:11.730402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:11.731108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.032600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.053381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.058201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.059800 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-65f36c94-65cd-48ac-bc75-66c3ecd06652 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1362 microversion: 2.25 time: 0.377276 Oct 31 15:22:12.060787 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 683/1442] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:11 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:12.077074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.078045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:12.099144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.099337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.099790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.102794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.103298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.103745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.231866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.249051 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd6ba415-510e-4353-9828-1d1f84ce6f47 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1708 microversion: 2.1 time: 0.738057 Oct 31 15:22:12.265459 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 760/1443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:11 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1708 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:12.277469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.285061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e75cffd-c3dd-43d6-acd0-2356c2f151df tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Action: 'create', calling method: .version_select at 0x7f16e553e670>, body: {"pool": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:12.292045 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d4e9e1e-28c5-4fb4-9b8b-b08b9afcadcd tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1271 microversion: 2.1 time: 0.230128 Oct 31 15:22:12.294351 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 684/1444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1271 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:12.310449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2761594a-954b-4246-8516-3e3f581b086b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.314567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2761594a-954b-4246-8516-3e3f581b086b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:12.501355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2761594a-954b-4246-8516-3e3f581b086b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.509700 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2761594a-954b-4246-8516-3e3f581b086b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1207 microversion: 2.1 time: 0.212446 Oct 31 15:22:12.510311 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 685/1445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1207 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:12.543850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4765ecf1-3f7c-4eb4-836f-297739d6f5c1 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '.version_select at 0x7f16e11e7790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.597799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4765ecf1-3f7c-4eb4-836f-297739d6f5c1 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.598912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4765ecf1-3f7c-4eb4-836f-297739d6f5c1 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.599519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4765ecf1-3f7c-4eb4-836f-297739d6f5c1 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.621580 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4765ecf1-3f7c-4eb4-836f-297739d6f5c1 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.091341 Oct 31 15:22:12.627833 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 686/1446] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:12.642247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.646792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:12.667739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.672431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.676521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.678975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.679645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.680690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.911967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.924830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.926858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:12.928190 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6cb285b7-20fa-46dd-9865-525b34b0c465 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] 10.222.0.20 "GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999" status: 200 len: 1339 microversion: 2.47 time: 0.299075 Oct 31 15:22:12.928925 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 687/1447] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999 => generated 1339 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:12.944769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f88518d9-6bdd-4899-8145-60a616fb424f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:12.946477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f88518d9-6bdd-4899-8145-60a616fb424f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:12.956983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f88518d9-6bdd-4899-8145-60a616fb424f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.957863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f88518d9-6bdd-4899-8145-60a616fb424f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.958580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f88518d9-6bdd-4899-8145-60a616fb424f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:12.959846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f88518d9-6bdd-4899-8145-60a616fb424f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:12.960548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f88518d9-6bdd-4899-8145-60a616fb424f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:12.961505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f88518d9-6bdd-4899-8145-60a616fb424f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:13.175155 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f88518d9-6bdd-4899-8145-60a616fb424f tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1861 microversion: 2.1 time: 0.244559 Oct 31 15:22:13.176084 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 688/1448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:12 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1861 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:13.193332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:13.193956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:13.201094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.201664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.202159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:13.203241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.203373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.203747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:13.938694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:13.952475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:13.954348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:13.956013 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed4346a2-bcc6-4b3b-ad4b-e68380e376bf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1362 microversion: 2.25 time: 0.778579 Oct 31 15:22:13.957249 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 689/1449] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:13 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1362 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:13.963980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f223bfe3-59a5-4a53-bf8b-fde08c117d49 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:13.968669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f223bfe3-59a5-4a53-bf8b-fde08c117d49 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:13.979358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f223bfe3-59a5-4a53-bf8b-fde08c117d49 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.980304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f223bfe3-59a5-4a53-bf8b-fde08c117d49 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.980912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f223bfe3-59a5-4a53-bf8b-fde08c117d49 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:13.982047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f223bfe3-59a5-4a53-bf8b-fde08c117d49 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:13.982672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f223bfe3-59a5-4a53-bf8b-fde08c117d49 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:13.983258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f223bfe3-59a5-4a53-bf8b-fde08c117d49 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:14.670184 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f223bfe3-59a5-4a53-bf8b-fde08c117d49 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1861 microversion: 2.1 time: 0.711565 Oct 31 15:22:14.670776 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 690/1450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:13 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1861 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:14.694018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:14.697495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:14.719741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:14.720575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:14.721268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:14.722211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:14.722853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:14.723520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.288242 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e75cffd-c3dd-43d6-acd0-2356c2f151df tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.020018 Oct 31 15:22:15.288861 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 761/1451] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:22:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:15.293613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:15.295278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:15.309591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.309794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.310197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.312964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.313643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.318905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.472437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.480913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.489577 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-403bb8de-052a-4b8c-9e87-c93819f7fd60 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1313 microversion: 2.1 time: 0.812699 Oct 31 15:22:15.492500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c47837a-4fbd-4351-ac87-491e7e5a8fd7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1265 microversion: 2.1 time: 0.201884 Oct 31 15:22:15.497181 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 762/1452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:15 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:15.503237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:15.504031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:15.510971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.511864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.512801 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 691/1453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:14 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1313 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:15.513153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.514158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.514828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.515752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.645086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.661517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1588310627", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "942ea272-9a7a-4042-b342-fe98a8b8489d"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:15.664385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.670477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:15.675290 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-77a164c2-98c4-482a-9e6b-149bf37d3864 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] 10.222.0.20 "GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999" status: 200 len: 1360 microversion: 2.47 time: 0.174172 Oct 31 15:22:15.677770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 763/1454] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:15 2022] GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999 => generated 1360 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:15.691100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2da1192f-f950-4d4e-8abc-bda8d81c6c07 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:15.701691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2da1192f-f950-4d4e-8abc-bda8d81c6c07 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:15.711194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2da1192f-f950-4d4e-8abc-bda8d81c6c07 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.714888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2da1192f-f950-4d4e-8abc-bda8d81c6c07 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.716355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2da1192f-f950-4d4e-8abc-bda8d81c6c07 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.717050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2da1192f-f950-4d4e-8abc-bda8d81c6c07 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.717361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2da1192f-f950-4d4e-8abc-bda8d81c6c07 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.717841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2da1192f-f950-4d4e-8abc-bda8d81c6c07 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.776497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] validate_networks() for [('942ea272-9a7a-4042-b342-fe98a8b8489d', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:22:15.805495 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2da1192f-f950-4d4e-8abc-bda8d81c6c07 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125195 Oct 31 15:22:15.806894 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 764/1455] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:22:15 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:22:15.818867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:15.819558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:15.828297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.829081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.829735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.831180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:15.832464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:15.833076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:15.998286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lazy-loading 'services' on Instance uuid f3848bfc-68ef-48e5-8d45-4a700c478f0a {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:16.141473 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1105cfe0-628e-43dd-aeb2-699635c3bb7e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments/6a535416-e1d2-4f56-ae49-e33363b2cf54" status: 202 len: 0 microversion: 2.1 time: 0.331942 Oct 31 15:22:16.155006 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 765/1456] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:22:15 2022] DELETE /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments/6a535416-e1d2-4f56-ae49-e33363b2cf54 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:16.167299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6edeaba4-b45a-47d3-b05b-171459adef16 req-4f217027-2732-409c-8824-e643e50480d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb133a9d-fd24-477f-bfd0-31c7e301802d", "name": "network-vif-plugged", "status": "completed", "tag": "830ca30e-3090-4f40-8f89-0c31ab02a113"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:16.205431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6edeaba4-b45a-47d3-b05b-171459adef16 req-4f217027-2732-409c-8824-e643e50480d8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:16.205859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6edeaba4-b45a-47d3-b05b-171459adef16 req-4f217027-2732-409c-8824-e643e50480d8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:16.206305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6edeaba4-b45a-47d3-b05b-171459adef16 req-4f217027-2732-409c-8824-e643e50480d8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:16.245754 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6edeaba4-b45a-47d3-b05b-171459adef16 req-4f217027-2732-409c-8824-e643e50480d8 service nova] Creating event network-vif-plugged:830ca30e-3090-4f40-8f89-0c31ab02a113 for instance cb133a9d-fd24-477f-bfd0-31c7e301802d on n-h1-858384-17 Oct 31 15:22:16.253213 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6edeaba4-b45a-47d3-b05b-171459adef16 req-4f217027-2732-409c-8824-e643e50480d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096595 Oct 31 15:22:16.254468 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 766/1457] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:16.261243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:16.262247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:16.271538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:16.272039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:16.272484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:16.273378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:16.273848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:16.274314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:16.526902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:16.540347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:16.541841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:16.543257 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3b06e897-0159-412d-92b5-379dcb6cd817 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1362 microversion: 2.25 time: 0.287597 Oct 31 15:22:16.557154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 767/1458] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:16 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:16.557154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff889a88-1c5c-4856-8262-6aacacf59672 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Calling method '.version_select at 0x7f16e554a700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:17.052550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:17.053148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:17.054111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:17.055817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:17.057528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:17.092847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.094457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.097333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.098502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.099201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.099786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.168475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Getting quotas for project 7687292298c5476dabe26115be2d1faf. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:17.186983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Getting quotas for user 7de8009481e24fc7a113b58bb34a2eef and project 7687292298c5476dabe26115be2d1faf. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:17.229222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:22:17.232979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:22:17.390195 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6079cda2-5990-4ce1-bd8d-c3e06441cb14 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875395 Oct 31 15:22:17.395145 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 692/1459] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:22:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:22:17.415797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf9020d7-933c-41c6-b4cb-956a677433fd tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1064477873"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:17.426260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf9020d7-933c-41c6-b4cb-956a677433fd tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:17.442857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf9020d7-933c-41c6-b4cb-956a677433fd tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.443362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf9020d7-933c-41c6-b4cb-956a677433fd tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.443803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf9020d7-933c-41c6-b4cb-956a677433fd tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.444526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf9020d7-933c-41c6-b4cb-956a677433fd tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:17.444979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf9020d7-933c-41c6-b4cb-956a677433fd tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:17.449715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf9020d7-933c-41c6-b4cb-956a677433fd tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:17.674486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:17.705064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:18.004368 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf9020d7-933c-41c6-b4cb-956a677433fd tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] 10.222.0.20 "POST /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999/action" status: 202 len: 52 microversion: 2.47 time: 0.597432 Oct 31 15:22:18.011136 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 693/1460] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:22:17 2022] POST /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999/action => generated 52 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:22:18.035748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-35f5895f-b6bc-485a-a40b-79ed034d88a5 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:18.046061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-35f5895f-b6bc-485a-a40b-79ed034d88a5 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:18.071191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35f5895f-b6bc-485a-a40b-79ed034d88a5 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.071906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35f5895f-b6bc-485a-a40b-79ed034d88a5 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.089668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35f5895f-b6bc-485a-a40b-79ed034d88a5 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.094403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35f5895f-b6bc-485a-a40b-79ed034d88a5 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.094996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35f5895f-b6bc-485a-a40b-79ed034d88a5 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.096533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35f5895f-b6bc-485a-a40b-79ed034d88a5 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.211778 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-35f5895f-b6bc-485a-a40b-79ed034d88a5 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.189924 Oct 31 15:22:18.239485 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 694/1461] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:22:18 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1/os-volume_attachments => generated 25 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:22:18.251663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-366cd044-a742-47da-a0cc-3f69e9017cc8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:18.257291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-366cd044-a742-47da-a0cc-3f69e9017cc8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:18.284299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366cd044-a742-47da-a0cc-3f69e9017cc8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.288050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366cd044-a742-47da-a0cc-3f69e9017cc8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.289988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366cd044-a742-47da-a0cc-3f69e9017cc8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.290862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366cd044-a742-47da-a0cc-3f69e9017cc8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.292883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366cd044-a742-47da-a0cc-3f69e9017cc8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.296538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-366cd044-a742-47da-a0cc-3f69e9017cc8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.399073 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff889a88-1c5c-4856-8262-6aacacf59672 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/8150d9b5-61f5-4098-8fe8-400b0be9e75c" status: 202 len: 0 microversion: 2.1 time: 1.853255 Oct 31 15:22:18.399668 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 768/1462] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:22:16 2022] DELETE /compute/v2.1/os-floating-ips/8150d9b5-61f5-4098-8fe8-400b0be9e75c => generated 0 bytes in 1855 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:18.407333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:18.407957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:18.446818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.447323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.449101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.449888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.450354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.450781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.463514 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-366cd044-a742-47da-a0cc-3f69e9017cc8 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.219149 Oct 31 15:22:18.467861 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 695/1463] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:22:18 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:18.490140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:18.491498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:18.498221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.501727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.503501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.504493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.509072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.509994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.751514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:18.760833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-04a48083-ed8f-481d-ab81-29de1f68c984 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 0.359410 Oct 31 15:22:18.761453 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 769/1464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:18 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:18.777092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:18.778276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:18.793256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.794048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.794627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.795358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:18.795808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:18.796432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:18.932620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:18.936355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:18.944975 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db1549a6-10fa-4cd0-a202-da27e59c1d04 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1222 microversion: 2.1 time: 0.181532 Oct 31 15:22:18.949094 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 770/1465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:18 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1222 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:18.970359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:18.971158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:19.001745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:19.013576 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6562772c-cff7-448c-a00f-bdf68cd2682f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1334 microversion: 2.1 time: 0.540675 Oct 31 15:22:19.031191 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 696/1466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:18 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1334 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:19.031770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.036010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.036431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.037251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.037872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.050291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:19.051937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:19.056834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.063937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.064951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.065838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.067134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.068045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.068949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.174624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:19.292310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:19.408545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:19.420148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:19.424406 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-894c2730-8233-43e4-8382-f852629159a4 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999" status: 204 len: 0 microversion: 2.47 time: 0.387714 Oct 31 15:22:19.428383 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 697/1467] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:22:19 2022] DELETE /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:19.428534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:19.429942 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3eb19c0f-5606-4008-8bbe-a11f43adf559 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1362 microversion: 2.25 time: 0.479191 Oct 31 15:22:19.447696 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 771/1468] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:18 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:19.447696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41215218-f5ef-4ddd-8af5-1dfa8054de3e tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Calling method '.version_select at 0x7f16e55331f0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:19.456186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:19.461122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:19.493786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.494341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.499274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.500106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.500602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.501047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.557684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-41215218-f5ef-4ddd-8af5-1dfa8054de3e tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8150d9b5-61f5-4098-8fe8-400b0be9e75c could not be found", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:22:19.558566 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-41215218-f5ef-4ddd-8af5-1dfa8054de3e tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] HTTP exception thrown: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41215218-f5ef-4ddd-8af5-1dfa8054de3e tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Request method failure captured: Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-floating-ips/8150d9b5-61f5-4098-8fe8-400b0be9e75c HTTP/1.1 Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gSJXjujoM8cv0w6yuKpssZlPZ_LF3xIUDw0FJr4R3kiA4JwyGX_8JVQmUuIZa6kW9gTot-rbfQlVcPcQuKGOy3Ewk_cbZKKVp_hibCvPBFbNfgTNqXDKuQ_jagTJLDyVf0JUvAfIhh4_dyUyIDzzc_M7FYN9fZyjAcpMX5My9zgSU Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 45d5795fe97f4de6824f8e782980b08c Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FloatingIPsTestJSON-824739109 Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:22:19.566807 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45d5795fe97f4de6824f8e782980b08c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45d5795fe97f4de6824f8e782980b08c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45d5795fe97f4de6824f8e782980b08c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45d5795fe97f4de6824f8e782980b08c"}]}] Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FloatingIPsTestJSON-824739109 Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 45d5795fe97f4de6824f8e782980b08c Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FloatingIPsTestJSON-824739109 Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FloatingIPsTestJSON-824739109-project Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c44e9444c61c48e8937660bbe86749a7 Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FloatingIPsTestJSON-824739109-project Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: exception: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8150d9b5-61f5-4098-8fe8-400b0be9e75c'} Oct 31 15:22:19.568278 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:22:19.569195 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8150d9b5-61f5-4098-8fe8-400b0be9e75c could not be found Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-498d462a-ae17-462a-8a89-50acc1a53656'] Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c. Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:19.570446 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:19.571726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:19.583162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c Oct 31 15:22:19.583162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:19.583162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41215218-f5ef-4ddd-8af5-1dfa8054de3e tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Returning 404 to user: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:19.583162 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41215218-f5ef-4ddd-8af5-1dfa8054de3e tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/8150d9b5-61f5-4098-8fe8-400b0be9e75c" status: 404 len: 111 microversion: 2.1 time: 0.133096 Oct 31 15:22:19.583162 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 772/1469] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:22:19 2022] GET /compute/v2.1/os-floating-ips/8150d9b5-61f5-4098-8fe8-400b0be9e75c => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:22:19.583162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:19.583162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:19.603704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.607163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.607687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.610572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.611077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.611520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.625499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:19.796628 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2b8b255-06e1-406b-80a6-9941a047012e tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 204 len: 0 microversion: 2.1 time: 0.365483 Oct 31 15:22:19.802415 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 698/1470] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:22:19 2022] DELETE /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:19.815633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db1484e5-d013-41b4-88d8-e4973c025fbc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:19.818379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-db1484e5-d013-41b4-88d8-e4973c025fbc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:19.833333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:19.837075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db1484e5-d013-41b4-88d8-e4973c025fbc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.837532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db1484e5-d013-41b4-88d8-e4973c025fbc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.841764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db1484e5-d013-41b4-88d8-e4973c025fbc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.842679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db1484e5-d013-41b4-88d8-e4973c025fbc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.843268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db1484e5-d013-41b4-88d8-e4973c025fbc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.843804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db1484e5-d013-41b4-88d8-e4973c025fbc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.854385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:19.869725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:19.874816 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0dae1220-c10c-4922-9d05-8429b6363afa tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] 10.222.0.20 "GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999" status: 200 len: 1366 microversion: 2.47 time: 0.300566 Oct 31 15:22:19.880567 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 773/1471] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:19 2022] GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:19.896349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5e474b5-9aa1-4739-8741-050e7cb2a963 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Calling method '.version_select at 0x7f16e559a8b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:19.937272 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db1484e5-d013-41b4-88d8-e4973c025fbc tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132878 Oct 31 15:22:19.937967 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 699/1472] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:22:19 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:19.947219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:19.948183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:19.967168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.967621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.968177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:19.970308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:19.972361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:19.972361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.020465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-b5e474b5-9aa1-4739-8741-050e7cb2a963 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8150d9b5-61f5-4098-8fe8-400b0be9e75c could not be found", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:22:20.022813 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b5e474b5-9aa1-4739-8741-050e7cb2a963 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] HTTP exception thrown: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5e474b5-9aa1-4739-8741-050e7cb2a963 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Request method failure captured: Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-floating-ips/8150d9b5-61f5-4098-8fe8-400b0be9e75c HTTP/1.1 Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gSJXjujoM8cv0w6yuKpssZlPZ_LF3xIUDw0FJr4R3kiA4JwyGX_8JVQmUuIZa6kW9gTot-rbfQlVcPcQuKGOy3Ewk_cbZKKVp_hibCvPBFbNfgTNqXDKuQ_jagTJLDyVf0JUvAfIhh4_dyUyIDzzc_M7FYN9fZyjAcpMX5My9zgSU Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 45d5795fe97f4de6824f8e782980b08c Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FloatingIPsTestJSON-824739109 Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:22:20.025403 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45d5795fe97f4de6824f8e782980b08c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45d5795fe97f4de6824f8e782980b08c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45d5795fe97f4de6824f8e782980b08c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45d5795fe97f4de6824f8e782980b08c"}]}] Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FloatingIPsTestJSON-824739109 Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 45d5795fe97f4de6824f8e782980b08c Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FloatingIPsTestJSON-824739109 Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FloatingIPsTestJSON-824739109-project Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c44e9444c61c48e8937660bbe86749a7 Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FloatingIPsTestJSON-824739109-project Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: exception: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8150d9b5-61f5-4098-8fe8-400b0be9e75c'} Oct 31 15:22:20.027121 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:22:20.028092 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8150d9b5-61f5-4098-8fe8-400b0be9e75c could not be found Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29d63cf-8429-4db9-a521-ffbfb07ecebf'] Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c. Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:20.031501 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:20.033178 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:20.035554 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c Oct 31 15:22:20.035554 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:20.035554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5e474b5-9aa1-4739-8741-050e7cb2a963 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] Returning 404 to user: Floating IP not found for ID 8150d9b5-61f5-4098-8fe8-400b0be9e75c {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:20.035554 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5e474b5-9aa1-4739-8741-050e7cb2a963 tempest-FloatingIPsTestJSON-824739109 tempest-FloatingIPsTestJSON-824739109-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/8150d9b5-61f5-4098-8fe8-400b0be9e75c" status: 404 len: 111 microversion: 2.1 time: 0.144084 Oct 31 15:22:20.035554 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 774/1473] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:22:19 2022] DELETE /compute/v2.1/os-floating-ips/8150d9b5-61f5-4098-8fe8-400b0be9e75c => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:22:20.046728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:20.051761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:20.082449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.086608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.088178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.090921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.092606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.095588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.471890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:20.481603 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52ca2db3-644b-4d70-962d-fa3f4faf8ce8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 0.541593 Oct 31 15:22:20.487033 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 700/1474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:19 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:20.492216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:20.505171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:20.530956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.533179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.536171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.537950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:20.540829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:20.541750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:20.991928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:21.004350 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b244d4ea-c79d-433c-9960-cf73b6ab6f79 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1270 microversion: 2.1 time: 0.515829 Oct 31 15:22:21.006460 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 701/1475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:20 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1270 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:21.023954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.025039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:21.040878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.041666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.045282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.046380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.048525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.049182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.656948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:21.680558 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d4629ac-511a-41bc-9d80-35d5b68b5471 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1681 microversion: 2.1 time: 1.645558 Oct 31 15:22:21.685251 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 775/1476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:20 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1681 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:21.708853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:21.722493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:21.739247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.745367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.747558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:21.750249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:21.751537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:21.752520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.312652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.352250 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b1b29b8-cc43-4c4b-9be5-bcc51d83321b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 1.343239 Oct 31 15:22:22.366588 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 702/1477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:22.388254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.394126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:22.408264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.409359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.410129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.411219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.411853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.412752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.774630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.794782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.798397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.801336 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-36417a84-1912-4bcc-b25e-bfe5d8331587 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1559 microversion: 2.25 time: 1.113683 Oct 31 15:22:22.803054 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 776/1478] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:21 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1559 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:22.809890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d6f34ae-d3f7-4671-9303-dbf4e034e01b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.813774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d6f34ae-d3f7-4671-9303-dbf4e034e01b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:22.824145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6f34ae-d3f7-4671-9303-dbf4e034e01b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.825676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6f34ae-d3f7-4671-9303-dbf4e034e01b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.826357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6f34ae-d3f7-4671-9303-dbf4e034e01b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.827538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6f34ae-d3f7-4671-9303-dbf4e034e01b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.828579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6f34ae-d3f7-4671-9303-dbf4e034e01b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.829412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6f34ae-d3f7-4671-9303-dbf4e034e01b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.830465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.851695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.853215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc2d938c2ab240a3964b956f1b4144aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e6e81875eff46a6ac82ea6de2bc10f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:22.854371 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b1d9312-809f-4c0c-a6bc-4f1e33771e26 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] 10.222.0.20 "GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999" status: 200 len: 1366 microversion: 2.47 time: 0.486612 Oct 31 15:22:22.854943 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 703/1479] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:22.877108 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d6f34ae-d3f7-4671-9303-dbf4e034e01b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071723 Oct 31 15:22:22.878198 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 777/1480] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:22.891518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.892208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:22.898129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6c36f8eb-df28-4ee1-a92b-ae7503102d0f req-2f286bec-3ae4-4252-8d4a-dfd98c1dd6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee19e5b7-f848-4466-b5ea-ee5a51fd0be5", "tag": "fd121579-9a48-49b0-bf14-f059bfc71d97"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:22.908287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.908946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.909730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.916033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.916783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.917401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.933320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6c36f8eb-df28-4ee1-a92b-ae7503102d0f req-2f286bec-3ae4-4252-8d4a-dfd98c1dd6c6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:22.935113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6c36f8eb-df28-4ee1-a92b-ae7503102d0f req-2f286bec-3ae4-4252-8d4a-dfd98c1dd6c6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:22.935849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6c36f8eb-df28-4ee1-a92b-ae7503102d0f req-2f286bec-3ae4-4252-8d4a-dfd98c1dd6c6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:22.962662 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6c36f8eb-df28-4ee1-a92b-ae7503102d0f req-2f286bec-3ae4-4252-8d4a-dfd98c1dd6c6 service nova] Creating event network-changed:fd121579-9a48-49b0-bf14-f059bfc71d97 for instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 on n-h1-858384-17 Oct 31 15:22:22.977604 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6c36f8eb-df28-4ee1-a92b-ae7503102d0f req-2f286bec-3ae4-4252-8d4a-dfd98c1dd6c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088137 Oct 31 15:22:22.982784 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 704/1481] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:22.994664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:22.997251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:23.016929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.017725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.019629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.020577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.023881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.024536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.740134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:23.757671 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-756e06bc-9e9f-4892-9ee9-cb85b6b2328b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1276 microversion: 2.1 time: 0.767370 Oct 31 15:22:23.758955 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 705/1482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1276 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:23.764734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:23.765379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:23.795164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.797635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.798272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.801149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.802504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.802964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.914754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:23.924922 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11c5135d-cdbf-461e-8cca-defdc7b65ea6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 1.045517 Oct 31 15:22:23.931899 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 778/1483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:22 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:23.949840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:23.950639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:23.983816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.984599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.985193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:23.992589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:23.994274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:23.995592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.374280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid cb133a9d-fd24-477f-bfd0-31c7e301802d {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:24.408247 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32cfbe2a-e2b6-41ce-a80e-1069c7404e3b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 2054 microversion: 2.25 time: 0.474952 Oct 31 15:22:24.426361 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 779/1484] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:23 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 2054 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:24.451423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.452149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:24.464640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.465826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.466637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.467374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.467836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.468269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.862485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:24.885245 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b68654aa-f4dc-495e-9097-d2f8f5feaa01 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.440116 Oct 31 15:22:24.902678 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 780/1485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:24 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:24.902678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f8d4360c-d462-402d-9886-c49bb0b7dc3f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:24.903264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8d4360c-d462-402d-9886-c49bb0b7dc3f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:24.933612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8d4360c-d462-402d-9886-c49bb0b7dc3f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.937404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8d4360c-d462-402d-9886-c49bb0b7dc3f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.938921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8d4360c-d462-402d-9886-c49bb0b7dc3f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:24.939863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8d4360c-d462-402d-9886-c49bb0b7dc3f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:24.940271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8d4360c-d462-402d-9886-c49bb0b7dc3f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:24.940691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8d4360c-d462-402d-9886-c49bb0b7dc3f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.032001 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f8d4360c-d462-402d-9886-c49bb0b7dc3f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141690 Oct 31 15:22:25.035293 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 781/1486] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:22:24 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:25.044302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:25.050071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] [instance: 6035b37d-8f30-4776-a3d0-f634c1eca999] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:25.062568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.069905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.070425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.071489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.072122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.072766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.103045 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] HTTP exception thrown: Instance 6035b37d-8f30-4776-a3d0-f634c1eca999 could not be found. Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Request method failure captured: Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999 HTTP/1.1 Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gd1aurajcF8BEav9RE09uMg3joR4KRi5v8CDkc3iAQwNSnlXZktbILW3ojOMijfLmmKO8uG9V9tFZHQODM5ho5FihbHKrXrGzWLyLT9l4eUdOUG8lJ35LSitJ76rYtZXV9pCQfUSNpG4Ob1XS59Ny5FVlU90DdNczO05UvsG9AyAU Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.47 Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 9e6e81875eff46a6ac82ea6de2bc10f8 Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersAaction247Test-1136521419 Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:22:25.104647 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e6e81875eff46a6ac82ea6de2bc10f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9e6e81875eff46a6ac82ea6de2bc10f8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9e6e81875eff46a6ac82ea6de2bc10f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9e6e81875eff46a6ac82ea6de2bc10f8"}]}] Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersAaction247Test-1136521419 Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 9e6e81875eff46a6ac82ea6de2bc10f8 Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersAaction247Test-1136521419 Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersAaction247Test-1136521419-project Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cc2d938c2ab240a3964b956f1b4144aa Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersAaction247Test-1136521419-project Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 6035b37d-8f30-4776-a3d0-f634c1eca999 could not be found. Oct 31 15:22:25.106433 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '6035b37d-8f30-4776-a3d0-f634c1eca999'} Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6035b37d-8f30-4776-a3d0-f634c1eca999 could not be found. Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:25.107339 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6035b37d-8f30-4776-a3d0-f634c1eca999 could not be found. Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6035b37d-8f30-4776-a3d0-f634c1eca999 could not be found. Oct 31 15:22:25.111335 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:25.114036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] Returning 404 to user: Instance 6035b37d-8f30-4776-a3d0-f634c1eca999 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:25.114036 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-581cbd66-bf93-4aa3-85f5-fe85197f3731 tempest-ServersAaction247Test-1136521419 tempest-ServersAaction247Test-1136521419-project] 10.222.0.20 "GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999" status: 404 len: 111 microversion: 2.47 time: 0.069561 Oct 31 15:22:25.114036 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 782/1487] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:25 2022] GET /compute/v2.1/servers/6035b37d-8f30-4776-a3d0-f634c1eca999 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:22:25.119360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:25.119973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:25.144160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.144653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.149748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.151390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:25.154965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:25.156977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:25.884314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid cb133a9d-fd24-477f-bfd0-31c7e301802d {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:25.922593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:25.940308 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-633f91de-3d25-4d0c-9be5-f8fe44c5939f tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1681 microversion: 2.1 time: 2.179146 Oct 31 15:22:25.943097 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 706/1488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:23 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1681 bytes in 2184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:25.955012 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-944ad545-da68-4201-a9e5-f0522347259b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 2054 microversion: 2.25 time: 0.842014 Oct 31 15:22:25.966833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:25.970943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:25.972292 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 783/1489] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:25 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 2054 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:25.989666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:25.990419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:26.007545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.010414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.011137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.015885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.016635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.017329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.019047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.019812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.020434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.024141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.028076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.029647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.618411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:26.630465 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d7efad27-3e22-43b4-8928-0a29993bb9bd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1276 microversion: 2.1 time: 0.684637 Oct 31 15:22:26.632286 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 707/1490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:25 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1276 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:26.645390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:26.646306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:26.657525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.658589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.659038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.659758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.660223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.660656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.861064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:26.872523 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e0aa7d7-00f7-444a-b4ca-77451c2ef8ba tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 0.898811 Oct 31 15:22:26.898170 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 784/1491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:25 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:26.908241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55573847-8e94-447c-9ce1-6785ddc100b6 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:26.926680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55573847-8e94-447c-9ce1-6785ddc100b6 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.927170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55573847-8e94-447c-9ce1-6785ddc100b6 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.927611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55573847-8e94-447c-9ce1-6785ddc100b6 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:26.928350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55573847-8e94-447c-9ce1-6785ddc100b6 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:26.928802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55573847-8e94-447c-9ce1-6785ddc100b6 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:26.939822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55573847-8e94-447c-9ce1-6785ddc100b6 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.034389 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55573847-8e94-447c-9ce1-6785ddc100b6 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.134417 Oct 31 15:22:27.036897 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 785/1492] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 31 15:22:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:27.056213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ef8c20c-313c-4f7d-9019-7390544c3666 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:27.062955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ef8c20c-313c-4f7d-9019-7390544c3666 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:27.087620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ef8c20c-313c-4f7d-9019-7390544c3666 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.097616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ef8c20c-313c-4f7d-9019-7390544c3666 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.098729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ef8c20c-313c-4f7d-9019-7390544c3666 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.100312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ef8c20c-313c-4f7d-9019-7390544c3666 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.101615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ef8c20c-313c-4f7d-9019-7390544c3666 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.103121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ef8c20c-313c-4f7d-9019-7390544c3666 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.142454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:27.173346 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ef8c20c-313c-4f7d-9019-7390544c3666 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134783 Oct 31 15:22:27.175224 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 786/1493] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:22:27 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:27.180315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:27.186816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:27.207506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.211435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=20 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:27.212289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.212915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.214002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.214710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.222092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.435844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.456661 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-470744d9-5979-422a-8242-4c133d17bbd1 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1613 microversion: 2.1 time: 0.276982 Oct 31 15:22:27.460479 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 787/1494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:27 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1613 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:27.487567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b60c25c7-6724-4bac-add4-aeb45c86df62 req-93a56b3f-8254-4dab-afe5-dce1e4fa89a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "tag": "3911a063-e5a3-4643-b9f9-9a8f7991ddcf"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:27.508871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b60c25c7-6724-4bac-add4-aeb45c86df62 req-93a56b3f-8254-4dab-afe5-dce1e4fa89a3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.509395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b60c25c7-6724-4bac-add4-aeb45c86df62 req-93a56b3f-8254-4dab-afe5-dce1e4fa89a3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.509912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b60c25c7-6724-4bac-add4-aeb45c86df62 req-93a56b3f-8254-4dab-afe5-dce1e4fa89a3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.524149 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b60c25c7-6724-4bac-add4-aeb45c86df62 req-93a56b3f-8254-4dab-afe5-dce1e4fa89a3 service nova] Creating event network-changed:3911a063-e5a3-4643-b9f9-9a8f7991ddcf for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:22:27.530759 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b60c25c7-6724-4bac-add4-aeb45c86df62 req-93a56b3f-8254-4dab-afe5-dce1e4fa89a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066330 Oct 31 15:22:27.531638 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 788/1495] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:27.550198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1b5b64a-ee1d-45d0-80d6-622bf1a2d185 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:27.550459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1b5b64a-ee1d-45d0-80d6-622bf1a2d185 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:27.559718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b5b64a-ee1d-45d0-80d6-622bf1a2d185 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.560850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b5b64a-ee1d-45d0-80d6-622bf1a2d185 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.561324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b5b64a-ee1d-45d0-80d6-622bf1a2d185 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.562165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b5b64a-ee1d-45d0-80d6-622bf1a2d185 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.562681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b5b64a-ee1d-45d0-80d6-622bf1a2d185 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.563124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b5b64a-ee1d-45d0-80d6-622bf1a2d185 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.742238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:27.777267 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1b5b64a-ee1d-45d0-80d6-622bf1a2d185 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d/action" status: 202 len: 0 microversion: 2.25 time: 0.243004 Oct 31 15:22:27.778413 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 789/1496] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:22:27 2022] POST /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:27.795429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:27.796349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:27.809111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.809725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.810183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.811429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:27.812073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:27.812643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:27.985184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:27.995963 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99d30de1-f4bc-4de9-8ab4-73879c4fe031 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1276 microversion: 2.1 time: 0.216241 Oct 31 15:22:28.000245 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 790/1497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:27 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:28.023416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:28.024476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:28.047567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.048278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.048505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:28.049270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.056350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.056895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:28.383012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:28.395155 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64d37fcb-4233-4b09-8166-3c1fb784775c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 1.757428 Oct 31 15:22:28.397297 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 708/1498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:26 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:28.429566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:28.431322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:28.455878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.457014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.457527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:28.458419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:28.459220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:28.459737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.004028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid cb133a9d-fd24-477f-bfd0-31c7e301802d {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:29.021541 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a295586-9ec9-47d8-8f5b-588535397641 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 2059 microversion: 2.25 time: 1.018446 Oct 31 15:22:29.041740 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 791/1499] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:28 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 2059 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:29.051830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e1c8f1e-d0f8-4305-8f04-b3f5be0e02f0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:29.055326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e1c8f1e-d0f8-4305-8f04-b3f5be0e02f0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:29.062650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e1c8f1e-d0f8-4305-8f04-b3f5be0e02f0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.063134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e1c8f1e-d0f8-4305-8f04-b3f5be0e02f0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.064082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e1c8f1e-d0f8-4305-8f04-b3f5be0e02f0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.064795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e1c8f1e-d0f8-4305-8f04-b3f5be0e02f0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.065440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e1c8f1e-d0f8-4305-8f04-b3f5be0e02f0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.066317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e1c8f1e-d0f8-4305-8f04-b3f5be0e02f0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.082985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.094561 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7563720c-54e4-41d2-beab-aaa4525b7859 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 0.681733 Oct 31 15:22:29.095582 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 709/1500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:28 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:29.103656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:29.107964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:29.114756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:29.134953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.136635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.138970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.140039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.142167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.142858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.157694 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e1c8f1e-d0f8-4305-8f04-b3f5be0e02f0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110719 Oct 31 15:22:29.159876 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 792/1501] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:22:29 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:22:29.165617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:29.167051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:29.175473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.176280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.177110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.178310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.179025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.179673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.463213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.482087 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b3821c3-5e68-463a-9603-665f473de6d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.320519 Oct 31 15:22:29.483582 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 793/1502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:29 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:29.492138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:29.493307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:29.524154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.528745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.530880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.533434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.535483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.536241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.644268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da22dd5d34fb43d2a8da0473ee0fb959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2783823cac14b27b795276d990b4e08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:29.660812 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-80838ab8-cd45-46b8-8f4f-9d0d5ddfe030 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 200 len: 1613 microversion: 2.1 time: 0.563882 Oct 31 15:22:29.664553 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 710/1503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:29 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 1613 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:29.694562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-0596faa4-303b-495e-892a-5f2eeb13c550 req-a2ce6e3a-4498-412c-95f7-2016d3b5f137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01374025-1d71-467c-9d2d-ddf7719fa8d1", "name": "network-vif-deleted", "tag": "4aba674c-14c2-4953-a5fe-7f18b3e2fc7e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:29.739171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0596faa4-303b-495e-892a-5f2eeb13c550 req-a2ce6e3a-4498-412c-95f7-2016d3b5f137 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:29.740817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0596faa4-303b-495e-892a-5f2eeb13c550 req-a2ce6e3a-4498-412c-95f7-2016d3b5f137 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:29.743158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0596faa4-303b-495e-892a-5f2eeb13c550 req-a2ce6e3a-4498-412c-95f7-2016d3b5f137 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:29.816436 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-0596faa4-303b-495e-892a-5f2eeb13c550 req-a2ce6e3a-4498-412c-95f7-2016d3b5f137 service nova] Creating event network-vif-deleted:4aba674c-14c2-4953-a5fe-7f18b3e2fc7e for instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 on n-h2-858384-17 Oct 31 15:22:29.836168 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-0596faa4-303b-495e-892a-5f2eeb13c550 req-a2ce6e3a-4498-412c-95f7-2016d3b5f137 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167177 Oct 31 15:22:29.839045 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 711/1504] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:30.052858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:30.053439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:30.068395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.068760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.086590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:30.087472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.087973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.088418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:30.372251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:30.384239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca104c55-cfa1-45c8-b812-197b43c37907 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.898615 Oct 31 15:22:30.392588 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 794/1505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:29 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:30.398140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:30.401418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:30.421736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.434117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.434773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:30.438791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.440964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.442290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:30.911480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:30.919822 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03ba5165-31f3-4f70-a06c-02c0977afea7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 0.525531 Oct 31 15:22:30.924518 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 795/1506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:30 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:30.934496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:30.935368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:30.956005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.958806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.962045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:30.963347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:30.964067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:30.965350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.056163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid cb133a9d-fd24-477f-bfd0-31c7e301802d {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:31.101500 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1925c175-55de-445e-ba96-c039db2aa975 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 2039 microversion: 2.25 time: 1.053979 Oct 31 15:22:31.121777 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 712/1507] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:30 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 2039 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:31.126855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:31.127490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:31.134816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.135602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.136216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.140011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.140732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.141362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.145461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:31.162104 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] HTTP exception thrown: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Request method failure captured: Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 HTTP/1.1 Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-d5BcUoAgoDmpYkGxUZzxYI3q3SVCP9t-Nkfn7AtMWCH3xjRrNGjgqMR6dDfEu4qeKqOn_0H8UWlIwDUPMSdMqyEmwSoWO-ghRVXl_89p52owyXBlBggMhahqddmvB5zr18AD74ttlgsDPzz0x3ufUm3QYtsSQH0jgd36ZjnIdmmdU Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: a2783823cac14b27b795276d990b4e08 Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1458207543 Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:22:31.164088 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2783823cac14b27b795276d990b4e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2783823cac14b27b795276d990b4e08", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2783823cac14b27b795276d990b4e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2783823cac14b27b795276d990b4e08"}]}] Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1458207543 Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: a2783823cac14b27b795276d990b4e08 Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1458207543 Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachSCSIVolumeTestJSON-1458207543-project Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: da22dd5d34fb43d2a8da0473ee0fb959 Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1458207543-project Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:31.166146 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '01374025-1d71-467c-9d2d-ddf7719fa8d1'} Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:31.167128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:31.169728 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:31.171376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Returning 404 to user: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:31.171376 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3c6012c-7637-4193-afc9-57f4bb1e4299 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 404 len: 111 microversion: 2.1 time: 0.043069 Oct 31 15:22:31.171376 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 713/1508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:31 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:22:31.178319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-17", "block_migration": "auto"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:31.180930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:31.190445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.191951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.193038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.194706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.195396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.196313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.244327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'flavor' on Instance uuid cb133a9d-fd24-477f-bfd0-31c7e301802d {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:31.259995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Going to try to live migrate instance to n-h2-858384-17 {{(pid=120588) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:22:31.402885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:31.415995 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e14f7f40-3650-44c3-9986-dedcaac19069 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.489931 Oct 31 15:22:31.424881 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 796/1509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:30 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:31.437484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d67ff482-7b72-4db1-8f79-a11bec8971cd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '.version_select at 0x7f16e14a0940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:31.487475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d67ff482-7b72-4db1-8f79-a11bec8971cd tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540377468" status: 202 len: 0 microversion: 2.1 time: 0.060377 Oct 31 15:22:31.489438 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 797/1510] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:22:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540377468 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:22:31.495075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:31.496549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:31.513523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.514904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.516042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.518573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.519221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.520049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.864643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:31.875628 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c4cf3641-42db-47cd-a05a-fa2478afdefe tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.384537 Oct 31 15:22:31.876229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 798/1511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:31 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:31.951134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:31.951759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:31.971111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.971609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.972063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:31.972799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:31.973301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:31.973734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.299323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:32.309802 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-33475d0d-e13f-48b6-b01b-655e006ddce7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 0.362391 Oct 31 15:22:32.327608 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 799/1512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:31 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:32.334093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-56f08852-4467-4299-9ac8-240d52d11dac req-bdf4824a-0a84-4fa8-a47e-19c4ecca36d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "tag": "4078c6bc-c9e1-4ce2-aaf7-7bb76f9f0c37"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:32.345213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-56f08852-4467-4299-9ac8-240d52d11dac req-bdf4824a-0a84-4fa8-a47e-19c4ecca36d5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:32.345984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-56f08852-4467-4299-9ac8-240d52d11dac req-bdf4824a-0a84-4fa8-a47e-19c4ecca36d5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:32.346780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-56f08852-4467-4299-9ac8-240d52d11dac req-bdf4824a-0a84-4fa8-a47e-19c4ecca36d5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.367311 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-56f08852-4467-4299-9ac8-240d52d11dac req-bdf4824a-0a84-4fa8-a47e-19c4ecca36d5 service nova] Creating event network-changed:4078c6bc-c9e1-4ce2-aaf7-7bb76f9f0c37 for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:22:32.377425 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-56f08852-4467-4299-9ac8-240d52d11dac req-bdf4824a-0a84-4fa8-a47e-19c4ecca36d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046430 Oct 31 15:22:32.378778 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 800/1513] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:32.457785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:32.462270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:32.476933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:32.480053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:32.482153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.484999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:32.485902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:32.486661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.805574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:32.830015 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52882d5a-4457-4e7d-9453-a351c78d9095 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.389667 Oct 31 15:22:32.830015 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 801/1514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:32 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:32.905810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:32.907760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:32.921267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:32.924606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:32.925113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:32.926814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:32.927290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:32.927726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.274104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:33.301748 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0d9d218-e8be-4a5d-9aa1-f4fbafc3ce12 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.401793 Oct 31 15:22:33.304062 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 802/1515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:32 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:33.347380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:33.349333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:33.365378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.369689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.373923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.374973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.375725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.376512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.623761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:33.633166 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da1b1a13-eb8f-4c2e-b619-6dc537fdda42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 0.300689 Oct 31 15:22:33.634161 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 803/1516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:33 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:33.857098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:33.857866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:33.880059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.882457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.883638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:33.885146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:33.889888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:33.890447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:34.728885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:34.738308 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4f4703d-e8af-4547-a5f8-3c239d671882 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.886307 Oct 31 15:22:34.738908 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 804/1517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:33 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:34.756940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:34.757797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:34.771421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:34.772172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:34.772845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:34.773789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:34.774489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:34.775106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.014024 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34bde586-322a-4f2a-8be6-b91f5412a90d tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d/action" status: 202 len: 0 microversion: 2.25 time: 3.846225 Oct 31 15:22:35.015455 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 714/1518] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:22:31 2022] POST /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d/action => generated 0 bytes in 3848 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:35.021444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e4455c3a-155d-42c6-8cd3-4cba158e2c27 req-ebac76b8-5fa2-4e82-af93-827d93b66908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c3e20a-338d-4dcb-946c-7012911f7928", "tag": "a5d743e8-b414-4676-a691-44ad4577180c"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:35.070754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e4455c3a-155d-42c6-8cd3-4cba158e2c27 req-ebac76b8-5fa2-4e82-af93-827d93b66908 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.071258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e4455c3a-155d-42c6-8cd3-4cba158e2c27 req-ebac76b8-5fa2-4e82-af93-827d93b66908 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.071899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e4455c3a-155d-42c6-8cd3-4cba158e2c27 req-ebac76b8-5fa2-4e82-af93-827d93b66908 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.123748 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e4455c3a-155d-42c6-8cd3-4cba158e2c27 req-ebac76b8-5fa2-4e82-af93-827d93b66908 service nova] Creating event network-changed:a5d743e8-b414-4676-a691-44ad4577180c for instance 45c3e20a-338d-4dcb-946c-7012911f7928 on n-h1-858384-17 Oct 31 15:22:35.200714 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e4455c3a-155d-42c6-8cd3-4cba158e2c27 req-ebac76b8-5fa2-4e82-af93-827d93b66908 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179723 Oct 31 15:22:35.205267 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 715/1519] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:35.247426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:35.248157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:35.283234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.283767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.284216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.297185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.298013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.298654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.381205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:35.392377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe37d2c5-6d06-43ac-a808-abedc0c63d15 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.645778 Oct 31 15:22:35.393045 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 805/1520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:34 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:35.412438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:35.413089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:35.438527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.438527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.439002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.439676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:35.440160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:35.446451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:35.998407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.006956 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47997caf-bee2-48d3-b4cc-69dc5de1d6c0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 0.793628 Oct 31 15:22:36.010515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.023411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.024341 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 716/1521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:35 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:36.027880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.030076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3bf89b9b-f0b2-4942-b092-8d14c32a7e5d req-75f9d323-a0d0-472a-bc2b-46c771af8620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee19e5b7-f848-4466-b5ea-ee5a51fd0be5", "name": "network-vif-plugged", "status": "completed", "tag": "fd121579-9a48-49b0-bf14-f059bfc71d97"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:36.031436 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a220fe7-66d1-495d-a1e2-f52054611655 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 0.627193 Oct 31 15:22:36.032408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 806/1522] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:35 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:36.041234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3bf89b9b-f0b2-4942-b092-8d14c32a7e5d req-75f9d323-a0d0-472a-bc2b-46c771af8620 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:36.042171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3bf89b9b-f0b2-4942-b092-8d14c32a7e5d req-75f9d323-a0d0-472a-bc2b-46c771af8620 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:36.042827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3bf89b9b-f0b2-4942-b092-8d14c32a7e5d req-75f9d323-a0d0-472a-bc2b-46c771af8620 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:36.047624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:36.048456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:36.056295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3bf89b9b-f0b2-4942-b092-8d14c32a7e5d req-75f9d323-a0d0-472a-bc2b-46c771af8620 service nova] Creating event network-vif-plugged:fd121579-9a48-49b0-bf14-f059bfc71d97 for instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 on n-h1-858384-17 Oct 31 15:22:36.058504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:36.059016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:36.059590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:36.063990 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3bf89b9b-f0b2-4942-b092-8d14c32a7e5d req-75f9d323-a0d0-472a-bc2b-46c771af8620 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038351 Oct 31 15:22:36.065114 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 717/1523] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:36.065826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:36.066409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:36.067358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:36.417095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:36.418757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:36.446422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:36.447350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:36.448073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:36.449949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:36.451420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:36.452221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:36.935022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.937413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:36.947644 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-276c7d36-8f67-4121-810f-c58cab28eee2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.909490 Oct 31 15:22:36.950237 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 807/1524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:36 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:36.975687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:36.986354 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5260fd37-d374-40c0-887f-485d5a0723e0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.573957 Oct 31 15:22:36.987071 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 718/1525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:36 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:37.038758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:37.040202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:37.054344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:37.056369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.064225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.064447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:37.064948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:37.066274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.067115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.068089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.068728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.083991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.084573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.085027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.094231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.095068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.096679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.831614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:37.846377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8efe8b01-66a3-4997-a0ff-320bca5f770e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1307 microversion: 2.1 time: 0.810889 Oct 31 15:22:37.848777 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 808/1526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:37 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1307 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:37.879620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-669cab79-8b31-415c-9d1d-ceb1a93a5853 req-9cdb732d-0c6b-449d-ade7-255bc888cd4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "tag": "21e9a392-5cb7-4937-9ecb-e5668f0d9d46"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:37.922404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-669cab79-8b31-415c-9d1d-ceb1a93a5853 req-9cdb732d-0c6b-449d-ade7-255bc888cd4b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:37.923205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-669cab79-8b31-415c-9d1d-ceb1a93a5853 req-9cdb732d-0c6b-449d-ade7-255bc888cd4b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:37.924269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-669cab79-8b31-415c-9d1d-ceb1a93a5853 req-9cdb732d-0c6b-449d-ade7-255bc888cd4b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:37.957145 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-669cab79-8b31-415c-9d1d-ceb1a93a5853 req-9cdb732d-0c6b-449d-ade7-255bc888cd4b service nova] Creating event network-changed:21e9a392-5cb7-4937-9ecb-e5668f0d9d46 for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:22:37.971412 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-669cab79-8b31-415c-9d1d-ceb1a93a5853 req-9cdb732d-0c6b-449d-ade7-255bc888cd4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121015 Oct 31 15:22:37.975134 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 809/1527] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:37.986870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:37.987823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:38.003161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.005632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.006301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:38.008270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.009856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.010503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:38.201291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.213085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.225270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.244650 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5853446d-476c-4573-aee6-782ad8ee23ea tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 1.171836 Oct 31 15:22:38.246399 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 719/1528] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:37 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:22:38.285925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:38.286607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:38.318717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.322360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.325589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:38.329281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.329895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.330381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:38.621602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:38.629348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71c9b46a-95c8-41a3-a353-5deaf3e01460 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.650302 Oct 31 15:22:38.629995 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 810/1529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:37 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:38.879437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:38.880473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:38.891352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:38.898409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.900230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.904121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:38.905482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:38.906636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:38.908445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.021723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.035029 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3fa88c34-041f-42eb-a61f-ec8e981b740c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.764630 Oct 31 15:22:39.036255 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 720/1530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:38 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:39.271735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:39.273076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:39.285836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.288039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.291113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.293452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.294187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.294787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.632824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:39.653255 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75d1fc6d-bc69-46a3-8efc-05288a25dd6b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1487 microversion: 2.1 time: 0.778309 Oct 31 15:22:39.657612 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 811/1531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:38 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1487 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:39.671243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:39.674589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:39.690823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.693601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.694415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:39.696200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:39.699211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:39.700064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.030738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:40.039053 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2214773c-2916-4451-b8d5-8330834213fd tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.379717 Oct 31 15:22:40.044639 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 812/1532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:39 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:40.049702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:40.054809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:40.077818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.078395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.078915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.081277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.081761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.084595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.257386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:40.552035 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75f54a92-c6aa-4da9-8132-e835c7960608 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 204 len: 0 microversion: 2.1 time: 0.505797 Oct 31 15:22:40.555465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:40.567516 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 813/1533] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:22:40 2022] DELETE /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:40.573093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:40.579024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:40.591077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:40.592375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:40.605776 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e81f4cc5-78d8-4ac7-b9d3-1f468c84de3d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 1.338054 Oct 31 15:22:40.610666 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 721/1534] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:39 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:22:40.618033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.622251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.624327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.627134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:40.628213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.632828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.633536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.638051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:40.663827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.664332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.664775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:40.665525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:40.665987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:40.666415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.153483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:41.163780 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1972c597-8497-4bb4-94e4-1fd54357c43a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.596928 Oct 31 15:22:41.166759 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 814/1535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:40 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:41.198034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2aec0e2f-ed75-450a-9d7b-dfe2035157aa req-44c82247-68a1-46a1-be82-030963004c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb133a9d-fd24-477f-bfd0-31c7e301802d", "name": "network-vif-unplugged", "status": "completed", "tag": "830ca30e-3090-4f40-8f89-0c31ab02a113"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:41.222558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2aec0e2f-ed75-450a-9d7b-dfe2035157aa req-44c82247-68a1-46a1-be82-030963004c38 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.224217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2aec0e2f-ed75-450a-9d7b-dfe2035157aa req-44c82247-68a1-46a1-be82-030963004c38 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.224846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2aec0e2f-ed75-450a-9d7b-dfe2035157aa req-44c82247-68a1-46a1-be82-030963004c38 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.247460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:41.256292 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99ea0e99-6e1d-4d0d-9bf1-fd7ee0fa7a39 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1493 microversion: 2.1 time: 0.644312 Oct 31 15:22:41.257044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2aec0e2f-ed75-450a-9d7b-dfe2035157aa req-44c82247-68a1-46a1-be82-030963004c38 service nova] Creating event network-vif-unplugged:830ca30e-3090-4f40-8f89-0c31ab02a113 for instance cb133a9d-fd24-477f-bfd0-31c7e301802d on n-h1-858384-17 Oct 31 15:22:41.266111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 722/1536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:40 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1493 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:41.279329 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2aec0e2f-ed75-450a-9d7b-dfe2035157aa req-44c82247-68a1-46a1-be82-030963004c38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091707 Oct 31 15:22:41.279959 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 815/1537] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:41.282047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:41.282630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:41.302440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.302948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.303388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.311709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:41.312315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:41.313804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.314510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.316977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.324866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.336092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.336818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.338425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.339092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.339752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.375694 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] HTTP exception thrown: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Request method failure captured: Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 HTTP/1.1 Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-d5BcUoAgoDmpYkGxUZzxYI3q3SVCP9t-Nkfn7AtMWCH3xjRrNGjgqMR6dDfEu4qeKqOn_0H8UWlIwDUPMSdMqyEmwSoWO-ghRVXl_89p52owyXBlBggMhahqddmvB5zr18AD74ttlgsDPzz0x3ufUm3QYtsSQH0jgd36ZjnIdmmdU Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: a2783823cac14b27b795276d990b4e08 Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1458207543 Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:22:41.380847 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2783823cac14b27b795276d990b4e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2783823cac14b27b795276d990b4e08", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2783823cac14b27b795276d990b4e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2783823cac14b27b795276d990b4e08"}]}] Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1458207543 Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: a2783823cac14b27b795276d990b4e08 Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1458207543 Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachSCSIVolumeTestJSON-1458207543-project Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: da22dd5d34fb43d2a8da0473ee0fb959 Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1458207543-project Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.382498 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '01374025-1d71-467c-9d2d-ddf7719fa8d1'} Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:41.383358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.384788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.388598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Returning 404 to user: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:41.389709 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c2901e8-2fe7-4c92-86d8-b232609e288b tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 404 len: 111 microversion: 2.1 time: 0.084829 Oct 31 15:22:41.395065 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 816/1538] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:22:41 2022] DELETE /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:22:41.403770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:41.410914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] [instance: 01374025-1d71-467c-9d2d-ddf7719fa8d1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:41.426502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.427155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.427721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.434616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.435575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.436233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.473229 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] HTTP exception thrown: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Request method failure captured: Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 HTTP/1.1 Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-d5BcUoAgoDmpYkGxUZzxYI3q3SVCP9t-Nkfn7AtMWCH3xjRrNGjgqMR6dDfEu4qeKqOn_0H8UWlIwDUPMSdMqyEmwSoWO-ghRVXl_89p52owyXBlBggMhahqddmvB5zr18AD74ttlgsDPzz0x3ufUm3QYtsSQH0jgd36ZjnIdmmdU Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: a2783823cac14b27b795276d990b4e08 Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1458207543 Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:22:41.478567 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2783823cac14b27b795276d990b4e08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a2783823cac14b27b795276d990b4e08", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a2783823cac14b27b795276d990b4e08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a2783823cac14b27b795276d990b4e08"}]}] Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1458207543 Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: a2783823cac14b27b795276d990b4e08 Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1458207543 Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachSCSIVolumeTestJSON-1458207543-project Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: da22dd5d34fb43d2a8da0473ee0fb959 Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1458207543-project Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.480914 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '01374025-1d71-467c-9d2d-ddf7719fa8d1'} Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:41.481967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. Oct 31 15:22:41.483558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:41.486204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] Returning 404 to user: Instance 01374025-1d71-467c-9d2d-ddf7719fa8d1 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:41.487268 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7aee40c6-3cd6-4773-b5ed-2fc1ff2a7649 tempest-AttachSCSIVolumeTestJSON-1458207543 tempest-AttachSCSIVolumeTestJSON-1458207543-project] 10.222.0.20 "GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1" status: 404 len: 111 microversion: 2.1 time: 0.088354 Oct 31 15:22:41.494352 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 817/1539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:41 2022] GET /compute/v2.1/servers/01374025-1d71-467c-9d2d-ddf7719fa8d1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:22:41.640944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:41.642772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:41.651986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.655299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.658672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.659742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:41.660445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:41.661121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:41.877848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:41.888331 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-46962084-28d2-4631-b12e-bb9d708ac527 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.617343 Oct 31 15:22:41.891851 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 723/1540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:41 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:42.193975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:42.194800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:42.203634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:42.204500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:42.205363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:42.206610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:42.207364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:42.208473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:42.536306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:42.556974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:42.569984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:42.571269 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e028b89d-480f-48d3-a7f9-d4ee2f482c7d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 0.939330 Oct 31 15:22:42.600317 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 818/1541] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:41 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:42.610131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:42.615166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:42.630419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:42.642722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:42.645157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:42.648445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:42.649824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:42.652165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:42.683385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:42.694789 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ee60d813-972d-4ecc-8e06-020542a16cc7 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.505097 Oct 31 15:22:42.700592 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 724/1542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:42 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:42.915081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:42.916422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:42.928237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:42.931709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:42.932368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:42.934723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:42.937234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:42.937900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:43.321215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:43.341904 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-159fed5d-23ab-431d-996f-204b2bd29ae4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1451 microversion: 2.1 time: 0.740128 Oct 31 15:22:43.354010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:43.369607 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-409ec3f8-51f2-4a2f-a403-5f1acf9d320b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.461433 Oct 31 15:22:43.374267 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 725/1544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:42 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:43.375394 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 819/1544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:42 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1451 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:43.379439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-73b1d8b7-832d-4eda-813b-67cbe34483b9 req-333150b1-1ce0-43f0-823b-ac68b1528190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb133a9d-fd24-477f-bfd0-31c7e301802d", "tag": "830ca30e-3090-4f40-8f89-0c31ab02a113"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:43.413550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73b1d8b7-832d-4eda-813b-67cbe34483b9 req-333150b1-1ce0-43f0-823b-ac68b1528190 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:43.414416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73b1d8b7-832d-4eda-813b-67cbe34483b9 req-333150b1-1ce0-43f0-823b-ac68b1528190 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:43.415108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73b1d8b7-832d-4eda-813b-67cbe34483b9 req-333150b1-1ce0-43f0-823b-ac68b1528190 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:43.455178 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-73b1d8b7-832d-4eda-813b-67cbe34483b9 req-333150b1-1ce0-43f0-823b-ac68b1528190 service nova] Creating event network-changed:830ca30e-3090-4f40-8f89-0c31ab02a113 for instance cb133a9d-fd24-477f-bfd0-31c7e301802d on n-h1-858384-17 Oct 31 15:22:43.475106 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-73b1d8b7-832d-4eda-813b-67cbe34483b9 req-333150b1-1ce0-43f0-823b-ac68b1528190 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099201 Oct 31 15:22:43.478622 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 726/1545] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:43.606126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:43.607269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:43.671298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:43.678394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:43.679211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:43.683499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:43.684369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:43.687297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:43.740771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:43.742963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:43.755193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:43.757639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:43.758594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:43.759958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:43.761839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:43.762773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:44.335094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:44.345435 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f351a6ab-9a02-4ae7-af84-dc9a5c43b131 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.614613 Oct 31 15:22:44.350580 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 727/1546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:43 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:44.383322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:44.384310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:44.394089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:44.397816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:44.399625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:44.403040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:44.403838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:44.404661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:44.502670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:44.508213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:44.509009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:44.509693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:44.510387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lazy-loading 'fault' on Instance uuid ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:44.515827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:44.520853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:44.523078 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e16e1cbe-653e-450e-8722-cdf151a97213 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 0.923837 Oct 31 15:22:44.524692 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 820/1547] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:43 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:44.545081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:44.547078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:44.587725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:44.590690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:44.592526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:44.595361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:44.597560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:44.608550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:44.847794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:44.856082 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e1795d95-d7c8-47b1-a29b-2c673ba48f17 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 200 len: 1297 microversion: 2.1 time: 0.476875 Oct 31 15:22:44.861740 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 728/1548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:44 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 1297 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:22:45.376697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:45.377395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:45.387843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:45.388614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:45.393764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:45.394769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:45.395416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:45.396015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:45.477582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:45.486830 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0bbdb7b-fb11-4706-a996-877c27d96bf2 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.960753 Oct 31 15:22:45.503675 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 821/1549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:44 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:45.557388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:45.558256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:45.568668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:45.574248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:45.575203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:45.576157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:45.576799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:45.580450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:45.892259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:45.901370 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1dce1e8-10ba-45ab-8c89-cf9af43a2690 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.528326 Oct 31 15:22:45.902261 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 729/1550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:45 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:45.910374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2b6e5c24-70fd-4a85-a32f-e80275b97f86 req-660ab306-5cfa-46d1-923f-4d8005601bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee19e5b7-f848-4466-b5ea-ee5a51fd0be5", "name": "network-vif-deleted", "tag": "fd121579-9a48-49b0-bf14-f059bfc71d97"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:45.922126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2b6e5c24-70fd-4a85-a32f-e80275b97f86 req-660ab306-5cfa-46d1-923f-4d8005601bc6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:45.923074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2b6e5c24-70fd-4a85-a32f-e80275b97f86 req-660ab306-5cfa-46d1-923f-4d8005601bc6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:45.923683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2b6e5c24-70fd-4a85-a32f-e80275b97f86 req-660ab306-5cfa-46d1-923f-4d8005601bc6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:45.930337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:45.950712 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2b6e5c24-70fd-4a85-a32f-e80275b97f86 req-660ab306-5cfa-46d1-923f-4d8005601bc6 service nova] Creating event network-vif-deleted:fd121579-9a48-49b0-bf14-f059bfc71d97 for instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 on n-h1-858384-17 Oct 31 15:22:45.958496 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2b6e5c24-70fd-4a85-a32f-e80275b97f86 req-660ab306-5cfa-46d1-923f-4d8005601bc6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053377 Oct 31 15:22:45.960878 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 730/1551] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:45.968364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d89b2520-e6a4-46ee-a6a5-88a8ea1a23ac req-1653de01-6500-40e5-a43b-3b665176af53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c3e20a-338d-4dcb-946c-7012911f7928", "name": "network-vif-plugged", "status": "completed", "tag": "a5d743e8-b414-4676-a691-44ad4577180c"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:46.003104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d89b2520-e6a4-46ee-a6a5-88a8ea1a23ac req-1653de01-6500-40e5-a43b-3b665176af53 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:46.004204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d89b2520-e6a4-46ee-a6a5-88a8ea1a23ac req-1653de01-6500-40e5-a43b-3b665176af53 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:46.005665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d89b2520-e6a4-46ee-a6a5-88a8ea1a23ac req-1653de01-6500-40e5-a43b-3b665176af53 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:46.061437 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d89b2520-e6a4-46ee-a6a5-88a8ea1a23ac req-1653de01-6500-40e5-a43b-3b665176af53 service nova] Creating event network-vif-plugged:a5d743e8-b414-4676-a691-44ad4577180c for instance 45c3e20a-338d-4dcb-946c-7012911f7928 on n-h1-858384-17 Oct 31 15:22:46.075533 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d89b2520-e6a4-46ee-a6a5-88a8ea1a23ac req-1653de01-6500-40e5-a43b-3b665176af53 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112516 Oct 31 15:22:46.079223 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 731/1552] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:46.091578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:46.092299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:46.114407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:46.115526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:46.117588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:46.118176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:46.118632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:46.134893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:46.195780 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 HTTP/1.1 Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:22:46.202329 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:22:46.204201 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'ee19e5b7-f848-4466-b5ea-ee5a51fd0be5'} Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:46.205301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:22:46.206948 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:22:46.210082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:46.214438 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-afbe0de7-46a5-459e-94c3-acd0a9bcc6f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 404 len: 111 microversion: 2.1 time: 0.133819 Oct 31 15:22:46.221863 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 732/1553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:46 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:22:46.241567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a3773d8-ffd0-43a1-aa98-be2475abe9f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e18bc4c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:47.077764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:47.130082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:47.141240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:47.143523 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-973c4ad9-83a3-4bff-a795-e60d0820655a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 1.592934 Oct 31 15:22:47.144411 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 822/1554] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:45 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:47.163647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:47.164820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:47.186760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.202671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.204067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.208810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.210450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.215309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.690205 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a3773d8-ffd0-43a1-aa98-be2475abe9f0 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 204 len: 0 microversion: 2.1 time: 1.465931 Oct 31 15:22:47.690789 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 733/1555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:46 2022] DELETE /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 0 bytes in 1468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:47.696244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:47.699363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:47.712646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.714344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.715071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.717239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.718678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.719560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.919968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:47.929987 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cec9da78-0fa3-4c91-91f0-174347ca760f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1318 microversion: 2.1 time: 0.784185 Oct 31 15:22:47.947898 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 823/1556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:47 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1318 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:47.954552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:47.955642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:47.965160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.966027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.966774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:47.967723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:47.968418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:47.969812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:48.002091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:48.059236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:48.181797 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a0886deb-c6c8-49e7-a828-c3e54defcd27 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 204 len: 0 microversion: 2.1 time: 0.229316 Oct 31 15:22:48.183394 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 824/1557] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:22:47 2022] DELETE /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:48.191174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:48.205958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:48.218695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:48.219793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:48.221375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:48.223035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:48.223961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:48.224614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:48.289102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:48.307964 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3cc2d3d7-5277-4a18-a615-2c0817e11086 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.615318 Oct 31 15:22:48.309233 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 734/1558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:47 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:48.412669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1297684968", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fae45c93-5c66-4e3d-908c-bfaf50cd6c4a"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:48.532649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] validate_networks() for [('fae45c93-5c66-4e3d-908c-bfaf50cd6c4a', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:22:48.971213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:48.980556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:48.982041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:48.983760 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48ddacd2-c272-453a-bd15-e15a9b89722b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 0.797927 Oct 31 15:22:49.012032 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 825/1559] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:48 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:49.029790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:49.031538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:49.042204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:49.043038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:49.043683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:49.044594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:49.045295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:49.045912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:49.568476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:49.597748 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16112c15-abc3-489d-85a3-c7b8e1486913 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1509 microversion: 2.1 time: 0.581124 Oct 31 15:22:49.601563 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 826/1560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:49 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1509 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:49.622498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:49.624790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:49.649363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:49.650324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:49.652177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:49.654021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:49.659580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:49.661312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.038363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:50.042447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:50.043361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:50.044024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:50.044699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:50.048960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:50.060516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.061454 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34315b7e-e167-4632-a3d4-f0f65fbb4ee2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.451091 Oct 31 15:22:50.063544 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 827/1561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:49 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:50.064374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.068647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.069793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.070514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.071182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.091782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:50.092423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:50.112205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.112983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.114376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.116248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.117673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.121238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.127455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:50.147601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Getting quotas for user cd661f82522f4d5ab5f54d9fcdb81232 and project 142fd4435ce245d39b8e4a3c8fec565f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:50.176505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:22:50.188763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:22:50.309291 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8130e8dc-cf6a-4a3f-b68b-ae0b06ecbbe3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900342 Oct 31 15:22:50.309957 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 735/1562] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:22:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:22:50.590012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:50.603003 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a221b47b-34ea-4065-8c13-70df4d6e90ea tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1509 microversion: 2.1 time: 0.538349 Oct 31 15:22:50.605643 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 828/1563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:50 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:50.613065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:50.616386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:50.644179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.650717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.652353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.654097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:50.656284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e20225a4-07c6-4e1e-9211-2705b527560b tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Action: 'create', calling method: .version_select at 0x7f16e1676430>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:50.658204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:50.659733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:50.708862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e20225a4-07c6-4e1e-9211-2705b527560b tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Getting quotas for project 14dded2c4ac54ab4b1fbdd3402b463e7. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:50.726736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e20225a4-07c6-4e1e-9211-2705b527560b tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Getting quotas for user bd655953c3e34c759a4bd52e0121d54e and project 14dded2c4ac54ab4b1fbdd3402b463e7. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:50.823868 n-d-858384-17 devstack@n-api.service[120588]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e20225a4-07c6-4e1e-9211-2705b527560b tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] [5029fb4f-96b9-4765-872f-c1cdceccae56] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:22:51.020204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:51.036151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:51.038242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:51.039495 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78a8f0fc-2522-4a24-b426-17ed3ebc867d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 0.430894 Oct 31 15:22:51.040454 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 829/1564] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:50 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:51.050088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d01cf0c-6257-4391-9a98-c3b4b91e172f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:51.051512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d01cf0c-6257-4391-9a98-c3b4b91e172f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:51.146688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d01cf0c-6257-4391-9a98-c3b4b91e172f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:51.159015 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d01cf0c-6257-4391-9a98-c3b4b91e172f tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1208 microversion: 2.1 time: 0.114095 Oct 31 15:22:51.161070 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 830/1565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:51 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:51.173743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:51.184340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:51.202705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.204965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.206848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.208679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.211581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.212148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.407491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:51.408430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:51.409080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:51.409851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:51.414642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:51.561312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:51.570498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.571284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.572161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.574136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.575283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.575935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.638887 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-850a2957-083a-4f78-8fbf-24726e58182c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "POST /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928/action" status: 202 len: 1111 microversion: 2.1 time: 0.475530 Oct 31 15:22:51.641628 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 831/1566] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:22:51 2022] POST /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928/action => generated 1111 bytes in 479 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 15:22:51.658250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:51.674411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:51.683426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.684362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.685004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.685990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:51.686748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:51.687346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:51.836959 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [None req-e20225a4-07c6-4e1e-9211-2705b527560b tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] [5029fb4f-96b9-4765-872f-c1cdceccae56] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 52496. Oct 31 15:22:51.916099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e20225a4-07c6-4e1e-9211-2705b527560b tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Getting quotas for project 14dded2c4ac54ab4b1fbdd3402b463e7. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:51.938468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e20225a4-07c6-4e1e-9211-2705b527560b tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Getting quotas for user bd655953c3e34c759a4bd52e0121d54e and project 14dded2c4ac54ab4b1fbdd3402b463e7. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:52.008006 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e20225a4-07c6-4e1e-9211-2705b527560b tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.692572 Oct 31 15:22:52.008860 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 736/1567] 10.222.0.20 () {62 vars in 1214 bytes} [Mon Oct 31 15:22:50 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:52.036257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:52.036871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:52.065848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:52.066381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:52.066823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:52.067527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:52.070429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:52.071238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:52.177889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:52.192893 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e2849ee-c994-4e42-a84d-c9e801162bf5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.545069 Oct 31 15:22:52.194015 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 832/1568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:51 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:52.205155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cecdddc8-cd19-4c50-8af8-df1256f95b37 tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:52.247126 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cecdddc8-cd19-4c50-8af8-df1256f95b37 tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.050335 Oct 31 15:22:52.253853 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 833/1569] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Oct 31 15:22:52 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:52.264250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:52.269790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:52.284176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:52.284685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:52.285148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:52.285851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:52.286335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:52.286771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:52.485886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:52.497513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:52.498966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:52.500188 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bd7ee09-bc08-49b9-ae2d-f030b0872afc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 0.245044 Oct 31 15:22:52.501961 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 834/1570] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:52 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:52.508219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:52.509612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:52.522129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:52.523156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:52.523810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:52.525427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:52.529009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:52.529744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:52.652718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:52.677467 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-86d481bf-b26c-4674-a278-e7e5d61c5fc1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1260 microversion: 2.1 time: 0.166497 Oct 31 15:22:52.695336 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 835/1571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:52 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:52.714549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6db58b6-e790-419e-ac1f-558e95d243e2 tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:52.739586 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6db58b6-e790-419e-ac1f-558e95d243e2 tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/840887fc-67ed-49f6-8061-d817aa6f79f9" status: 200 len: 235 microversion: 2.64 time: 0.038888 Oct 31 15:22:52.740390 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 836/1572] 10.222.0.20 () {60 vars in 1304 bytes} [Mon Oct 31 15:22:52 2022] GET /compute/v2.1/os-server-groups/840887fc-67ed-49f6-8061-d817aa6f79f9 => generated 235 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:22:52.749202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-306a5bcc-e5cc-4308-84b9-a105f97e368c req-fd4718b6-b2b3-447d-ba86-ce491730a1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "name": "network-vif-plugged", "status": "completed", "tag": "4078c6bc-c9e1-4ce2-aaf7-7bb76f9f0c37"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:52.796768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-306a5bcc-e5cc-4308-84b9-a105f97e368c req-fd4718b6-b2b3-447d-ba86-ce491730a1f2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:52.797196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-306a5bcc-e5cc-4308-84b9-a105f97e368c req-fd4718b6-b2b3-447d-ba86-ce491730a1f2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:52.797631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-306a5bcc-e5cc-4308-84b9-a105f97e368c req-fd4718b6-b2b3-447d-ba86-ce491730a1f2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:52.825582 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-306a5bcc-e5cc-4308-84b9-a105f97e368c req-fd4718b6-b2b3-447d-ba86-ce491730a1f2 service nova] Creating event network-vif-plugged:4078c6bc-c9e1-4ce2-aaf7-7bb76f9f0c37 for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:22:52.841311 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-306a5bcc-e5cc-4308-84b9-a105f97e368c req-fd4718b6-b2b3-447d-ba86-ce491730a1f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099851 Oct 31 15:22:52.842228 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 837/1573] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:52.847393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b98c84d-5f9e-494f-b95b-02cd9b665d08 tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:52.907026 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b98c84d-5f9e-494f-b95b-02cd9b665d08 tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/840887fc-67ed-49f6-8061-d817aa6f79f9" status: 204 len: 0 microversion: 2.64 time: 0.063482 Oct 31 15:22:52.907842 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 838/1574] 10.222.0.20 () {60 vars in 1307 bytes} [Mon Oct 31 15:22:52 2022] DELETE /compute/v2.1/os-server-groups/840887fc-67ed-49f6-8061-d817aa6f79f9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:22:52.917934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8d1b7b4-b102-4c93-8ed3-f5febeaecb3c tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:52.926088 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d8d1b7b4-b102-4c93-8ed3-f5febeaecb3c tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] HTTP exception thrown: Instance group 840887fc-67ed-49f6-8061-d817aa6f79f9 could not be found. Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8d1b7b4-b102-4c93-8ed3-f5febeaecb3c tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Request method failure captured: Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-server-groups/840887fc-67ed-49f6-8061-d817aa6f79f9 HTTP/1.1 Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hJrM-HLyvPynO_JCpLTwp3GbigpogGlFF_n9s4iO0m1TzPFMurdmWfZPNPglfuZXsAy4G2sXsu1a8iOrNhk3ERmsFXomEgW666A6bfSIdrGd3ZAWm-V4qYgBBsn54tp4ieAMyf6cWY0i9eSxnhhHHTxhYn6bxIcqkWCsTM9cZI1-c Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.64 Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 14dded2c4ac54ab4b1fbdd3402b463e7 Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerGroup264TestJSON-1656201669 Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:22:52.936710 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14dded2c4ac54ab4b1fbdd3402b463e7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14dded2c4ac54ab4b1fbdd3402b463e7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14dded2c4ac54ab4b1fbdd3402b463e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14dded2c4ac54ab4b1fbdd3402b463e7"}]}] Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerGroup264TestJSON-1656201669 Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 14dded2c4ac54ab4b1fbdd3402b463e7 Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1656201669 Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerGroup264TestJSON-1656201669-project Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: bd655953c3e34c759a4bd52e0121d54e Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerGroup264TestJSON-1656201669-project Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance group 840887fc-67ed-49f6-8061-d817aa6f79f9 could not be found. Oct 31 15:22:52.938886 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '840887fc-67ed-49f6-8061-d817aa6f79f9'} Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 840887fc-67ed-49f6-8061-d817aa6f79f9 could not be found. Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:52.939904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 840887fc-67ed-49f6-8061-d817aa6f79f9 could not be found. Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 840887fc-67ed-49f6-8061-d817aa6f79f9 could not be found. Oct 31 15:22:52.941402 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:22:52.942612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8d1b7b4-b102-4c93-8ed3-f5febeaecb3c tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] Returning 404 to user: Instance group 840887fc-67ed-49f6-8061-d817aa6f79f9 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:22:52.942612 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8d1b7b4-b102-4c93-8ed3-f5febeaecb3c tempest-ServerGroup264TestJSON-1656201669 tempest-ServerGroup264TestJSON-1656201669-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/840887fc-67ed-49f6-8061-d817aa6f79f9" status: 404 len: 117 microversion: 2.64 time: 0.025568 Oct 31 15:22:52.942612 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 839/1575] 10.222.0.20 () {60 vars in 1307 bytes} [Mon Oct 31 15:22:52 2022] DELETE /compute/v2.1/os-server-groups/840887fc-67ed-49f6-8061-d817aa6f79f9 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:22:53.042230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:53.053527 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7e5cffb-98e9-413e-b9b5-5d678870a67d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 1.029199 Oct 31 15:22:53.055027 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 737/1576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:52 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:53.230480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:53.231688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:53.261543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:53.262400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:53.262945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:53.263983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:53.264626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:53.265295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:53.536559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:53.537598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:53.559464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:53.560150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:53.561280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:53.562382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:53.576109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:53.576854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.284642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:54.358614 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a66eda7-dbfe-4c67-8104-f25953a5d71b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 1.145196 Oct 31 15:22:54.359206 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 840/1577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:53 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:54.369029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ecd9319f-0989-40ec-9e7e-0d4a710970fb req-209281b8-f421-435e-9173-51d639892328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34017fcd-17ac-42cc-b924-4c2519a21f0c", "name": "network-vif-deleted", "tag": "d4e2d90d-8190-4cbd-a7bf-d295ce2c356e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:54.425927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ecd9319f-0989-40ec-9e7e-0d4a710970fb req-209281b8-f421-435e-9173-51d639892328 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.427031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ecd9319f-0989-40ec-9e7e-0d4a710970fb req-209281b8-f421-435e-9173-51d639892328 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.428161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ecd9319f-0989-40ec-9e7e-0d4a710970fb req-209281b8-f421-435e-9173-51d639892328 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.447349 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ecd9319f-0989-40ec-9e7e-0d4a710970fb req-209281b8-f421-435e-9173-51d639892328 service nova] Creating event network-vif-deleted:d4e2d90d-8190-4cbd-a7bf-d295ce2c356e for instance 34017fcd-17ac-42cc-b924-4c2519a21f0c on n-h2-858384-17 Oct 31 15:22:54.456434 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ecd9319f-0989-40ec-9e7e-0d4a710970fb req-209281b8-f421-435e-9173-51d639892328 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094319 Oct 31 15:22:54.459315 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 841/1578] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:54.470231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:54.471283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:54.480627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.481408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.482024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.482980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.483660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.484689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.717727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:54.726141 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-88af34d1-b258-4e03-8d84-a6f8674ba7c5 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1266 microversion: 2.1 time: 0.265235 Oct 31 15:22:54.730172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:54.739332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:54.742641 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 842/1579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:54 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:54.748624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:54.753765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:54.758170 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3978ff25-6aae-4708-a8bb-ccbf43addf99 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1569 microversion: 2.25 time: 1.230364 Oct 31 15:22:54.759360 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 738/1580] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:53 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1569 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:54.762651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:54.779130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.780967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.781699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.783286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.785109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.786558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.904442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b6cf7190-dafa-48cc-8a2e-ea9a0eafb12c req-881fc141-20ec-44f4-b4c9-893cce84dd0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "name": "network-vif-plugged", "status": "completed", "tag": "3911a063-e5a3-4643-b9f9-9a8f7991ddcf"}, {"server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "name": "network-vif-plugged", "status": "completed", "tag": "21e9a392-5cb7-4937-9ecb-e5668f0d9d46"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:54.919214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:54.927625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b6cf7190-dafa-48cc-8a2e-ea9a0eafb12c req-881fc141-20ec-44f4-b4c9-893cce84dd0a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:54.928428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b6cf7190-dafa-48cc-8a2e-ea9a0eafb12c req-881fc141-20ec-44f4-b4c9-893cce84dd0a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:54.928974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b6cf7190-dafa-48cc-8a2e-ea9a0eafb12c req-881fc141-20ec-44f4-b4c9-893cce84dd0a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:54.955965 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b6cf7190-dafa-48cc-8a2e-ea9a0eafb12c req-881fc141-20ec-44f4-b4c9-893cce84dd0a service nova] Creating event network-vif-plugged:3911a063-e5a3-4643-b9f9-9a8f7991ddcf for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:22:54.961848 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b6cf7190-dafa-48cc-8a2e-ea9a0eafb12c req-881fc141-20ec-44f4-b4c9-893cce84dd0a service nova] Creating event network-vif-plugged:21e9a392-5cb7-4937-9ecb-e5668f0d9d46 for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:22:54.971156 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b6cf7190-dafa-48cc-8a2e-ea9a0eafb12c req-881fc141-20ec-44f4-b4c9-893cce84dd0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070739 Oct 31 15:22:54.976175 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 739/1581] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:55.341907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:55.356329 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b864de22-1d9c-4884-b8fd-0fc9e576e708 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.612201 Oct 31 15:22:55.370040 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 843/1582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:54 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:55.386382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:55.387312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:55.410375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.411110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.411927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.412838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.415300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.417699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.519037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1408876675", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "95a68319-1b18-4de1-8444-da4272667e8a"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:55.615720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] validate_networks() for [('95a68319-1b18-4de1-8444-da4272667e8a', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:22:55.916052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:55.933351 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be2c28eb-ec2f-4c5b-baf2-89d7b9bf485c tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1355 microversion: 2.1 time: 0.551767 Oct 31 15:22:55.935729 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 740/1583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:55 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1355 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:55.941976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:55.943652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:55.954642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.955704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.956455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:55.957846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:55.958579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:55.959183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:56.333165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:56.342627 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9439442-1ad1-44fd-982c-b5f756b5f84a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1308 microversion: 2.1 time: 0.405397 Oct 31 15:22:56.343423 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 741/1584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:55 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:56.351594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:56.353150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:56.360786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:56.361590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:56.362838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:56.365155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:56.365793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:56.366379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:56.742382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:56.755482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:56.757494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:56.759292 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4fbd24f4-b061-4c0d-8c67-ec6974aa054c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1544 microversion: 2.25 time: 0.414500 Oct 31 15:22:56.783790 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 742/1585] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:56 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1544 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:56.790286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:56.791706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:56.833550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:56.834494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:56.836563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:56.841292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:56.848008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:56.849973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.159580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:57.174483 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b51c6067-2dfb-43da-8ae4-0c07b552477c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.389132 Oct 31 15:22:57.175723 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 743/1586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:56 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:57.180290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f69b3eb-efa6-4e9d-83e5-199b787f869b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '.version_select at 0x7f16e0fdda60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:57.188530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f69b3eb-efa6-4e9d-83e5-199b787f869b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.193544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f69b3eb-efa6-4e9d-83e5-199b787f869b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.194315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f69b3eb-efa6-4e9d-83e5-199b787f869b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.217869 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f69b3eb-efa6-4e9d-83e5-199b787f869b tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2380 microversion: 2.25 time: 0.040815 Oct 31 15:22:57.218746 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 744/1587] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Oct 31 15:22:57 2022] GET /compute/v2.1/os-migrations => generated 2380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:57.224517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:57.225603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:57.233221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.233956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.234565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.235473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.236396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.236991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.616354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:57.632126 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64dd6e19-b082-401b-a0f8-bf37f4e2ac61 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1804 microversion: 2.1 time: 0.407849 Oct 31 15:22:57.657767 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 745/1588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:57 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1804 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:57.678878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:57.681458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:57.695542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.697085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.697911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.698863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:57.699540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:57.701943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:57.968296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid cb133a9d-fd24-477f-bfd0-31c7e301802d {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:22:58.027091 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c4578e7-ce3f-442d-9779-468e26aa1073 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 2039 microversion: 2.25 time: 0.367396 Oct 31 15:22:58.028707 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 746/1589] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:22:57 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 2039 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:22:58.066534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:58.070485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:58.087430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.092296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.093063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.094189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.094885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.095574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.435992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:22:58.436563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:22:58.437008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:22:58.437541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:22:58.438089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:22:58.441914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:58.455123 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef201823-479e-4456-99cf-10f8a7546270 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1308 microversion: 2.1 time: 0.422407 Oct 31 15:22:58.467886 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 747/1590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:58 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:58.473934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea3f5e5a-1a7e-4e51-81dc-d11fac3df73b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:58.474673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea3f5e5a-1a7e-4e51-81dc-d11fac3df73b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:58.484522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.485019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.485481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.486300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.486762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.487189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.505790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea3f5e5a-1a7e-4e51-81dc-d11fac3df73b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.506588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea3f5e5a-1a7e-4e51-81dc-d11fac3df73b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.507216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea3f5e5a-1a7e-4e51-81dc-d11fac3df73b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.508172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea3f5e5a-1a7e-4e51-81dc-d11fac3df73b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.509912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea3f5e5a-1a7e-4e51-81dc-d11fac3df73b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.510546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea3f5e5a-1a7e-4e51-81dc-d11fac3df73b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.551849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Getting quotas for project fcce475650d3431183d58264fb3f6c28. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:58.568228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Getting quotas for user 424d514ff89b4b5795394b8bf0bad558 and project fcce475650d3431183d58264fb3f6c28. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:58.585419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea3f5e5a-1a7e-4e51-81dc-d11fac3df73b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff/ips" status: 200 len: 217 microversion: 2.1 time: 0.115153 Oct 31 15:22:58.586025 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 748/1591] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:22:58 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff/ips => generated 217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:22:58.608111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60d507f1-161f-4840-84c4-beb739a3691e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Action: 'create', calling method: .version_select at 0x7f16e168a670>, body: {"keypair": {"name": "tempest-keypair-1056490735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLywDMa7fM59x/GackXhhW4B2BXieXrCxTuskVwGlQoH3s4XLLuvezGuC6sWLckkyV3vg5imayWl1wZs6iGI6tcqsPloM56LeODikIdP9P0snFKkQUzlxaggNosE2Jc0OQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:22:58.622337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:58.624157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:22:58.632130 n-d-858384-17 devstack@n-api.service[120587]: WARNING nova.utils [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1408876675 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-140887667 Oct 31 15:22:58.633197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:22:58.688013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-60d507f1-161f-4840-84c4-beb739a3691e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:22:58.694089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-60d507f1-161f-4840-84c4-beb739a3691e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for user 676d4f2214e848c0aa654f0863b9f4a4 and project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:22:58.761243 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60d507f1-161f-4840-84c4-beb739a3691e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.174014 Oct 31 15:22:58.762142 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 749/1592] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 31 15:22:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:22:58.766837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:58.772671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:58.778288 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5e9cbf91-4a95-4906-90c3-c0345a0a7350 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.380299 Oct 31 15:22:58.785439 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 844/1593] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:22:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:22:58.787625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.788332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.788958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.789929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.790600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.791748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.799777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:58.800345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:58.819401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.820036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.820510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.825923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:58.827548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:58.828595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:58.881795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:22:58.897310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:22:59.106451 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21455371-4396-4048-99d6-6d9d489853de tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 204 len: 0 microversion: 2.1 time: 0.319655 Oct 31 15:22:59.107791 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 845/1594] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:22:58 2022] DELETE /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:22:59.116472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09adb114-2ab1-4e79-abbb-e82375ac8629 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:59.117299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09adb114-2ab1-4e79-abbb-e82375ac8629 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:59.265084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:59.277185 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34ba43be-f9d7-4b29-adff-34f9dc1d5a1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.513533 Oct 31 15:22:59.283877 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 750/1595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:58 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:59.296522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:59.297719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:59.314841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.315943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.316848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.319040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.319789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.322036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.886435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-09adb114-2ab1-4e79-abbb-e82375ac8629 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:22:59.898613 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09adb114-2ab1-4e79-abbb-e82375ac8629 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1232 microversion: 2.1 time: 0.789484 Oct 31 15:22:59.902956 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 846/1596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:59 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1232 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:22:59.916710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:22:59.918030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:22:59.933348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.935322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.938608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:22:59.940218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:22:59.941345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:22:59.941948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:00.095667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:00.257502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:00.271417 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-82689a23-3d69-49dd-b6d9-0d973733456d tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1810 microversion: 2.1 time: 0.985862 Oct 31 15:23:00.276927 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 751/1597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:59 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1810 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:00.305088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:00.305973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:00.354806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.356517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.358507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:00.359734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.361331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.362090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:00.689833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:00.700894 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fced31e3-979f-4ff1-9839-6920266cc206 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.400215 Oct 31 15:23:00.717573 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 752/1598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:00 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:00.789001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:00.807345 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5abc984-5b37-44fa-b77e-906e38c25470 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1308 microversion: 2.1 time: 0.902222 Oct 31 15:23:00.808376 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 847/1599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:22:59 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1308 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:00.931524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:00.934276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:00.947705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.950989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.952933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:00.956051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:00.958817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:00.959432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.219918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:01.222882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:01.248410 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c89d1400-b635-4a7a-b542-cb77f6dd812f tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1292 microversion: 2.1 time: 0.320412 Oct 31 15:23:01.252683 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 753/1600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:00 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1292 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:01.301379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:01.302158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:01.311299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.318056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.318911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.320118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.320828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.324534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.729666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:01.730303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:01.773418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.774002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.777454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:01.792131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:01.793666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:01.794615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.473407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:02.500497 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb8450fd-41d6-4872-af89-0830d36b021e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.768434 Oct 31 15:23:02.502345 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 754/1601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:01 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:02.550437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:02.551532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:02.570521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.572443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.573746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.574696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.579135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.579653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.693512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:02.703888 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f24dd3a-845f-4222-b2b1-05c862cdec32 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1810 microversion: 2.1 time: 1.407077 Oct 31 15:23:02.705102 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 848/1602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:01 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1810 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:02.710920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:02.711989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:02.732709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.733425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.735350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.736404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:02.737619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:02.738300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:02.962032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:02.973319 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea84b9f3-5c91-47af-b301-adb46277d5ec tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1290 microversion: 2.1 time: 0.266785 Oct 31 15:23:02.992896 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 849/1603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:02 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1290 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:03.000586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fbd722b5-692e-49e9-a63c-4b5f26542c3c req-570ce925-7796-4d48-9d81-8af1613e5e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "name": "network-vif-deleted", "tag": "21e9a392-5cb7-4937-9ecb-e5668f0d9d46"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:03.025080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fbd722b5-692e-49e9-a63c-4b5f26542c3c req-570ce925-7796-4d48-9d81-8af1613e5e35 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.026176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fbd722b5-692e-49e9-a63c-4b5f26542c3c req-570ce925-7796-4d48-9d81-8af1613e5e35 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.028946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fbd722b5-692e-49e9-a63c-4b5f26542c3c req-570ce925-7796-4d48-9d81-8af1613e5e35 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.051215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fbd722b5-692e-49e9-a63c-4b5f26542c3c req-570ce925-7796-4d48-9d81-8af1613e5e35 service nova] Creating event network-vif-deleted:21e9a392-5cb7-4937-9ecb-e5668f0d9d46 for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:23:03.067637 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fbd722b5-692e-49e9-a63c-4b5f26542c3c req-570ce925-7796-4d48-9d81-8af1613e5e35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072623 Oct 31 15:23:03.068699 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 850/1604] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:03.177093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-04e980cb-5d56-4d5d-99b4-45232d465044 req-fd565b13-26d9-4b27-b5d0-de399f11bd85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbd9582-09fc-4113-9a9d-99f6c6a894c4", "tag": "f43de6e8-275d-4dcf-bbfb-2acb88431dd6"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:03.189929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04e980cb-5d56-4d5d-99b4-45232d465044 req-fd565b13-26d9-4b27-b5d0-de399f11bd85 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.190413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04e980cb-5d56-4d5d-99b4-45232d465044 req-fd565b13-26d9-4b27-b5d0-de399f11bd85 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.190841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04e980cb-5d56-4d5d-99b4-45232d465044 req-fd565b13-26d9-4b27-b5d0-de399f11bd85 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.217183 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-04e980cb-5d56-4d5d-99b4-45232d465044 req-fd565b13-26d9-4b27-b5d0-de399f11bd85 service nova] Creating event network-changed:f43de6e8-275d-4dcf-bbfb-2acb88431dd6 for instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 on n-h2-858384-17 Oct 31 15:23:03.224239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-04e980cb-5d56-4d5d-99b4-45232d465044 req-fd565b13-26d9-4b27-b5d0-de399f11bd85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153843 Oct 31 15:23:03.225006 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 851/1605] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:03.309965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:03.348993 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-08f52b2b-ca8e-4f43-acec-879fa88b08c6 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1308 microversion: 2.1 time: 0.813287 Oct 31 15:23:03.355166 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 755/1606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:02 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1308 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:03.528334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:03.529045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:03.547647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.548143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.548581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.549487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.549838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.550239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.733371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:03.735233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:03.742080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.742960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.743566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:03.745644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:03.746324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:03.746941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.066115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:04.079975 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff346f58-047e-4c12-9e89-cf7135afa907 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.558686 Oct 31 15:23:04.081868 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 852/1607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:03 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:04.095982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:04.096817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:04.105954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.106637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.107275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.108160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.108779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.109406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.408499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:04.439478 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5fac5f1-8fef-4c82-a021-4a9266c916f0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1675 microversion: 2.1 time: 0.709203 Oct 31 15:23:04.440650 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 756/1608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:03 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1675 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:04.457825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:04.458673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:04.459599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:04.470397 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bd9b4e0-d002-4763-8d35-fe32e5beb4e5 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1332 microversion: 2.1 time: 0.386941 Oct 31 15:23:04.489957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.492158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.493566 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 853/1609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:04 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1332 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:04.495564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.496784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:04.498721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:04.523804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:04.799527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-212058826", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "21925cce-417c-497a-868e-676a18905b25"}], "block_device_mapping_v2": [{"uuid": "6944ee32-f5cf-452a-b17a-c1aa9b5d5719", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:04.919338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] validate_networks() for [('21925cce-417c-497a-868e-676a18905b25', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:05.267462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:05.281462 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f42c1a4a-5c19-47f1-b74d-5496d07524c9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1308 microversion: 2.1 time: 0.838021 Oct 31 15:23:05.282297 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 757/1610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:04 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1308 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:05.287315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9dfa74a1-6ec2-43f2-b76a-8c4d71309659 req-fc2abbf8-bc27-47bd-bb72-ac828c3cda37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "name": "network-vif-unplugged", "status": "completed", "tag": "3911a063-e5a3-4643-b9f9-9a8f7991ddcf"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:05.298616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9dfa74a1-6ec2-43f2-b76a-8c4d71309659 req-fc2abbf8-bc27-47bd-bb72-ac828c3cda37 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.299379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9dfa74a1-6ec2-43f2-b76a-8c4d71309659 req-fc2abbf8-bc27-47bd-bb72-ac828c3cda37 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.299812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9dfa74a1-6ec2-43f2-b76a-8c4d71309659 req-fc2abbf8-bc27-47bd-bb72-ac828c3cda37 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.321025 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9dfa74a1-6ec2-43f2-b76a-8c4d71309659 req-fc2abbf8-bc27-47bd-bb72-ac828c3cda37 service nova] Creating event network-vif-unplugged:3911a063-e5a3-4643-b9f9-9a8f7991ddcf for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:23:05.328783 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9dfa74a1-6ec2-43f2-b76a-8c4d71309659 req-fc2abbf8-bc27-47bd-bb72-ac828c3cda37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044877 Oct 31 15:23:05.329946 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 758/1611] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:05.339220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:05.340087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:05.348568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.349275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.350002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.350809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.351563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.352352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.800025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:05.825045 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa62efd6-62e7-499c-bc23-6ede46504b7b tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.493775 Oct 31 15:23:05.847085 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 759/1612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:05 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:05.858388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2448c773-a4df-4a79-850c-1799347a4a5f req-68032d80-354b-4503-bcb8-ea846083f73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "name": "network-vif-deleted", "tag": "4078c6bc-c9e1-4ce2-aaf7-7bb76f9f0c37"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:05.874703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2448c773-a4df-4a79-850c-1799347a4a5f req-68032d80-354b-4503-bcb8-ea846083f73c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.875549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2448c773-a4df-4a79-850c-1799347a4a5f req-68032d80-354b-4503-bcb8-ea846083f73c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.876225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2448c773-a4df-4a79-850c-1799347a4a5f req-68032d80-354b-4503-bcb8-ea846083f73c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.909408 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2448c773-a4df-4a79-850c-1799347a4a5f req-68032d80-354b-4503-bcb8-ea846083f73c service nova] Creating event network-vif-deleted:4078c6bc-c9e1-4ce2-aaf7-7bb76f9f0c37 for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:23:05.917545 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2448c773-a4df-4a79-850c-1799347a4a5f req-68032d80-354b-4503-bcb8-ea846083f73c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067381 Oct 31 15:23:05.919331 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 760/1613] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:05.927835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:05.928973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:05.939701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.940692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.942358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.944248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:05.944948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:05.945623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:05.981343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:05.981921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:05.982402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:05.982821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:05.983285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:06.008533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.009877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.010984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.012053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.014087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.014739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.038897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for project 330c65ee73534d8080c0ec2441c55f16. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:06.050532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Getting quotas for user 02e166a77a2c45ccab7a1f343e53542e and project 330c65ee73534d8080c0ec2441c55f16. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:06.193009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:06.204221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6944ee32-f5cf-452a-b17a-c1aa9b5d5719',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:06.443183 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccf89167-3be0-4121-90eb-08e407befe7c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.648165 Oct 31 15:23:06.447317 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 854/1614] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:06.463063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:06.465889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:06.481688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.485418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.486084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.490308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:06.491227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:06.492092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:06.986876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:06.999855 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f42de090-1fd3-4ea9-8513-ee386ca6777e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1654 microversion: 2.1 time: 1.078253 Oct 31 15:23:07.004697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 761/1615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:05 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1654 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:07.014019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1582423967", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "bf5d2157-6069-42f8-b335-fc42f2652c58"}], "security_groups": [{"name": "tempest-securitygroup--189870591"}], "key_name": "tempest-keypair-1056490735", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:07.021110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:07.037897 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da449d25-4fe8-4b1c-ac3b-d48fb5958ade tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1332 microversion: 2.1 time: 0.583613 Oct 31 15:23:07.042073 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 855/1616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:06 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1332 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:07.049376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:07.051886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.076082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.077419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.078858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.082736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.083454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.084104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.578856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:07.594168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] validate_networks() for [('bf5d2157-6069-42f8-b335-fc42f2652c58', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:07.602602 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cee89683-d7bb-466e-99a8-91bba7712fd9 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1308 microversion: 2.1 time: 0.559129 Oct 31 15:23:07.618893 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 856/1617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:07 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1308 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:07.628763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:07.629838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.641671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.643180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.643846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.644770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.645572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.646213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.744166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:07.769299 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53bf48b3-8ca6-4c92-a5fd-5c521e7b1a83 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1094 microversion: 2.1 time: 0.144939 Oct 31 15:23:07.770850 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 857/1618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:07 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1094 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:07.777780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:07.779558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:07.788571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.789558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.791235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:07.792664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:07.793672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:07.794359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:08.089307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:08.099257 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4af4d512-6d43-491c-b83e-ce9f3c139b1c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.327027 Oct 31 15:23:08.100429 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 858/1619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:07 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:08.123247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0555d137-b1c9-4aae-ae90-6d424763d250 req-828852e3-e13c-4c93-8319-8280888cf26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5824db-4ae4-4ffa-a7d9-200dcf2289ff", "name": "network-vif-deleted", "tag": "3911a063-e5a3-4643-b9f9-9a8f7991ddcf"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:08.133028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0555d137-b1c9-4aae-ae90-6d424763d250 req-828852e3-e13c-4c93-8319-8280888cf26d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:08.133663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0555d137-b1c9-4aae-ae90-6d424763d250 req-828852e3-e13c-4c93-8319-8280888cf26d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:08.134281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0555d137-b1c9-4aae-ae90-6d424763d250 req-828852e3-e13c-4c93-8319-8280888cf26d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:08.180083 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0555d137-b1c9-4aae-ae90-6d424763d250 req-828852e3-e13c-4c93-8319-8280888cf26d service nova] Creating event network-vif-deleted:3911a063-e5a3-4643-b9f9-9a8f7991ddcf for instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff on n-h2-858384-17 Oct 31 15:23:08.189110 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0555d137-b1c9-4aae-ae90-6d424763d250 req-828852e3-e13c-4c93-8319-8280888cf26d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070253 Oct 31 15:23:08.193550 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 859/1620] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:08.202392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:08.203404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:08.238837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:08.248226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:08.249881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:08.252168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:08.254522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:08.255239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:08.324451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:08.325072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:08.325798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:08.326457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lazy-loading 'fault' on Instance uuid 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:23:08.407941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:08.435765 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0beaca2-3bb7-42e7-84e2-0e258438e8ab tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 200 len: 1303 microversion: 2.1 time: 0.236045 Oct 31 15:23:08.436996 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 860/1621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:08 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:08.459817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:08.462592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:08.488558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:08.490435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:08.491231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:08.495509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:08.496327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:08.499495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:08.725075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:08.730609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=18 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:08.738671 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5851ecbf-2c4e-4b46-aad5-4c15579951ba tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1332 microversion: 2.1 time: 0.290108 Oct 31 15:23:08.740287 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 861/1622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:08 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1332 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:08.753993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:08.756877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:08.771988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:08.773519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:08.776445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:08.777340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:08.778988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:08.779475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.190728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:09.200587 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-271e7a23-cacc-4a3d-96cd-41bc350a9406 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1308 microversion: 2.1 time: 0.455904 Oct 31 15:23:09.207752 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 862/1623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:08 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:09.220678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:09.221737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:09.230639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.231228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.232677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.234733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.235982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.237802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.365359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:09.370162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:09.376283 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b78b843-33ba-473d-aa1a-e6be89f4ec0c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1158 microversion: 2.1 time: 0.166818 Oct 31 15:23:09.378227 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 863/1624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:09 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1158 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:09.383347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:09.384809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:09.409274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.409994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.410875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.411923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.412564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.413204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.698397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:09.702823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:09.703255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:09.703988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:09.705180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:09.705619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:09.725625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.726195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.726640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.727381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.728620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.729067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.729788 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8eb43521-0383-463e-a33c-338685d78496 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.346627 Oct 31 15:23:09.745656 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 864/1625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:09 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:09.753208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:09.755997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:09.780072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.780585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.785327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:09.794172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.795127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.795625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.796073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.797141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for user 676d4f2214e848c0aa654f0863b9f4a4 and project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:09.830264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:09.832893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:09.862104 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] HTTP exception thrown: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Request method failure captured: Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff HTTP/1.1 Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gMmYCZMfCBoXekqAC4nsxmyzv2-CSLPHESFTrzM9KDwvQ5paFaNmMK0amyBoHgZbz4-PTISYBuHZErcW20WNWw1bMPC82aFmcV9XdBSy1-1fbEI2Uh-RWfm0Ed_4O6gOhKJS4U0KNqi3IFQhAlLdF-neLlx2Pahz-F5939z1kAZXE Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:09.866021 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684abec7b7d6434bba2ef0e09aa1f5b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684abec7b7d6434bba2ef0e09aa1f5b5"}]}] Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestMultiNic-357236422 Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestMultiNic-357236422-project Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c2d979b14bbf4bb38564f46273334271 Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestMultiNic-357236422-project Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:23:09.867886 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '6a5824db-4ae4-4ffa-a7d9-200dcf2289ff'} Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:09.874223 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:23:09.875893 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:09.877342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Returning 404 to user: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:09.878974 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4df20f6c-bbc7-4a04-9021-ab19c462d4be tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 404 len: 111 microversion: 2.1 time: 0.136269 Oct 31 15:23:09.885266 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 865/1626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:09 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:09.891381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:09.892005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:09.899438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.900042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.900546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.901295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:09.901756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:09.902238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:09.953393 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96d7c3e2-a5a2-423a-a46d-be79e0ab11db tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 2.946785 Oct 31 15:23:09.957866 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 762/1627] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:23:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 2952 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:23:09.969271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00d2b694-c66e-4562-952d-b0e822fd4d07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:09.970374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00d2b694-c66e-4562-952d-b0e822fd4d07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:10.138262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00d2b694-c66e-4562-952d-b0e822fd4d07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:10.146098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00d2b694-c66e-4562-952d-b0e822fd4d07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:10.147587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00d2b694-c66e-4562-952d-b0e822fd4d07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:10.148715 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00d2b694-c66e-4562-952d-b0e822fd4d07 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1286 microversion: 2.25 time: 0.183631 Oct 31 15:23:10.160697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 763/1628] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:09 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1286 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:23:10.230710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:10.231650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:10.242140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.244299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.247285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.248161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.248749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.250677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.467731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:10.477167 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8dcdc268-4ca4-42cb-9f39-945e3e016e4b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1332 microversion: 2.1 time: 0.590353 Oct 31 15:23:10.480289 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 866/1629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:09 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1332 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:10.485808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d0fb1e43-f8ff-4193-b533-b97e00c09781 req-67274c42-c2c3-4729-9860-ac95e59a1ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1fb23b1-7ddc-4acb-becb-aac4d9884e7c", "tag": "5716d5ab-5829-43d1-b848-520b1e2c399f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:10.514913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0fb1e43-f8ff-4193-b533-b97e00c09781 req-67274c42-c2c3-4729-9860-ac95e59a1ffb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.515774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0fb1e43-f8ff-4193-b533-b97e00c09781 req-67274c42-c2c3-4729-9860-ac95e59a1ffb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.516415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0fb1e43-f8ff-4193-b533-b97e00c09781 req-67274c42-c2c3-4729-9860-ac95e59a1ffb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.547891 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d0fb1e43-f8ff-4193-b533-b97e00c09781 req-67274c42-c2c3-4729-9860-ac95e59a1ffb service nova] Creating event network-changed:5716d5ab-5829-43d1-b848-520b1e2c399f for instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c on n-h1-858384-17 Oct 31 15:23:10.570867 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d0fb1e43-f8ff-4193-b533-b97e00c09781 req-67274c42-c2c3-4729-9860-ac95e59a1ffb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088280 Oct 31 15:23:10.581193 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 867/1630] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:10.587834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:10.589360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:10.600319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.601600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.604568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.605645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.606949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.608288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.761355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:10.794790 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60671e7d-2489-4cae-a974-dde7152cc73a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1168 microversion: 2.1 time: 0.193232 Oct 31 15:23:10.810360 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 868/1631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:10 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1168 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:10.818152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:10.825967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:10.838337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.839112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.839738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:10.840599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:10.853982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:10.855450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.108274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:11.139077 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9eaaa503-d9ac-4133-a469-9bf3423de15e tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1308 microversion: 2.1 time: 0.912770 Oct 31 15:23:11.172392 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 764/1632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:10 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1308 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:11.200257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d8e70346-e810-4be8-b759-795317aa0cbd req-e62f3993-ca04-469f-a666-511ff9a8563a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd9582-09fc-4113-9a9d-99f6c6a894c4", "name": "network-vif-plugged", "status": "completed", "tag": "f43de6e8-275d-4dcf-bbfb-2acb88431dd6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:11.232287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d8e70346-e810-4be8-b759-795317aa0cbd req-e62f3993-ca04-469f-a666-511ff9a8563a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.233263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d8e70346-e810-4be8-b759-795317aa0cbd req-e62f3993-ca04-469f-a666-511ff9a8563a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.234084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d8e70346-e810-4be8-b759-795317aa0cbd req-e62f3993-ca04-469f-a666-511ff9a8563a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.253742 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d8e70346-e810-4be8-b759-795317aa0cbd req-e62f3993-ca04-469f-a666-511ff9a8563a service nova] Creating event network-vif-plugged:f43de6e8-275d-4dcf-bbfb-2acb88431dd6 for instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 on n-h2-858384-17 Oct 31 15:23:11.263458 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d8e70346-e810-4be8-b759-795317aa0cbd req-e62f3993-ca04-469f-a666-511ff9a8563a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086266 Oct 31 15:23:11.264591 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 765/1633] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:11.272263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:11.273382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:11.296442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.297230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.297901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.298790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.299419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.300665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.504312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:11.518317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:11.522405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:11.526834 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d0ee8e4-b993-40e5-b5aa-5019f3944708 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1282 microversion: 2.25 time: 0.260486 Oct 31 15:23:11.527331 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 766/1634] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:11 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1282 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:11.542158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:11.546996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:11.563325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.564064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.564695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.565607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.567200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.576154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.743007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:11.752361 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bf08f887-75fa-43ee-9db0-90a43bc8216a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.944541 Oct 31 15:23:11.756799 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 869/1635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:10 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:11.822677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:11.823717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:11.835626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.836416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.837115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.838034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:11.839793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:11.840409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:11.972005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:11.983618 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b410f213-570b-402e-965b-842bf66ebea2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1168 microversion: 2.1 time: 0.164741 Oct 31 15:23:11.985951 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 870/1636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:11 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1168 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:12.165891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:12.167640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:12.190596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.192174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.195362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.196463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.197111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.198810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.380492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:12.405481 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-340f3f93-0283-4215-a5aa-d05d971bd6b0 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1332 microversion: 2.1 time: 0.873922 Oct 31 15:23:12.408135 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 767/1637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:11 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1332 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:12.558405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:12.559289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:12.577605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.578289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.578892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.580348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.581089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.582243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.717848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:12.739593 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d445d977-7809-4019-8563-3d4ef1d96b11 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1308 microversion: 2.1 time: 0.578429 Oct 31 15:23:12.745087 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 871/1638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:12 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:12.756455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:12.768290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:12.771283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:12.776889 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5db2acb-6b8b-4473-8917-236a7f98c179 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1356 microversion: 2.25 time: 0.222431 Oct 31 15:23:12.777536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:12.778153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:12.779128 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 768/1639] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:12 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1356 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:23:12.797005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.801645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.802128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:12.802892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:12.803379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:12.803806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.009988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:13.010602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:13.026348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.026843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.027295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.041413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.042581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.056799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.433409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:13.448181 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef687ab5-3219-4a58-a2ac-01507a6a0a58 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.675937 Oct 31 15:23:13.450847 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 872/1640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:12 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:13.457365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:13.458219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:13.468306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.468877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.469401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.470232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.470762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.471248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.752504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:13.761737 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f0bd9d5-cff3-48bf-8bda-a52000bc656d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1210 microversion: 2.1 time: 0.756013 Oct 31 15:23:13.776637 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 769/1641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:13 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1210 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:13.783599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:13.785375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:13.794896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.795773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.796455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:13.798963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:13.800212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:13.800882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.262593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:14.270525 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87e12a12-32d6-414c-841c-e32c432fbba3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1332 microversion: 2.1 time: 0.818110 Oct 31 15:23:14.271123 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 873/1642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:13 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1332 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:14.282574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:14.283524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:14.295645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.296435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.297094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.297995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.298610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.299192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.389527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:14.408089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:14.409997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:14.411649 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9047cc2d-9a58-4a68-ba42-d88f93a36575 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1344 microversion: 2.25 time: 0.135267 Oct 31 15:23:14.412761 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 874/1643] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:14 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1344 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:14.475626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:14.476632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:14.488743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.489645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.490325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.491282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.492072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.495208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.911636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:14.929529 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2179caa-d999-4fd9-9e00-e8ca0f969f55 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1489 microversion: 2.1 time: 1.149677 Oct 31 15:23:14.932225 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 770/1644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:13 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1489 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:14.936866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:14.937500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:14.959731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.960267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.960706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.961527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:14.962158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:14.963057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:14.973697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:14.981758 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-095674fc-1102-4213-9ca5-3e4fb6308ac4 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.509802 Oct 31 15:23:14.986463 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 875/1645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:14 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:14.991743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2036322e-e721-48a1-a80d-84dd37737f99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-483744226"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:15.002404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2036322e-e721-48a1-a80d-84dd37737f99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:15.018940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2036322e-e721-48a1-a80d-84dd37737f99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.021756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2036322e-e721-48a1-a80d-84dd37737f99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.023240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2036322e-e721-48a1-a80d-84dd37737f99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.024277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2036322e-e721-48a1-a80d-84dd37737f99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.025186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2036322e-e721-48a1-a80d-84dd37737f99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.026673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2036322e-e721-48a1-a80d-84dd37737f99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.507363 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2036322e-e721-48a1-a80d-84dd37737f99 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "POST /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4/action" status: 202 len: 0 microversion: 2.1 time: 0.519176 Oct 31 15:23:15.516248 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 876/1646] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:14 2022] POST /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:23:15.559896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:15.570115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:15.594690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.599903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.600561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.602123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.605971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.606602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.634829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:15.650219 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83f27bc7-4834-4d79-b15d-1077f18f9d8b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1210 microversion: 2.1 time: 0.716855 Oct 31 15:23:15.664515 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 771/1647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:14 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1210 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:15.669851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b1066460-9402-479d-abcd-0bb2d7307af9 req-89f90613-6061-4793-8acb-04f7771bf7e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fb23b1-7ddc-4acb-becb-aac4d9884e7c", "name": "network-vif-plugged", "status": "completed", "tag": "5716d5ab-5829-43d1-b848-520b1e2c399f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:15.694673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b1066460-9402-479d-abcd-0bb2d7307af9 req-89f90613-6061-4793-8acb-04f7771bf7e4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.695159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b1066460-9402-479d-abcd-0bb2d7307af9 req-89f90613-6061-4793-8acb-04f7771bf7e4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.695629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b1066460-9402-479d-abcd-0bb2d7307af9 req-89f90613-6061-4793-8acb-04f7771bf7e4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.723180 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b1066460-9402-479d-abcd-0bb2d7307af9 req-89f90613-6061-4793-8acb-04f7771bf7e4 service nova] Creating event network-vif-plugged:5716d5ab-5829-43d1-b848-520b1e2c399f for instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c on n-h1-858384-17 Oct 31 15:23:15.735533 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b1066460-9402-479d-abcd-0bb2d7307af9 req-89f90613-6061-4793-8acb-04f7771bf7e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068379 Oct 31 15:23:15.738692 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 772/1648] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:15.752283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:15.753539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:15.775271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.775776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.776221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:15.776943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:15.777432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:15.777861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:16.028448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:16.083752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=16 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:16.355096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:16.371464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:16.372939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:16.374167 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a7d9c54-6bb2-466a-9c2d-d7189fb36e95 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1411 microversion: 2.25 time: 0.634267 Oct 31 15:23:16.374751 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 773/1649] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:15 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1411 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:16.389640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0c8a8b9a-9bfd-4f57-a1bd-01c2c12f1c42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e0f86550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:16.478362 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0c8a8b9a-9bfd-4f57-a1bd-01c2c12f1c42 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408" status: 200 len: 1413 microversion: 2.1 time: 0.099414 Oct 31 15:23:16.479730 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 774/1650] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:16 2022] GET /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408 => generated 1413 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:16.492634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:16.494536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:16.502916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:16.505403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:16.506105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:16.508474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:16.514036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:16.514721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:16.587843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:16.601338 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-984e26ef-b5f6-4587-9df1-cdec2fa7065c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1332 microversion: 2.1 time: 1.081825 Oct 31 15:23:16.603818 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 877/1651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:15 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1332 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:16.795320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:16.816676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:16.826441 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9e902839-7d00-47dc-892f-04e512f1ea6e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.343558 Oct 31 15:23:16.842920 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 775/1652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:16 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:16.852840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05c4c736-1f93-4b8e-8ab0-a5efef89beed tempest-FlavorsV2NegativeTest-968298543 tempest-FlavorsV2NegativeTest-968298543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:16.855482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ad00f17-efcb-42e7-a548-cdb473525ffd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e0ff6280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:16.876555 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05c4c736-1f93-4b8e-8ab0-a5efef89beed tempest-FlavorsV2NegativeTest-968298543 tempest-FlavorsV2NegativeTest-968298543-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.260620 Oct 31 15:23:16.877287 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 878/1653] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:23:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:16.882188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:16.882790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:16.894036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:16.894580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:16.895014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:16.895720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:16.901186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:16.901654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:16.920488 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9ad00f17-efcb-42e7-a548-cdb473525ffd tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408" status: 200 len: 1413 microversion: 2.1 time: 0.076231 Oct 31 15:23:16.921723 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 776/1654] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:16 2022] GET /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:16.939076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8694e2ce-25c7-4f97-bc14-2179fe6876d1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e0f86820>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:17.256459 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8694e2ce-25c7-4f97-bc14-2179fe6876d1 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408" status: 204 len: 0 microversion: 2.1 time: 0.323306 Oct 31 15:23:17.257368 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 777/1655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:16 2022] DELETE /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:17.266892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8f6e44a6-0d9a-497c-8e93-77568ae5157a req-0065d888-cde7-4699-8353-60dcc6348d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dd3510-86d0-472f-bd84-6226b34335e3", "tag": "3f50c566-97a8-463a-ba3d-5e8786d8d971"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:17.287119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8f6e44a6-0d9a-497c-8e93-77568ae5157a req-0065d888-cde7-4699-8353-60dcc6348d43 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.287932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8f6e44a6-0d9a-497c-8e93-77568ae5157a req-0065d888-cde7-4699-8353-60dcc6348d43 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.288748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8f6e44a6-0d9a-497c-8e93-77568ae5157a req-0065d888-cde7-4699-8353-60dcc6348d43 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.304960 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8f6e44a6-0d9a-497c-8e93-77568ae5157a req-0065d888-cde7-4699-8353-60dcc6348d43 service nova] Creating event network-changed:3f50c566-97a8-463a-ba3d-5e8786d8d971 for instance b7dd3510-86d0-472f-bd84-6226b34335e3 on n-h2-858384-17 Oct 31 15:23:17.313075 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8f6e44a6-0d9a-497c-8e93-77568ae5157a req-0065d888-cde7-4699-8353-60dcc6348d43 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050554 Oct 31 15:23:17.315097 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 778/1656] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:17.324785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27956719-b9b8-4c7a-850e-b53636c43764 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e10c1160>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:17.359383 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-27956719-b9b8-4c7a-850e-b53636c43764 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Image not found. Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27956719-b9b8-4c7a-850e-b53636c43764 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408 HTTP/1.1 Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:23:17.363520 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f8af0a88-6489-4df1-9cb6-508d6aacf408'} Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:17.366350 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f8af0a88-6489-4df1-9cb6-508d6aacf408 Oct 31 15:23:17.368849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:17.371142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f8af0a88-6489-4df1-9cb6-508d6aacf408 could not be found. Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:17.374279 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:23:17.377335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:17.381941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27956719-b9b8-4c7a-850e-b53636c43764 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:17.384004 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27956719-b9b8-4c7a-850e-b53636c43764 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408" status: 404 len: 62 microversion: 2.1 time: 0.065858 Oct 31 15:23:17.385093 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 779/1657] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:17 2022] GET /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:17.395959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:17.398131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:17.410992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:17.413800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.415813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.416316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.417794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.418589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.419311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.457399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:17.467750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17eda05f-94dc-43df-bb6d-23fbd1676d11 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1210 microversion: 2.1 time: 0.589304 Oct 31 15:23:17.474179 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 879/1658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:16 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1210 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:17.480151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:17.480755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:17.489079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:17.504885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.506308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.506748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.507465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.509383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.509837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.820427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:17.832928 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5133865b-bf23-43ae-bcf5-ba49be7aedce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1507 microversion: 2.1 time: 0.443427 Oct 31 15:23:17.835161 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 780/1659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:17 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1507 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:17.842920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:17.843534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:17.869316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.871372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.872559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:17.875337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:17.875912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:17.876354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.017435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:18.039715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:18.047048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:18.051219 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-389e0ffb-b88d-4c30-922f-3a5666ac34dc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1411 microversion: 2.25 time: 0.575530 Oct 31 15:23:18.053779 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 880/1660] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:17 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1411 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:18.072054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a16afe67-a2a5-4f93-96a8-471e2f39cd9a tempest-FlavorsV2NegativeTest-968298543 tempest-FlavorsV2NegativeTest-968298543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-162078127", "imageRef": "3fbd402c-9a09-40dc-93be-87bd827cc840", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:18.158563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a16afe67-a2a5-4f93-96a8-471e2f39cd9a tempest-FlavorsV2NegativeTest-968298543 tempest-FlavorsV2NegativeTest-968298543-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:18.307487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:18.318433 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-42e70c2a-b418-43bf-8d2b-d25a28f7880b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1536 microversion: 2.1 time: 0.477822 Oct 31 15:23:18.321053 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 781/1661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:17 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1536 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:18.333746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:18.334400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:18.345577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.348409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.348897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.349691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.350105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.350702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.641284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:18.657232 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8477206a-42c6-4563-a540-21e223305821 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.334131 Oct 31 15:23:18.658485 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 782/1662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:18 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:18.666756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7071dfe1-7c4e-4d12-95d4-8cacd9a4351a req-5a983806-7240-4b3d-b40a-5ebbd9c42c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ace9f23-0d08-4d3b-8c64-dd82142559be", "tag": "c5178817-b9fc-4b5a-bd24-5ee1112ab04c"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:18.683045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7071dfe1-7c4e-4d12-95d4-8cacd9a4351a req-5a983806-7240-4b3d-b40a-5ebbd9c42c70 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.689147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7071dfe1-7c4e-4d12-95d4-8cacd9a4351a req-5a983806-7240-4b3d-b40a-5ebbd9c42c70 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.689829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7071dfe1-7c4e-4d12-95d4-8cacd9a4351a req-5a983806-7240-4b3d-b40a-5ebbd9c42c70 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.706110 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7071dfe1-7c4e-4d12-95d4-8cacd9a4351a req-5a983806-7240-4b3d-b40a-5ebbd9c42c70 service nova] Creating event network-changed:c5178817-b9fc-4b5a-bd24-5ee1112ab04c for instance 0ace9f23-0d08-4d3b-8c64-dd82142559be on n-h2-858384-17 Oct 31 15:23:18.714020 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7071dfe1-7c4e-4d12-95d4-8cacd9a4351a req-5a983806-7240-4b3d-b40a-5ebbd9c42c70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054128 Oct 31 15:23:18.715692 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 783/1663] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:18.722711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28da885d-d9ac-4ffb-84bb-fdf7769459cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Action: 'create', calling method: .version_select at 0x7f16e0fd64c0>, body: {"pool": "14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed"} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:18.798013 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-a16afe67-a2a5-4f93-96a8-471e2f39cd9a tempest-FlavorsV2NegativeTest-968298543 tempest-FlavorsV2NegativeTest-968298543-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a16afe67-a2a5-4f93-96a8-471e2f39cd9a tempest-FlavorsV2NegativeTest-968298543 tempest-FlavorsV2NegativeTest-968298543-project] Request method failure captured: Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 142 Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hk0f4x4O05PQ0oXtkKRJspCUx9c8gTaKegXoO4eYAOkk4fYcqPH4bH0RG3rVgUZ3YkwkMkv4fXaGin4TApRfWXWHcolWrkxUPS_cW70mshD9FWXwhyuIwwWCceGdwv1c28XNOXzBjUuGWqOIboyz5OMlPajxTFU8gI9UfOKo5Q-wY Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: cfe6548f108a41769e3ca5cc77c68c33 Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FlavorsV2NegativeTest-968298543 Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:18.800358 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cfe6548f108a41769e3ca5cc77c68c33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cfe6548f108a41769e3ca5cc77c68c33", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cfe6548f108a41769e3ca5cc77c68c33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cfe6548f108a41769e3ca5cc77c68c33"}]}] Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FlavorsV2NegativeTest-968298543 Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: cfe6548f108a41769e3ca5cc77c68c33 Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-968298543 Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FlavorsV2NegativeTest-968298543-project Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 83b41cbbdb494e12a144767fa5029a6f Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FlavorsV2NegativeTest-968298543-project Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-162078127", "imageRef": "3fbd402c-9a09-40dc-93be-87bd827cc840", "flavorRef": "452"}} Oct 31 15:23:18.802162 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: exception: Flavor's memory is too small for requested image. Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-162078127', 'imageRef': '3fbd402c-9a09-40dc-93be-87bd827cc840', 'flavorRef': '452'}}} Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:18.803184 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.804952 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:18.806978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:18.806978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:18.806978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:18.806978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:18.806978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 31 15:23:18.806978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:18.806978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a16afe67-a2a5-4f93-96a8-471e2f39cd9a tempest-FlavorsV2NegativeTest-968298543 tempest-FlavorsV2NegativeTest-968298543-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:18.806978 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a16afe67-a2a5-4f93-96a8-471e2f39cd9a tempest-FlavorsV2NegativeTest-968298543 tempest-FlavorsV2NegativeTest-968298543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.746243 Oct 31 15:23:18.811872 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 881/1664] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:18 2022] POST /compute/v2.1/servers => generated 93 bytes in 757 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:23:18.817751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:18.818484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:18.825829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.826550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.827075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.827879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:18.828473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:18.828963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:18.847996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:19.353921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:19.363178 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61efc55f-d227-4cea-a35a-3ef084ff46dd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1198 microversion: 2.1 time: 0.550071 Oct 31 15:23:19.369059 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 882/1665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:18 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1198 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:19.373917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:19.379514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:19.393153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.397677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.398509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.400346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.403014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.403793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.764887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:19.939236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd661f82522f4d5ab5f54d9fcdb81232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '142fd4435ce245d39b8e4a3c8fec565f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:19.963420 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2239ceb-3347-426e-b2fd-8de024d6e39a tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 200 len: 1489 microversion: 2.1 time: 0.591589 Oct 31 15:23:19.964364 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 883/1666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:19 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 1489 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:19.969933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:19.970800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:19.981205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.981950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.985792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:19.986959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:19.987626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:19.988073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:20.146109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:20.860718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:20.882541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:20.888684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:20.890417 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cf48d770-1376-4d55-a550-3f1aeaa8b5fb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1411 microversion: 2.25 time: 0.924864 Oct 31 15:23:20.891095 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 884/1667] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:19 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1411 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:20.896990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:20.898259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:20.907370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:20.911120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:20.912007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:20.913863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:20.914927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:20.915583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:21.337329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:21.346452 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b94fffa-f6de-498f-bcd6-a47fdf54be1e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.453893 Oct 31 15:23:21.347229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 885/1668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:20 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:21.363669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:21.363669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:21.372084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:21.372680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:21.379153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:21.380268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:21.380909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:21.381488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:21.442692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:21.659825 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c0926b5-a0a2-4706-8d9b-960133bf111b tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 204 len: 0 microversion: 2.1 time: 0.310906 Oct 31 15:23:21.660780 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 886/1669] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:21 2022] DELETE /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:21.672867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:21.679553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:21.689954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:21.690448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:21.690879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:21.696626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:21.697222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:21.697671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:22.122419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:22.138580 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-189bda8c-1f41-4b95-a814-9ae430636a29 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1198 microversion: 2.1 time: 0.476307 Oct 31 15:23:22.159508 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 887/1670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:21 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1198 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:22.182880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-468697883", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "d7722de3-e7f9-4adb-9568-1918f813a6a7"}, {"uuid": "09b321d7-f56d-45b8-b076-b30b4f463736"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:22.310058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] validate_networks() for [('d7722de3-e7f9-4adb-9568-1918f813a6a7', None, None, None, None, None), ('09b321d7-f56d-45b8-b076-b30b4f463736', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:22.981746 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28da885d-d9ac-4ffb-84bb-fdf7769459cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.264605 Oct 31 15:23:22.982465 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 784/1671] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:23:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:22.987167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-cdec210c-d781-4388-a16d-9c8e73329c8f req-8f749e18-0bef-429b-8e34-329c303c12cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd9582-09fc-4113-9a9d-99f6c6a894c4", "name": "network-vif-plugged", "status": "completed", "tag": "f43de6e8-275d-4dcf-bbfb-2acb88431dd6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:22.998518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cdec210c-d781-4388-a16d-9c8e73329c8f req-8f749e18-0bef-429b-8e34-329c303c12cb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:22.999362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cdec210c-d781-4388-a16d-9c8e73329c8f req-8f749e18-0bef-429b-8e34-329c303c12cb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.000232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cdec210c-d781-4388-a16d-9c8e73329c8f req-8f749e18-0bef-429b-8e34-329c303c12cb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.012696 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-cdec210c-d781-4388-a16d-9c8e73329c8f req-8f749e18-0bef-429b-8e34-329c303c12cb service nova] Creating event network-vif-plugged:f43de6e8-275d-4dcf-bbfb-2acb88431dd6 for instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 on n-h2-858384-17 Oct 31 15:23:23.018589 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-cdec210c-d781-4388-a16d-9c8e73329c8f req-8f749e18-0bef-429b-8e34-329c303c12cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034709 Oct 31 15:23:23.019505 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 785/1672] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:23.025756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b382ffc1-942d-4ccd-b545-7f5433456c02 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e0fdd1f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:23.050061 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b382ffc1-942d-4ccd-b545-7f5433456c02 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Image not found. Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b382ffc1-942d-4ccd-b545-7f5433456c02 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408 HTTP/1.1 Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:23:23.052426 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f8af0a88-6489-4df1-9cb6-508d6aacf408'} Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:23.054625 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f8af0a88-6489-4df1-9cb6-508d6aacf408 to delete Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:23.056424 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f8af0a88-6489-4df1-9cb6-508d6aacf408 could not be found. Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:23.058204 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:23.059896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b382ffc1-942d-4ccd-b545-7f5433456c02 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:23.061921 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b382ffc1-942d-4ccd-b545-7f5433456c02 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408" status: 404 len: 62 microversion: 2.1 time: 0.039849 Oct 31 15:23:23.065695 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 786/1673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:23 2022] DELETE /compute/v2.1/images/f8af0a88-6489-4df1-9cb6-508d6aacf408 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:23.073299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:23.074588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:23.085707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.087680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.089236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.090418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.091245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.093707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.435350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:23.449783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:23.451088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:23.452868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c1737bb-1e76-40c4-8309-9cffd9a04917 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1411 microversion: 2.25 time: 0.386050 Oct 31 15:23:23.453694 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 787/1674] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:23 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1411 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:23.460800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:23.462519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:23.470362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.471114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.474782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.475777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.476434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.477639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.687550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:23.688064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:23.688493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:23.689557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:23.690438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:23.702916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.703710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.704325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.705269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.705930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.706796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.735891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Getting quotas for project 684abec7b7d6434bba2ef0e09aa1f5b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:23.741143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:23.743892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Getting quotas for user c2d979b14bbf4bb38564f46273334271 and project 684abec7b7d6434bba2ef0e09aa1f5b5. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:23.755974 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b540d43c-1d94-47ec-ac5f-f3443ca5a0c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1516 microversion: 2.1 time: 0.299651 Oct 31 15:23:23.757712 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 788/1675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:23 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:23.783012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:23.785392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:23.788187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.76"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:23.797318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:23.806480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.807446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.808073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.810594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:23.811816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:23.812565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:23.867321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:23:23.868487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquired lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:23:23.874665 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e56cbd92-4e17-42af-8cf6-682f7c674001 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.713897 Oct 31 15:23:23.875669 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 888/1676] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:24.148168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-778782923", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:24.245468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:24.982877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:24.983579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:24.984031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:24.984572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:24.984996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:25.006904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.011843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.012866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.016381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.016880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.017377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.059745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Getting quotas for project 95d5bc4f1cb64997a33609c07379cc60. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:25.078883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Getting quotas for user d3fa70260a7640f5b8fbb7eb9b75580e and project 95d5bc4f1cb64997a33609c07379cc60. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:25.106930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:25.114714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:25.240527 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-525b2f47-5d96-4f68-9d08-b299a395213d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363708 Oct 31 15:23:25.241228 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 889/1677] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:25.261575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:25.262149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:25.270700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.271591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.272197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.274582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.275706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.277049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.339454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:25.530963 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdd90218-d34d-4f75-aa51-5c95b60ecf28 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 204 len: 0 microversion: 2.1 time: 0.284458 Oct 31 15:23:25.533723 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 890/1678] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:25 2022] DELETE /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:25.550054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:25.550786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:25.568872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.569534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.569974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:25.571343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:25.571944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:25.572375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.315153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:26.330115 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4bd5ca8c-304e-49d6-b8a7-ce2c57f7c743 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1198 microversion: 2.1 time: 0.793848 Oct 31 15:23:26.331222 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 891/1679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:25 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1198 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:26.336207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.342405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:26.359677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.360170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.360601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.361546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.362156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.362754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.525261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:26.542134 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cf345b22-85e8-4224-ae4f-1d4c56909a6b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1270 microversion: 2.1 time: 0.209661 Oct 31 15:23:26.552614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Building network info cache for instance {{(pid=120588) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:23:26.556486 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 892/1680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:26.563858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:26.564528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:26.595355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.595753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.596386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:26.597332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:26.597951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:26.598537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:27.199692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:27.216537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:27.218514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:27.219910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b894b3b5-7dfa-4cd0-a074-ad157f5c9e33 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1411 microversion: 2.25 time: 0.662503 Oct 31 15:23:27.221792 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 893/1681] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:26 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1411 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:27.232980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:27.234024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:27.248549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.255478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.256191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:27.257205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.258464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.259142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:27.519794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Updating instance_info_cache with network_info: [{"id": "5716d5ab-5829-43d1-b848-520b1e2c399f", "address": "fa:16:3e:d4:9c:d5", "network": {"id": "95a68319-1b18-4de1-8444-da4272667e8a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1476669207-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fcce475650d3431183d58264fb3f6c28", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5716d5ab-58", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120588) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:23:27.546090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Releasing lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:23:27.547423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-45946cfe-fd7d-48e2-8e5d-34a8bee923b3 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action" status: 202 len: 0 microversion: 2.1 time: 3.769064 Oct 31 15:23:27.548453 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 789/1682] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:23 2022] POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action => generated 0 bytes in 3774 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:23:27.554739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-434e28a0-8074-475e-8eff-85fa588aa04f req-d04860f8-9ee8-4ecf-9ecd-aa7a09078992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd9582-09fc-4113-9a9d-99f6c6a894c4", "name": "network-vif-deleted", "tag": "f43de6e8-275d-4dcf-bbfb-2acb88431dd6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:27.582919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-434e28a0-8074-475e-8eff-85fa588aa04f req-d04860f8-9ee8-4ecf-9ecd-aa7a09078992 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.583547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-434e28a0-8074-475e-8eff-85fa588aa04f req-d04860f8-9ee8-4ecf-9ecd-aa7a09078992 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.584275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-434e28a0-8074-475e-8eff-85fa588aa04f req-d04860f8-9ee8-4ecf-9ecd-aa7a09078992 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:27.613648 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-434e28a0-8074-475e-8eff-85fa588aa04f req-d04860f8-9ee8-4ecf-9ecd-aa7a09078992 service nova] Creating event network-vif-deleted:f43de6e8-275d-4dcf-bbfb-2acb88431dd6 for instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 on n-h2-858384-17 Oct 31 15:23:27.629205 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-434e28a0-8074-475e-8eff-85fa588aa04f req-d04860f8-9ee8-4ecf-9ecd-aa7a09078992 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079104 Oct 31 15:23:27.630235 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 790/1683] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:27.636606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e37ad7c8-f3ce-480a-afe9-087f4cdc2320 req-3de439c2-6b3d-489b-8bb5-a77451f3976d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbd9582-09fc-4113-9a9d-99f6c6a894c4", "name": "network-vif-unplugged", "status": "completed", "tag": "f43de6e8-275d-4dcf-bbfb-2acb88431dd6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:27.657543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e37ad7c8-f3ce-480a-afe9-087f4cdc2320 req-3de439c2-6b3d-489b-8bb5-a77451f3976d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.661744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e37ad7c8-f3ce-480a-afe9-087f4cdc2320 req-3de439c2-6b3d-489b-8bb5-a77451f3976d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.662313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e37ad7c8-f3ce-480a-afe9-087f4cdc2320 req-3de439c2-6b3d-489b-8bb5-a77451f3976d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:27.682362 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e37ad7c8-f3ce-480a-afe9-087f4cdc2320 req-3de439c2-6b3d-489b-8bb5-a77451f3976d service nova] Creating event network-vif-unplugged:f43de6e8-275d-4dcf-bbfb-2acb88431dd6 for instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 on n-h2-858384-17 Oct 31 15:23:27.710563 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e37ad7c8-f3ce-480a-afe9-087f4cdc2320 req-3de439c2-6b3d-489b-8bb5-a77451f3976d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078613 Oct 31 15:23:27.712210 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 791/1684] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:27.717594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:27.722258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:27.739813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.740792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.741494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:27.743200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:27.743923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:27.744608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.009359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:28.021857 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7fa5f1d-edd5-4d0a-8377-f86151401e73 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1522 microversion: 2.1 time: 0.798174 Oct 31 15:23:28.022469 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 894/1685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:27 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1522 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:28.034956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:28.035977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 0dbd9582-09fc-4113-9a9d-99f6c6a894c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:28.044592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.045579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.046191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.047137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.047909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.048513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.072242 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 could not be found. Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 HTTP/1.1 Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:28.074339 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 could not be found. Oct 31 15:23:28.076129 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '0dbd9582-09fc-4113-9a9d-99f6c6a894c4'} Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 could not be found. Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:28.077180 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 could not be found. Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 could not be found. Oct 31 15:23:28.079880 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:28.085026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance 0dbd9582-09fc-4113-9a9d-99f6c6a894c4 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:28.086705 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2cdd10f-0284-4144-9439-43a2dc402487 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4" status: 404 len: 111 microversion: 2.1 time: 0.060080 Oct 31 15:23:28.087749 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 895/1686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:28 2022] GET /compute/v2.1/servers/0dbd9582-09fc-4113-9a9d-99f6c6a894c4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:28.095863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-913db5aa-6e6d-40be-9de9-ffa94b255204 req-4f34d251-038c-4851-8d42-39ec3ae85e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1fb23b1-7ddc-4acb-becb-aac4d9884e7c", "tag": "5716d5ab-5829-43d1-b848-520b1e2c399f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:28.109067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-913db5aa-6e6d-40be-9de9-ffa94b255204 req-4f34d251-038c-4851-8d42-39ec3ae85e4e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.109846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-913db5aa-6e6d-40be-9de9-ffa94b255204 req-4f34d251-038c-4851-8d42-39ec3ae85e4e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.110483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-913db5aa-6e6d-40be-9de9-ffa94b255204 req-4f34d251-038c-4851-8d42-39ec3ae85e4e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.126273 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-913db5aa-6e6d-40be-9de9-ffa94b255204 req-4f34d251-038c-4851-8d42-39ec3ae85e4e service nova] Creating event network-changed:5716d5ab-5829-43d1-b848-520b1e2c399f for instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c on n-h1-858384-17 Oct 31 15:23:28.162149 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-913db5aa-6e6d-40be-9de9-ffa94b255204 req-4f34d251-038c-4851-8d42-39ec3ae85e4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072736 Oct 31 15:23:28.163624 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 896/1687] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:28.172641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:28.176334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:28.191542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.192227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.192689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.193522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.198195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.198732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.381666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:28.401778 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f36a6ab5-ecba-4781-849b-8a38867caafe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1286 microversion: 2.1 time: 0.688111 Oct 31 15:23:28.404548 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 792/1688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:27 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1286 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:28.421633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b775615c-7315-4597-81c9-d22b36947d4c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Action: 'create', calling method: .version_select at 0x7f16e0f96c10>, body: {"pool": "14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed"} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:28.504210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:28.518481 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c0c5893-2f2d-4b81-8ceb-9c5093d44437 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1198 microversion: 2.1 time: 0.352283 Oct 31 15:23:28.535787 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 897/1689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:28 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1198 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:28.543434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:28.544933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:28.551796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.552605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.553239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.554176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:28.554889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:28.555496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:28.589041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:29.031009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:29.042669 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c242afb4-b3e7-4830-955a-c49f9ace2a77 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1312 microversion: 2.1 time: 0.505474 Oct 31 15:23:29.047658 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 898/1690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:28 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1312 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:29.065650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:29.066161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:29.076842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.077858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.078401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.079452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.080427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.081289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.098921 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 HTTP/1.1 Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:29.103034 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:29.104905 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ee19e5b7-f848-4466-b5ea-ee5a51fd0be5'} Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:29.105965 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:29.107610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:29.109348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:29.109348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae2f3a3b-9369-4479-b18d-656b04a3c9d3 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 404 len: 111 microversion: 2.1 time: 0.057123 Oct 31 15:23:29.109348 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 899/1691] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:29 2022] DELETE /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:29.119213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:29.120727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:29.134216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.134841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.135297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.137975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.139360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.140131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.724338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:29.768436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:29.770307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:29.771635 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da1c826d-809b-4a00-ad8a-dbed66afe6f4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1411 microversion: 2.25 time: 0.658781 Oct 31 15:23:29.772777 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 900/1692] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:29 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1411 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:29.778896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:29.779721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:29.805838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.806393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.806826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:29.807573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:29.808030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:29.808454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:30.147163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:30.158002 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e905f56b-2785-4a66-b30d-7e86b1eba0e5 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1522 microversion: 2.1 time: 0.383229 Oct 31 15:23:30.175619 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 901/1693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:29 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:30.287102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-376632724", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:30.391689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] validate_networks() for [('ab7e23b0-155e-4226-9a15-6e50ea9a0142', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:31.217235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:31.218367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:31.221967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:31.229615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:31.230136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:31.250096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.251320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.253341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.254880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.262013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.262739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.293257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Getting quotas for project 6e81a4d86ac64eef904bb82724322c40. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:31.312602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Getting quotas for user b058345f19944e0880a4552d6add5ba7 and project 6e81a4d86ac64eef904bb82724322c40. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:31.337952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:31.344145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:31.426372 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3b06f95-6157-455b-ae40-14fd03fdedba tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249773 Oct 31 15:23:31.431581 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 902/1694] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:31.442578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:31.447766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: ee19e5b7-f848-4466-b5ea-ee5a51fd0be5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:31.458724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:31.461387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.463158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.463786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.464844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.465509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.466109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.502574 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 HTTP/1.1 Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:31.505637 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:31.507590 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ee19e5b7-f848-4466-b5ea-ee5a51fd0be5'} Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:31.508915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. Oct 31 15:23:31.510558 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:31.515339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:31.516441 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-986d5ce7-df8a-4ada-8bee-52529bf9156c tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5" status: 404 len: 111 microversion: 2.1 time: 0.083559 Oct 31 15:23:31.517582 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 903/1695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:31 2022] GET /compute/v2.1/servers/ee19e5b7-f848-4466-b5ea-ee5a51fd0be5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:31.522598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:31.524279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:31.540268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.541078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.541720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.542649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.543279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.543876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.824698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:31.833405 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b775615c-7315-4597-81c9-d22b36947d4c tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.425825 Oct 31 15:23:31.843571 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 793/1696] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:23:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:31.843983 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7d10f36-56e1-47b0-8a8a-a7733d8d0b33 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1316 microversion: 2.1 time: 0.325135 Oct 31 15:23:31.844738 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 904/1697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:31 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:31.849361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:31.850195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:31.850317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-98f52671-75a3-4701-97bc-343c9b70511f req-e8379d9c-8d75-4756-bafa-b5ba13e21119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ace9f23-0d08-4d3b-8c64-dd82142559be", "name": "network-vif-plugged", "status": "completed", "tag": "c5178817-b9fc-4b5a-bd24-5ee1112ab04c"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:31.859683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.861250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.862125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.863604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.864074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.864813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.886666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-98f52671-75a3-4701-97bc-343c9b70511f req-e8379d9c-8d75-4756-bafa-b5ba13e21119 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.887235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-98f52671-75a3-4701-97bc-343c9b70511f req-e8379d9c-8d75-4756-bafa-b5ba13e21119 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.887684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-98f52671-75a3-4701-97bc-343c9b70511f req-e8379d9c-8d75-4756-bafa-b5ba13e21119 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.925471 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-98f52671-75a3-4701-97bc-343c9b70511f req-e8379d9c-8d75-4756-bafa-b5ba13e21119 service nova] Creating event network-vif-plugged:c5178817-b9fc-4b5a-bd24-5ee1112ab04c for instance 0ace9f23-0d08-4d3b-8c64-dd82142559be on n-h2-858384-17 Oct 31 15:23:31.943649 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-98f52671-75a3-4701-97bc-343c9b70511f req-e8379d9c-8d75-4756-bafa-b5ba13e21119 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091464 Oct 31 15:23:31.952186 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 905/1698] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:31.960359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:31.962277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:31.972813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.973535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.974200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:31.975268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:31.975904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:31.977057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.172513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:32.184601 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d44e819a-ccf6-4d27-82c7-0719a2a3c586 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1198 microversion: 2.1 time: 0.338939 Oct 31 15:23:32.186576 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 794/1699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:31 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1198 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:32.199868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.214125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.214334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:32.223121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.224438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.225371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.226345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.226979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.227581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.236755 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4cb612a-d374-4a83-a3c0-7b21e7ac0dc4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.281355 Oct 31 15:23:32.245738 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 906/1700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:31 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:32.255080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-22cde893-9d3b-43a6-9e40-45205377275c req-704c7d34-2aa1-47a4-8ce5-491869826015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57828c57-25f9-4820-abae-396b40b5db0a", "tag": "77af5736-44c8-4ad7-b405-90164244d290"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:32.282696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22cde893-9d3b-43a6-9e40-45205377275c req-704c7d34-2aa1-47a4-8ce5-491869826015 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.283534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22cde893-9d3b-43a6-9e40-45205377275c req-704c7d34-2aa1-47a4-8ce5-491869826015 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.284227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22cde893-9d3b-43a6-9e40-45205377275c req-704c7d34-2aa1-47a4-8ce5-491869826015 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.301052 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-22cde893-9d3b-43a6-9e40-45205377275c req-704c7d34-2aa1-47a4-8ce5-491869826015 service nova] Creating event network-changed:77af5736-44c8-4ad7-b405-90164244d290 for instance 57828c57-25f9-4820-abae-396b40b5db0a on n-h2-858384-17 Oct 31 15:23:32.307016 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-22cde893-9d3b-43a6-9e40-45205377275c req-704c7d34-2aa1-47a4-8ce5-491869826015 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059984 Oct 31 15:23:32.307818 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 907/1701] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:32.313213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.313965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.321241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.321915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.322347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.323107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.323632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.324253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.480636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:32.489008 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a92b404-c704-4490-bc63-6b2bb4b367d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1522 microversion: 2.1 time: 0.180058 Oct 31 15:23:32.489658 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 908/1702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:32 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:32.495886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.496892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.503752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.504755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.505469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.506442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.507015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.507444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.585321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:32.594147 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6ef6d42-1079-47f4-ae8e-507b2b8b60cb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1220 microversion: 2.1 time: 0.102981 Oct 31 15:23:32.595025 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 909/1703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:32 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:32.612609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73f9bb65-62e2-4f25-8946-94820098ab89 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e574ea60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.655116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-73f9bb65-62e2-4f25-8946-94820098ab89 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Image not found. Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73f9bb65-62e2-4f25-8946-94820098ab89 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac HTTP/1.1 Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:32.657030 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: exception: Image not found. Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'd8d4e7c0-19ec-4dd6-95c7-21c44a3884ac'} Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:32.658829 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac to delete Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.664908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac could not be found. Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:32.666273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73f9bb65-62e2-4f25-8946-94820098ab89 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Image not found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73f9bb65-62e2-4f25-8946-94820098ab89 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac" status: 404 len: 62 microversion: 2.1 time: 0.062494 Oct 31 15:23:32.667624 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 910/1704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:32 2022] DELETE /compute/v2.1/images/d8d4e7c0-19ec-4dd6-95c7-21c44a3884ac => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:32.668674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.130"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:32.668674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.676009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.676510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.676950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.677706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.678337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.678775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.706780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:23:32.707184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquired lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:23:32.762632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:32.773089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:32.774736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:32.775861 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e5c3a947-1ee5-4584-9f2a-560f876b127e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1411 microversion: 2.25 time: 0.582861 Oct 31 15:23:32.790041 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 795/1705] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:32 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1411 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:32.800457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.801311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.808430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.809222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.809866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.810798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.811502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.812147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.827193 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c HTTP/1.1 Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:23:32.829359 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.831111 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '34017fcd-17ac-42cc-b924-4c2519a21f0c'} Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:32.832113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.834760 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.841141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:32.841141 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e6ab6f5-154a-43a2-b829-d979425aebe8 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 404 len: 111 microversion: 2.1 time: 0.043793 Oct 31 15:23:32.841141 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 796/1706] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:32 2022] DELETE /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:32.860384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.861700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 34017fcd-17ac-42cc-b924-4c2519a21f0c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.870078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.870862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.871501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.872449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.873111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.873797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.889254 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c HTTP/1.1 Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:23:32.890801 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.892335 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '34017fcd-17ac-42cc-b924-4c2519a21f0c'} Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:32.893200 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. Oct 31 15:23:32.894744 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:32.895967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance 34017fcd-17ac-42cc-b924-4c2519a21f0c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:32.895967 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a32f110a-44af-43b7-92a3-58cb3ed98bda tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c" status: 404 len: 111 microversion: 2.1 time: 0.050964 Oct 31 15:23:32.895967 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 797/1707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:32 2022] GET /compute/v2.1/servers/34017fcd-17ac-42cc-b924-4c2519a21f0c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:32.901876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4af9a7eb-b62a-4517-8103-23b068f8c9cb req-6603adbe-3613-4103-a574-bc56237fdb29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02cc5e68-4057-4b4f-b91e-95cd526f91fc", "tag": "92be1209-62cc-417d-bfaf-50cace03895b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:32.911830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4af9a7eb-b62a-4517-8103-23b068f8c9cb req-6603adbe-3613-4103-a574-bc56237fdb29 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.912509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4af9a7eb-b62a-4517-8103-23b068f8c9cb req-6603adbe-3613-4103-a574-bc56237fdb29 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.914205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4af9a7eb-b62a-4517-8103-23b068f8c9cb req-6603adbe-3613-4103-a574-bc56237fdb29 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.925812 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4af9a7eb-b62a-4517-8103-23b068f8c9cb req-6603adbe-3613-4103-a574-bc56237fdb29 service nova] Creating event network-changed:92be1209-62cc-417d-bfaf-50cace03895b for instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc on n-h1-858384-17 Oct 31 15:23:32.931679 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4af9a7eb-b62a-4517-8103-23b068f8c9cb req-6603adbe-3613-4103-a574-bc56237fdb29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033219 Oct 31 15:23:32.932738 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 798/1708] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:32.938092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:32.939101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:32.961651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.962602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.963785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:32.964680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:32.965334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:32.966222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.246762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.130 (6a211967-0dc9-448c-aeaf-d486d2fa85c9) with port 5716d5ab-5829-43d1-b848-520b1e2c399f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed.", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:23:33.247345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Releasing lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:23:33.248143 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.130 (6a211967-0dc9-448c-aeaf-d486d2fa85c9) with port 5716d5ab-5829-43d1-b848-520b1e2c399f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed. Oct 31 15:23:33.248143 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-df965ab7-c63a-48fe-bb7f-15e3dc4846da'] Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Request method failure captured: Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action HTTP/1.1 Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 46 Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hPivi862ov6eOaPTo9wGmycaSpJkScyslvvAEyX1qwopNx8n8eJAjbZqa8mzo5TSfZUd9rPWEY4uOXPWRQstTujGqQyMFWWoX7i5X9XGwhilzJ-Ce9AZ0GGcat8-IWkD3RkkD_I31cfgkE0kmvij3vqiqAbcOH5sg6tSJSBhs7t0Y Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:33.250153 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcce475650d3431183d58264fb3f6c28", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcce475650d3431183d58264fb3f6c28"}]}] Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 424d514ff89b4b5795394b8bf0bad558 Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: {"addFloatingIp": {"address": "172.25.1.130"}} Oct 31 15:23:33.251921 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: exception: Cannot associate floating IP 172.25.1.130 (6a211967-0dc9-448c-aeaf-d486d2fa85c9) with port 5716d5ab-5829-43d1-b848-520b1e2c399f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed. Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-df965ab7-c63a-48fe-bb7f-15e3dc4846da'] Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b1fb23b1-7ddc-4acb-becb-aac4d9884e7c', 'body': {'addFloatingIp': {'address': '172.25.1.130'}}} Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:33.252967 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:23:33.254200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.130 (6a211967-0dc9-448c-aeaf-d486d2fa85c9) with port 5716d5ab-5829-43d1-b848-520b1e2c399f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed. Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df965ab7-c63a-48fe-bb7f-15e3dc4846da'] Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.130 (6a211967-0dc9-448c-aeaf-d486d2fa85c9) with port 5716d5ab-5829-43d1-b848-520b1e2c399f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed. Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df965ab7-c63a-48fe-bb7f-15e3dc4846da'] Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.255879 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.130 (6a211967-0dc9-448c-aeaf-d486d2fa85c9) with port 5716d5ab-5829-43d1-b848-520b1e2c399f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed. Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df965ab7-c63a-48fe-bb7f-15e3dc4846da'] Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.257386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:33.258988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.258988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:33.258988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:33.258988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:33.258988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:33.258988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:33.258988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.130 (6a211967-0dc9-448c-aeaf-d486d2fa85c9) with port 5716d5ab-5829-43d1-b848-520b1e2c399f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed. Oct 31 15:23:33.258988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df965ab7-c63a-48fe-bb7f-15e3dc4846da'] Oct 31 15:23:33.258988 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.260706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Returning 400 to user: Cannot associate floating IP 172.25.1.130 (6a211967-0dc9-448c-aeaf-d486d2fa85c9) with port 5716d5ab-5829-43d1-b848-520b1e2c399f using fixed IP 172.20.0.5, as that fixed IP already has a floating IP on external network 14b63e8b-2b04-4d02-9bb7-e5c6ababa8ed. Oct 31 15:23:33.260706 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-df965ab7-c63a-48fe-bb7f-15e3dc4846da'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:33.261626 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a736793-08d7-47c1-9063-20970d14d698 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action" status: 400 len: 381 microversion: 2.1 time: 0.601014 Oct 31 15:23:33.262229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 911/1709] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:32 2022] POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action => generated 381 bytes in 602 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:23:33.269857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc247433-1b45-4cd8-9fa3-e0e68c2ce5d7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e14bf9d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:33.293155 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-dc247433-1b45-4cd8-9fa3-e0e68c2ce5d7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Image not found. Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc247433-1b45-4cd8-9fa3-e0e68c2ce5d7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 HTTP/1.1 Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:33.294940 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: exception: Image not found. Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '5b3da909-8e62-4b07-ba2e-e6e74fe224f5'} Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:33.296505 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5b3da909-8e62-4b07-ba2e-e6e74fe224f5 to delete Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.297510 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5b3da909-8e62-4b07-ba2e-e6e74fe224f5 could not be found. Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:33.298784 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc247433-1b45-4cd8-9fa3-e0e68c2ce5d7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Image not found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:33.300125 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc247433-1b45-4cd8-9fa3-e0e68c2ce5d7 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5" status: 404 len: 62 microversion: 2.1 time: 0.033038 Oct 31 15:23:33.305521 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 912/1710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:33 2022] DELETE /compute/v2.1/images/5b3da909-8e62-4b07-ba2e-e6e74fe224f5 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:33.312406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:33.313361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:33.320297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.320857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.321449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.322020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.322625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.323056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.378462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:33.388343 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d01d8741-88e1-4d37-af43-5074b1488b7d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1316 microversion: 2.1 time: 0.454372 Oct 31 15:23:33.398215 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 799/1711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:32 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:33.403910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:33.404535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:33.413176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.414207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.414647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.415359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.416663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.417451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.521180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:33.534901 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-edace132-2c93-4715-a82b-3708ef55f505 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1198 microversion: 2.1 time: 0.228004 Oct 31 15:23:33.536171 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 913/1712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:33 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1198 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:33.542630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1fe2f4f9-bf47-4e3a-a5c8-39579d5b52a1 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '.version_select at 0x7f16e158b820>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:33.905583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:33.920220 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f86a1820-c592-461a-b36f-b2a74f1cfcbc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.520794 Oct 31 15:23:33.921451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 800/1713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:33 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:33.935249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:33.936435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:33.953598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.955031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.956639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.957636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:33.959703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:33.961450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:33.993876 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 HTTP/1.1 Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:23:34.002341 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:34.003872 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '874038fc-9845-4416-ae6b-1186e8c6c1f0'} Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:34.004734 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:34.006120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:34.007593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:34.008995 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00d9dd9e-c4b8-4a0c-9082-2984e7009954 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 404 len: 111 microversion: 2.1 time: 0.086283 Oct 31 15:23:34.009660 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 801/1714] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:33 2022] DELETE /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:34.022350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:34.023006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:34.042184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.042886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.043131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.043860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.044334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.044767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.484488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:34.495259 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f86eaa1c-0a15-4ee2-a815-1eae408dd239 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1522 microversion: 2.1 time: 0.484515 Oct 31 15:23:34.496160 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 802/1715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:34 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:34.527060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:34.527965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:34.537168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.537771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.538303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.539797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.540568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.541239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.584173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:34.656660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:34.666098 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f16ff51-f685-4d82-a70c-6aa5ee81314e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1268 microversion: 2.1 time: 0.154286 Oct 31 15:23:34.667280 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 803/1716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:34 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:34.673161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:34.674364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:34.685044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.685772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.686432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.688295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.689635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:34.691684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:34.973212 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1fe2f4f9-bf47-4e3a-a5c8-39579d5b52a1 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/6a211967-0dc9-448c-aeaf-d486d2fa85c9" status: 202 len: 0 microversion: 2.1 time: 1.435706 Oct 31 15:23:34.977685 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 914/1717] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:23:33 2022] DELETE /compute/v2.1/os-floating-ips/6a211967-0dc9-448c-aeaf-d486d2fa85c9 => generated 0 bytes in 1437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:34.977881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:34.979245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:34.979855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 874038fc-9845-4416-ae6b-1186e8c6c1f0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:34.995737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:34.996044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:34.997792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:34.999214 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d7dc8dc-c708-47c0-b7a8-f1fae37c494e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1607 microversion: 2.25 time: 0.330588 Oct 31 15:23:35.017181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.017181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.017181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.017181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.018205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.019589 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 804/1718] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:23:34 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1607 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:23:35.027792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2fca1079-697d-49a1-af83-0aa593cbf38e req-733ea600-71a2-41e8-8e79-76c0eeda94b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c3e20a-338d-4dcb-946c-7012911f7928", "name": "network-vif-plugged", "status": "completed", "tag": "a5d743e8-b414-4676-a691-44ad4577180c"}, {"server_uuid": "b7dd3510-86d0-472f-bd84-6226b34335e3", "name": "network-vif-plugged", "status": "completed", "tag": "3f50c566-97a8-463a-ba3d-5e8786d8d971"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:35.033595 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 HTTP/1.1 Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:35.035560 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:35.037518 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '874038fc-9845-4416-ae6b-1186e8c6c1f0'} Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:35.038882 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. Oct 31 15:23:35.040725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.042373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance 874038fc-9845-4416-ae6b-1186e8c6c1f0 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:35.045710 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f379cd5-5327-49e6-8424-2c35113dff98 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0" status: 404 len: 111 microversion: 2.1 time: 0.067533 Oct 31 15:23:35.046736 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 915/1719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:34 2022] GET /compute/v2.1/servers/874038fc-9845-4416-ae6b-1186e8c6c1f0 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:35.067523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2fca1079-697d-49a1-af83-0aa593cbf38e req-733ea600-71a2-41e8-8e79-76c0eeda94b8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.068002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2fca1079-697d-49a1-af83-0aa593cbf38e req-733ea600-71a2-41e8-8e79-76c0eeda94b8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.068421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2fca1079-697d-49a1-af83-0aa593cbf38e req-733ea600-71a2-41e8-8e79-76c0eeda94b8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.072885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:35.075939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:35.085325 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2fca1079-697d-49a1-af83-0aa593cbf38e req-733ea600-71a2-41e8-8e79-76c0eeda94b8 service nova] Creating event network-vif-plugged:a5d743e8-b414-4676-a691-44ad4577180c for instance 45c3e20a-338d-4dcb-946c-7012911f7928 on n-h1-858384-17 Oct 31 15:23:35.086501 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2fca1079-697d-49a1-af83-0aa593cbf38e req-733ea600-71a2-41e8-8e79-76c0eeda94b8 service nova] Creating event network-vif-plugged:3f50c566-97a8-463a-ba3d-5e8786d8d971 for instance b7dd3510-86d0-472f-bd84-6226b34335e3 on n-h2-858384-17 Oct 31 15:23:35.090105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.092022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.094377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.095255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.096569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.097446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.098536 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2fca1079-697d-49a1-af83-0aa593cbf38e req-733ea600-71a2-41e8-8e79-76c0eeda94b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077457 Oct 31 15:23:35.099656 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 805/1720] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:35.117281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:35.121270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:35.129889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.133022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.133948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.134911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.135575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.142042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.355025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:35.370400 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5104fab5-c9bb-4ffa-9e77-a5cb8e2c3e2a tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1316 microversion: 2.1 time: 0.322278 Oct 31 15:23:35.386212 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 916/1721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:35 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:35.388339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:35.388734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:35.397243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.399177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.400215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.401571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.402041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.402475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.610130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:35.622153 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-086472ad-c3b4-4e0d-9f88-21a7083d663b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1198 microversion: 2.1 time: 0.520238 Oct 31 15:23:35.633156 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 806/1722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:35 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1198 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:35.633156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-169debad-e175-46d6-aee3-e5e45a6eae06 req-050017b6-0911-41f2-abca-f89584681aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02cc5e68-4057-4b4f-b91e-95cd526f91fc", "tag": "3e4abe77-43a1-40a6-bce8-58b1b94e0ed6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:35.638750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-169debad-e175-46d6-aee3-e5e45a6eae06 req-050017b6-0911-41f2-abca-f89584681aa8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.638750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-169debad-e175-46d6-aee3-e5e45a6eae06 req-050017b6-0911-41f2-abca-f89584681aa8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.638750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-169debad-e175-46d6-aee3-e5e45a6eae06 req-050017b6-0911-41f2-abca-f89584681aa8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.651107 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-169debad-e175-46d6-aee3-e5e45a6eae06 req-050017b6-0911-41f2-abca-f89584681aa8 service nova] Creating event network-changed:3e4abe77-43a1-40a6-bce8-58b1b94e0ed6 for instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc on n-h1-858384-17 Oct 31 15:23:35.651297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:35.656638 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-169debad-e175-46d6-aee3-e5e45a6eae06 req-050017b6-0911-41f2-abca-f89584681aa8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032471 Oct 31 15:23:35.657287 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 807/1723] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:35.664301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.76"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:35.665076 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c991850-db0b-4837-9a29-3309ed56f9b9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.284839 Oct 31 15:23:35.669802 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 917/1724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:35 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:35.675409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e3f48422-427a-441e-9992-9ee343b8e155 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:35.676282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e3f48422-427a-441e-9992-9ee343b8e155 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:35.697837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3f48422-427a-441e-9992-9ee343b8e155 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.698617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3f48422-427a-441e-9992-9ee343b8e155 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.700691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3f48422-427a-441e-9992-9ee343b8e155 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.701793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3f48422-427a-441e-9992-9ee343b8e155 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.702698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3f48422-427a-441e-9992-9ee343b8e155 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.703493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3f48422-427a-441e-9992-9ee343b8e155 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.819299 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e3f48422-427a-441e-9992-9ee343b8e155 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.148281 Oct 31 15:23:35.820726 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 918/1725] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 31 15:23:35 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:23:35.826216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-125cd14b-187c-424d-b3ab-8bc121a5b732 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e57295e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:35.853217 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-125cd14b-187c-424d-b3ab-8bc121a5b732 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Image not found. Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-125cd14b-187c-424d-b3ab-8bc121a5b732 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e HTTP/1.1 Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:35.855205 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: exception: Image not found. Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '9a08f03b-3720-4b19-800b-1c11e26bc14e'} Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:35.856810 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9a08f03b-3720-4b19-800b-1c11e26bc14e to delete Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.857806 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a08f03b-3720-4b19-800b-1c11e26bc14e could not be found. Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:35.859096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:23:35.860884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:35.863160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-125cd14b-187c-424d-b3ab-8bc121a5b732 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Image not found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:35.864689 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-125cd14b-187c-424d-b3ab-8bc121a5b732 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e" status: 404 len: 62 microversion: 2.1 time: 0.042115 Oct 31 15:23:35.865764 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 919/1726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:35 2022] DELETE /compute/v2.1/images/9a08f03b-3720-4b19-800b-1c11e26bc14e => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:35.871937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:35.873048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:35.881284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.882009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.883496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.884428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.885082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.885716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.943882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:35.953454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.953972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.956563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:35.959479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:35.960189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:35.961309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.171784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:36.182973 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c56a246-54d8-450f-aa4c-d0e2624c12c0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1522 microversion: 2.1 time: 0.315768 Oct 31 15:23:36.184415 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 920/1727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:35 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:36.189415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:36.190025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:36.196558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.197448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.198159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.199344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.199803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.200417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.446604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:36.466836 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-165e82d3-dc9b-4193-b3a0-f67247d23766 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1316 microversion: 2.1 time: 0.277757 Oct 31 15:23:36.480455 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 921/1728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:36 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:36.486841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:36.487547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:36.494970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.495514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.495959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.496671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.497191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.497621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.513845 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 HTTP/1.1 Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:36.516002 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.517609 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '20f21ec1-2fb0-4adc-a4fb-c3d41643dca7'} Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:36.518559 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.521433 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.524091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:36.524091 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7289a26-2487-42af-ba8d-cd5cba975529 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 404 len: 111 microversion: 2.1 time: 0.035623 Oct 31 15:23:36.529158 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 922/1729] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:36 2022] DELETE /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:36.530211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:36.530831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:36.537418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.537920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.538361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.540273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.540745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.541451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.700424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:23:36.700925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquired lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:23:36.857388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:36.872205 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65be25de-8c83-44df-a139-e7c43750f1c8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1316 microversion: 2.1 time: 0.346317 Oct 31 15:23:36.873210 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 923/1730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:36 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:36.878163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:36.879738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:36.886339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.887113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.887806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.888837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.889586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.890319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.907175 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 HTTP/1.1 Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:36.909191 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.910713 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '20f21ec1-2fb0-4adc-a4fb-c3d41643dca7'} Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:36.911546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. Oct 31 15:23:36.912936 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:36.916707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance 20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:36.917671 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f21ca12-7855-4027-b9e1-86179143cd65 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7" status: 404 len: 111 microversion: 2.1 time: 0.043237 Oct 31 15:23:36.921371 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 924/1731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:36 2022] GET /compute/v2.1/servers/20f21ec1-2fb0-4adc-a4fb-c3d41643dca7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:36.926349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:36.927362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:36.935708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.936511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.937252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.938233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:36.938935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:36.939592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:36.944431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:37.152046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:37.165476 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-136c6124-b21e-4fdc-9846-f1a28b7128af tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1381 microversion: 2.1 time: 0.242896 Oct 31 15:23:37.166384 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 925/1732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:36 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1381 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:37.172083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:37.172721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:37.181444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.181955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.183229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.184192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.184868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.186266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.465911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:37.477990 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41838a7e-1f76-4e2d-b1a1-0267c1644536 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.309836 Oct 31 15:23:37.478749 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 926/1733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:37 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:37.500779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f1443ea-de7d-4d0a-8639-2b1f911b51af tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '.version_select at 0x7f16e1d325e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:37.525941 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7f1443ea-de7d-4d0a-8639-2b1f911b51af tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Image not found. Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f1443ea-de7d-4d0a-8639-2b1f911b51af tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 HTTP/1.1 Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:37.527814 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: exception: Image not found. Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '449c9a24-10a9-407f-be7f-d2c9777d50f1'} Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:37.529757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 449c9a24-10a9-407f-be7f-d2c9777d50f1 to delete Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:37.530847 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 449c9a24-10a9-407f-be7f-d2c9777d50f1 could not be found. Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:37.532328 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f1443ea-de7d-4d0a-8639-2b1f911b51af tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Image not found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f1443ea-de7d-4d0a-8639-2b1f911b51af tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1" status: 404 len: 62 microversion: 2.1 time: 0.040958 Oct 31 15:23:37.534083 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 927/1734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:37 2022] DELETE /compute/v2.1/images/449c9a24-10a9-407f-be7f-d2c9777d50f1 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:37.684237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dcea09f9-5b27-4940-91b5-fdd85a23895e tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:37.685282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dcea09f9-5b27-4940-91b5-fdd85a23895e tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:37.693445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcea09f9-5b27-4940-91b5-fdd85a23895e tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.694220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcea09f9-5b27-4940-91b5-fdd85a23895e tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.696259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcea09f9-5b27-4940-91b5-fdd85a23895e tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.697667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcea09f9-5b27-4940-91b5-fdd85a23895e tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.698320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcea09f9-5b27-4940-91b5-fdd85a23895e tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.698922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcea09f9-5b27-4940-91b5-fdd85a23895e tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.947025 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dcea09f9-5b27-4940-91b5-fdd85a23895e tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1534 microversion: 2.1 time: 0.413784 Oct 31 15:23:37.947925 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 928/1735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:37 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1534 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:37.953164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:37.953441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:37.959781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.961008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.961794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:37.962570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:37.963105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:37.963604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.097795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:38.106462 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65d30551-09c7-4a03-ba88-b1c163995d70 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1507 microversion: 2.1 time: 0.157485 Oct 31 15:23:38.107046 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 929/1736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:37 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:38.111826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-bfda7f07-333e-41c1-b397-cb9642649c38 req-fc32cb30-8c7a-4180-a3e8-784a3e01591e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57828c57-25f9-4820-abae-396b40b5db0a", "name": "network-vif-plugged", "status": "completed", "tag": "77af5736-44c8-4ad7-b405-90164244d290"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:38.121627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bfda7f07-333e-41c1-b397-cb9642649c38 req-fc32cb30-8c7a-4180-a3e8-784a3e01591e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.122108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bfda7f07-333e-41c1-b397-cb9642649c38 req-fc32cb30-8c7a-4180-a3e8-784a3e01591e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.122538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bfda7f07-333e-41c1-b397-cb9642649c38 req-fc32cb30-8c7a-4180-a3e8-784a3e01591e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.133984 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-bfda7f07-333e-41c1-b397-cb9642649c38 req-fc32cb30-8c7a-4180-a3e8-784a3e01591e service nova] Creating event network-vif-plugged:77af5736-44c8-4ad7-b405-90164244d290 for instance 57828c57-25f9-4820-abae-396b40b5db0a on n-h2-858384-17 Oct 31 15:23:38.138889 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-bfda7f07-333e-41c1-b397-cb9642649c38 req-fc32cb30-8c7a-4180-a3e8-784a3e01591e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030448 Oct 31 15:23:38.139499 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 930/1737] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:38.145224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-750271d7-4e52-49c1-9f27-a7559447b6ef req-af830bcd-a805-4151-9b09-3678facf79a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4faf82e-33b1-482e-a400-e57ebf462f65", "tag": "5c17a2b4-0599-4cd9-ac6a-66a5a6df9448"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:38.156598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-750271d7-4e52-49c1-9f27-a7559447b6ef req-af830bcd-a805-4151-9b09-3678facf79a0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.157080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-750271d7-4e52-49c1-9f27-a7559447b6ef req-af830bcd-a805-4151-9b09-3678facf79a0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.157748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-750271d7-4e52-49c1-9f27-a7559447b6ef req-af830bcd-a805-4151-9b09-3678facf79a0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.170134 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-750271d7-4e52-49c1-9f27-a7559447b6ef req-af830bcd-a805-4151-9b09-3678facf79a0 service nova] Creating event network-changed:5c17a2b4-0599-4cd9-ac6a-66a5a6df9448 for instance f4faf82e-33b1-482e-a400-e57ebf462f65 on n-h2-858384-17 Oct 31 15:23:38.175642 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-750271d7-4e52-49c1-9f27-a7559447b6ef req-af830bcd-a805-4151-9b09-3678facf79a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034615 Oct 31 15:23:38.176787 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 931/1738] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:38.182827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.183498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.189861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.190987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.191592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.192492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.193115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.194243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.216603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Building network info cache for instance {{(pid=120588) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:23:38.362790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:38.373153 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1754e1a3-5369-4d51-a3f4-12c55c31a335 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1316 microversion: 2.1 time: 0.195096 Oct 31 15:23:38.374898 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 932/1739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:38 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:38.380415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.381171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.389369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.390131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.391233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.391233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.391705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.392123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.408674 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 HTTP/1.1 Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:38.411353 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:38.413109 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'd28f347d-fe10-4885-bbf4-1d8591ca6340'} Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:38.414522 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:38.415871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:38.417743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:38.417743 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-77be0530-6fa5-4f30-9093-5a8c102f4bb4 tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 404 len: 111 microversion: 2.1 time: 0.036150 Oct 31 15:23:38.417743 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 933/1740] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:38 2022] DELETE /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:38.420775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.421407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.431131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.431632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.432229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.433667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.434338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.434944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.607817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:38.618276 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e859904a-8ee6-47e6-b7c0-f05d3e7615ef tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1316 microversion: 2.1 time: 0.203398 Oct 31 15:23:38.625219 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 934/1741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:38 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:38.637071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-707598f6-a2b2-4563-bd6e-cb0b7519c62c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.639653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-707598f6-a2b2-4563-bd6e-cb0b7519c62c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.646325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-707598f6-a2b2-4563-bd6e-cb0b7519c62c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.646827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-707598f6-a2b2-4563-bd6e-cb0b7519c62c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.647266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-707598f6-a2b2-4563-bd6e-cb0b7519c62c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.648330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-707598f6-a2b2-4563-bd6e-cb0b7519c62c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.648844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-707598f6-a2b2-4563-bd6e-cb0b7519c62c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.649316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-707598f6-a2b2-4563-bd6e-cb0b7519c62c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.838132 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-707598f6-a2b2-4563-bd6e-cb0b7519c62c tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1534 microversion: 2.1 time: 0.208420 Oct 31 15:23:38.855604 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 935/1742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:38 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1534 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:38.861070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:38.861959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:38.872016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.872820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.873476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:38.874715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:38.875521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:38.876132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.164533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:39.177158 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e16bfcc-5565-497b-b32e-64f32f52a7a6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 200 len: 1507 microversion: 2.1 time: 0.320172 Oct 31 15:23:39.189212 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 936/1743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:38 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 1507 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:39.200198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0440dfda-ffdb-4f26-8653-0080dfc2ce67 req-815a1ec4-0637-49cb-acad-a49bf18a1e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ace9f23-0d08-4d3b-8c64-dd82142559be", "tag": "c5178817-b9fc-4b5a-bd24-5ee1112ab04c"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:39.213920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0440dfda-ffdb-4f26-8653-0080dfc2ce67 req-815a1ec4-0637-49cb-acad-a49bf18a1e67 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.214565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0440dfda-ffdb-4f26-8653-0080dfc2ce67 req-815a1ec4-0637-49cb-acad-a49bf18a1e67 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.215007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0440dfda-ffdb-4f26-8653-0080dfc2ce67 req-815a1ec4-0637-49cb-acad-a49bf18a1e67 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.229408 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0440dfda-ffdb-4f26-8653-0080dfc2ce67 req-815a1ec4-0637-49cb-acad-a49bf18a1e67 service nova] Creating event network-changed:c5178817-b9fc-4b5a-bd24-5ee1112ab04c for instance 0ace9f23-0d08-4d3b-8c64-dd82142559be on n-h2-858384-17 Oct 31 15:23:39.234590 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0440dfda-ffdb-4f26-8653-0080dfc2ce67 req-815a1ec4-0637-49cb-acad-a49bf18a1e67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044380 Oct 31 15:23:39.235563 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 937/1744] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:39.253938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:39.254659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] [instance: d28f347d-fe10-4885-bbf4-1d8591ca6340] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:39.267936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.269218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.270397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.271636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.272111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.272529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.291602 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] HTTP exception thrown: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Request method failure captured: Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 HTTP/1.1 Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-bycdTnUIaluFY9REXj_5pkOpbViA5HqDiyE0n8nf7v98Dmy8F_MXB21mikxV1-gn8_R5gTCzgBI5ApBCw7cWWucxbxzDtSHKfjeZOa0VEifpZzoFs7esZQaDSGn5fnCA6wtO9TvO6372S7qA90SuOb6vU3AZWdN9GAEiJXYgOQU7E Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:39.293559 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_142fd4435ce245d39b8e4a3c8fec565f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/142fd4435ce245d39b8e4a3c8fec565f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/142fd4435ce245d39b8e4a3c8fec565f"}]}] Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 142fd4435ce245d39b8e4a3c8fec565f Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesTestJSON-1433872925 Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cd661f82522f4d5ab5f54d9fcdb81232 Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesTestJSON-1433872925-project Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:39.298571 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'd28f347d-fe10-4885-bbf4-1d8591ca6340'} Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:39.299512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. Oct 31 15:23:39.300866 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:39.302269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] Returning 404 to user: Instance d28f347d-fe10-4885-bbf4-1d8591ca6340 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:39.302269 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-517d9e62-90b1-4d1b-87c0-3484fcd5acce tempest-ImagesTestJSON-1433872925 tempest-ImagesTestJSON-1433872925-project] 10.222.0.20 "GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340" status: 404 len: 111 microversion: 2.1 time: 0.056163 Oct 31 15:23:39.302269 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 938/1745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:39 2022] GET /compute/v2.1/servers/d28f347d-fe10-4885-bbf4-1d8591ca6340 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:39.302269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:39.302269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:39.310191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.311239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.311758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.312491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.312955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.313479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.549783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:39.559414 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3636172f-0b0c-4388-8340-3ef952174273 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.262605 Oct 31 15:23:39.571029 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 939/1746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:39 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:39.581425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19d09a2f-4c69-413f-8162-96fb6351b405 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:39.585921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Updating instance_info_cache with network_info: [{"id": "5716d5ab-5829-43d1-b848-520b1e2c399f", "address": "fa:16:3e:d4:9c:d5", "network": {"id": "95a68319-1b18-4de1-8444-da4272667e8a", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1476669207-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "fcce475650d3431183d58264fb3f6c28", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5716d5ab-58", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120588) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:23:39.588488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d09a2f-4c69-413f-8162-96fb6351b405 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.591094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d09a2f-4c69-413f-8162-96fb6351b405 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.592533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d09a2f-4c69-413f-8162-96fb6351b405 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.594200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d09a2f-4c69-413f-8162-96fb6351b405 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.595008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d09a2f-4c69-413f-8162-96fb6351b405 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.595737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d09a2f-4c69-413f-8162-96fb6351b405 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.604248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Releasing lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:23:39.605049 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6ea079c1-fa02-428a-a8b9-f4e2ab893841 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action" status: 202 len: 0 microversion: 2.1 time: 3.946638 Oct 31 15:23:39.605690 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 808/1747] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:35 2022] POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action => generated 0 bytes in 3948 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:23:39.611087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:39.611822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:39.625387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.626037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.626827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.627671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.628426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.629043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.642977 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19d09a2f-4c69-413f-8162-96fb6351b405 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.070351 Oct 31 15:23:39.651775 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 940/1748] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 31 15:23:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:39.656949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:39.657616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:39.664792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.665333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.665776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.666818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:39.667338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:39.667815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:39.668252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:39.793386 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8a6ca60-a59b-45e6-a4ec-59ea5d958f2c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 204 len: 0 microversion: 2.1 time: 0.185845 Oct 31 15:23:39.794431 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 809/1749] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:39 2022] DELETE /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:39.801772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37b125d4-9c75-48d1-9d68-768703c4852e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '.version_select at 0x7f16e1007ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:40.121708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:40.131625 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-84b28bb8-16c1-4db7-84c0-83642afcffb3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1316 microversion: 2.1 time: 0.478703 Oct 31 15:23:40.151078 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 941/1750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:39 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:40.157968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:40.159778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:40.170121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:40.171635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:40.172339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:40.173378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:40.174106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:40.175584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:40.834741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:40.845719 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ad2519f-9e77-4e30-bb5a-00a479ebb2ec tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1316 microversion: 2.1 time: 0.692984 Oct 31 15:23:40.846634 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 942/1751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:40 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1316 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:40.870372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-17", "block_migration": false, "disk_over_commit": false}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:40.873790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:40.888440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:40.888960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:40.889771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:40.891010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:40.891667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:40.897749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:40.932625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lazy-loading 'flavor' on Instance uuid b7dd3510-86d0-472f-bd84-6226b34335e3 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:23:40.949260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Going to try to live migrate instance to n-h1-858384-17 {{(pid=120587) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:23:41.054716 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-37b125d4-9c75-48d1-9d68-768703c4852e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/08568490-3f79-4f0f-8992-90ee6e7707e2" status: 202 len: 0 microversion: 2.1 time: 1.258261 Oct 31 15:23:41.055322 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 810/1752] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:23:39 2022] DELETE /compute/v2.1/os-floating-ips/08568490-3f79-4f0f-8992-90ee6e7707e2 => generated 0 bytes in 1260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:41.060598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1811795434", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "942ea272-9a7a-4042-b342-fe98a8b8489d"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:41.143862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] validate_networks() for [('942ea272-9a7a-4042-b342-fe98a8b8489d', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:41.324712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=18 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:42.060293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:42.060908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:42.061270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:42.061913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:42.062561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:42.074251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.074742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.075177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.075897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.076350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.077449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.104042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Getting quotas for project 7687292298c5476dabe26115be2d1faf. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:42.110855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Getting quotas for user 7de8009481e24fc7a113b58bb34a2eef and project 7687292298c5476dabe26115be2d1faf. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:42.133484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:42.137602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:42.213342 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b085ab53-7d74-400b-8850-e03e088d7198 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.156327 Oct 31 15:23:42.216369 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 811/1753] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:42.229573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:42.233745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:42.246185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.246835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.247335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.248062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.248702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.249142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.582439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:42.591416 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6deb91f5-f1bf-4e5d-9cda-4e46302e8631 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.372430 Oct 31 15:23:42.595943 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 812/1754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:42 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:42.603002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b151d4ee-92d5-450e-ab4d-5ad69af624be tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b151d4ee-92d5-450e-ab4d-5ad69af624be tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Request method failure captured: Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action HTTP/1.1 Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 34 Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hPivi862ov6eOaPTo9wGmycaSpJkScyslvvAEyX1qwopNx8n8eJAjbZqa8mzo5TSfZUd9rPWEY4uOXPWRQstTujGqQyMFWWoX7i5X9XGwhilzJ-Ce9AZ0GGcat8-IWkD3RkkD_I31cfgkE0kmvij3vqiqAbcOH5sg6tSJSBhs7t0Y Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:23:42.617878 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcce475650d3431183d58264fb3f6c28", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcce475650d3431183d58264fb3f6c28"}]}] Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 424d514ff89b4b5795394b8bf0bad558 Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: {"addFloatingIp": {"address": ""}} Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:23:42.619557 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'b1fb23b1-7ddc-4acb-becb-aac4d9884e7c', 'body': {'addFloatingIp': {'address': ''}}} Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '' Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:42.620529 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:23:42.622214 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:23:42.623539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 31 15:23:42.623539 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:42.626755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b151d4ee-92d5-450e-ab4d-5ad69af624be tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:42.632793 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b151d4ee-92d5-450e-ab4d-5ad69af624be tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action" status: 400 len: 142 microversion: 2.1 time: 0.034740 Oct 31 15:23:42.636577 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 813/1755] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:42 2022] POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action => generated 142 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:23:42.648987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:42.649745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:42.664263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.666878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.667405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:42.670016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:42.670567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:42.671068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.255007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:43.265116 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23f3196c-65f1-463c-8c6b-6db9515de6e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1316 microversion: 2.1 time: 0.623143 Oct 31 15:23:43.277736 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 814/1756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:42 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1316 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:43.286813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-008bd8e2-bbfa-49e1-b1a5-f7b9f42fc9ed req-0588e8fb-1b88-4e94-bcf5-11211225e385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1fb23b1-7ddc-4acb-becb-aac4d9884e7c", "tag": "5716d5ab-5829-43d1-b848-520b1e2c399f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:43.298740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-008bd8e2-bbfa-49e1-b1a5-f7b9f42fc9ed req-0588e8fb-1b88-4e94-bcf5-11211225e385 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.299582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-008bd8e2-bbfa-49e1-b1a5-f7b9f42fc9ed req-0588e8fb-1b88-4e94-bcf5-11211225e385 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.300204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-008bd8e2-bbfa-49e1-b1a5-f7b9f42fc9ed req-0588e8fb-1b88-4e94-bcf5-11211225e385 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.325929 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-008bd8e2-bbfa-49e1-b1a5-f7b9f42fc9ed req-0588e8fb-1b88-4e94-bcf5-11211225e385 service nova] Creating event network-changed:5716d5ab-5829-43d1-b848-520b1e2c399f for instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c on n-h1-858384-17 Oct 31 15:23:43.337625 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-008bd8e2-bbfa-49e1-b1a5-f7b9f42fc9ed req-0588e8fb-1b88-4e94-bcf5-11211225e385 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058509 Oct 31 15:23:43.340036 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 815/1757] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:43.352928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:43.354887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:43.373568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.374223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.374667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.375403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.375864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.376291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.403426 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1ba16d7-2118-4f04-92ac-5828a2653e75 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3/action" status: 202 len: 0 microversion: 2.1 time: 2.555510 Oct 31 15:23:43.408742 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 943/1758] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:40 2022] POST /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3/action => generated 0 bytes in 2561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:23:43.425203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:43.426971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:43.448586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.449074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.449525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.455992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.456486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.458496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.608711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:43.615319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:43.623808 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-529d1436-3e1c-48c6-8763-3b876284ad02 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1214 microversion: 2.1 time: 0.212532 Oct 31 15:23:43.624679 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 944/1759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:43 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:43.646652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:43.652984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:43.674319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.679045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.679718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.683055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.683755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.684512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.753331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:23:43.753868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquired lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:23:43.945949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Releasing lock "refresh_cache-b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:23:43.946543 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] HTTP exception thrown: floating IP not found Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Request method failure captured: Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action HTTP/1.1 Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 41 Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hPivi862ov6eOaPTo9wGmycaSpJkScyslvvAEyX1qwopNx8n8eJAjbZqa8mzo5TSfZUd9rPWEY4uOXPWRQstTujGqQyMFWWoX7i5X9XGwhilzJ-Ce9AZ0GGcat8-IWkD3RkkD_I31cfgkE0kmvij3vqiqAbcOH5sg6tSJSBhs7t0Y Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:43.948128 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcce475650d3431183d58264fb3f6c28", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcce475650d3431183d58264fb3f6c28"}]}] Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 424d514ff89b4b5795394b8bf0bad558 Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:23:43.949789 n-d-858384-17 devstack@n-api.service[120587]: exception: floating IP not found Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b1fb23b1-7ddc-4acb-becb-aac4d9884e7c', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:43.950764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 31 15:23:43.952434 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:43.955873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Returning 404 to user: floating IP not found {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:43.955873 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3aabee7-20c1-44fd-a62c-a00847676a77 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action" status: 404 len: 67 microversion: 2.1 time: 0.321528 Oct 31 15:23:43.957447 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 945/1760] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:43 2022] POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action => generated 67 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:43.968435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:43.969068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:43.978169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.978684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.979738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:43.980386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:43.981057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:43.981923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.105261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:44.117938 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da8da6a9-3ed8-4c84-bcb3-48ba6ec3ef05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1465 microversion: 2.1 time: 0.775254 Oct 31 15:23:44.120052 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 816/1761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:43 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1465 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:44.127463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:44.128175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:44.135872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.136790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.141801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.142638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.143128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.143567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.347316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:44.357114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:44.359476 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-467026ff-a26a-4df1-983e-e4ec0a7f7355 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.401290 Oct 31 15:23:44.360078 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 946/1762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:43 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:44.367374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b4241de-6f92-4de1-95bb-0087c8dddde1 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:44.411418 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0aa79e20-e85d-438e-a5ee-a672d8828f6a tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.285959 Oct 31 15:23:44.412164 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 817/1763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:44 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:44.425887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1206295155", "metadata": {"image_type": "test"}}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:44.431842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:44.451621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.455930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.456626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.458738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.460664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.462901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.471229 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-5b4241de-6f92-4de1-95bb-0087c8dddde1 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b4241de-6f92-4de1-95bb-0087c8dddde1 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Request method failure captured: Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action HTTP/1.1 Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 44 Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hPivi862ov6eOaPTo9wGmycaSpJkScyslvvAEyX1qwopNx8n8eJAjbZqa8mzo5TSfZUd9rPWEY4uOXPWRQstTujGqQyMFWWoX7i5X9XGwhilzJ-Ce9AZ0GGcat8-IWkD3RkkD_I31cfgkE0kmvij3vqiqAbcOH5sg6tSJSBhs7t0Y Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:23:44.473526 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcce475650d3431183d58264fb3f6c28", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcce475650d3431183d58264fb3f6c28"}]}] Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 424d514ff89b4b5795394b8bf0bad558 Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:23:44.475209 n-d-858384-17 devstack@n-api.service[120587]: exception: Floating IP not found for address 0.0.0.0. Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b1fb23b1-7ddc-4acb-becb-aac4d9884e7c', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:44.476729 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 31 15:23:44.479417 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:23:44.482725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b4241de-6f92-4de1-95bb-0087c8dddde1 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:44.482725 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b4241de-6f92-4de1-95bb-0087c8dddde1 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action" status: 404 len: 88 microversion: 2.1 time: 0.114033 Oct 31 15:23:44.486705 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 947/1764] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:44 2022] POST /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c/action => generated 88 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:23:44.492772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:44.502246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:44.536908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.539261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.539877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.540714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:44.543004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:44.543529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:44.549560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Getting quotas for project 95d5bc4f1cb64997a33609c07379cc60. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:44.573410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Getting quotas for user d3fa70260a7640f5b8fbb7eb9b75580e and project 95d5bc4f1cb64997a33609c07379cc60. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:44.977053 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe9dc905-b737-4c67-bcc1-1bc641482c4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "POST /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a/action" status: 202 len: 0 microversion: 2.1 time: 0.563521 Oct 31 15:23:44.980630 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 818/1765] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:23:44 2022] POST /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:23:44.995434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:44.996055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:45.014586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.017876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.019315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.021035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.024168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.025328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.098340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:45.197960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:45.232559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:45.247308 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3b3edce6-164a-42de-bfc0-da944abf4d19 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1316 microversion: 2.1 time: 0.759161 Oct 31 15:23:45.248398 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 948/1766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:44 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1316 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:45.253147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:45.269102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:45.278438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.278931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.283274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.284209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.284896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.285553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.318656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:45.329398 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5539fd82-fc89-43f9-9512-346614ac806e tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 204 len: 0 microversion: 2.1 time: 0.345589 Oct 31 15:23:45.330340 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 819/1767] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:44 2022] DELETE /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:45.343884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-903988b3-0006-4203-b757-85a5a56af7f0 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f3a790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:45.404106 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-903988b3-0006-4203-b757-85a5a56af7f0 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.069222 Oct 31 15:23:45.406207 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 820/1768] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:45 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:45.414128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:45.417719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:45.431978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.431978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.431978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.432797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.432797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.432797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.565306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:45.574889 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b139c2e-e292-4908-84ee-7edb101f7055 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1276 microversion: 2.1 time: 0.325298 Oct 31 15:23:45.577829 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 949/1769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:45 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1276 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:45.584711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8b8cb0c5-354c-47b1-951a-9982db0d4f94 req-1a87a77f-d467-404b-a861-14fbe09d1c12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c3e20a-338d-4dcb-946c-7012911f7928", "name": "network-vif-deleted", "tag": "a5d743e8-b414-4676-a691-44ad4577180c"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:45.595539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:45.605208 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9471e4d-fc4c-4562-bc36-18388b5ae058 tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1542 microversion: 2.1 time: 0.197720 Oct 31 15:23:45.607434 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 821/1770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:45 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1542 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:45.612751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:45.613755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:45.625337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b8cb0c5-354c-47b1-951a-9982db0d4f94 req-1a87a77f-d467-404b-a861-14fbe09d1c12 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.626229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b8cb0c5-354c-47b1-951a-9982db0d4f94 req-1a87a77f-d467-404b-a861-14fbe09d1c12 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.626824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b8cb0c5-354c-47b1-951a-9982db0d4f94 req-1a87a77f-d467-404b-a861-14fbe09d1c12 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.627563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.628165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.628873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.630889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.633629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.634271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.641304 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8b8cb0c5-354c-47b1-951a-9982db0d4f94 req-1a87a77f-d467-404b-a861-14fbe09d1c12 service nova] Creating event network-vif-deleted:a5d743e8-b414-4676-a691-44ad4577180c for instance 45c3e20a-338d-4dcb-946c-7012911f7928 on n-h1-858384-17 Oct 31 15:23:45.648389 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8b8cb0c5-354c-47b1-951a-9982db0d4f94 req-1a87a77f-d467-404b-a861-14fbe09d1c12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068563 Oct 31 15:23:45.649748 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 950/1771] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:45.656577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:45.657492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:45.666844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.667561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.668266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.669339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.670093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.670721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.912545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:45.923524 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7017eea6-ed29-4337-9eb0-dfbae60a13cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.313975 Oct 31 15:23:45.925049 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 822/1772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:45 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:45.932614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a8e367b5-8b22-480d-addf-6b837be84c8c req-ec617d5b-6390-40c7-b7b2-8c860b5cf8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4faf82e-33b1-482e-a400-e57ebf462f65", "name": "network-vif-plugged", "status": "completed", "tag": "5c17a2b4-0599-4cd9-ac6a-66a5a6df9448"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:45.948264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a8e367b5-8b22-480d-addf-6b837be84c8c req-ec617d5b-6390-40c7-b7b2-8c860b5cf8ed service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:45.948988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a8e367b5-8b22-480d-addf-6b837be84c8c req-ec617d5b-6390-40c7-b7b2-8c860b5cf8ed service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:45.949647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a8e367b5-8b22-480d-addf-6b837be84c8c req-ec617d5b-6390-40c7-b7b2-8c860b5cf8ed service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:45.963928 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a8e367b5-8b22-480d-addf-6b837be84c8c req-ec617d5b-6390-40c7-b7b2-8c860b5cf8ed service nova] Creating event network-vif-plugged:5c17a2b4-0599-4cd9-ac6a-66a5a6df9448 for instance f4faf82e-33b1-482e-a400-e57ebf462f65 on n-h2-858384-17 Oct 31 15:23:45.971413 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a8e367b5-8b22-480d-addf-6b837be84c8c req-ec617d5b-6390-40c7-b7b2-8c860b5cf8ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043754 Oct 31 15:23:45.972244 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 823/1773] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:46.120611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:46.130813 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-88f0710b-f780-4190-b36b-156ca8ac4686 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.479540 Oct 31 15:23:46.148084 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 951/1774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:45 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:46.271973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:46.274023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:46.294254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.295467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.297732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.298725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.300164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.301119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.422595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8ed59a7-bacc-4232-8b2b-b400475af339 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f36c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:46.498021 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8ed59a7-bacc-4232-8b2b-b400475af339 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.079624 Oct 31 15:23:46.501442 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 952/1775] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:46 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:46.606805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:46.607584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:46.614013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.614500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.614938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.615648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.616176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.616913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.713568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:46.724029 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-265d91c6-a7ea-4d66-875c-c5d1340354ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1316 microversion: 2.1 time: 0.456097 Oct 31 15:23:46.738026 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 824/1776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:46 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:46.747382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:46.748499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:46.755230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.756027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.757434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.758673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.759423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.760123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.914892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:46.925271 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46082cf4-6a9c-46ea-91a9-b7fa9772ae2f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1318 microversion: 2.1 time: 0.324585 Oct 31 15:23:46.927787 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 953/1777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:46 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:46.950503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:46.951844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:46.964327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.966675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.967300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:46.969820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:46.970481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:46.973955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.217202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:47.231691 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-532ef130-0c57-46b7-bb6a-72240ea052cd tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1542 microversion: 2.1 time: 0.488285 Oct 31 15:23:47.232653 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 825/1778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:46 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1542 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:47.237752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:47.239692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:47.254466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.254957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.255386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.256088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.257294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.257844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.424708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:47.437406 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23869dfe-6e63-45fe-930c-0e89f2ef91d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.492855 Oct 31 15:23:47.440258 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 954/1779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:46 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:47.515419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a87290d-a9bd-48a6-9692-66325b3f7f61 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e1a5eb80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:47.604590 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a87290d-a9bd-48a6-9692-66325b3f7f61 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.094231 Oct 31 15:23:47.613025 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 955/1780] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:47 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:47.613897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:47.634966 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f2ef7be-f6cf-4dc6-a241-cf8c72d609e2 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.400777 Oct 31 15:23:47.638795 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 826/1781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:47 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:47.756040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:47.757498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:47.774938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.776730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.778554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.779681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.782803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.783538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.877484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a6afd1f4-7457-4195-a8cb-d6597309ffc7 req-e3dfbcd2-91ac-4df9-adae-b6096b9f7f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fb23b1-7ddc-4acb-becb-aac4d9884e7c", "name": "network-vif-deleted", "tag": "5716d5ab-5829-43d1-b848-520b1e2c399f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:47.918848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a6afd1f4-7457-4195-a8cb-d6597309ffc7 req-e3dfbcd2-91ac-4df9-adae-b6096b9f7f62 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:47.920315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a6afd1f4-7457-4195-a8cb-d6597309ffc7 req-e3dfbcd2-91ac-4df9-adae-b6096b9f7f62 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:47.920841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a6afd1f4-7457-4195-a8cb-d6597309ffc7 req-e3dfbcd2-91ac-4df9-adae-b6096b9f7f62 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:47.961828 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a6afd1f4-7457-4195-a8cb-d6597309ffc7 req-e3dfbcd2-91ac-4df9-adae-b6096b9f7f62 service nova] Creating event network-vif-deleted:5716d5ab-5829-43d1-b848-520b1e2c399f for instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c on n-h1-858384-17 Oct 31 15:23:47.976243 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a6afd1f4-7457-4195-a8cb-d6597309ffc7 req-e3dfbcd2-91ac-4df9-adae-b6096b9f7f62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102050 Oct 31 15:23:47.977443 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 827/1782] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:48.005000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:48.005779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:48.022847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.026782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.027486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.028501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.031691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.032472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.368449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:48.383449 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ca7aab5-9500-4298-9204-3cddfdea5651 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1318 microversion: 2.1 time: 0.391568 Oct 31 15:23:48.384293 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 828/1783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:47 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:48.389222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:48.390036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:48.396252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.396956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.397790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.398890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.399586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.400516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.431876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:48.462914 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6dd5de7-0a70-4942-ab17-0faaac94f1ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1316 microversion: 2.1 time: 0.709956 Oct 31 15:23:48.464720 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 956/1784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:47 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:48.487764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fd7d878a-8791-429d-9bd6-a620880bf4cd req-ed71d410-d9d3-44cf-87c3-9255ca66ed38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cc5e68-4057-4b4f-b91e-95cd526f91fc", "name": "network-vif-plugged", "status": "completed", "tag": "92be1209-62cc-417d-bfaf-50cace03895b"}, {"server_uuid": "02cc5e68-4057-4b4f-b91e-95cd526f91fc", "name": "network-vif-plugged", "status": "completed", "tag": "3e4abe77-43a1-40a6-bce8-58b1b94e0ed6"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:48.509833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fd7d878a-8791-429d-9bd6-a620880bf4cd req-ed71d410-d9d3-44cf-87c3-9255ca66ed38 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.511200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.511704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.512752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fd7d878a-8791-429d-9bd6-a620880bf4cd req-ed71d410-d9d3-44cf-87c3-9255ca66ed38 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.513481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.513959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lazy-loading 'fault' on Instance uuid b1fb23b1-7ddc-4acb-becb-aac4d9884e7c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:23:48.515959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fd7d878a-8791-429d-9bd6-a620880bf4cd req-ed71d410-d9d3-44cf-87c3-9255ca66ed38 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.557079 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fd7d878a-8791-429d-9bd6-a620880bf4cd req-ed71d410-d9d3-44cf-87c3-9255ca66ed38 service nova] Creating event network-vif-plugged:92be1209-62cc-417d-bfaf-50cace03895b for instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc on n-h1-858384-17 Oct 31 15:23:48.558253 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fd7d878a-8791-429d-9bd6-a620880bf4cd req-ed71d410-d9d3-44cf-87c3-9255ca66ed38 service nova] Creating event network-vif-plugged:3e4abe77-43a1-40a6-bce8-58b1b94e0ed6 for instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc on n-h1-858384-17 Oct 31 15:23:48.566462 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fd7d878a-8791-429d-9bd6-a620880bf4cd req-ed71d410-d9d3-44cf-87c3-9255ca66ed38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.100216 Oct 31 15:23:48.572942 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 957/1785] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:48.579430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:48.580643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:48.589900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.590736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.591462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.592427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:48.593164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:48.593904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:48.608890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424d514ff89b4b5795394b8bf0bad558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcce475650d3431183d58264fb3f6c28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:48.620393 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71d000bf-54a3-43bd-a88e-0265783ff25b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 200 len: 1322 microversion: 2.1 time: 0.234696 Oct 31 15:23:48.622211 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 829/1786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:48 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:48.822984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b391757a-c0e0-44b6-b0e6-04ab07f760a1 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Action: 'create', calling method: .version_select at 0x7f16e0f591f0>, body: {"keypair": {"name": "tempest-keypair-735657094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2Vpbu9tZehQExa+hJPeiTBzMHemquU//puR761qHXp+e1VmqrSim6SE2WVC7+wzXFMSQJ8CODFySJnBqYtu3lxCa9mAVPSp0XkF/r9AVXVYsgFTVkDzwkzQTUBF7Sepw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:48.859810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b391757a-c0e0-44b6-b0e6-04ab07f760a1 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:48.867713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b391757a-c0e0-44b6-b0e6-04ab07f760a1 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for user 57fe9e372ff244cb84e7bac10d9dfbfd and project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:48.934214 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b391757a-c0e0-44b6-b0e6-04ab07f760a1 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.310432 Oct 31 15:23:48.940651 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 830/1787] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 31 15:23:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 312 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:23:48.947878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b22a54bc-3725-4071-b251-58c97d91bd4b tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f014c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.023821 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b22a54bc-3725-4071-b251-58c97d91bd4b tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.085042 Oct 31 15:23:49.025038 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 831/1788] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:48 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:49.044923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.047780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:49.053152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:49.060159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.062742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.064699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.066936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.067116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ecbd1271-d384-4af7-9be0-c3f7f74c7375 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.492537 Oct 31 15:23:49.068810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.070137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.077075 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 958/1789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:48 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:49.100915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0c97aeaf-e951-4240-9556-5dfe38d0fc2d req-99a2ac40-3968-4416-b8e6-f89a82dd369d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14785246-ca49-46bc-a3be-a98cc68d6a5c", "tag": "056d4a62-dcbf-44f5-858b-7ffb06218964"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:49.128083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:49.145812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0c97aeaf-e951-4240-9556-5dfe38d0fc2d req-99a2ac40-3968-4416-b8e6-f89a82dd369d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.146329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0c97aeaf-e951-4240-9556-5dfe38d0fc2d req-99a2ac40-3968-4416-b8e6-f89a82dd369d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.149475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0c97aeaf-e951-4240-9556-5dfe38d0fc2d req-99a2ac40-3968-4416-b8e6-f89a82dd369d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.186110 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0c97aeaf-e951-4240-9556-5dfe38d0fc2d req-99a2ac40-3968-4416-b8e6-f89a82dd369d service nova] Creating event network-changed:056d4a62-dcbf-44f5-858b-7ffb06218964 for instance 14785246-ca49-46bc-a3be-a98cc68d6a5c on n-h1-858384-17 Oct 31 15:23:49.193293 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0c97aeaf-e951-4240-9556-5dfe38d0fc2d req-99a2ac40-3968-4416-b8e6-f89a82dd369d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111958 Oct 31 15:23:49.193956 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 959/1790] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:49.200057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75928a83-974e-44b1-a104-670b376a0d65 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e14bf4c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.211807 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75928a83-974e-44b1-a104-670b376a0d65 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-735657094" status: 200 len: 512 microversion: 2.2 time: 0.016514 Oct 31 15:23:49.212925 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 960/1791] 10.222.0.20 () {60 vars in 1255 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-735657094 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:49.224550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b341cd99-6e80-4593-9497-e31fffc9fa18 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e1abd9d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.250071 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b341cd99-6e80-4593-9497-e31fffc9fa18 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-735657094" status: 204 len: 0 microversion: 2.2 time: 0.029463 Oct 31 15:23:49.251448 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 961/1792] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Oct 31 15:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-735657094 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:23:49.269897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7136349-c30c-4093-8ae2-5bb059c009de tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Action: 'create', calling method: .version_select at 0x7f16e55a1dc0>, body: {"keypair": {"name": "tempest-keypair-131102508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa8NyvfShoJXckLCuvLPfbDY8jSYPg2tMA9w0LMBk5ABdT/Gyx1Zbl/E0tFZIhFrogym08T+nqIMn8YAfY49rslnhZykeo/1ifFrHhEVyE4tQHjqlLzGvhihgyCF/wPgg=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:49.294006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f7136349-c30c-4093-8ae2-5bb059c009de tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:49.300845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f7136349-c30c-4093-8ae2-5bb059c009de tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for user 57fe9e372ff244cb84e7bac10d9dfbfd and project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:49.351790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:49.357233 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7136349-c30c-4093-8ae2-5bb059c009de tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.091996 Oct 31 15:23:49.358978 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 962/1793] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 31 15:23:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:23:49.365661 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc1be640-98cc-43dc-be7c-c2ecfaf3c6e9 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1333 microversion: 2.1 time: 0.331157 Oct 31 15:23:49.367017 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 832/1794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1333 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:49.393576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d18d3267-e1c0-47f2-8d22-e3380de17663 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e55d30d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.411197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.412140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:49.423715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.424313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.424818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.425701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.426409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.427212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.440572 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d18d3267-e1c0-47f2-8d22-e3380de17663 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-131102508" status: 204 len: 0 microversion: 2.2 time: 0.064017 Oct 31 15:23:49.442114 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 963/1795] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Oct 31 15:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-131102508 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:49.454130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af7c02b9-d4bd-471d-90a3-cc61b3fc2406 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Action: 'create', calling method: .version_select at 0x7f16e1600700>, body: {"keypair": {"name": "tempest-keypair-994666412", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:49.474801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-af7c02b9-d4bd-471d-90a3-cc61b3fc2406 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:49.484572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-af7c02b9-d4bd-471d-90a3-cc61b3fc2406 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for user 57fe9e372ff244cb84e7bac10d9dfbfd and project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:49.512281 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af7c02b9-d4bd-471d-90a3-cc61b3fc2406 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.062767 Oct 31 15:23:49.514399 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 964/1796] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 31 15:23:49 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:23:49.525144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.528344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:49.547154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.547730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.548239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.549036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.556842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.557876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.615360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:49.672038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:49.680685 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c274d7f-9398-46bf-bd21-cc65e245cd80 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1318 microversion: 2.1 time: 0.273995 Oct 31 15:23:49.681858 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 833/1797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:49.687020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b50f39ab-5206-4744-b73b-3f5fb825adaa tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e0f595e0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.721725 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b50f39ab-5206-4744-b73b-3f5fb825adaa tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994666412" status: 204 len: 0 microversion: 2.2 time: 0.038509 Oct 31 15:23:49.722340 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 834/1798] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Oct 31 15:23:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994666412 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:49.729664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:49.730286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] [instance: b1fb23b1-7ddc-4acb-becb-aac4d9884e7c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:49.738905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.739908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.741443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.742490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:49.743206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:49.744134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:49.765487 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] HTTP exception thrown: Instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c could not be found. Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Request method failure captured: Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c HTTP/1.1 Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hPivi862ov6eOaPTo9wGmycaSpJkScyslvvAEyX1qwopNx8n8eJAjbZqa8mzo5TSfZUd9rPWEY4uOXPWRQstTujGqQyMFWWoX7i5X9XGwhilzJ-Ce9AZ0GGcat8-IWkD3RkkD_I31cfgkE0kmvij3vqiqAbcOH5sg6tSJSBhs7t0Y Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:23:49.767952 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcce475650d3431183d58264fb3f6c28", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcce475650d3431183d58264fb3f6c28"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcce475650d3431183d58264fb3f6c28"}]}] Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: fcce475650d3431183d58264fb3f6c28 Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868 Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 424d514ff89b4b5795394b8bf0bad558 Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:23:49.769510 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c could not be found. Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'b1fb23b1-7ddc-4acb-becb-aac4d9884e7c'} Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c could not be found. Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:23:49.770295 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c could not be found. Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c could not be found. Oct 31 15:23:49.771746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:23:49.775882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] Returning 404 to user: Instance b1fb23b1-7ddc-4acb-becb-aac4d9884e7c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:23:49.776987 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8018672c-4b13-4750-ac34-7c93bd35878b tempest-FloatingIPsAssociationNegativeTestJSON-515666868 tempest-FloatingIPsAssociationNegativeTestJSON-515666868-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c" status: 404 len: 111 microversion: 2.1 time: 0.053723 Oct 31 15:23:49.791309 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 835/1799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/servers/b1fb23b1-7ddc-4acb-becb-aac4d9884e7c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:23:49.796656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8048c015-3307-438c-8efb-8e6b4767cfc9 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Action: 'create', calling method: .version_select at 0x7f16e0f01670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1765963875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOchHxfpB2wGwovpJZSld0zw6VH5arcXTfBXY5VcOxzKLbM7Vqpi3LTEU96o40VYbyqrBNdrQBLrUnR3iZOoxnc9ZwUNgjY2qeWfxHquaPk1oSgAxvt0xaulwLAo9TdUjg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:49.845367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8048c015-3307-438c-8efb-8e6b4767cfc9 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:49.868164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8048c015-3307-438c-8efb-8e6b4767cfc9 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for user 57fe9e372ff244cb84e7bac10d9dfbfd and project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:49.912086 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8048c015-3307-438c-8efb-8e6b4767cfc9 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.118999 Oct 31 15:23:49.914238 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 836/1800] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 31 15:23:49 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:23:49.929751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7eb2d86-2bdc-4dbb-aad5-f8172ef6357e tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Action: 'create', calling method: .version_select at 0x7f16e0fe39d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-764072998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+APaFr3NUCfa860Wo79u+3UQiGWX8HVWCSHLSTZavM1JcL1Y2Mm2NhVlz/JnogxAcyztWpPlsZLptQPZRSTj7GLBL0IYs/BoP3bkuNPY2JaoCJklfb35m5DBxlCIsiwQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:49.956914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c7eb2d86-2bdc-4dbb-aad5-f8172ef6357e tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:49.968384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c7eb2d86-2bdc-4dbb-aad5-f8172ef6357e tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for user 57fe9e372ff244cb84e7bac10d9dfbfd and project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:50.003661 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7eb2d86-2bdc-4dbb-aad5-f8172ef6357e tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.079580 Oct 31 15:23:50.007937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 837/1801] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 31 15:23:49 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:23:50.023373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-10f7e99a-b32f-4bbe-bef8-d01028df8eb3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Action: 'create', calling method: .version_select at 0x7f16e0f36ca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1373193625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwda8L63fO21Z8tyyvfTsM5cyWGfXp2iP8L+Dz+wMEBfV5QuIxa15DvIgTEFoyao9b9akygiOuse3KMvluhbETMnACaZG83cQnV4f6bkhcChEbb6CpoqMFCf9emXbw+IA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:50.066579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-10f7e99a-b32f-4bbe-bef8-d01028df8eb3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:50.082424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-10f7e99a-b32f-4bbe-bef8-d01028df8eb3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for user 57fe9e372ff244cb84e7bac10d9dfbfd and project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:50.146573 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-10f7e99a-b32f-4bbe-bef8-d01028df8eb3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.128295 Oct 31 15:23:50.151198 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 838/1802] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 31 15:23:50 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 31 15:23:50.159897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d246f072-7448-4348-8a83-22ef8b17a53f tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f59310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.238309 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d246f072-7448-4348-8a83-22ef8b17a53f tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.085666 Oct 31 15:23:50.241035 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 839/1803] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:50 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:50.264947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.266697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:50.291734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.292140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.292588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.293360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.293823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.294300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.462511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:50.472298 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9dfa2823-7db7-4fc1-a315-dd963ef9165e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.956524 Oct 31 15:23:50.499407 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 965/1804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:49 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:50.512953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d24360cf-c8dd-4d13-834a-1bfad66316bb tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e1abdaf0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.519009 n-d-858384-17 devstack@n-api.service[120587]: WARNING oslo_db.sqlalchemy.utils [None req-d24360cf-c8dd-4d13-834a-1bfad66316bb tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:23:50.526858 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d24360cf-c8dd-4d13-834a-1bfad66316bb tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.024605 Oct 31 15:23:50.535377 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 966/1805] 10.222.0.20 () {60 vars in 1177 bytes} [Mon Oct 31 15:23:50 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:50.551649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.551649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:50.562178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.562744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.563358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.565939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.566461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.566996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.650424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:50.665717 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de411ab6-6fe7-48d4-9807-cdbddcc06e26 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.423498 Oct 31 15:23:50.681158 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 840/1806] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:50 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:50.681158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d240962-be43-4c88-a5b7-97ea3babefd9 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e0f01550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.721916 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d240962-be43-4c88-a5b7-97ea3babefd9 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1373193625" status: 204 len: 0 microversion: 2.2 time: 0.051935 Oct 31 15:23:50.729501 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 841/1807] 10.222.0.20 () {60 vars in 1321 bytes} [Mon Oct 31 15:23:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1373193625 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:50.740600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-19a54596-0677-4f81-9bfd-5c6924f5c368 req-e07805ed-a84a-466a-8975-ffec0c80eb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57828c57-25f9-4820-abae-396b40b5db0a", "name": "network-vif-plugged", "status": "completed", "tag": "77af5736-44c8-4ad7-b405-90164244d290"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:50.763101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-19a54596-0677-4f81-9bfd-5c6924f5c368 req-e07805ed-a84a-466a-8975-ffec0c80eb9e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.763751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-19a54596-0677-4f81-9bfd-5c6924f5c368 req-e07805ed-a84a-466a-8975-ffec0c80eb9e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.764259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-19a54596-0677-4f81-9bfd-5c6924f5c368 req-e07805ed-a84a-466a-8975-ffec0c80eb9e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.783832 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-19a54596-0677-4f81-9bfd-5c6924f5c368 req-e07805ed-a84a-466a-8975-ffec0c80eb9e service nova] Creating event network-vif-plugged:77af5736-44c8-4ad7-b405-90164244d290 for instance 57828c57-25f9-4820-abae-396b40b5db0a on n-h2-858384-17 Oct 31 15:23:50.799848 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-19a54596-0677-4f81-9bfd-5c6924f5c368 req-e07805ed-a84a-466a-8975-ffec0c80eb9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069176 Oct 31 15:23:50.801016 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 842/1808] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:50.810210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:50.812796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:50.825323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.831738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.832230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.833175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:50.833659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:50.834093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:50.874539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:50.889105 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d45e21f7-013a-4e7f-a961-58eae5dd2b7e tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1667 microversion: 2.1 time: 0.353012 Oct 31 15:23:50.890120 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 967/1809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:50 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1667 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:50.900218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1951576273", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:50.987989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] validate_networks() for [('ab7e23b0-155e-4226-9a15-6e50ea9a0142', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:23:51.112189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:51.127041 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-878773e4-7e22-41cb-893f-780256ee19ff tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1318 microversion: 2.1 time: 0.324697 Oct 31 15:23:51.128800 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 843/1810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:50 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:51.140890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c20b40d-ce86-42ec-9099-461f010e381a tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e0ff6940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:51.190217 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c20b40d-ce86-42ec-9099-461f010e381a tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-764072998" status: 204 len: 0 microversion: 2.2 time: 0.059332 Oct 31 15:23:51.194519 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 844/1811] 10.222.0.20 () {60 vars in 1318 bytes} [Mon Oct 31 15:23:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-764072998 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:51.197921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-18b21450-d348-48fc-976a-ccccb39e8f4b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:51.198564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-18b21450-d348-48fc-976a-ccccb39e8f4b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:51.214561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18b21450-d348-48fc-976a-ccccb39e8f4b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.215241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18b21450-d348-48fc-976a-ccccb39e8f4b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.215752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18b21450-d348-48fc-976a-ccccb39e8f4b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.218436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18b21450-d348-48fc-976a-ccccb39e8f4b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.218992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18b21450-d348-48fc-976a-ccccb39e8f4b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.220575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18b21450-d348-48fc-976a-ccccb39e8f4b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.288397 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-18b21450-d348-48fc-976a-ccccb39e8f4b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc/ips" status: 200 len: 178 microversion: 2.1 time: 0.094938 Oct 31 15:23:51.296695 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 845/1812] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:23:51 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc/ips => generated 178 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:51.309233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30416ec4-98a3-422a-9606-727e98a88fd3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e1803dc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:51.344576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:51.360527 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30416ec4-98a3-422a-9606-727e98a88fd3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1765963875" status: 204 len: 0 microversion: 2.2 time: 0.062485 Oct 31 15:23:51.362119 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 846/1813] 10.222.0.20 () {60 vars in 1321 bytes} [Mon Oct 31 15:23:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1765963875 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:51.409595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e30ec93-3bf4-433a-b040-21f259ffd5cc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f01f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:51.478820 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e30ec93-3bf4-433a-b040-21f259ffd5cc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.114600 Oct 31 15:23:51.479784 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 847/1814] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:51 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:51.484857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:51.485671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:51.501416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.502330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.503063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.504094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.504773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.505470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.551322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:23:51.634629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:51.704223 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23221c98-697f-46e9-9f77-4525e5d10ae0 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "DELETE /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 204 len: 0 microversion: 2.1 time: 0.222735 Oct 31 15:23:51.705563 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 848/1815] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:23:51 2022] DELETE /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:51.717519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a239fe9-023f-4fc0-a51f-df4a7a932ae3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Action: 'create', calling method: .version_select at 0x7f16e0ee8c10>, body: {"keypair": {"name": "tempest-keypair-1405289018", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5MvCwjPFmgIvDCW3Y8RNd0wzJ2cvUtuTRz41yVaQVqdlPf+xvBxW/8NN81d3q0ekZH1UHYzoV5BCQ48FsWseKUXjjp5AUOV7n1RI8PM6HwFRGcxWg3Ocym5a2ROyeS5w=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:51.759378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-1a239fe9-023f-4fc0-a51f-df4a7a932ae3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:51.780863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-1a239fe9-023f-4fc0-a51f-df4a7a932ae3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for user 57fe9e372ff244cb84e7bac10d9dfbfd and project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:51.822098 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a239fe9-023f-4fc0-a51f-df4a7a932ae3 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.114373 Oct 31 15:23:51.823052 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 849/1816] 10.222.0.20 () {62 vars in 1199 bytes} [Mon Oct 31 15:23:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:23:51.834500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:51.836151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:51.854222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:23:51.855411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.856023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.856777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:23:51.857917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.860693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.860693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.860693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.862294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:23:51.863388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:23:51.864932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:23:51.890784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.892258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.893059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.896442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:51.901079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:51.902919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:51.950919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Getting quotas for project 6e81a4d86ac64eef904bb82724322c40. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:51.958529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Getting quotas for user b058345f19944e0880a4552d6add5ba7 and project 6e81a4d86ac64eef904bb82724322c40. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:51.974775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:23:51.981853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:23:52.094205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:52.112126 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71138e81-0c6e-44e4-815c-5a672798e34d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216665 Oct 31 15:23:52.121298 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 968/1817] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:23:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:23:52.134162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:52.135093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:52.151018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:52.152148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:52.152766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:52.154016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:52.154653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:52.155654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:52.300474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:52.326029 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ab20f76-8d9c-4422-964e-ded38a3f72e6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.498793 Oct 31 15:23:52.347714 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 850/1818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:51 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:52.370966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8fd15689-2681-44ca-8975-03c32504f9f5 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e1007ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:52.391939 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8fd15689-2681-44ca-8975-03c32504f9f5 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1405289018" status: 200 len: 513 microversion: 2.2 time: 0.042993 Oct 31 15:23:52.395882 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 851/1819] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Oct 31 15:23:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1405289018 => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:52.419727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2888e094-22a2-43d4-a0cf-4fd1cd3d693d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:52.427046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2888e094-22a2-43d4-a0cf-4fd1cd3d693d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:52.526784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:52.543328 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6a8ac3e5-4a5c-4697-9bf6-9740fbd9f83f tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1673 microversion: 2.1 time: 0.418925 Oct 31 15:23:52.548231 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 969/1820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:52 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1673 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:52.561884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:52.562509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:52.586960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2888e094-22a2-43d4-a0cf-4fd1cd3d693d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:52.597032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:52.597568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:52.598017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:52.598740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:52.599201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:52.599631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:52.607324 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2888e094-22a2-43d4-a0cf-4fd1cd3d693d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1217 microversion: 2.1 time: 0.206017 Oct 31 15:23:52.612394 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 852/1821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:52 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:52.623170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed35d3ad-2c56-46e5-b5a7-e714be3b8c5e tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e0f36dc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:52.633697 n-d-858384-17 devstack@n-api.service[120588]: WARNING oslo_db.sqlalchemy.utils [None req-ed35d3ad-2c56-46e5-b5a7-e714be3b8c5e tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:23:52.645878 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed35d3ad-2c56-46e5-b5a7-e714be3b8c5e tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.032069 Oct 31 15:23:52.655359 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 853/1822] 10.222.0.20 () {60 vars in 1177 bytes} [Mon Oct 31 15:23:52 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:52.659298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-277f5bd1-4b65-4b7d-8b74-9dcdadcada11 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0ee8a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:52.747122 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-277f5bd1-4b65-4b7d-8b74-9dcdadcada11 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.095266 Oct 31 15:23:52.760510 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 854/1823] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:52 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:52.760510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed60bc7b-330c-4abc-b773-8115e178b983 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e0f36940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:52.810023 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed60bc7b-330c-4abc-b773-8115e178b983 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405289018" status: 204 len: 0 microversion: 2.2 time: 0.054700 Oct 31 15:23:52.811177 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 855/1824] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Oct 31 15:23:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405289018 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:52.820575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Action: 'create', calling method: .version_select at 0x7f16e0ee8940>, body: {"keypair": {"name": "tempest-keypair-1434243428", "type": "x509"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:52.860902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:52.887240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for user 57fe9e372ff244cb84e7bac10d9dfbfd and project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:52.942702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.processutils [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp9qxia5hc/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9qxia5hc/temp.key -subj /CN=57fe9e372ff244cb84e7bac10d9dfbfd -extensions v3_req_client {{(pid=120588) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 31 15:23:53.543083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:53.558220 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b19a2d7-fec4-4682-9efe-2ce79c89a599 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1318 microversion: 2.1 time: 1.008034 Oct 31 15:23:53.605342 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 970/1825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:52 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1318 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:53.610872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:53.618510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:53.641377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:53.646557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:53.653507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:53.655476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:53.656783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:53.657783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:53.783195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.processutils [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp9qxia5hc/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9qxia5hc/temp.key -subj /CN=57fe9e372ff244cb84e7bac10d9dfbfd -extensions v3_req_client" returned: 0 in 0.840s {{(pid=120588) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 31 15:23:53.785819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.processutils [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp9qxia5hc/temp.key -password pass: {{(pid=120588) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 31 15:23:53.888471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.processutils [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp9qxia5hc/temp.key -password pass:" returned: 0 in 0.102s {{(pid=120588) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 31 15:23:53.972807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:23:53.984536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Getting quotas for user 57fe9e372ff244cb84e7bac10d9dfbfd and project 048f8f2e9a7d4ca69ee5d64340b893a6. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:23:54.023329 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-134f9ec7-4636-4390-b4be-2d1bc8f1e17b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.206823 Oct 31 15:23:54.029841 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 856/1826] 10.222.0.20 () {62 vars in 1198 bytes} [Mon Oct 31 15:23:52 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1212 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:23:54.041426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:54.042382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:54.062866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.064043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.066652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.070934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.072570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.074692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.530611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:54.540820 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66bd7abd-4582-4523-806a-d5cccdb9a6a0 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.933699 Oct 31 15:23:54.544738 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 971/1827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:53 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:54.563249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:54.571712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:54.596517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.597414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.598348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.599235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:54.600119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:54.600724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:54.871778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:54.887303 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ba36e21-cbf9-4007-aec3-2a4b1c5b6345 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1269 microversion: 2.1 time: 0.340770 Oct 31 15:23:54.910915 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 972/1828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:54 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1269 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:54.923469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7629439c-5caf-43a4-bd51-fd30003c3e5f tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f36ca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:55.047453 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7629439c-5caf-43a4-bd51-fd30003c3e5f tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.134916 Oct 31 15:23:55.048214 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 973/1829] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:54 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:55.065973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c08238f-da3d-4941-9558-253eb13fe24b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e15cfdc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:55.105306 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c08238f-da3d-4941-9558-253eb13fe24b tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1434243428" status: 200 len: 1534 microversion: 2.2 time: 0.051628 Oct 31 15:23:55.106364 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 974/1830] 10.222.0.20 () {60 vars in 1258 bytes} [Mon Oct 31 15:23:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1434243428 => generated 1534 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:55.111687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:55.112317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:55.132808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.133447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.133918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.136911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.137431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.137878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.183259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:23:55.201022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:55.211211 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5437edbd-7db0-4654-9a97-648b145b536b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1673 microversion: 2.1 time: 1.181389 Oct 31 15:23:55.218653 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 857/1831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:54 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1673 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:55.230450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd93e488-26ef-4f72-a903-7c820a151b2c tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e0f36c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:55.246770 n-d-858384-17 devstack@n-api.service[120588]: WARNING oslo_db.sqlalchemy.utils [None req-bd93e488-26ef-4f72-a903-7c820a151b2c tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:23:55.259468 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd93e488-26ef-4f72-a903-7c820a151b2c tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.039444 Oct 31 15:23:55.264152 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 858/1832] 10.222.0.20 () {60 vars in 1177 bytes} [Mon Oct 31 15:23:55 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:55.279158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91869ccb-76f0-4392-90e3-81eccbc74712 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] Calling method '.version_select at 0x7f16e0ef89d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:55.340687 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91869ccb-76f0-4392-90e3-81eccbc74712 tempest-KeyPairsV22TestJSON-69785394 tempest-KeyPairsV22TestJSON-69785394-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434243428" status: 204 len: 0 microversion: 2.2 time: 0.068907 Oct 31 15:23:55.342761 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 859/1833] 10.222.0.20 () {60 vars in 1261 bytes} [Mon Oct 31 15:23:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434243428 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:23:55.580312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:55.580933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:55.590078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:55.603894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.606047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.607591 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-480962ae-23e3-4ce8-841c-3661d977c622 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1318 microversion: 2.1 time: 0.497808 Oct 31 15:23:55.621152 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 975/1834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:55 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:55.621421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.621421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.621421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.621421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.626028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8a8cdcf2-cb76-4f51-b64e-2e1a191b7aa5 req-145f133b-3e97-42b9-a9dc-33025a1258f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14785246-ca49-46bc-a3be-a98cc68d6a5c", "name": "network-vif-plugged", "status": "completed", "tag": "056d4a62-dcbf-44f5-858b-7ffb06218964"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:55.657670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8a8cdcf2-cb76-4f51-b64e-2e1a191b7aa5 req-145f133b-3e97-42b9-a9dc-33025a1258f0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.664930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8a8cdcf2-cb76-4f51-b64e-2e1a191b7aa5 req-145f133b-3e97-42b9-a9dc-33025a1258f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.665487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8a8cdcf2-cb76-4f51-b64e-2e1a191b7aa5 req-145f133b-3e97-42b9-a9dc-33025a1258f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.700228 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8a8cdcf2-cb76-4f51-b64e-2e1a191b7aa5 req-145f133b-3e97-42b9-a9dc-33025a1258f0 service nova] Creating event network-vif-plugged:056d4a62-dcbf-44f5-858b-7ffb06218964 for instance 14785246-ca49-46bc-a3be-a98cc68d6a5c on n-h1-858384-17 Oct 31 15:23:55.715143 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8a8cdcf2-cb76-4f51-b64e-2e1a191b7aa5 req-145f133b-3e97-42b9-a9dc-33025a1258f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094830 Oct 31 15:23:55.720185 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 976/1835] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:23:55.918868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:55.919810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:55.937067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.940817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.944933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:55.947922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:55.949910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:55.951432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.269963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:56.279522 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccbcdfc0-dd71-4bb7-b453-baef40656997 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1275 microversion: 2.1 time: 0.365278 Oct 31 15:23:56.294044 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 977/1836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:55 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1275 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:56.310906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d946db1-8f8f-4346-a386-c912486b02a9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e158bd30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:56.403757 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d946db1-8f8f-4346-a386-c912486b02a9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.102641 Oct 31 15:23:56.404335 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 978/1837] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:56 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:56.416363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:56.416891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:56.444310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:56.450226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.452450 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3bf72e37-8bfb-4b31-b4fd-fcf26bd4308f tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.884334 Oct 31 15:23:56.453062 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 860/1838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:55 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:56.458439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.458898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.460298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.460756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.466116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.635174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:56.636128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:56.647226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.649592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.651393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:56.654646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:56.655345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:56.655982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:57.013081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:57.027410 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa1ab4f6-7e7f-46fc-acc7-c289c2e64cf3 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1673 microversion: 2.1 time: 0.622007 Oct 31 15:23:57.030708 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 979/1839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:56 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1673 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:57.307302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:57.308368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:57.326809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:57.332513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:57.333452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:57.335932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:57.338820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:57.341701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:57.515207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:57.527054 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d98c2a39-4343-465d-a2b1-736d29250fac tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1318 microversion: 2.1 time: 0.896697 Oct 31 15:23:57.527677 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 861/1840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:56 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:57.577558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a0c73e0-4f67-46fa-b5da-d1fb0a13dedc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f12dc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:57.664867 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a0c73e0-4f67-46fa-b5da-d1fb0a13dedc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.097759 Oct 31 15:23:57.665494 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 862/1841] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:57 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:57.680579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:57.681048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:57.714615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:57.714813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:57.715312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:57.721644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:57.722210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:57.726087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:57.949046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:57.960942 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f362f235-d71d-4d1c-8e12-fb5c758145b3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1317 microversion: 2.1 time: 0.657795 Oct 31 15:23:57.962670 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 980/1842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:57 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:57.968692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-849d93fa-45ad-4987-8b24-9e560f1da864 req-ead2b195-4432-45a2-b3d9-e5ad4db7c504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cc5e68-4057-4b4f-b91e-95cd526f91fc", "name": "network-vif-unplugged", "status": "completed", "tag": "3e4abe77-43a1-40a6-bce8-58b1b94e0ed6"}, {"server_uuid": "02cc5e68-4057-4b4f-b91e-95cd526f91fc", "name": "network-vif-unplugged", "status": "completed", "tag": "92be1209-62cc-417d-bfaf-50cace03895b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:58.000542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-849d93fa-45ad-4987-8b24-9e560f1da864 req-ead2b195-4432-45a2-b3d9-e5ad4db7c504 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.002242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-849d93fa-45ad-4987-8b24-9e560f1da864 req-ead2b195-4432-45a2-b3d9-e5ad4db7c504 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.004146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-849d93fa-45ad-4987-8b24-9e560f1da864 req-ead2b195-4432-45a2-b3d9-e5ad4db7c504 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.030521 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-849d93fa-45ad-4987-8b24-9e560f1da864 req-ead2b195-4432-45a2-b3d9-e5ad4db7c504 service nova] Creating event network-vif-unplugged:3e4abe77-43a1-40a6-bce8-58b1b94e0ed6 for instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc on n-h1-858384-17 Oct 31 15:23:58.032771 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-849d93fa-45ad-4987-8b24-9e560f1da864 req-ead2b195-4432-45a2-b3d9-e5ad4db7c504 service nova] Creating event network-vif-unplugged:92be1209-62cc-417d-bfaf-50cace03895b for instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc on n-h1-858384-17 Oct 31 15:23:58.056009 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-849d93fa-45ad-4987-8b24-9e560f1da864 req-ead2b195-4432-45a2-b3d9-e5ad4db7c504 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.090973 Oct 31 15:23:58.059862 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 981/1843] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:58.081116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-74cffb7a-bcc5-4eef-bda1-cb6edade2c39 req-63b5474d-2e5b-4351-b6d2-fa41bae07ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cc5e68-4057-4b4f-b91e-95cd526f91fc", "name": "network-vif-deleted", "tag": "92be1209-62cc-417d-bfaf-50cace03895b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:58.112018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-74cffb7a-bcc5-4eef-bda1-cb6edade2c39 req-63b5474d-2e5b-4351-b6d2-fa41bae07ced service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.113668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-74cffb7a-bcc5-4eef-bda1-cb6edade2c39 req-63b5474d-2e5b-4351-b6d2-fa41bae07ced service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.117265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-74cffb7a-bcc5-4eef-bda1-cb6edade2c39 req-63b5474d-2e5b-4351-b6d2-fa41bae07ced service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.141270 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-74cffb7a-bcc5-4eef-bda1-cb6edade2c39 req-63b5474d-2e5b-4351-b6d2-fa41bae07ced service nova] Creating event network-vif-deleted:92be1209-62cc-417d-bfaf-50cace03895b for instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc on n-h1-858384-17 Oct 31 15:23:58.169844 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-74cffb7a-bcc5-4eef-bda1-cb6edade2c39 req-63b5474d-2e5b-4351-b6d2-fa41bae07ced service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102090 Oct 31 15:23:58.170756 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 982/1844] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:58.179943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:58.180967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:58.190340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:58.205574 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77426a56-a002-4c20-9f28-1c3a9129a6d2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.538871 Oct 31 15:23:58.214501 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 863/1845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:57 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:58.224513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.225300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.225933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.226876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.228879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.229600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.557479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:58.558725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:58.588634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.592275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.592760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.593802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:58.594277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:58.599821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:58.707669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:58.753677 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2fe7cef-ec5d-455e-8619-8bcd691c5083 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1496 microversion: 2.1 time: 0.581461 Oct 31 15:23:58.765911 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 983/1846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:58 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1496 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:58.801276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d7bda07-add4-4e64-a032-e94d8fc44acb tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e1a5e040>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:58.912672 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d7bda07-add4-4e64-a032-e94d8fc44acb tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.138948 Oct 31 15:23:58.913439 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 984/1847] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:23:58 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:58.988820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:58.991550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:59.016191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.017647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.018202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.025414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.025681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.026220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.154344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:59.180590 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5290a02-db0a-4a11-8399-60a9cc7183c9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1509 microversion: 2.1 time: 0.615696 Oct 31 15:23:59.202366 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 864/1848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:58 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1509 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:23:59.228716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7c75ae49-d06d-43cd-a1e6-6c95ccc7f048 req-43d0cafd-53fc-4e06-b0b1-4ec82285c0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ae2161-df7f-41c2-a0e7-e78be34827ff", "tag": "c55783a7-c2a7-4e9a-9a80-5cc54f0216ae"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:23:59.278063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7c75ae49-d06d-43cd-a1e6-6c95ccc7f048 req-43d0cafd-53fc-4e06-b0b1-4ec82285c0f1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.280047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7c75ae49-d06d-43cd-a1e6-6c95ccc7f048 req-43d0cafd-53fc-4e06-b0b1-4ec82285c0f1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.282780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7c75ae49-d06d-43cd-a1e6-6c95ccc7f048 req-43d0cafd-53fc-4e06-b0b1-4ec82285c0f1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.325832 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7c75ae49-d06d-43cd-a1e6-6c95ccc7f048 req-43d0cafd-53fc-4e06-b0b1-4ec82285c0f1 service nova] Creating event network-changed:c55783a7-c2a7-4e9a-9a80-5cc54f0216ae for instance 54ae2161-df7f-41c2-a0e7-e78be34827ff on n-h1-858384-17 Oct 31 15:23:59.342879 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7c75ae49-d06d-43cd-a1e6-6c95ccc7f048 req-43d0cafd-53fc-4e06-b0b1-4ec82285c0f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139249 Oct 31 15:23:59.346242 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 865/1849] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:23:59.370028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:59.370744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:59.398466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.401663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.402920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.410137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.413103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.413880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.455848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:23:59.472562 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-36b8e44d-3494-43ad-8a82-1d03ad04db8d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1317 microversion: 2.1 time: 0.488639 Oct 31 15:23:59.476892 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 985/1850] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:58 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:23:59.486123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:23:59.493467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:23:59.517473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.518279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.518929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.520010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:23:59.521990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:23:59.523108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:23:59.984006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:00.014785 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2440b365-034f-46c6-af58-1cd1b32aa61c tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.535400 Oct 31 15:24:00.018589 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 986/1851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:59 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:00.210376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:00.228868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-46fff5fa-09de-4658-a46e-95d80562196c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1509 microversion: 2.1 time: 0.876693 Oct 31 15:24:00.232458 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 866/1852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:23:59 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1509 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:00.274664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:00.275719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:00.290472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.307254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.313186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.315173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.315673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.316121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.320148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2ffdf8e6-2741-41e5-a365-ce9e7c4859d9 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Calling method '.version_select at 0x7f16e14cba60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:00.359532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ffdf8e6-2741-41e5-a365-ce9e7c4859d9 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.360444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ffdf8e6-2741-41e5-a365-ce9e7c4859d9 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.361471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ffdf8e6-2741-41e5-a365-ce9e7c4859d9 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.362484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ffdf8e6-2741-41e5-a365-ce9e7c4859d9 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.364660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ffdf8e6-2741-41e5-a365-ce9e7c4859d9 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.368107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ffdf8e6-2741-41e5-a365-ce9e7c4859d9 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.395692 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2ffdf8e6-2741-41e5-a365-ce9e7c4859d9 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.375104 Oct 31 15:24:00.397761 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 987/1853] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 31 15:24:00 2022] GET /compute/v2.1/limits => generated 511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:00.403151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-07971f12-5092-423a-b646-e2b708414dd3 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e55a15e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:00.470476 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-07971f12-5092-423a-b646-e2b708414dd3 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.071392 Oct 31 15:24:00.471993 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 988/1854] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:00 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:00.480010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bfa46632-2dea-45e1-ba9c-e922c0fc998d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:00.489260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bfa46632-2dea-45e1-ba9c-e922c0fc998d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:00.496165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfa46632-2dea-45e1-ba9c-e922c0fc998d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.497162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfa46632-2dea-45e1-ba9c-e922c0fc998d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.497796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfa46632-2dea-45e1-ba9c-e922c0fc998d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.498768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfa46632-2dea-45e1-ba9c-e922c0fc998d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.499405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfa46632-2dea-45e1-ba9c-e922c0fc998d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.500036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfa46632-2dea-45e1-ba9c-e922c0fc998d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.588913 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bfa46632-2dea-45e1-ba9c-e922c0fc998d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "PUT /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1081 microversion: 2.1 time: 0.115689 Oct 31 15:24:00.604729 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 989/1855] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 15:24:00 2022] PUT /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1081 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:00.604729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d5da0591-5a95-49f1-a57b-37e55ed79cd1 req-6f3ebd3e-fc62-4a67-a143-cca6c6d9a3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cc5e68-4057-4b4f-b91e-95cd526f91fc", "name": "network-vif-deleted", "tag": "3e4abe77-43a1-40a6-bce8-58b1b94e0ed6"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:00.605313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d5da0591-5a95-49f1-a57b-37e55ed79cd1 req-6f3ebd3e-fc62-4a67-a143-cca6c6d9a3cf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.605735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d5da0591-5a95-49f1-a57b-37e55ed79cd1 req-6f3ebd3e-fc62-4a67-a143-cca6c6d9a3cf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.606800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d5da0591-5a95-49f1-a57b-37e55ed79cd1 req-6f3ebd3e-fc62-4a67-a143-cca6c6d9a3cf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.607802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:00.617014 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-927e0322-93b5-41d6-a9be-108526df667b tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1454 microversion: 2.1 time: 0.380072 Oct 31 15:24:00.620882 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 867/1856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:00 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1454 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:00.621705 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d5da0591-5a95-49f1-a57b-37e55ed79cd1 req-6f3ebd3e-fc62-4a67-a143-cca6c6d9a3cf service nova] Creating event network-vif-deleted:3e4abe77-43a1-40a6-bce8-58b1b94e0ed6 for instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc on n-h1-858384-17 Oct 31 15:24:00.630148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dc4a0d3-8cb4-4662-8f9c-3f85c63fa0e2 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-709387619", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:00.636451 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d5da0591-5a95-49f1-a57b-37e55ed79cd1 req-6f3ebd3e-fc62-4a67-a143-cca6c6d9a3cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045136 Oct 31 15:24:00.637074 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 990/1857] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:00.642295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:00.642808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:00.655054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.655555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.660910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.661721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.662869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.668169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.761725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-9dc4a0d3-8cb4-4662-8f9c-3f85c63fa0e2 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:24:00.876008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:00.893332 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5d24b43-83fc-4ed0-8527-4f810e52b952 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1317 microversion: 2.1 time: 0.254600 Oct 31 15:24:00.895210 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 991/1858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:00 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:00.900762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:00.901818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:00.905467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:00.909108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.909867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.910703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:00.911819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:00.912650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:00.913544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.132723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9dc4a0d3-8cb4-4662-8f9c-3f85c63fa0e2 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Getting quotas for project 59b39beea9204efab41bb7383acecbb8. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:01.142324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9dc4a0d3-8cb4-4662-8f9c-3f85c63fa0e2 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Getting quotas for user 524eca5ede634c9ca452bb240310761b and project 59b39beea9204efab41bb7383acecbb8. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:01.163367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:01.175123 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c5d1635-63e1-4369-a8ec-69ee1dc517d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1507 microversion: 2.1 time: 0.278603 Oct 31 15:24:01.178051 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9dc4a0d3-8cb4-4662-8f9c-3f85c63fa0e2 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 31 15:24:01.179475 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 992/1859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:00 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:01.184346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:01.186972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.198866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.199799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.200460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.201460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.202141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.202802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dc4a0d3-8cb4-4662-8f9c-3f85c63fa0e2 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Request method failure captured: Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 1751 Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-iPGP8fUGQcQ8pU9GXdm5WP6mCstPMWQVRtaV2DHij_W8DKY8OeBYHHshTF8AtaHsKAovndVl0bETvThmHc3xq2dRQ5x-ikfrKFmVXq7r0Kra3PB90M1zoXjwNoSohR87EYeZZWvYtYtL_Jd_1xLf_LElBALSFsQoqRTfsPJMq6luM Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 59b39beea9204efab41bb7383acecbb8 Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-193627269 Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59b39beea9204efab41bb7383acecbb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_59b39beea9204efab41bb7383acecbb8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/59b39beea9204efab41bb7383acecbb8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/59b39beea9204efab41bb7383acecbb8"}]}] Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-193627269 Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 59b39beea9204efab41bb7383acecbb8 Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-193627269 Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-193627269-project Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 524eca5ede634c9ca452bb240310761b Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-193627269-project Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-709387619", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:24:01.215374 n-d-858384-17 devstack@n-api.service[120588]: exception: Maximum number of metadata items exceeds 128 Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-709387619', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:01.218483 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 31 15:24:01.221849 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:01.226831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dc4a0d3-8cb4-4662-8f9c-3f85c63fa0e2 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:01.228548 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dc4a0d3-8cb4-4662-8f9c-3f85c63fa0e2 tempest-AbsoluteLimitsNegativeTestJSON-193627269 tempest-AbsoluteLimitsNegativeTestJSON-193627269-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.602360 Oct 31 15:24:01.229815 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 868/1860] 10.222.0.20 () {60 vars in 1148 bytes} [Mon Oct 31 15:24:00 2022] POST /compute/v2.1/servers => generated 87 bytes in 604 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:01.244130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:01.249882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.271313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.274207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.274700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.281243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.281766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.282220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.516851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:01.529162 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ace21d7-93f4-401a-930c-744e47d27a10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1507 microversion: 2.1 time: 0.298016 Oct 31 15:24:01.530337 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 869/1861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:01 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:01.537331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd1bc9f6-a986-41c3-b87c-8aa33e537c19 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f12f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:01.625794 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd1bc9f6-a986-41c3-b87c-8aa33e537c19 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.092889 Oct 31 15:24:01.627080 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 870/1862] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:01 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:01.634339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:01.639126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.648975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.649719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.650685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.651719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.652472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.653324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.684470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:01.693643 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-055b0aae-f213-4a83-9b6d-152557a994a3 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.512827 Oct 31 15:24:01.696660 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 993/1863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:01 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:01.712278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:01.713205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.725708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.731982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.732614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.734728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.735312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.737156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.800729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.803358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.804544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.805364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lazy-loading 'fault' on Instance uuid 02cc5e68-4057-4b4f-b91e-95cd526f91fc {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:24:01.807109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:24:01.809303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:24:01.810095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:24:01.810596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:24:01.811030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:24:01.924721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.933343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:01.941612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.942620 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-556d7a82-db3e-4909-bfa7-36e2e18a3446 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1302 microversion: 2.1 time: 0.242674 Oct 31 15:24:01.944133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.944760 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 994/1864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:01 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1302 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:01.946276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.948467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.950630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.951259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.952066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:01.952361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:01.961820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.962615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.963268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:01.964976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:01.965856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:01.966466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.046387 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7530a992-c4ac-48d0-bb3e-ad9bdcb7398c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "POST /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c/action" status: 202 len: 1113 microversion: 2.1 time: 0.416361 Oct 31 15:24:02.048963 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 871/1865] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:24:01 2022] POST /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c/action => generated 1113 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 15:24:02.069290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:02.071914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:02.088708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:02.092081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:02.094128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.096393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:02.097225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:02.097903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.194758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:02.205028 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0eac867-29f9-4c19-86f8-ea88f1730e6d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1317 microversion: 2.1 time: 0.258955 Oct 31 15:24:02.205875 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 995/1866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:01 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:02.366266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:02.378165 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ebe42b7-c9d6-48ed-92b2-64e38caab711 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.314281 Oct 31 15:24:02.379697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 872/1867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:02 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:02.643147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a48aa869-b715-4a4d-a1dc-03d63347b2e8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e808b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:02.727194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:02.730087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:02.732807 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a48aa869-b715-4a4d-a1dc-03d63347b2e8 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.094111 Oct 31 15:24:02.736987 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 996/1868] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:02 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:02.742010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:02.744366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:02.745042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:02.745730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.746628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:02.747253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:02.747835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:02.971873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:02.972877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:03.005200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.007212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.007823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.010286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.011560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.012700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.061056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.061766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.077806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.080381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lazy-loading 'fault' on Instance uuid 02cc5e68-4057-4b4f-b91e-95cd526f91fc {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:24:03.219866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2d979b14bbf4bb38564f46273334271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684abec7b7d6434bba2ef0e09aa1f5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:03.233288 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-97a8d3ed-c6c8-4827-add3-c60017d892bc tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 200 len: 1302 microversion: 2.1 time: 0.265565 Oct 31 15:24:03.258034 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 997/1869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:02 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 1302 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:03.263700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:03.270796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:03.288589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.291031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.291708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.292634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.294973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.295607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.301947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:03.674699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:03.713575 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aa34817f-2ba3-42ff-8c0b-37f11361dfac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1317 microversion: 2.1 time: 0.451786 Oct 31 15:24:03.730342 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 998/1870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:03 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:03.763524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:03.780541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:03.803628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.805318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.809307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:03.811818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:03.816187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:03.817063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:04.136004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:04.156879 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9252b3bb-e598-44b3-bc08-3f2a0f8d959a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 1.437909 Oct 31 15:24:04.182136 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 873/1871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:02 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:04.196172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fde34984-57b9-439e-9d5a-4925f104ba93 req-028244aa-f9c5-4923-8433-5781c936113a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dd3510-86d0-472f-bd84-6226b34335e3", "name": "network-vif-unplugged", "status": "completed", "tag": "3f50c566-97a8-463a-ba3d-5e8786d8d971"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:04.236808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fde34984-57b9-439e-9d5a-4925f104ba93 req-028244aa-f9c5-4923-8433-5781c936113a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:04.237358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fde34984-57b9-439e-9d5a-4925f104ba93 req-028244aa-f9c5-4923-8433-5781c936113a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:04.240809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fde34984-57b9-439e-9d5a-4925f104ba93 req-028244aa-f9c5-4923-8433-5781c936113a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:04.265066 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fde34984-57b9-439e-9d5a-4925f104ba93 req-028244aa-f9c5-4923-8433-5781c936113a service nova] Creating event network-vif-unplugged:3f50c566-97a8-463a-ba3d-5e8786d8d971 for instance b7dd3510-86d0-472f-bd84-6226b34335e3 on n-h2-858384-17 Oct 31 15:24:04.275482 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fde34984-57b9-439e-9d5a-4925f104ba93 req-028244aa-f9c5-4923-8433-5781c936113a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091409 Oct 31 15:24:04.279126 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 874/1872] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:04.289291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59e35286-4bd8-40f6-ab31-666ac3a70480 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0ef8280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:04.386610 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59e35286-4bd8-40f6-ab31-666ac3a70480 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.104360 Oct 31 15:24:04.388507 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 875/1873] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:04 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:04.395180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:04.396250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:04.405971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:04.406941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:04.407588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:04.409956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:04.412740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:04.413965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:04.451612 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] HTTP exception thrown: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Request method failure captured: Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc HTTP/1.1 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-gMmYCZMfCBoXekqAC4nsxmyzv2-CSLPHESFTrzM9KDwvQ5paFaNmMK0amyBoHgZbz4-PTISYBuHZErcW20WNWw1bMPC82aFmcV9XdBSy1-1fbEI2Uh-RWfm0Ed_4O6gOhKJS4U0KNqi3IFQhAlLdF-neLlx2Pahz-F5939z1kAZXE Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684abec7b7d6434bba2ef0e09aa1f5b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684abec7b7d6434bba2ef0e09aa1f5b5"}]}] Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c2d979b14bbf4bb38564f46273334271 Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '02cc5e68-4057-4b4f-b91e-95cd526f91fc'} Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:04.457005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.463412 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:04.463412 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:04.463412 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:04.463412 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:04.463412 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:04.463412 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:04.463412 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:04.466124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Returning 404 to user: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:04.467181 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87a0fa3a-1d7c-48e6-80fd-f1992ab092a5 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 404 len: 111 microversion: 2.1 time: 0.076785 Oct 31 15:24:04.468520 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 876/1874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:04 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:04.518350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:04.532842 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2beff71-fb65-4267-8bc4-107b947979d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.799294 Oct 31 15:24:04.533765 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 999/1875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:03 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:04.774473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:04.785111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:04.817604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:04.819413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:04.820157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:04.821977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:04.823196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:04.824965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.186894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.188399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:05.205095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.205919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.206592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.211269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.211797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.215795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.370562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:05.389251 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54ae1a6b-6be0-43bc-9c77-e6d3a8a9906c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1317 microversion: 2.1 time: 0.631110 Oct 31 15:24:05.392444 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 877/1876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:04 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:05.412214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc6a7a37-282d-499c-8278-c3b5d994567c tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0ef8670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.545177 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc6a7a37-282d-499c-8278-c3b5d994567c tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.145289 Oct 31 15:24:05.558542 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 878/1877] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:05 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:05.586575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:05.588448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:05.605460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.606329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.606981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.607903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:05.609040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:05.609729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:05.620004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:05.800238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:05.811770 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-853f168d-4428-4557-a3b4-9946102bb8c4 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.629008 Oct 31 15:24:05.815592 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1000/1878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:05 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:06.070346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:06.082692 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f78924c4-192e-4d12-a131-d30aa8701531 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.520899 Oct 31 15:24:06.104781 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 879/1879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:05 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:06.123192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4026fbc-cd96-4671-a13c-51c177886638 tempest-AZV2TestJSON-1024881701 tempest-AZV2TestJSON-1024881701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.125002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4026fbc-cd96-4671-a13c-51c177886638 tempest-AZV2TestJSON-1024881701 tempest-AZV2TestJSON-1024881701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.127128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4026fbc-cd96-4671-a13c-51c177886638 tempest-AZV2TestJSON-1024881701 tempest-AZV2TestJSON-1024881701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.127526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4026fbc-cd96-4671-a13c-51c177886638 tempest-AZV2TestJSON-1024881701 tempest-AZV2TestJSON-1024881701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.128267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4026fbc-cd96-4671-a13c-51c177886638 tempest-AZV2TestJSON-1024881701 tempest-AZV2TestJSON-1024881701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.128734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4026fbc-cd96-4671-a13c-51c177886638 tempest-AZV2TestJSON-1024881701 tempest-AZV2TestJSON-1024881701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.129194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4026fbc-cd96-4671-a13c-51c177886638 tempest-AZV2TestJSON-1024881701 tempest-AZV2TestJSON-1024881701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.217652 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4026fbc-cd96-4671-a13c-51c177886638 tempest-AZV2TestJSON-1024881701 tempest-AZV2TestJSON-1024881701-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.392498 Oct 31 15:24:06.220957 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1001/1880] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Oct 31 15:24:05 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:24:06.350616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ff57c1ad-653c-4d98-af95-f16a24ec8e26 req-2d1726ab-16a0-4dd1-b163-13a27bb9ede6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7dd3510-86d0-472f-bd84-6226b34335e3", "tag": "3f50c566-97a8-463a-ba3d-5e8786d8d971"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:06.372610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ff57c1ad-653c-4d98-af95-f16a24ec8e26 req-2d1726ab-16a0-4dd1-b163-13a27bb9ede6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.373359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ff57c1ad-653c-4d98-af95-f16a24ec8e26 req-2d1726ab-16a0-4dd1-b163-13a27bb9ede6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.373625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ff57c1ad-653c-4d98-af95-f16a24ec8e26 req-2d1726ab-16a0-4dd1-b163-13a27bb9ede6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.407908 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ff57c1ad-653c-4d98-af95-f16a24ec8e26 req-2d1726ab-16a0-4dd1-b163-13a27bb9ede6 service nova] Creating event network-changed:3f50c566-97a8-463a-ba3d-5e8786d8d971 for instance b7dd3510-86d0-472f-bd84-6226b34335e3 on n-h2-858384-17 Oct 31 15:24:06.420226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.421161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:06.432536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.432846 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ff57c1ad-653c-4d98-af95-f16a24ec8e26 req-2d1726ab-16a0-4dd1-b163-13a27bb9ede6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087542 Oct 31 15:24:06.434789 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 880/1881] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:24:06.435157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.435780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.436918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.437852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.446195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.562525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-657123d4-5b0f-4663-87d1-d08a03ab7995 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0ef8d30>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.655041 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-657123d4-5b0f-4663-87d1-d08a03ab7995 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.096817 Oct 31 15:24:06.664828 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 881/1882] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:06 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:06.851753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:06.852531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:06.876384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.882495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.883315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:06.885797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:06.890824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:06.891653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:07.327738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:07.347335 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a50044aa-9f1f-47f2-a36b-e80c5faea681 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.507354 Oct 31 15:24:07.369208 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 882/1883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:06 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:07.386708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ef3a49e8-493d-438b-a66f-20724c4e645c req-0af37f5a-48ab-45b5-b769-39ec9ac95681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ae2161-df7f-41c2-a0e7-e78be34827ff", "name": "network-vif-plugged", "status": "completed", "tag": "c55783a7-c2a7-4e9a-9a80-5cc54f0216ae"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:07.396503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef3a49e8-493d-438b-a66f-20724c4e645c req-0af37f5a-48ab-45b5-b769-39ec9ac95681 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:07.397616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef3a49e8-493d-438b-a66f-20724c4e645c req-0af37f5a-48ab-45b5-b769-39ec9ac95681 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:07.398214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef3a49e8-493d-438b-a66f-20724c4e645c req-0af37f5a-48ab-45b5-b769-39ec9ac95681 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:07.425795 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ef3a49e8-493d-438b-a66f-20724c4e645c req-0af37f5a-48ab-45b5-b769-39ec9ac95681 service nova] Creating event network-vif-plugged:c55783a7-c2a7-4e9a-9a80-5cc54f0216ae for instance 54ae2161-df7f-41c2-a0e7-e78be34827ff on n-h1-858384-17 Oct 31 15:24:07.435670 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ef3a49e8-493d-438b-a66f-20724c4e645c req-0af37f5a-48ab-45b5-b769-39ec9ac95681 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065033 Oct 31 15:24:07.437482 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 883/1884] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:07.459637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:07.463871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:07.490452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:07.493258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:07.496848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:07.501033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:07.501896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:07.502910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:07.899750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:07.909972 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85986a49-0a13-469b-ab4d-6cb82a2e0bab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1317 microversion: 2.1 time: 1.493996 Oct 31 15:24:07.914804 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1002/1885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:06 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1317 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:07.919878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2418f639-5546-4fc9-bd20-2af5a3dde911 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e7d550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:08.012611 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2418f639-5546-4fc9-bd20-2af5a3dde911 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.096344 Oct 31 15:24:08.023622 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1003/1886] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:07 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:08.076098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:08.089822 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a276e751-2db1-4f18-a768-0fa3001b12c1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.649514 Oct 31 15:24:08.092300 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 884/1887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:07 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:08.387836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:08.388920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:08.402414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:08.403741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:08.404894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:08.412585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:08.413716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:08.414371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:08.939629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:08.941528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:08.945347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:08.969665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:08.970210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:08.970665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:08.972290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:08.973906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:08.975836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:08.977276 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89779175-fcf4-49d4-a3e9-6b6201d8983e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.588894 Oct 31 15:24:08.980192 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1004/1888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:08 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:09.031406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0192702b-0543-46fe-af76-56467ddc64fe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e1600280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:09.167039 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0192702b-0543-46fe-af76-56467ddc64fe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.140526 Oct 31 15:24:09.183613 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1005/1889] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:09 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:09.210096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:09.210817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:09.241489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:09.241863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:09.245707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:09.249371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:09.249935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:09.252900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:09.610422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:09.632069 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16f55a9a-d5e6-470c-85d5-fecd761d708a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1317 microversion: 2.1 time: 0.698145 Oct 31 15:24:09.632677 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 885/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:08 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1317 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:10.014246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:10.014978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:10.047566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:10.058645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:10.066269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:10.066736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:10.067479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:10.068459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:10.074673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:10.077700 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2dd6344-0a8e-40ca-8149-b9cb02666617 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.892823 Oct 31 15:24:10.101386 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1006/1891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:09 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:10.183477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3194ae25-b5ea-44d3-b950-ed9b9ac74d37 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e181d8b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:10.295421 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3194ae25-b5ea-44d3-b950-ed9b9ac74d37 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.090743 Oct 31 15:24:10.295421 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1007/1892] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:10 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:10.655966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=16 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:10.671275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:10.672293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:10.685209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:10.686206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:10.692426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:10.694403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:10.695781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:10.697617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:10.887582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:10.902910 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c6b209d3-8739-478e-9f44-4d8a25c8b381 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.899493 Oct 31 15:24:10.927624 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 886/1893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:09 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:10.983216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:10.983833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:11.006920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.017410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.018137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.022539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.024639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.027353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.078630 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] HTTP exception thrown: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Request method failure captured: Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc HTTP/1.1 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-gMmYCZMfCBoXekqAC4nsxmyzv2-CSLPHESFTrzM9KDwvQ5paFaNmMK0amyBoHgZbz4-PTISYBuHZErcW20WNWw1bMPC82aFmcV9XdBSy1-1fbEI2Uh-RWfm0Ed_4O6gOhKJS4U0KNqi3IFQhAlLdF-neLlx2Pahz-F5939z1kAZXE Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684abec7b7d6434bba2ef0e09aa1f5b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684abec7b7d6434bba2ef0e09aa1f5b5"}]}] Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c2d979b14bbf4bb38564f46273334271 Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '02cc5e68-4057-4b4f-b91e-95cd526f91fc'} Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:11.088655 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.097242 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.102809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Returning 404 to user: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:11.103596 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b0912917-0237-4b5f-b7b5-78708bde59e4 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "DELETE /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 404 len: 111 microversion: 2.1 time: 0.130072 Oct 31 15:24:11.104520 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 887/1894] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:10 2022] DELETE /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:11.132730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:11.133396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:11.150576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:11.152810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.153354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.153800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.154507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.154963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.155383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.155952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=40 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:11.164611 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab873f00-9541-41d3-9c69-000cf1fc8bf1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1505 microversion: 2.1 time: 0.509200 Oct 31 15:24:11.169494 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1008/1895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:10 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:11.185703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:11.186394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 02cc5e68-4057-4b4f-b91e-95cd526f91fc] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:11.209254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.213548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.214717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.215494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.218448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.220229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.274957 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] HTTP exception thrown: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Request method failure captured: Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc HTTP/1.1 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gMmYCZMfCBoXekqAC4nsxmyzv2-CSLPHESFTrzM9KDwvQ5paFaNmMK0amyBoHgZbz4-PTISYBuHZErcW20WNWw1bMPC82aFmcV9XdBSy1-1fbEI2Uh-RWfm0Ed_4O6gOhKJS4U0KNqi3IFQhAlLdF-neLlx2Pahz-F5939z1kAZXE Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684abec7b7d6434bba2ef0e09aa1f5b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684abec7b7d6434bba2ef0e09aa1f5b5"}]}] Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c2d979b14bbf4bb38564f46273334271 Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '02cc5e68-4057-4b4f-b91e-95cd526f91fc'} Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:11.279177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Returning 404 to user: Instance 02cc5e68-4057-4b4f-b91e-95cd526f91fc could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5b503db-0670-47e6-aa8a-5643317927f1 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc" status: 404 len: 111 microversion: 2.1 time: 0.110139 Oct 31 15:24:11.290268 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1009/1896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:11 2022] GET /compute/v2.1/servers/02cc5e68-4057-4b4f-b91e-95cd526f91fc => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:11.294026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:11.307775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:11.326840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.327271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.327778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.328509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.333518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.334037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.398962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:24:11.669610 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-419f46a2-8358-4475-bd4a-928198fc4e84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 204 len: 0 microversion: 2.1 time: 0.379665 Oct 31 15:24:11.670233 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1010/1897] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:11 2022] DELETE /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:11.705613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0f2bbe91-42eb-4eed-92e7-a86151d22238 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e30790>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:11.831476 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0f2bbe91-42eb-4eed-92e7-a86151d22238 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.154782 Oct 31 15:24:11.832804 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1011/1898] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:11 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:11.833858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:11.843901 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-067f8383-dc95-446a-94b4-13dea897415e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.732452 Oct 31 15:24:11.847858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:11.848796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:11.852657 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 888/1899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:11 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:11.860053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:11.860692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:11.861804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.862527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.863129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.864137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.867495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.876550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.904283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.909921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.912418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.916177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.930459 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] HTTP exception thrown: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:11.931825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.932408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Request method failure captured: Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff HTTP/1.1 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gMmYCZMfCBoXekqAC4nsxmyzv2-CSLPHESFTrzM9KDwvQ5paFaNmMK0amyBoHgZbz4-PTISYBuHZErcW20WNWw1bMPC82aFmcV9XdBSy1-1fbEI2Uh-RWfm0Ed_4O6gOhKJS4U0KNqi3IFQhAlLdF-neLlx2Pahz-F5939z1kAZXE Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684abec7b7d6434bba2ef0e09aa1f5b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684abec7b7d6434bba2ef0e09aa1f5b5"}]}] Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c2d979b14bbf4bb38564f46273334271 Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '6a5824db-4ae4-4ffa-a7d9-200dcf2289ff'} Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:11.934376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:11.940212 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:11.944587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Returning 404 to user: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:11.946343 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-242f0dd8-c7ea-4783-a933-21fb35c9e716 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 404 len: 111 microversion: 2.1 time: 0.111145 Oct 31 15:24:11.947574 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1012/1900] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:11 2022] DELETE /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:11.954713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:11.955694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:11.963788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.964610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.965183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:11.966040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:11.966806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:11.967469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:12.282650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:12.301143 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49427c6c-2fc9-42ce-be25-12b07d2c85fc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1511 microversion: 2.1 time: 0.445814 Oct 31 15:24:12.301981 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 889/1901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:11 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1511 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:12.332020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:12.334645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] [instance: 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:12.349907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:12.350747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:12.352731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:12.355168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:12.356140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:12.356866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:12.392428 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] HTTP exception thrown: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Request method failure captured: Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff HTTP/1.1 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-gMmYCZMfCBoXekqAC4nsxmyzv2-CSLPHESFTrzM9KDwvQ5paFaNmMK0amyBoHgZbz4-PTISYBuHZErcW20WNWw1bMPC82aFmcV9XdBSy1-1fbEI2Uh-RWfm0Ed_4O6gOhKJS4U0KNqi3IFQhAlLdF-neLlx2Pahz-F5939z1kAZXE Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_684abec7b7d6434bba2ef0e09aa1f5b5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/684abec7b7d6434bba2ef0e09aa1f5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/684abec7b7d6434bba2ef0e09aa1f5b5"}]}] Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 684abec7b7d6434bba2ef0e09aa1f5b5 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestMultiNic-357236422 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c2d979b14bbf4bb38564f46273334271 Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestMultiNic-357236422-project Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '6a5824db-4ae4-4ffa-a7d9-200dcf2289ff'} Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:12.397874 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:12.403473 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:12.403473 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:12.403473 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:12.403473 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:12.403473 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:12.403473 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. Oct 31 15:24:12.403473 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:12.407396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] Returning 404 to user: Instance 6a5824db-4ae4-4ffa-a7d9-200dcf2289ff could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:12.408661 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e3ce5a3c-bca4-498b-b3f4-82806c309948 tempest-ServersTestMultiNic-357236422 tempest-ServersTestMultiNic-357236422-project] 10.222.0.20 "GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff" status: 404 len: 111 microversion: 2.1 time: 0.103514 Oct 31 15:24:12.410816 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 890/1902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:12 2022] GET /compute/v2.1/servers/6a5824db-4ae4-4ffa-a7d9-200dcf2289ff => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:12.623057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:12.640875 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdd7182c-0c29-4c6b-bbb7-65f6c47e9840 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.690329 Oct 31 15:24:12.641796 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1013/1903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:11 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:12.861473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dfc457ce-3604-4edb-9345-ce2a84541a64 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f16af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:12.911010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:12.912746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:12.932922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:12.936422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:12.937317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:12.939477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:12.941115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:12.944370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:13.070168 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dfc457ce-3604-4edb-9345-ce2a84541a64 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1424 microversion: 2.1 time: 0.217591 Oct 31 15:24:13.077162 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 891/1904] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:12 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1424 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:13.333268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:13.337083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:13.360729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:13.363949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:13.366554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:13.368283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:13.371239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:13.373252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:14.153042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:14.163104 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5618a9b-c153-4a60-8536-067e32c78626 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 1.258840 Oct 31 15:24:14.177659 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1014/1905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:12 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:14.183611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:14.186970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:14.203458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:14.208392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:14.208989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:14.209796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:14.210276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:14.210945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:14.658195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:14.667024 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe00ab3d-15dd-4a85-999d-e6a60dcc8f28 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1511 microversion: 2.1 time: 1.341166 Oct 31 15:24:14.689559 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 892/1906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:13 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1511 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:14.698102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b8b7aa5-e85d-4ee4-8ad8-0363ca23fd9e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0ee8b80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:14.783759 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b8b7aa5-e85d-4ee4-8ad8-0363ca23fd9e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1433 microversion: 2.1 time: 0.093064 Oct 31 15:24:14.784362 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 893/1907] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:14 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1433 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:14.799251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1cd266d-b445-4761-95e2-e074bba8333d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f184c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:14.844016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:14.855935 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c128cb0b-3275-4679-bfc6-687510c4b5bb tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.689205 Oct 31 15:24:14.856559 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1015/1908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:14 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:14.898486 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b1cd266d-b445-4761-95e2-e074bba8333d tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 200 len: 1433 microversion: 2.1 time: 0.103380 Oct 31 15:24:14.901975 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 894/1909] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:14 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 1433 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:14.922725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:14.923330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:14.938231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:14.938831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:14.940332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:14.943231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:14.944461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:14.945087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:15.195269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:15.196356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:15.205740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:15.207028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:15.208280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:15.209879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:15.210589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:15.211319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:15.495735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:15.514538 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4ca31fca-76c5-4e97-9d53-4aaf03a355c9 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1478 microversion: 2.1 time: 0.596443 Oct 31 15:24:15.517556 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1016/1910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:14 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1478 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:15.531635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:15.532878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:15.569883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:15.570439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:15.572667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:15.575893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:15.576465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:15.576907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:15.820992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:15.839147 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc3e73e1-7a2d-4f69-a802-ec37cd249438 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.651694 Oct 31 15:24:15.840173 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 895/1911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:15 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:15.845044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:15.849943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:15.861718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:15.862268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:15.862658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:15.863433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:15.863843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:15.864851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.013559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:16.030204 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0a2eaf86-6810-4cc0-9994-35a9923457ca tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 200 len: 1469 microversion: 2.1 time: 0.188644 Oct 31 15:24:16.042403 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 896/1912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:15 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 1469 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:16.078100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-41ddbd70-e28a-4174-bfb8-cf6fd5d1de7f req-da3dd415-b05f-4c41-a32b-4600df7a5cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ae2161-df7f-41c2-a0e7-e78be34827ff", "name": "network-vif-deleted", "tag": "c55783a7-c2a7-4e9a-9a80-5cc54f0216ae"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:16.120344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41ddbd70-e28a-4174-bfb8-cf6fd5d1de7f req-da3dd415-b05f-4c41-a32b-4600df7a5cfa service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:16.121194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41ddbd70-e28a-4174-bfb8-cf6fd5d1de7f req-da3dd415-b05f-4c41-a32b-4600df7a5cfa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:16.122175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41ddbd70-e28a-4174-bfb8-cf6fd5d1de7f req-da3dd415-b05f-4c41-a32b-4600df7a5cfa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.157734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:16.197673 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-41ddbd70-e28a-4174-bfb8-cf6fd5d1de7f req-da3dd415-b05f-4c41-a32b-4600df7a5cfa service nova] Creating event network-vif-deleted:c55783a7-c2a7-4e9a-9a80-5cc54f0216ae for instance 54ae2161-df7f-41c2-a0e7-e78be34827ff on n-h1-858384-17 Oct 31 15:24:16.213571 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-41ddbd70-e28a-4174-bfb8-cf6fd5d1de7f req-da3dd415-b05f-4c41-a32b-4600df7a5cfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167581 Oct 31 15:24:16.215472 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 897/1913] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:16.228515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:16.229701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:16.242320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:16.242830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:16.243268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.244160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:16.244634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:16.245166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.324389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid 0ace9f23-0d08-4d3b-8c64-dd82142559be {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:24:16.390904 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-baae4cf3-b965-4ad9-9fbb-56e452ddcc03 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 2347 microversion: 2.25 time: 0.871891 Oct 31 15:24:16.405796 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1017/1914] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:24:15 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 2347 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:24:16.423046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9168026-b035-4c7e-8d2a-7f220b60dbe9 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:16.435497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9168026-b035-4c7e-8d2a-7f220b60dbe9 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:16.436083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9168026-b035-4c7e-8d2a-7f220b60dbe9 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:16.436606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9168026-b035-4c7e-8d2a-7f220b60dbe9 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.438983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9168026-b035-4c7e-8d2a-7f220b60dbe9 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:16.441275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9168026-b035-4c7e-8d2a-7f220b60dbe9 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:16.442893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9168026-b035-4c7e-8d2a-7f220b60dbe9 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.519048 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9168026-b035-4c7e-8d2a-7f220b60dbe9 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.092774 Oct 31 15:24:16.529528 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1018/1915] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 31 15:24:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:24:16.547827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:16.548442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:16.562534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:16.563054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:16.563500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.564337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:16.564804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:16.565257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:16.639532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:16.939549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:16.954512 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00932873-c2ee-4d3e-bb88-7e4e2ed8f672 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.734545 Oct 31 15:24:16.969745 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 898/1916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:16 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:16.988782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:16.990175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:17.024310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.027357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.028019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.029378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.034138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.034838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.576756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:17.584990 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9b0464ff-2ba9-4ced-b65d-2645c97e5c67 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1465 microversion: 2.1 time: 1.040892 Oct 31 15:24:17.591424 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1019/1917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:16 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1465 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:17.596280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:17.602626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:17.616602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.618545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.621501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.622367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.622915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.623418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.652345 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff HTTP/1.1 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '54ae2161-df7f-41c2-a0e7-e78be34827ff'} Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:17.663427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.668324 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:17.668324 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:17.668324 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:17.668324 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:17.668324 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:17.668324 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:24:17.668324 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:17.668324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:17.668324 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5460927-e95a-45c5-9970-5c7a9bc61ace tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 404 len: 111 microversion: 2.1 time: 0.072399 Oct 31 15:24:17.673012 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1020/1918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:17 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:17.678527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b9608d0-8c41-4baf-b0f7-a5ef90a7389c tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e399d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:17.750152 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6b9608d0-8c41-4baf-b0f7-a5ef90a7389c tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/524d630e-d0c9-4d4c-9057-837f830c46f6" status: 200 len: 784 microversion: 2.1 time: 0.075774 Oct 31 15:24:17.751069 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1021/1919] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:17 2022] GET /compute/v2.1/images/524d630e-d0c9-4d4c-9057-837f830c46f6 => generated 784 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:17.756903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:17.757551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:17.763561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:17.773721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.774223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.774662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.775437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:17.775839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:17.776264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:17.778353 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-446952db-6b43-4d8f-bdb2-6d6aeda31048 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.804531 Oct 31 15:24:17.779221 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 899/1920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:16 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:17.793290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5a98e505-f9b9-43f5-843b-66bb6219d2a7 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:17.805701 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5a98e505-f9b9-43f5-843b-66bb6219d2a7 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024980 Oct 31 15:24:17.809784 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 900/1921] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:24:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:17.826918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-188d740e-1e72-4f4a-8376-5c7a70748c8b tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e8cf70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:18.245859 n-d-858384-17 devstack@n-api.service[120588]: Exception ignored in: . at 0x7f16e0f511f0> Oct 31 15:24:18.246691 n-d-858384-17 devstack@n-api.service[120588]: Traceback (most recent call last): Oct 31 15:24:18.246900 n-d-858384-17 devstack@n-api.service[120588]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 31 15:24:18.257859 n-d-858384-17 devstack@n-api.service[120588]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 31 15:24:18.258187 n-d-858384-17 devstack@n-api.service[120588]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 31 15:24:18.259387 n-d-858384-17 devstack@n-api.service[120588]: connection_record.checkin() Oct 31 15:24:18.259610 n-d-858384-17 devstack@n-api.service[120588]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 31 15:24:18.260103 n-d-858384-17 devstack@n-api.service[120588]: pool.dispatch.checkin(connection, self) Oct 31 15:24:18.260470 n-d-858384-17 devstack@n-api.service[120588]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 31 15:24:18.271046 n-d-858384-17 devstack@n-api.service[120588]: fn(*args, **kw) Oct 31 15:24:18.271489 n-d-858384-17 devstack@n-api.service[120588]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Oct 31 15:24:18.279173 n-d-858384-17 devstack@n-api.service[120588]: time.sleep(0) Oct 31 15:24:18.279646 n-d-858384-17 devstack@n-api.service[120588]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 31 15:24:18.286317 n-d-858384-17 devstack@n-api.service[120588]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 31 15:24:18.286650 n-d-858384-17 devstack@n-api.service[120588]: AssertionError: do not call blocking functions from the mainloop Oct 31 15:24:18.443382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:18.457076 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d999f3c-6d78-4d61-8cad-6f150036e79a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.701666 Oct 31 15:24:18.459935 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1022/1922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:17 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:18.478455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:18.479075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:18.524614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:18.525434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:18.527824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:18.529452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:18.532535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:18.535695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:19.121573 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-188d740e-1e72-4f4a-8376-5c7a70748c8b tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "DELETE /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 204 len: 0 microversion: 2.1 time: 1.301620 Oct 31 15:24:19.122674 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 901/1923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:17 2022] DELETE /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 0 bytes in 1304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:19.254414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:19.284518 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-79b353be-2ad9-428e-b610-d00a42c71326 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.818931 Oct 31 15:24:19.288418 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1023/1924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:18 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:19.319268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-843e156e-3745-4972-8445-28ed598271dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-843e156e-3745-4972-8445-28ed598271dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 163 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": 12345, "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 12345 Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:24:19.362341 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-843e156e-3745-4972-8445-28ed598271dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:19.371194 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-843e156e-3745-4972-8445-28ed598271dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.073702 Oct 31 15:24:19.382091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1024/1925] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:19 2022] POST /compute/v2.1/servers => generated 127 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:24:19.401202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:19.406772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:19.432774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8dcb035-2ce7-443c-9866-8ce05f389e44 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Action: 'create', calling method: .version_select at 0x7f16e0f01ee0>, body: {"pool": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:19.435055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:19.435557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:19.436002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:19.447699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:19.449477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:19.450354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.102706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:20.133722 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35d9c60c-a54b-4e84-9648-bc9c8521f2d0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.745565 Oct 31 15:24:20.134388 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1025/1926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:19 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:20.146441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c3088a19-3d55-4b5b-9554-88b538aae410 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e7da60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:20.180657 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c3088a19-3d55-4b5b-9554-88b538aae410 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] HTTP exception thrown: Image not found. Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c3088a19-3d55-4b5b-9554-88b538aae410 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Request method failure captured: Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 HTTP/1.1 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hqarFnMlbtD88ltC0buSfEUbtxgcGnknqAWfa8NjTm5sgSS96rFOCVMTp8SYp76-7V10BNsw9RLNHtLx4sn037o8ndkOiylsC9r9K1M99E4bx53wonhukIY7jMGNiLbo1G0xWAQdIw6GQIe61Zo0UIUz27izmxi_fy-SWHSFgdIhk Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 95d5bc4f1cb64997a33609c07379cc60 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesOneServerTestJSON-1096504688 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95d5bc4f1cb64997a33609c07379cc60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_95d5bc4f1cb64997a33609c07379cc60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95d5bc4f1cb64997a33609c07379cc60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/95d5bc4f1cb64997a33609c07379cc60"}]}] Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesOneServerTestJSON-1096504688 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 95d5bc4f1cb64997a33609c07379cc60 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1096504688 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesOneServerTestJSON-1096504688-project Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d3fa70260a7640f5b8fbb7eb9b75580e Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesOneServerTestJSON-1096504688-project Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: exception: Image not found. Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'eeec4154-a979-4bc9-823e-dd1594a5ca64'} Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID eeec4154-a979-4bc9-823e-dd1594a5ca64 Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:24:20.194197 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eeec4154-a979-4bc9-823e-dd1594a5ca64 could not be found. Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c3088a19-3d55-4b5b-9554-88b538aae410 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Returning 404 to user: Image not found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c3088a19-3d55-4b5b-9554-88b538aae410 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 404 len: 62 microversion: 2.1 time: 0.060457 Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1026/1927] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:20 2022] GET /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:20.203106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:20.219042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.219549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.219990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.221458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.222471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.222471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.762878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:20.780617 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-62b926e4-cf97-4529-943c-d27677c1d0c2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.582798 Oct 31 15:24:20.781234 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1027/1928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:20 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:20.796752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-768206da-6cad-4350-90ff-b1e054d44640 req-b4b3c049-4002-4253-b254-17d09289a102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57828c57-25f9-4820-abae-396b40b5db0a", "name": "network-vif-unplugged", "status": "completed", "tag": "77af5736-44c8-4ad7-b405-90164244d290"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:20.822109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-768206da-6cad-4350-90ff-b1e054d44640 req-b4b3c049-4002-4253-b254-17d09289a102 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.823349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-768206da-6cad-4350-90ff-b1e054d44640 req-b4b3c049-4002-4253-b254-17d09289a102 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.823954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-768206da-6cad-4350-90ff-b1e054d44640 req-b4b3c049-4002-4253-b254-17d09289a102 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.843652 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-768206da-6cad-4350-90ff-b1e054d44640 req-b4b3c049-4002-4253-b254-17d09289a102 service nova] Creating event network-vif-unplugged:77af5736-44c8-4ad7-b405-90164244d290 for instance 57828c57-25f9-4820-abae-396b40b5db0a on n-h2-858384-17 Oct 31 15:24:20.859552 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-768206da-6cad-4350-90ff-b1e054d44640 req-b4b3c049-4002-4253-b254-17d09289a102 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070704 Oct 31 15:24:20.860729 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1028/1929] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:20.866188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b2303a5-ca35-446b-a7cd-3f15b050ff50 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-160754404"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:20.880670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b2303a5-ca35-446b-a7cd-3f15b050ff50 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:20.899336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2303a5-ca35-446b-a7cd-3f15b050ff50 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.899841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2303a5-ca35-446b-a7cd-3f15b050ff50 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.900284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2303a5-ca35-446b-a7cd-3f15b050ff50 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:20.901011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2303a5-ca35-446b-a7cd-3f15b050ff50 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:20.901527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2303a5-ca35-446b-a7cd-3f15b050ff50 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:20.902151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2303a5-ca35-446b-a7cd-3f15b050ff50 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:21.244379 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b2303a5-ca35-446b-a7cd-3f15b050ff50 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "POST /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a/action" status: 202 len: 0 microversion: 2.1 time: 0.382014 Oct 31 15:24:21.252240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1029/1930] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:24:20 2022] POST /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:24:21.258546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:21.262306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:21.278827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:21.279665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:21.280272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:21.281198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:21.285541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:21.286701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:21.620616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:21.632659 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7558c26e-0bb4-4d8b-979c-2aca769580de tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1391 microversion: 2.1 time: 0.378501 Oct 31 15:24:21.633681 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1030/1931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:21 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1391 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:21.650812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d38159e5-98a3-46c9-9ce5-b498fa872415 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f564928f-1801-477d-976a-b470047f1747", "device": "/dev/xvdb"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:21.656286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d38159e5-98a3-46c9-9ce5-b498fa872415 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:21.664075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38159e5-98a3-46c9-9ce5-b498fa872415 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:21.665014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38159e5-98a3-46c9-9ce5-b498fa872415 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:21.665741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38159e5-98a3-46c9-9ce5-b498fa872415 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:21.666731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38159e5-98a3-46c9-9ce5-b498fa872415 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:21.667430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38159e5-98a3-46c9-9ce5-b498fa872415 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:21.668136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38159e5-98a3-46c9-9ce5-b498fa872415 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:22.169838 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d38159e5-98a3-46c9-9ce5-b498fa872415 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "POST /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.532750 Oct 31 15:24:22.171277 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1031/1932] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Oct 31 15:24:21 2022] POST /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments => generated 194 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:24:22.185449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:22.186738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:22.205502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:22.209671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:22.211559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:22.212771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:22.215306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:22.215949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:22.689423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:22.698994 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3402cdab-c829-4336-b796-453db2e4f387 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.526353 Oct 31 15:24:22.701750 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1032/1933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:22 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:22.721313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:22.723517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:22.745422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:22.746983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:22.747609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:22.750228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:22.751506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:22.752889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:23.089951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:23.106182 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-165b93de-ec06-4965-b1a9-94d4af1e7422 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.400803 Oct 31 15:24:23.120753 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1033/1934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:22 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:23.145863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c3ffc68c-a9d2-4b79-8ed0-e80db49d4a69 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e30430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:23.225760 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c3ffc68c-a9d2-4b79-8ed0-e80db49d4a69 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.103439 Oct 31 15:24:23.227940 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1034/1935] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:23 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:23.240671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:23.245498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:23.263342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:23.268878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:23.273104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:23.274121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:23.274799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:23.275471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:23.970779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:23.987227 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-464a77b4-d913-425e-97db-379b91c3c943 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1381 microversion: 2.1 time: 0.757841 Oct 31 15:24:23.991891 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1035/1936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:23 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1381 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:24.018207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfd8c385-30c9-4aac-8079-590bae782865 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '.version_select at 0x7f16e1600700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:24.024257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfd8c385-30c9-4aac-8079-590bae782865 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:24.025912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfd8c385-30c9-4aac-8079-590bae782865 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:24.026863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfd8c385-30c9-4aac-8079-590bae782865 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:24.081997 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfd8c385-30c9-4aac-8079-590bae782865 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2342 microversion: 2.1 time: 0.061599 Oct 31 15:24:24.088806 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1036/1937] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:24:24 2022] GET /compute/v2.1/os-migrations => generated 2342 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:24.106732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c32a0dab-cbc3-4dc7-8cf4-120418d18686 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:24.109665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c32a0dab-cbc3-4dc7-8cf4-120418d18686 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:24.134160 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8dcb035-2ce7-443c-9866-8ce05f389e44 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.010218 Oct 31 15:24:24.142165 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 902/1938] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:24:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:24.142388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c32a0dab-cbc3-4dc7-8cf4-120418d18686 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:24.143869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:24.144370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c32a0dab-cbc3-4dc7-8cf4-120418d18686 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:24.144555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:24.145103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c32a0dab-cbc3-4dc7-8cf4-120418d18686 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:24.148060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c32a0dab-cbc3-4dc7-8cf4-120418d18686 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:24.149414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c32a0dab-cbc3-4dc7-8cf4-120418d18686 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:24.152780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c32a0dab-cbc3-4dc7-8cf4-120418d18686 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:24.158370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:24.158370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:24.158674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:24.166083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:24.166592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:24.167041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:24.720370 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c32a0dab-cbc3-4dc7-8cf4-120418d18686 tempest-LiveMigrationTest-898712507 tempest-LiveMigrationTest-898712507-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1534 microversion: 2.1 time: 0.617738 Oct 31 15:24:24.732777 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1037/1939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:24 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1534 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:24.739187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a89b758-e2c8-452f-80f9-077b675ecb7a tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Action: 'create', calling method: .version_select at 0x7f16e0de6040>, body: {"pool": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:24.898422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:24.912497 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5497205c-ebcb-45ed-883b-af1b495136d7 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.772500 Oct 31 15:24:24.925246 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 903/1940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:24 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:24.938431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec0568ff-8e72-408c-a6eb-c0cde8c48ccc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e1676af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:25.090526 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec0568ff-8e72-408c-a6eb-c0cde8c48ccc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.176025 Oct 31 15:24:25.092954 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 904/1941] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:24 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:25.107025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:25.115247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:25.138639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:25.139329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:25.139593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:25.140285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:25.140751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:25.141205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:25.243482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:24:25.417938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:25.493209 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97796364-0e78-4510-a642-9f1559a20ed2 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 204 len: 0 microversion: 2.1 time: 0.400570 Oct 31 15:24:25.494564 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 905/1942] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:25 2022] DELETE /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:25.509942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:25.513937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:25.527022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:25.527523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:25.527970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:25.528813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:25.536779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:25.537889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:26.465503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:27.029094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:27.039792 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c95825ef-d7a7-4624-a4dc-ec42b98e233d tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1387 microversion: 2.1 time: 1.540353 Oct 31 15:24:27.042616 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 906/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:25 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1387 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:27.068114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:27.068757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:27.085447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:27.085955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:27.086615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:27.087514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:27.088147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:27.088912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:27.482055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:27.493068 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9aecdcfb-7921-49f0-a298-c7f81ca5f49a tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1518 microversion: 2.1 time: 0.449368 Oct 31 15:24:27.497439 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 907/1944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:27 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1518 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:27.509408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c148811c-8288-4bbc-b96c-73a1a8bf180c tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0ea59d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:27.609955 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c148811c-8288-4bbc-b96c-73a1a8bf180c tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.111198 Oct 31 15:24:27.610556 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 908/1945] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:27 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:28.023359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2090313021", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "c356d61f-2e01-42fa-9c99-c94fb61838ec"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:28.192974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] validate_networks() for [('c356d61f-2e01-42fa-9c99-c94fb61838ec', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:24:28.230576 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a89b758-e2c8-452f-80f9-077b675ecb7a tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.496495 Oct 31 15:24:28.231890 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1038/1946] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:24:24 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:28.237668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:28.239236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:28.256016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:28.259728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:28.261079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:28.263379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:28.265349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:28.267378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:28.440884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:28.450040 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ce0eead-2992-415e-a354-360942b3dc31 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1345 microversion: 2.1 time: 0.216789 Oct 31 15:24:28.460229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1039/1947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:28 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1345 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:28.476953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab112071-bb98-4499-a071-eac34c5d7ea8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1740706380", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "cb74fbc9-5df9-497a-aec5-ced323f744c4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:28.664796 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ab112071-bb98-4499-a071-eac34c5d7ea8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Block Device cb74fbc9-5df9-497a-aec5-ced323f744c4 is not bootable. Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab112071-bb98-4499-a071-eac34c5d7ea8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 358 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1740706380", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "cb74fbc9-5df9-497a-aec5-ced323f744c4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: exception: Block Device cb74fbc9-5df9-497a-aec5-ced323f744c4 is not bootable. Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1740706380', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'cb74fbc9-5df9-497a-aec5-ced323f744c4'}], 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device cb74fbc9-5df9-497a-aec5-ced323f744c4 is not bootable. Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:28.679390 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device cb74fbc9-5df9-497a-aec5-ced323f744c4 is not bootable. Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device cb74fbc9-5df9-497a-aec5-ced323f744c4 is not bootable. Oct 31 15:24:28.686723 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:28.689268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab112071-bb98-4499-a071-eac34c5d7ea8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Block Device cb74fbc9-5df9-497a-aec5-ced323f744c4 is not bootable. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:28.690539 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab112071-bb98-4499-a071-eac34c5d7ea8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.229143 Oct 31 15:24:28.692427 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1040/1948] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:24:28.702669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-46cf9064-a84a-49c2-813f-4918a83d1f9a req-f471d78c-5bac-4911-a70e-c98c37e1858e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57828c57-25f9-4820-abae-396b40b5db0a", "name": "network-vif-plugged", "status": "completed", "tag": "77af5736-44c8-4ad7-b405-90164244d290"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:28.743363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-46cf9064-a84a-49c2-813f-4918a83d1f9a req-f471d78c-5bac-4911-a70e-c98c37e1858e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:28.744191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-46cf9064-a84a-49c2-813f-4918a83d1f9a req-f471d78c-5bac-4911-a70e-c98c37e1858e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:28.744889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-46cf9064-a84a-49c2-813f-4918a83d1f9a req-f471d78c-5bac-4911-a70e-c98c37e1858e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:28.787720 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-46cf9064-a84a-49c2-813f-4918a83d1f9a req-f471d78c-5bac-4911-a70e-c98c37e1858e service nova] Creating event network-vif-plugged:77af5736-44c8-4ad7-b405-90164244d290 for instance 57828c57-25f9-4820-abae-396b40b5db0a on n-h2-858384-17 Oct 31 15:24:28.797797 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-46cf9064-a84a-49c2-813f-4918a83d1f9a req-f471d78c-5bac-4911-a70e-c98c37e1858e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103423 Oct 31 15:24:28.800102 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1041/1949] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:28.814351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f2f3bca1-1fd5-42cc-ab22-21cd48047dab req-bf57cbc0-373e-47f8-9626-1b55c50dd68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7dd3510-86d0-472f-bd84-6226b34335e3", "name": "network-vif-deleted", "tag": "3f50c566-97a8-463a-ba3d-5e8786d8d971"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:28.841107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f2f3bca1-1fd5-42cc-ab22-21cd48047dab req-bf57cbc0-373e-47f8-9626-1b55c50dd68a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:28.842656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f2f3bca1-1fd5-42cc-ab22-21cd48047dab req-bf57cbc0-373e-47f8-9626-1b55c50dd68a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:28.843214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f2f3bca1-1fd5-42cc-ab22-21cd48047dab req-bf57cbc0-373e-47f8-9626-1b55c50dd68a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:28.862680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:28.868854 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f2f3bca1-1fd5-42cc-ab22-21cd48047dab req-bf57cbc0-373e-47f8-9626-1b55c50dd68a service nova] Creating event network-vif-deleted:3f50c566-97a8-463a-ba3d-5e8786d8d971 for instance b7dd3510-86d0-472f-bd84-6226b34335e3 on n-h1-858384-17 Oct 31 15:24:28.884298 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f2f3bca1-1fd5-42cc-ab22-21cd48047dab req-bf57cbc0-373e-47f8-9626-1b55c50dd68a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081916 Oct 31 15:24:28.885831 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1042/1950] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:28.901671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ffe2f602-ce2d-4985-b0b2-f79976420868 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Action: 'create', calling method: .version_select at 0x7f16e0e39550>, body: {"pool": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:29.205773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:24:29.206544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:24:29.207224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:24:29.208058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:24:29.209019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:24:29.226972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:29.229036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:29.230963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:29.233373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:29.235342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:29.239343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:29.283294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:29.297297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for user 93f77a1d41fd431d9da6587e0ca9cb1e and project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:29.343651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:24:29.347392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:24:29.415378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c0c484f-f463-4b72-b623-604f806169a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.660871 Oct 31 15:24:29.416814 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 909/1951] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:24:29.423355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:29.424405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:29.471089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:29.471592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:29.475308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:29.481430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:29.482130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:29.484736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:29.939054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:29.954996 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54a7d4b8-fc9e-4a71-a5c9-c26c5d771bdb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1536 microversion: 2.1 time: 0.536688 Oct 31 15:24:29.955948 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 910/1952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:29 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1536 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:29.974542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86c45f98-645f-4a52-8a6f-702049d30512 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e8cf70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:30.068902 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86c45f98-645f-4a52-8a6f-702049d30512 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.111662 Oct 31 15:24:30.079425 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 911/1953] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:29 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:30.089544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:30.090694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:30.112354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:30.113189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:30.114582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:30.115499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:30.120320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:30.121627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:30.438667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:30.466185 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5a7c044-7cd9-440c-86ac-ea303558f226 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.384763 Oct 31 15:24:30.487152 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 912/1954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:30 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:30.508895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-479e59c9-523c-4f0d-9f7a-6f3387e9740d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:30.510259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-479e59c9-523c-4f0d-9f7a-6f3387e9740d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:30.625187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-479e59c9-523c-4f0d-9f7a-6f3387e9740d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:30.634986 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-479e59c9-523c-4f0d-9f7a-6f3387e9740d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1215 microversion: 2.1 time: 0.139221 Oct 31 15:24:30.637440 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 913/1955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:30 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:30.656890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:30.658070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:30.680561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:30.685436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:30.685900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:30.688852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:30.689388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:30.691248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:30.818593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:30.828369 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c352323c-b670-4809-8460-37e2d64f9311 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1183 microversion: 2.1 time: 0.189554 Oct 31 15:24:30.845808 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 914/1956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:30 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:30.853827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:30.854697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:30.864067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:30.865741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:30.867965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:30.868999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:30.870105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:30.871485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:31.253279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:31.265721 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fdf50ef8-552c-4128-87d6-75b5e2b154d5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.417792 Oct 31 15:24:31.267435 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 915/1957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:30 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:31.273597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:31.274611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:31.295046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:31.295735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:31.296592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:31.299326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:31.299925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:31.301252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:31.664465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:31.676856 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d6162d2-d0eb-46e8-aaeb-09b6e58633e6 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1524 microversion: 2.1 time: 0.406792 Oct 31 15:24:31.681145 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 916/1958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:31 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1524 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:31.715945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5384ace6-96c0-4100-8143-e6403445c170 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0f514c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:31.817167 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5384ace6-96c0-4100-8143-e6403445c170 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.132995 Oct 31 15:24:31.818044 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 917/1959] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:31 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:31.830171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:31.838220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:31.859677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:31.863205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:31.865274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:31.866323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:31.869348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:31.870057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:31.966972 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ffe2f602-ce2d-4985-b0b2-f79976420868 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.077563 Oct 31 15:24:31.968137 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1043/1960] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:24:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:31.976511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:31.983672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:31.989906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:32.014167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:32.023603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:32.024332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:32.025605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:32.027015 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-055e3b35-ecf8-4758-821e-40738325343e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1275 microversion: 2.1 time: 0.206642 Oct 31 15:24:32.029483 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 918/1961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:31 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:32.030791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:32.031539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:32.033067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:32.042693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33b8f4f6-ce56-4980-b8fd-047973bce9ad tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Action: 'create', calling method: .version_select at 0x7f16e1007ca0>, body: {"pool": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:33.116051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:33.129909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2bbfd974-1ed9-47e9-849d-e18eba0a63cd tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1183 microversion: 2.1 time: 1.159902 Oct 31 15:24:33.133346 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1044/1962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:31 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1183 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:33.151335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:33.152109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:33.168822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:33.170497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:33.172334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:33.174216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:33.176360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:33.178987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:33.927712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:33.960011 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9cceab77-9bef-4774-9305-14dadae4e72c tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1524 microversion: 2.1 time: 0.821587 Oct 31 15:24:33.961064 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1045/1963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:33 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1524 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:33.972838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4c0b0e5-a2d1-498b-8943-aa672f295679 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e39af0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:34.063363 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4c0b0e5-a2d1-498b-8943-aa672f295679 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.100853 Oct 31 15:24:34.068774 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1046/1964] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:33 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:34.073976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2d000195-a07a-4d1b-8f30-96341e0dd623 req-802e536d-35a5-4deb-a492-6c23009a8b08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14785246-ca49-46bc-a3be-a98cc68d6a5c", "name": "network-vif-unplugged", "status": "completed", "tag": "056d4a62-dcbf-44f5-858b-7ffb06218964"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:34.104750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2d000195-a07a-4d1b-8f30-96341e0dd623 req-802e536d-35a5-4deb-a492-6c23009a8b08 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.107434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2d000195-a07a-4d1b-8f30-96341e0dd623 req-802e536d-35a5-4deb-a492-6c23009a8b08 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.109760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2d000195-a07a-4d1b-8f30-96341e0dd623 req-802e536d-35a5-4deb-a492-6c23009a8b08 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:34.133555 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2d000195-a07a-4d1b-8f30-96341e0dd623 req-802e536d-35a5-4deb-a492-6c23009a8b08 service nova] Creating event network-vif-unplugged:056d4a62-dcbf-44f5-858b-7ffb06218964 for instance 14785246-ca49-46bc-a3be-a98cc68d6a5c on n-h1-858384-17 Oct 31 15:24:34.155327 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2d000195-a07a-4d1b-8f30-96341e0dd623 req-802e536d-35a5-4deb-a492-6c23009a8b08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084873 Oct 31 15:24:34.157709 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1047/1965] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:34.167968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:34.171590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:34.185546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.186426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.187133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:34.188099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.188793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.189483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:34.731099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:34.749451 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17b7894f-da8c-48cf-9ca8-b31a4b50156e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1315 microversion: 2.1 time: 0.583122 Oct 31 15:24:34.751319 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1048/1966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:34 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:34.758712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:34.781709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:34.816443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.819891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.820615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:34.824321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:34.825163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:34.825883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:35.059491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:35.103911 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-44e665d7-5305-4a82-9741-57f00b21c24a tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1183 microversion: 2.1 time: 0.348950 Oct 31 15:24:35.123002 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1049/1967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:34 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:35.143386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:35.150187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:35.171090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:35.174278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:35.177714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:35.186922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:35.187923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:35.189950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:35.679480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:35.694987 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccbe2d44-8e0a-471b-bed8-4265d5f8ad6d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1524 microversion: 2.1 time: 0.574005 Oct 31 15:24:35.696649 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1050/1968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:35 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1524 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:35.712613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bdfd891-72c4-4913-9a53-9e5025b849c2 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e1a5e940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:35.815367 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bdfd891-72c4-4913-9a53-9e5025b849c2 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.113904 Oct 31 15:24:35.816080 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1051/1969] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:35 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:35.829945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:35.830596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:35.881390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:35.881901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:35.882346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:35.883076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:35.883535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:35.883961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.303081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:36.318345 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5049c0ef-9da8-496e-a5bc-bb86bb51260c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1315 microversion: 2.1 time: 0.499590 Oct 31 15:24:36.321169 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1052/1970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:35 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:36.337318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:36.339690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:36.355919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.358802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.358802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.361654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.362399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.364737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.523077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:36.532139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d6cd718a-1d86-48a8-b914-c65fa4411dac tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1183 microversion: 2.1 time: 0.209643 Oct 31 15:24:36.537545 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1053/1971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:36 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:36.544751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3ac0629e-c522-4cec-bd43-420c1ac2cad6 req-038bc92e-8710-4b83-b0de-14bda0d11d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14785246-ca49-46bc-a3be-a98cc68d6a5c", "name": "network-vif-plugged", "status": "completed", "tag": "056d4a62-dcbf-44f5-858b-7ffb06218964"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:36.563194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3ac0629e-c522-4cec-bd43-420c1ac2cad6 req-038bc92e-8710-4b83-b0de-14bda0d11d83 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.565873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3ac0629e-c522-4cec-bd43-420c1ac2cad6 req-038bc92e-8710-4b83-b0de-14bda0d11d83 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.568059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3ac0629e-c522-4cec-bd43-420c1ac2cad6 req-038bc92e-8710-4b83-b0de-14bda0d11d83 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.580482 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33b8f4f6-ce56-4980-b8fd-047973bce9ad tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.548423 Oct 31 15:24:36.581103 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 919/1972] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:24:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:36.595477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7342a691-9839-442c-8a51-08e0bd1dcb83 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Calling method '.version_select at 0x7f16e0e2cdc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:36.603089 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3ac0629e-c522-4cec-bd43-420c1ac2cad6 req-038bc92e-8710-4b83-b0de-14bda0d11d83 service nova] Creating event network-vif-plugged:056d4a62-dcbf-44f5-858b-7ffb06218964 for instance 14785246-ca49-46bc-a3be-a98cc68d6a5c on n-h1-858384-17 Oct 31 15:24:36.617073 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3ac0629e-c522-4cec-bd43-420c1ac2cad6 req-038bc92e-8710-4b83-b0de-14bda0d11d83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077974 Oct 31 15:24:36.618375 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1054/1973] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:36.727100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:36.728237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:36.746314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.747249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.754599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:36.756022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:36.757031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:36.759844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:37.252179 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7342a691-9839-442c-8a51-08e0bd1dcb83 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/b7b1e72f-a1ad-41b1-bf33-a0504986bee1" status: 200 len: 141 microversion: 2.1 time: 0.661827 Oct 31 15:24:37.254479 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 920/1974] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:24:36 2022] GET /compute/v2.1/os-floating-ips/b7b1e72f-a1ad-41b1-bf33-a0504986bee1 => generated 141 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:37.261812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8fdb898a-18d1-4556-8a4e-a38b44aafd4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e8c3a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:37.279528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:37.293976 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2fbd326c-da5a-4aaa-b4d2-158067ae5e71 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1524 microversion: 2.1 time: 0.572130 Oct 31 15:24:37.294935 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1055/1975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:36 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1524 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:24:37.299471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5401adfb-597b-4d61-aa27-b5385ace477c tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Calling method '.version_select at 0x7f16e0e39af0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:37.373738 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8fdb898a-18d1-4556-8a4e-a38b44aafd4e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.117446 Oct 31 15:24:37.377325 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 921/1976] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:37 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:37.405414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:37.406440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:37.409221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:37.425953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:37.427390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:37.427875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:37.428607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:37.429098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:37.434322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:37.770998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:37.784162 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0dc0a83-1ecd-44aa-ad48-c7b2480a4cc5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1315 microversion: 2.1 time: 0.401415 Oct 31 15:24:37.799590 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 922/1977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:37 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:37.811867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-92dae5b3-a25d-421a-b519-7f98f6aee219 req-2019e1d4-ad94-4784-a0e6-da1cd0456885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2acca25b-b31f-4943-932e-062a314fca5c", "tag": "d99898f2-115a-4940-bb35-cfcb7a25ac4d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:37.823349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-92dae5b3-a25d-421a-b519-7f98f6aee219 req-2019e1d4-ad94-4784-a0e6-da1cd0456885 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:37.824210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-92dae5b3-a25d-421a-b519-7f98f6aee219 req-2019e1d4-ad94-4784-a0e6-da1cd0456885 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:37.824894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-92dae5b3-a25d-421a-b519-7f98f6aee219 req-2019e1d4-ad94-4784-a0e6-da1cd0456885 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:37.840299 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-92dae5b3-a25d-421a-b519-7f98f6aee219 req-2019e1d4-ad94-4784-a0e6-da1cd0456885 service nova] Creating event network-changed:d99898f2-115a-4940-bb35-cfcb7a25ac4d for instance 2acca25b-b31f-4943-932e-062a314fca5c on n-h2-858384-17 Oct 31 15:24:37.845900 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-92dae5b3-a25d-421a-b519-7f98f6aee219 req-2019e1d4-ad94-4784-a0e6-da1cd0456885 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040302 Oct 31 15:24:37.847561 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 923/1978] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:37.854175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:37.855919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:37.867948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:37.871150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:37.873680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:37.874627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:37.875266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:37.876918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:38.054155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:38.067253 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e1b3b769-3928-428d-92d7-a399ccd1fdc1 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1183 microversion: 2.1 time: 0.218201 Oct 31 15:24:38.089659 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 924/1979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:37 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:38.320980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:38.321902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:38.329116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:38.330037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:38.330638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:38.332631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:38.333506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:38.334177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:38.964889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:38.978907 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-93f270ea-e320-45ef-84d6-8c567a770013 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1524 microversion: 2.1 time: 0.663524 Oct 31 15:24:38.996412 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 925/1980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:38 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1524 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:39.005883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bbc4f439-3053-47ed-8c86-6c9f3f906445 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0ef84c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:39.083003 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bbc4f439-3053-47ed-8c86-6c9f3f906445 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.088469 Oct 31 15:24:39.084249 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 926/1981] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:38 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:39.093527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:39.097787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:39.115504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.116802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.119232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.121863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.122579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.124561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.267331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:39.431248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:39.440395 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a163fb92-7b43-478a-9318-ce91a5163b4f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1315 microversion: 2.1 time: 0.352408 Oct 31 15:24:39.446895 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 927/1982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:39 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:39.461919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:39.462714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:39.471471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.471968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.477692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.479588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:39.480321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:39.481013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:39.629578 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5401adfb-597b-4d61-aa27-b5385ace477c tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/b7b1e72f-a1ad-41b1-bf33-a0504986bee1" status: 202 len: 0 microversion: 2.1 time: 2.332839 Oct 31 15:24:39.644139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:39.645852 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1056/1983] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:24:37 2022] DELETE /compute/v2.1/os-floating-ips/b7b1e72f-a1ad-41b1-bf33-a0504986bee1 => generated 0 bytes in 2342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:39.651827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e31d893-1681-49f7-b34d-4f4200e28bb7 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Calling method '.version_select at 0x7f16e0df3430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:39.705455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-810265c0-62bf-438f-ba1b-e13141659450 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 200 len: 1183 microversion: 2.1 time: 0.256722 Oct 31 15:24:39.709119 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 928/1984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:39 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 1183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:40.007862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:40.008510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:40.026412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:40.026947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:40.032898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:40.033749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:40.036964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:40.039719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:40.200984 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e31d893-1681-49f7-b34d-4f4200e28bb7 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.553732 Oct 31 15:24:40.202026 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1057/1985] 10.222.0.20 () {58 vars in 1164 bytes} [Mon Oct 31 15:24:39 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:24:40.208320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f6d55286-8fde-4c63-b7f4-db0b6fb6f503 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e30310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:40.403971 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f6d55286-8fde-4c63-b7f4-db0b6fb6f503 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.199348 Oct 31 15:24:40.407567 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1058/1986] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:40 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:40.418644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c518d8e1-4cd3-4a8d-9381-62031fd66118 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Calling method '.version_select at 0x7f16e0f36b80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:40.633054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:41.155937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:41.169905 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2bbfe7f7-62bb-4d2f-bba4-d9d74a8c64f9 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1509 microversion: 2.1 time: 1.167347 Oct 31 15:24:41.171101 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 929/1987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:40 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1509 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:41.176531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:41.190068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:41.225009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:41.228033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:41.231183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:41.233048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:41.249913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:41.251366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:41.832871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:41.849441 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c466748-d00a-462f-8dd0-ea7ac0000145 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1315 microversion: 2.1 time: 0.675394 Oct 31 15:24:41.852046 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 930/1988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:41 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:41.860049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:41.860949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: b7dd3510-86d0-472f-bd84-6226b34335e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:41.891134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:41.892236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:41.893319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:41.895797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:41.896501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:41.899610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:41.947394 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] HTTP exception thrown: Instance b7dd3510-86d0-472f-bd84-6226b34335e3 could not be found. Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Request method failure captured: Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 HTTP/1.1 Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cMhz5Bk_i_uznufFf4yJfBq3kYmzK81nDB2KVqt7g5fRpkZAU4c1uV1CBSb1cAVwcNuMoRvBAq_bUE69zpj3XJ3_8uq7Nj8DMYgyv0gPKkiOd9_F_OIF5EhQ8jtljGC_L9BukrJ1rsR3gef3stDHNCAL3TrJ26-dIBeyvV7J8KQzU Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 330c65ee73534d8080c0ec2441c55f16 Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-LiveMigrationTest-241057870 Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330c65ee73534d8080c0ec2441c55f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_330c65ee73534d8080c0ec2441c55f16", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330c65ee73534d8080c0ec2441c55f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/330c65ee73534d8080c0ec2441c55f16"}]}] Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-LiveMigrationTest-241057870 Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 330c65ee73534d8080c0ec2441c55f16 Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-LiveMigrationTest-241057870 Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-LiveMigrationTest-241057870-project Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 02e166a77a2c45ccab7a1f343e53542e Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-LiveMigrationTest-241057870-project Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance b7dd3510-86d0-472f-bd84-6226b34335e3 could not be found. Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'b7dd3510-86d0-472f-bd84-6226b34335e3'} Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7dd3510-86d0-472f-bd84-6226b34335e3 could not be found. Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7dd3510-86d0-472f-bd84-6226b34335e3 could not be found. Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:41.949120 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7dd3510-86d0-472f-bd84-6226b34335e3 could not be found. Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Returning 404 to user: Instance b7dd3510-86d0-472f-bd84-6226b34335e3 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1501f62c-5f14-4fdf-ae2d-18058e5b6e1e tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3" status: 404 len: 111 microversion: 2.1 time: 0.097344 Oct 31 15:24:41.955499 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 931/1989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:41 2022] GET /compute/v2.1/servers/b7dd3510-86d0-472f-bd84-6226b34335e3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:41.998627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:41.999253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:42.023138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:42.023637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:42.024080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:42.024795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:42.038573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:42.039046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:42.168999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:42.265794 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c518d8e1-4cd3-4a8d-9381-62031fd66118 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 1.851692 Oct 31 15:24:42.266614 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1059/1990] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:24:40 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:42.274693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c63b943-94bb-4461-be63-32250b43d5fd tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e5a550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:42.420687 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c63b943-94bb-4461-be63-32250b43d5fd tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.152619 Oct 31 15:24:42.421248 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1060/1991] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:42 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:42.468064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7028a891-7cae-4aa3-af4f-657606f87f34 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Calling method '.version_select at 0x7f16e0df3af0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:42.544143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:42.554326 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d0e85b0a-1b84-464c-81df-14c656e72d1d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 200 len: 1509 microversion: 2.1 time: 0.601872 Oct 31 15:24:42.555249 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 932/1992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:41 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 1509 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:42.589896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:42.589896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:42.610680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:42.611194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:42.611640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:42.612366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:42.613406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:42.613851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:42.695385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:24:42.934619 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-907c30bf-c2d3-46cf-85cb-df6c5a2d22b3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 204 len: 0 microversion: 2.1 time: 0.353230 Oct 31 15:24:42.935757 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 933/1993] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:42 2022] DELETE /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:42.961436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:42.977265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:43.000247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:43.000757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:43.001221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:43.001946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:43.010279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:43.010847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:43.293039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:43.308267 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8c129dc-2de0-4f43-b8fa-9ede704667d6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1315 microversion: 2.1 time: 0.370760 Oct 31 15:24:43.308888 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 934/1994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:42 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:43.318415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25ef7793-e20a-42ab-bc8f-d7689700b986 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1118566009", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "524d630e-d0c9-4d4c-9057-837f830c46f6", "destination_type": "local"}, {"source_type": "volume", "uuid": "8b4f9bfb-fc60-433c-9521-f203c44dd80e", "destination_type": "invalid"}], "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25ef7793-e20a-42ab-bc8f-d7689700b986 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 495 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1118566009", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "524d630e-d0c9-4d4c-9057-837f830c46f6", "destination_type": "local"}, {"source_type": "volume", "uuid": "8b4f9bfb-fc60-433c-9521-f203c44dd80e", "destination_type": "invalid"}], "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1118566009', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '8b4f9bfb-fc60-433c-9521-f203c44dd80e', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:43.333096 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 31 15:24:43.338203 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:43.341587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25ef7793-e20a-42ab-bc8f-d7689700b986 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:43.342683 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25ef7793-e20a-42ab-bc8f-d7689700b986 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.029370 Oct 31 15:24:43.343519 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 935/1995] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:43 2022] POST /compute/v2.1/servers => generated 155 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:24:43.354007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1525661824", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "942ea272-9a7a-4042-b342-fe98a8b8489d"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:43.449375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] validate_networks() for [('942ea272-9a7a-4042-b342-fe98a8b8489d', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:24:44.196033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:24:44.196458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:24:44.196940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:24:44.197376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:24:44.198436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:24:44.227573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:44.231381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:44.233710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:44.234705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:44.236886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:44.238181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:44.308527 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7028a891-7cae-4aa3-af4f-657606f87f34 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/326b7de3-77f8-4c6d-912a-89053598b700" status: 202 len: 0 microversion: 2.1 time: 1.886209 Oct 31 15:24:44.309652 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1061/1996] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:24:42 2022] DELETE /compute/v2.1/os-floating-ips/326b7de3-77f8-4c6d-912a-89053598b700 => generated 0 bytes in 1888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:44.315124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:44.316691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:44.317896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Getting quotas for project 7687292298c5476dabe26115be2d1faf. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:24:44.338940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:44.339181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Getting quotas for user 7de8009481e24fc7a113b58bb34a2eef and project 7687292298c5476dabe26115be2d1faf. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:24:44.344880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:44.349942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:44.354788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:44.358621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:44.364266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:44.387944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:24:44.402228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:24:44.606952 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa655769-57c1-4608-a844-9f01364b5d31 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.262177 Oct 31 15:24:44.615888 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 936/1997] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:24:44.630593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-025d7bcf-6967-454b-b348-da4090157c26 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0ea5f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:44.757729 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-025d7bcf-6967-454b-b348-da4090157c26 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.140668 Oct 31 15:24:44.762396 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 937/1998] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:44 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:44.778438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0c6eb893-c0c0-4832-8873-05f1ab462a71 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Calling method '.version_select at 0x7f16e0ef8c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:44.954154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:44.975614 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d24a55c3-40db-4f40-b251-028d9affc7ae tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.660317 Oct 31 15:24:44.990021 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1062/1999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:44 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:45.019163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:45.026991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:45.053752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:45.054097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:45.054653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:45.055242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:45.055712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:45.056121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:46.031413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:46.052347 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49c77104-9b83-4193-9026-595832c8d76f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1315 microversion: 2.1 time: 1.057521 Oct 31 15:24:46.053754 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1063/2000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:44 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1315 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:46.088993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:46.094610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:46.112950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:46.114465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:46.126633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:46.127888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:46.129363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:46.130186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:46.764647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:46.808219 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b62f21e-7596-4e50-b33b-bdefd41adead tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1222 microversion: 2.1 time: 0.752573 Oct 31 15:24:46.814665 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1064/2001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:46 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1222 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:46.834017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c2c145eb-d74a-47a2-ba04-0e42d6a7495c req-6d554e79-c068-492c-b5c5-fc0e99826d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2acca25b-b31f-4943-932e-062a314fca5c", "name": "network-vif-plugged", "status": "completed", "tag": "d99898f2-115a-4940-bb35-cfcb7a25ac4d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:46.862600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c2c145eb-d74a-47a2-ba04-0e42d6a7495c req-6d554e79-c068-492c-b5c5-fc0e99826d7e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:46.867322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c2c145eb-d74a-47a2-ba04-0e42d6a7495c req-6d554e79-c068-492c-b5c5-fc0e99826d7e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:46.872266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c2c145eb-d74a-47a2-ba04-0e42d6a7495c req-6d554e79-c068-492c-b5c5-fc0e99826d7e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:46.947603 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c2c145eb-d74a-47a2-ba04-0e42d6a7495c req-6d554e79-c068-492c-b5c5-fc0e99826d7e service nova] Creating event network-vif-plugged:d99898f2-115a-4940-bb35-cfcb7a25ac4d for instance 2acca25b-b31f-4943-932e-062a314fca5c on n-h2-858384-17 Oct 31 15:24:46.978161 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c2c145eb-d74a-47a2-ba04-0e42d6a7495c req-6d554e79-c068-492c-b5c5-fc0e99826d7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161757 Oct 31 15:24:46.981885 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1065/2002] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:47.001401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:47.005254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:47.024142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:47.024643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:47.025079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:47.038211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:47.038823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:47.039281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:47.414071 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0c6eb893-c0c0-4832-8873-05f1ab462a71 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/fb0d4cc6-10cf-470c-8911-82df11837341" status: 202 len: 0 microversion: 2.1 time: 2.650339 Oct 31 15:24:47.416165 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 938/2003] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:24:44 2022] DELETE /compute/v2.1/os-floating-ips/fb0d4cc6-10cf-470c-8911-82df11837341 => generated 0 bytes in 2653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:47.422510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d279e2ba-9cf6-4e60-83a2-6b93b87d3c18 req-294bbe5f-ba10-4eb0-9c93-13667550b7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14785246-ca49-46bc-a3be-a98cc68d6a5c", "name": "network-vif-deleted", "tag": "056d4a62-dcbf-44f5-858b-7ffb06218964"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:47.448254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d279e2ba-9cf6-4e60-83a2-6b93b87d3c18 req-294bbe5f-ba10-4eb0-9c93-13667550b7b2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:47.452569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d279e2ba-9cf6-4e60-83a2-6b93b87d3c18 req-294bbe5f-ba10-4eb0-9c93-13667550b7b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:47.453707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d279e2ba-9cf6-4e60-83a2-6b93b87d3c18 req-294bbe5f-ba10-4eb0-9c93-13667550b7b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:47.469575 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d279e2ba-9cf6-4e60-83a2-6b93b87d3c18 req-294bbe5f-ba10-4eb0-9c93-13667550b7b2 service nova] Creating event network-vif-deleted:056d4a62-dcbf-44f5-858b-7ffb06218964 for instance 14785246-ca49-46bc-a3be-a98cc68d6a5c on n-h1-858384-17 Oct 31 15:24:47.477695 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d279e2ba-9cf6-4e60-83a2-6b93b87d3c18 req-294bbe5f-ba10-4eb0-9c93-13667550b7b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059797 Oct 31 15:24:47.479089 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 939/2004] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:47.485461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a891f643-9bc2-4fe6-a3c4-945b244c7c8e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e45700>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:47.542462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:47.579295 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e78abd3-47b8-451b-b406-2060b600967c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.591802 Oct 31 15:24:47.582009 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1066/2005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:46 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:47.616714 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a891f643-9bc2-4fe6-a3c4-945b244c7c8e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.135144 Oct 31 15:24:47.618673 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 940/2006] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:47 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:47.625239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:47.633457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a03a3eec-4ca2-41fe-97cf-3d8214ccfa22 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] Calling method '.version_select at 0x7f16e0ea4280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:47.644813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:47.688261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:47.688973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:47.691214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:47.692104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:47.694552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:47.696512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.040518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:48.056008 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-701a2352-53b4-427b-82bf-a0e7f48a1c1d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1315 microversion: 2.1 time: 0.467652 Oct 31 15:24:48.070674 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1067/2007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:47 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:48.081218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:48.082158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:48.088997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.090597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.091244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.092362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.093012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.093824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.194535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:48.213994 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8779e7b-4330-4827-a6a0-6fdde82c8922 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1288 microversion: 2.1 time: 0.136190 Oct 31 15:24:48.234822 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1068/2008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:48 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1288 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:48.245664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-735d48f5-3d4a-42eb-8e83-5d7ea691e52e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1990692532", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-735d48f5-3d4a-42eb-8e83-5d7ea691e52e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 492 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1990692532", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1990692532', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:48.257362 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-735d48f5-3d4a-42eb-8e83-5d7ea691e52e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:48.261479 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-735d48f5-3d4a-42eb-8e83-5d7ea691e52e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.023177 Oct 31 15:24:48.264219 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1069/2009] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:48 2022] POST /compute/v2.1/servers => generated 624 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:24:48.272415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:48.273828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:48.289462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.289821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.290607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.291080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.291544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.291977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.664180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:48.681106 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f43fa2f-b7a0-40f9-805c-c14c4f24a8b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.408725 Oct 31 15:24:48.682930 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1070/2010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:48 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:48.719050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b6af5dc-f614-4bfa-82fb-2536ff7092fe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e308b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:48.853962 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b6af5dc-f614-4bfa-82fb-2536ff7092fe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.160895 Oct 31 15:24:48.855601 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1071/2011] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:48 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:48.870133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:48.871396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:48.886567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.889725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.890612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.955199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:48.955199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:48.955199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:48.955199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:49.153036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:49.164954 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b6c9c69-690e-43a8-a98c-af1507468d12 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.306784 Oct 31 15:24:49.166266 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1072/2012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:48 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:49.178364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:49.179794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:49.192444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.193693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.194734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.195691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.197282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.198007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.445231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:49.459804 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f6e3b57-72a8-4a30-a12d-ab927ec37859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1501 microversion: 2.1 time: 0.292123 Oct 31 15:24:49.479592 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1073/2013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:49 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:49.486152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:49.487175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:49.494846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.495610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.496134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.497715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.498519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.499508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.771102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:49.783317 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a727dc2b-5d16-4a46-ae33-10a845e15864 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1276 microversion: 2.1 time: 0.302666 Oct 31 15:24:49.783922 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1074/2014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:49 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:49.812529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c9e3975-3cff-46f9-ad85-ef6cb3d52b80 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c9e3975-3cff-46f9-ad85-ef6cb3d52b80 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 416 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:49.838263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:24:49.840823 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:49.843323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c9e3975-3cff-46f9-ad85-ef6cb3d52b80 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:49.851611 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c9e3975-3cff-46f9-ad85-ef6cb3d52b80 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.057965 Oct 31 15:24:49.852240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1075/2015] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:49 2022] POST /compute/v2.1/servers => generated 619 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:24:49.899049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:49.901269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:49.924259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.931037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.931575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:49.932328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:49.932799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:49.945956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:50.057465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:24:50.305514 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be949020-9907-41c0-9580-5eee55de098c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 204 len: 0 microversion: 2.1 time: 0.442726 Oct 31 15:24:50.319034 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1076/2016] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:49 2022] DELETE /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:50.338604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:50.339339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:50.354748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:50.357253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:50.357741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:50.358487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:50.358958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:50.359392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:50.705540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:50.720139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a6e5410d-7a32-4968-aad2-e664a1461227 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.399466 Oct 31 15:24:50.728549 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1077/2017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:50 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:50.739193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2aff4673-129e-42a1-9f3e-fcec579a11a0 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0de9940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:50.822001 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2aff4673-129e-42a1-9f3e-fcec579a11a0 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.091943 Oct 31 15:24:50.830618 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1078/2018] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:50 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:50.830618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:50.830618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:50.846229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:50.846736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:50.847175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:50.847939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:50.848399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:50.849461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:51.087108 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a03a3eec-4ca2-41fe-97cf-3d8214ccfa22 tempest-FloatingIPDetailsTestJSON-814176921 tempest-FloatingIPDetailsTestJSON-814176921-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/999c7f68-47b0-4bff-9ba4-00f54c5b1816" status: 202 len: 0 microversion: 2.1 time: 3.467046 Oct 31 15:24:51.087823 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 941/2019] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:24:47 2022] DELETE /compute/v2.1/os-floating-ips/999c7f68-47b0-4bff-9ba4-00f54c5b1816 => generated 0 bytes in 3469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:51.094470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:51.104033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:51.140037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:51.153417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:51.160351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:51.164711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:51.167073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:51.169306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:51.278673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid 0ace9f23-0d08-4d3b-8c64-dd82142559be {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:24:51.342065 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a10da84a-e4f9-48b1-8c5c-55a7ab2ed8b8 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 2425 microversion: 2.25 time: 0.517682 Oct 31 15:24:51.343416 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1079/2020] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:24:50 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 2425 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:24:51.355780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:51.359337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:51.386667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:51.387065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:51.387508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:51.391107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:51.391978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:51.392568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:51.678471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:51.694842 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f95bd3e-7977-4859-a2a9-50191055d516 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.350081 Oct 31 15:24:51.696054 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1080/2021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:51 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:51.700832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:51.708072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:51.737236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:51.737622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:51.744061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:51.745389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:51.745878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:51.746315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:51.950534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:51.964560 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fcf88842-6922-4882-b460-e6e68ab49b44 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1276 microversion: 2.1 time: 0.267186 Oct 31 15:24:51.965406 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1081/2022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:51 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:52.001758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-17", "block_migration": "auto"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:52.018510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:52.026661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:52.029951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:52.033215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:52.034398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:52.041116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:52.041870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:52.105839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'flavor' on Instance uuid 0ace9f23-0d08-4d3b-8c64-dd82142559be {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:24:52.161538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Going to try to live migrate instance to n-h1-858384-17 {{(pid=120587) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:24:52.993674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:53.018651 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b72b248c-99b1-468d-adbe-4e4152af34da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1507 microversion: 2.1 time: 1.914980 Oct 31 15:24:53.019869 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 942/2023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:51 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1507 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:53.044618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74927b74-afe9-4394-b9aa-6c9ac58479e6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1394136478", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": -1, "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:53.104599 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-74927b74-afe9-4394-b9aa-6c9ac58479e6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Flavor -1 could not be found. Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74927b74-afe9-4394-b9aa-6c9ac58479e6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 206 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1394136478", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": -1, "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: exception: Flavor -1 could not be found. Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1394136478', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': -1, 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:53.118621 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 31 15:24:53.121586 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:53.130523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74927b74-afe9-4394-b9aa-6c9ac58479e6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:53.136996 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-74927b74-afe9-4394-b9aa-6c9ac58479e6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.101447 Oct 31 15:24:53.141045 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 943/2024] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:53 2022] POST /compute/v2.1/servers => generated 73 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:24:53.168613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0a01b0ca-bc47-4b6f-8e8d-47460de74e40 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0ded8b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:53.269939 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0a01b0ca-bc47-4b6f-8e8d-47460de74e40 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.127444 Oct 31 15:24:53.273953 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 944/2025] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:53 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:53.295522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:53.311029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:53.345829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:53.346334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:53.346781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:53.348049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:53.348524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:53.348951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:53.789145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:53.797600 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c89d9f26-b34f-44cf-afc4-be5977c2e7e0 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1318 microversion: 2.1 time: 0.511635 Oct 31 15:24:53.804592 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 945/2026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:53 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:53.809661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:53.812031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:53.829763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:53.830448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:53.831026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:53.836874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:53.838500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:53.839088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:53.908296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:24:54.075291 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e075583e-6a52-47ed-b5c7-6e7b2f1dd9d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 204 len: 0 microversion: 2.1 time: 0.268853 Oct 31 15:24:54.076192 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 946/2027] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:24:53 2022] DELETE /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:54.093306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:54.094530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:54.102106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.102847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.103574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.104550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.105172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.117876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.249714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:54.369713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:54.770662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:54.778896 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-421fcc1a-4e58-4b80-981e-c0f24c1e2800 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.701347 Oct 31 15:24:54.790263 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 947/2028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:54 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:54.795233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:54.796002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:54.808557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.809054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.809693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:54.810856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:54.811459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:54.812054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:55.673760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:55.695840 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1f1524d2-7680-48b7-8373-00152fa378df tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1507 microversion: 2.1 time: 0.903908 Oct 31 15:24:55.696412 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 948/2029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:54 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1507 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:55.726663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:55.729948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:55.756432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:55.760801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:55.761307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:55.762071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:55.762546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:55.762973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:56.384491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:56.393062 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5587b564-f8d7-4087-aedc-2cf49d9f0a46 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 200 len: 1601 microversion: 2.1 time: 0.689750 Oct 31 15:24:56.394023 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 949/2030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:55 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 1601 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:56.409176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71456a0b-db69-4855-a13d-ebf234f80126 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e451f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:56.480278 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71456a0b-db69-4855-a13d-ebf234f80126 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1428 microversion: 2.1 time: 0.084497 Oct 31 15:24:56.491723 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 950/2031] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:56 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1428 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:56.534400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:56.536385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:56.543298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:56.544120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:56.544798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:56.545824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:56.546494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:56.547127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.292415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:57.323784 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3eccea07-7a7d-4119-82dc-f8fe46a536bb tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.828016 Oct 31 15:24:57.336312 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 951/2032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:56 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:57.349372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:57.354709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:57.361433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.362889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.364546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.365444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.368352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.368997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.802474 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e772a66f-125e-4aef-bf75-daaed1f1de00 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/action" status: 202 len: 0 microversion: 2.25 time: 5.814728 Oct 31 15:24:57.803236 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1082/2033] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:24:51 2022] POST /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/action => generated 0 bytes in 5837 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:24:57.815322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-228f55be-8246-4f10-a284-a8e22c489420 req-9a6fd68c-632a-4eb0-bde1-8d7f3c24b652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2acca25b-b31f-4943-932e-062a314fca5c", "name": "network-vif-unplugged", "status": "completed", "tag": "d99898f2-115a-4940-bb35-cfcb7a25ac4d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:57.848503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-228f55be-8246-4f10-a284-a8e22c489420 req-9a6fd68c-632a-4eb0-bde1-8d7f3c24b652 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.849596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-228f55be-8246-4f10-a284-a8e22c489420 req-9a6fd68c-632a-4eb0-bde1-8d7f3c24b652 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.850099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-228f55be-8246-4f10-a284-a8e22c489420 req-9a6fd68c-632a-4eb0-bde1-8d7f3c24b652 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.859509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:57.880454 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a01ec3b3-4651-423f-8fa7-f28729363ba8 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1318 microversion: 2.1 time: 0.537674 Oct 31 15:24:57.881089 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 952/2034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:57 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:57.891926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f3301186-1587-4768-ad01-66c9cdbd4857 req-8e9d06e8-f6e4-4137-b59d-db83fda1acdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3848bfc-68ef-48e5-8d45-4a700c478f0a", "name": "network-vif-deleted", "tag": "a2841d16-87c1-4e48-935e-723891a9ad43"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:57.902435 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-228f55be-8246-4f10-a284-a8e22c489420 req-9a6fd68c-632a-4eb0-bde1-8d7f3c24b652 service nova] Creating event network-vif-unplugged:d99898f2-115a-4940-bb35-cfcb7a25ac4d for instance 2acca25b-b31f-4943-932e-062a314fca5c on n-h2-858384-17 Oct 31 15:24:57.919899 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-228f55be-8246-4f10-a284-a8e22c489420 req-9a6fd68c-632a-4eb0-bde1-8d7f3c24b652 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114226 Oct 31 15:24:57.924593 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1083/2035] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:57.927035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f3301186-1587-4768-ad01-66c9cdbd4857 req-8e9d06e8-f6e4-4137-b59d-db83fda1acdb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.927545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f3301186-1587-4768-ad01-66c9cdbd4857 req-8e9d06e8-f6e4-4137-b59d-db83fda1acdb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.931628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f3301186-1587-4768-ad01-66c9cdbd4857 req-8e9d06e8-f6e4-4137-b59d-db83fda1acdb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.937355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:57.941070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:57.957366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.957872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.961026 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f3301186-1587-4768-ad01-66c9cdbd4857 req-8e9d06e8-f6e4-4137-b59d-db83fda1acdb service nova] Creating event network-vif-deleted:a2841d16-87c1-4e48-935e-723891a9ad43 for instance f3848bfc-68ef-48e5-8d45-4a700c478f0a on n-h1-858384-17 Oct 31 15:24:57.962694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.963435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:57.964403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:57.966453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:57.971853 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f3301186-1587-4768-ad01-66c9cdbd4857 req-8e9d06e8-f6e4-4137-b59d-db83fda1acdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089518 Oct 31 15:24:57.975172 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 953/2036] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:57.994395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ab07440f-5c15-4373-a462-92b4d12edbfd req-b1197a38-324f-4b70-84b7-af780bff640a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2acca25b-b31f-4943-932e-062a314fca5c", "name": "network-vif-deleted", "tag": "d99898f2-115a-4940-bb35-cfcb7a25ac4d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:58.038420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ab07440f-5c15-4373-a462-92b4d12edbfd req-b1197a38-324f-4b70-84b7-af780bff640a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.041584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ab07440f-5c15-4373-a462-92b4d12edbfd req-b1197a38-324f-4b70-84b7-af780bff640a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.043143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ab07440f-5c15-4373-a462-92b4d12edbfd req-b1197a38-324f-4b70-84b7-af780bff640a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:58.104496 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ab07440f-5c15-4373-a462-92b4d12edbfd req-b1197a38-324f-4b70-84b7-af780bff640a service nova] Creating event network-vif-deleted:d99898f2-115a-4940-bb35-cfcb7a25ac4d for instance 2acca25b-b31f-4943-932e-062a314fca5c on n-h2-858384-17 Oct 31 15:24:58.106283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.106823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.107353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:58.107964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lazy-loading 'fault' on Instance uuid 2acca25b-b31f-4943-932e-062a314fca5c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:24:58.120348 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ab07440f-5c15-4373-a462-92b4d12edbfd req-b1197a38-324f-4b70-84b7-af780bff640a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140439 Oct 31 15:24:58.124155 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 954/2037] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:24:58.139179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:58.140220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: f3848bfc-68ef-48e5-8d45-4a700c478f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:58.154060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.154870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.155415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:58.156228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.156785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.157348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:58.188898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] HTTP exception thrown: Instance f3848bfc-68ef-48e5-8d45-4a700c478f0a could not be found. Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Request method failure captured: Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a HTTP/1.1 Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-cMhz5Bk_i_uznufFf4yJfBq3kYmzK81nDB2KVqt7g5fRpkZAU4c1uV1CBSb1cAVwcNuMoRvBAq_bUE69zpj3XJ3_8uq7Nj8DMYgyv0gPKkiOd9_F_OIF5EhQ8jtljGC_L9BukrJ1rsR3gef3stDHNCAL3TrJ26-dIBeyvV7J8KQzU Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 330c65ee73534d8080c0ec2441c55f16 Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-LiveMigrationTest-241057870 Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330c65ee73534d8080c0ec2441c55f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_330c65ee73534d8080c0ec2441c55f16", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330c65ee73534d8080c0ec2441c55f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/330c65ee73534d8080c0ec2441c55f16"}]}] Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-LiveMigrationTest-241057870 Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 330c65ee73534d8080c0ec2441c55f16 Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-LiveMigrationTest-241057870 Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-LiveMigrationTest-241057870-project Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 02e166a77a2c45ccab7a1f343e53542e Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-LiveMigrationTest-241057870-project Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f3848bfc-68ef-48e5-8d45-4a700c478f0a could not be found. Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f3848bfc-68ef-48e5-8d45-4a700c478f0a'} Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3848bfc-68ef-48e5-8d45-4a700c478f0a could not be found. Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3848bfc-68ef-48e5-8d45-4a700c478f0a could not be found. Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:58.192112 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.195657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:58.195657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:58.195657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:58.195657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:58.195657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:58.195657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3848bfc-68ef-48e5-8d45-4a700c478f0a could not be found. Oct 31 15:24:58.195657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.206593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Returning 404 to user: Instance f3848bfc-68ef-48e5-8d45-4a700c478f0a could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:58.210161 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34ea7c80-9d20-4598-bf48-2dc76b5ff015 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a" status: 404 len: 111 microversion: 2.1 time: 0.081223 Oct 31 15:24:58.216950 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 955/2038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:58 2022] GET /compute/v2.1/servers/f3848bfc-68ef-48e5-8d45-4a700c478f0a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:58.230031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ea55f41-152a-4e7e-b4d5-c221ee4e4c3f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1817677552", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ea55f41-152a-4e7e-b4d5-c221ee4e4c3f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 173 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1817677552", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1817677552', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi -1 Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:24:58.245387 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 31 15:24:58.249021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:24:58.250422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ea55f41-152a-4e7e-b4d5-c221ee4e4c3f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:58.251136 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9ea55f41-152a-4e7e-b4d5-c221ee4e4c3f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.029610 Oct 31 15:24:58.255701 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 956/2039] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:24:58 2022] POST /compute/v2.1/servers => generated 145 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:24:58.265346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e2527599-57a0-4bd9-8d33-2239d05e89e7 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e2c3a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:58.286510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:58.299500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5cea1f2c-7fe2-4fb6-b54a-79e02873b33b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 200 len: 1305 microversion: 2.1 time: 0.370843 Oct 31 15:24:58.303405 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1084/2040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:57 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 1305 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:58.310065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:58.311921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:58.326190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.330932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.331821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:58.334360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.335414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.336779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:58.353004 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e2527599-57a0-4bd9-8d33-2239d05e89e7 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1437 microversion: 2.1 time: 0.096094 Oct 31 15:24:58.377801 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 957/2041] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:58 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:58.405503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2816d32a-912b-43ea-bae1-7b68ac4c577b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '.version_select at 0x7f16e0f184c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:58.470698 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2816d32a-912b-43ea-bae1-7b68ac4c577b tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051704933" status: 202 len: 0 microversion: 2.1 time: 0.098711 Oct 31 15:24:58.476974 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 958/2042] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 15:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051704933 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:24:58.484309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:58.484940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:58.508774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.509494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.510560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:58.513950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:58.515537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:58.516010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:58.810699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:58.831029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:58.837920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:58.842701 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-271a7a7f-a738-4bbd-8b8c-6285ba8673f3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.537984 Oct 31 15:24:58.858980 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1085/2043] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:24:58 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:24:58.875254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e284b5bd-b6ee-4eea-a371-1fe1de1407c5 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0de5e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:58.946504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:58.948982 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e284b5bd-b6ee-4eea-a371-1fe1de1407c5 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 200 len: 1437 microversion: 2.1 time: 0.088396 Oct 31 15:24:58.949249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:24:58.964445 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1086/2044] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:24:58 2022] GET /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 1437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:58.967223 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-355a2e6d-c7f2-4ce5-973b-56f10c13fcee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.485806 Oct 31 15:24:58.967883 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 959/2045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:58 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:58.981313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:58.982772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:58.986114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:58.986731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:59.002618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.003139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.003865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.008777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.009540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.009871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.010478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.011734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.014147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.021801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.022517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.026100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.387263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:59.399494 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2db232f-2c2b-498f-9313-c310031b5edc tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1465 microversion: 2.1 time: 0.425370 Oct 31 15:24:59.400236 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 960/2046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:58 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1465 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:59.411910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:59.413068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:59.423518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.435474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.436576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.437911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.438848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.441381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.564899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:59.582501 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c56790b2-da0e-4afd-b695-1621b75d8b8e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1318 microversion: 2.1 time: 0.615012 Oct 31 15:24:59.583676 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1087/2047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:58 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:59.594121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:59.595701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:59.610732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.611572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.612283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.613879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.619253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.619972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.666632 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c HTTP/1.1 Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '2acca25b-b31f-4943-932e-062a314fca5c'} Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:24:59.668949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:59.673078 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:24:59.673078 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:24:59.673078 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:24:59.673078 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:24:59.673078 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:24:59.673078 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:24:59.673078 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:24:59.675027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:24:59.684425 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09a5e5e6-f6b8-4286-a185-420d7f4e5903 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 404 len: 111 microversion: 2.1 time: 0.099165 Oct 31 15:24:59.685355 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1088/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:59 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:24:59.690152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd6f35c1-3a86-438f-9546-857c3cc29fbe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0de5820>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:59.842128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:24:59.860765 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a00cc7a-e5af-42fd-95a0-d4211ebb946d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.454898 Oct 31 15:24:59.866839 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 961/2049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:59 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:24:59.878579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:24:59.881811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:24:59.895108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.898605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.899244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:24:59.902004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:24:59.902641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:24:59.903666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:00.921376 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd6f35c1-3a86-438f-9546-857c3cc29fbe tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "DELETE /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074" status: 204 len: 0 microversion: 2.1 time: 1.234632 Oct 31 15:25:00.922380 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1089/2050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:24:59 2022] DELETE /compute/v2.1/images/18727035-3114-44ba-bdce-f251426cc074 => generated 0 bytes in 1236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:00.929270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1700502797", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "c356d61f-2e01-42fa-9c99-c94fb61838ec"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:01.074306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] validate_networks() for [('c356d61f-2e01-42fa-9c99-c94fb61838ec', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:01.227755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:01.242493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:01.244342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:01.245800 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd4ecf20-e301-47ad-8903-b0a975e404cd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 1.372041 Oct 31 15:25:01.246603 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 962/2051] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:24:59 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:25:01.253420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3b68acb-0d6f-44ad-931c-4eae179551da tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-171030312", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:01.260345 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-a3b68acb-0d6f-44ad-931c-4eae179551da tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3b68acb-0d6f-44ad-931c-4eae179551da tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 215 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-171030312", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-171030312', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:01.262563 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:01.266187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:01.266187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:01.266187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:01.266187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:01.266187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:01.266187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:01.266187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 31 15:25:01.266187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:01.267635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3b68acb-0d6f-44ad-931c-4eae179551da tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:01.268779 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3b68acb-0d6f-44ad-931c-4eae179551da tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.020980 Oct 31 15:25:01.270468 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 963/2052] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:01 2022] POST /compute/v2.1/servers => generated 123 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:01.279729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e8187960-39d3-4579-aed6-bcaecd6fb7df req-6f31ed52-a5f9-47fc-8ec2-2b0c32a3f9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be12352-a6e7-4e99-bc85-bd7d8ceccbe0", "tag": "c0a1ad8b-1588-4e71-bd34-b0864c01e4ac"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:01.314796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e8187960-39d3-4579-aed6-bcaecd6fb7df req-6f31ed52-a5f9-47fc-8ec2-2b0c32a3f9a6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.320599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e8187960-39d3-4579-aed6-bcaecd6fb7df req-6f31ed52-a5f9-47fc-8ec2-2b0c32a3f9a6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.321779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e8187960-39d3-4579-aed6-bcaecd6fb7df req-6f31ed52-a5f9-47fc-8ec2-2b0c32a3f9a6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:01.348641 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e8187960-39d3-4579-aed6-bcaecd6fb7df req-6f31ed52-a5f9-47fc-8ec2-2b0c32a3f9a6 service nova] Creating event network-changed:c0a1ad8b-1588-4e71-bd34-b0864c01e4ac for instance 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 on n-h1-858384-17 Oct 31 15:25:01.357581 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e8187960-39d3-4579-aed6-bcaecd6fb7df req-6f31ed52-a5f9-47fc-8ec2-2b0c32a3f9a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083190 Oct 31 15:25:01.358525 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 964/2053] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:01.376594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:01.377370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:01.393288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.393779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.397026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:01.398633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:01.399259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:01.406406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.224279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:02.239573 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0b6b127-de75-4e41-8b94-7235fbd0cacb tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1318 microversion: 2.1 time: 0.879752 Oct 31 15:25:02.255645 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 965/2054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:01 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1318 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:02.266855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c27b3cbd-bfa5-4bc1-848c-a0b54e101426 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '.version_select at 0x7f16e0e2c040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:02.311062 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c27b3cbd-bfa5-4bc1-848c-a0b54e101426 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] HTTP exception thrown: Image not found. Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c27b3cbd-bfa5-4bc1-848c-a0b54e101426 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Request method failure captured: Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 HTTP/1.1 Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hqarFnMlbtD88ltC0buSfEUbtxgcGnknqAWfa8NjTm5sgSS96rFOCVMTp8SYp76-7V10BNsw9RLNHtLx4sn037o8ndkOiylsC9r9K1M99E4bx53wonhukIY7jMGNiLbo1G0xWAQdIw6GQIe61Zo0UIUz27izmxi_fy-SWHSFgdIhk Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 95d5bc4f1cb64997a33609c07379cc60 Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ImagesOneServerTestJSON-1096504688 Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95d5bc4f1cb64997a33609c07379cc60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_95d5bc4f1cb64997a33609c07379cc60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95d5bc4f1cb64997a33609c07379cc60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/95d5bc4f1cb64997a33609c07379cc60"}]}] Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ImagesOneServerTestJSON-1096504688 Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 95d5bc4f1cb64997a33609c07379cc60 Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1096504688 Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ImagesOneServerTestJSON-1096504688-project Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d3fa70260a7640f5b8fbb7eb9b75580e Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ImagesOneServerTestJSON-1096504688-project Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'eeec4154-a979-4bc9-823e-dd1594a5ca64'} Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eeec4154-a979-4bc9-823e-dd1594a5ca64 to delete Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eeec4154-a979-4bc9-823e-dd1594a5ca64 could not be found. Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:02.313218 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:25:02.316905 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:02.319414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c27b3cbd-bfa5-4bc1-848c-a0b54e101426 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:02.320500 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c27b3cbd-bfa5-4bc1-848c-a0b54e101426 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "DELETE /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64" status: 404 len: 62 microversion: 2.1 time: 0.063779 Oct 31 15:25:02.321332 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 966/2055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:02 2022] DELETE /compute/v2.1/images/eeec4154-a979-4bc9-823e-dd1594a5ca64 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:25:02.331983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:02.332918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:02.343920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:02.344907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:02.345723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:02.346286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:02.346873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:02.355168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:02.371138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.376276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.377646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.381717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.383847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.398929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.399462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.399949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.400764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.401255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.401688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.403491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.458405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:02.515183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:02.526010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for user 93f77a1d41fd431d9da6587e0ca9cb1e and project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:02.546456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:25:02.550741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:25:02.663821 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-57dcaf37-79fc-4bcb-b98b-f84f7c1edc5a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.740063 Oct 31 15:25:02.667248 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1090/2056] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:25:02.681701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a0ee5c21-0660-4128-8b83-450576c22ab5 req-8871b8fe-2c45-432f-aed1-2fd186be6a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57828c57-25f9-4820-abae-396b40b5db0a", "name": "network-vif-unplugged", "status": "completed", "tag": "77af5736-44c8-4ad7-b405-90164244d290"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:02.702142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a0ee5c21-0660-4128-8b83-450576c22ab5 req-8871b8fe-2c45-432f-aed1-2fd186be6a91 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.702628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a0ee5c21-0660-4128-8b83-450576c22ab5 req-8871b8fe-2c45-432f-aed1-2fd186be6a91 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.708685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a0ee5c21-0660-4128-8b83-450576c22ab5 req-8871b8fe-2c45-432f-aed1-2fd186be6a91 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.733231 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a0ee5c21-0660-4128-8b83-450576c22ab5 req-8871b8fe-2c45-432f-aed1-2fd186be6a91 service nova] Creating event network-vif-unplugged:77af5736-44c8-4ad7-b405-90164244d290 for instance 57828c57-25f9-4820-abae-396b40b5db0a on n-h2-858384-17 Oct 31 15:25:02.747619 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a0ee5c21-0660-4128-8b83-450576c22ab5 req-8871b8fe-2c45-432f-aed1-2fd186be6a91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076432 Oct 31 15:25:02.748694 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1091/2057] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:02.763869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:02.764496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:02.783150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.783646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.784094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.784815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:02.785873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:02.786316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:02.860442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:03.063738 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ddef944-7de4-49e1-bce9-09b8a98d6cf9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "DELETE /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 204 len: 0 microversion: 2.1 time: 0.312086 Oct 31 15:25:03.065147 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1092/2058] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:02 2022] DELETE /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:03.076585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:03.079817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:03.089526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:03.090302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:03.090931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:03.091953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:03.092775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:03.093622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:03.122132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:03.134965 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c738ae4-316e-4693-b7b2-87cb427cd72b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.812323 Oct 31 15:25:03.137049 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 967/2059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:02 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:03.156375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:03.160224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:03.183744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:03.192220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:03.194222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:03.196273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:03.199623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:03.200291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:03.280910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:03.470082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:03.480056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:03.506201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:03.507617 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f9656f75-d46e-434e-a000-78eb612f6c76 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.441264 Oct 31 15:25:03.527233 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1093/2060] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:03 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:03.541444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7843ebd7-c6ad-4d99-839f-87a42d580a15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:03.544800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7843ebd7-c6ad-4d99-839f-87a42d580a15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:03.596183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:03.635240 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b4675951-e7bd-4d85-9153-2e6e8e7d5a1e tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 204 len: 0 microversion: 2.1 time: 0.493840 Oct 31 15:25:03.637826 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 968/2061] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:03 2022] DELETE /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:03.652785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:03.655403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:03.667098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7843ebd7-c6ad-4d99-839f-87a42d580a15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:03.676346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:03.676545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:03.676865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:03.677604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:03.678989 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7843ebd7-c6ad-4d99-839f-87a42d580a15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1215 microversion: 2.1 time: 0.149586 Oct 31 15:25:03.679723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:03.695789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:03.699320 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1094/2062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:03 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:03.711090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:03.711982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:03.748912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:03.749588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:03.751614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:03.752496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:03.755692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:03.756699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.290297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:04.307794 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-54c07214-400f-4b3c-af53-e1f6ca0155b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.600330 Oct 31 15:25:04.308910 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1095/2063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:03 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:04.318587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:04.321040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:04.337106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.338439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.347065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.351112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.351867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.353688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.815369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:04.838463 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98433769-dab1-4593-9878-c279f2f945c7 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 200 len: 1485 microversion: 2.1 time: 1.199298 Oct 31 15:25:04.839117 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 969/2064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:03 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 1485 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:04.876443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:04.877745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:04.887457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.888195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.888816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.889726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:04.890337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:04.890914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:04.922342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:04.942147 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49832225-53f8-4805-b11e-9e6b8fcf0b92 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1318 microversion: 2.1 time: 0.629581 Oct 31 15:25:04.944524 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1096/2065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:04 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:04.955604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b23e01d8-1334-4b83-a48d-5f302c80aa3b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1893834592", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "key_name": "tempest-key-1521150145", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:05.085121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-b23e01d8-1334-4b83-a48d-5f302c80aa3b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] validate_networks() for [('ab7e23b0-155e-4226-9a15-6e50ea9a0142', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:05.649933 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b23e01d8-1334-4b83-a48d-5f302c80aa3b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Invalid key_name provided. Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b23e01d8-1334-4b83-a48d-5f302c80aa3b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 247 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1893834592", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "key_name": "tempest-key-1521150145", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid key_name provided. Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1893834592', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'key_name': 'tempest-key-1521150145', 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1521150145 not found for user b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:05.658620 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b23e01d8-1334-4b83-a48d-5f302c80aa3b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid key_name provided. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:05.662788 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b23e01d8-1334-4b83-a48d-5f302c80aa3b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.714580 Oct 31 15:25:05.664697 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1097/2066] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:04 2022] POST /compute/v2.1/servers => generated 70 bytes in 719 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:05.677654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:05.678624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:05.692346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.693311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.693916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:05.694846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.695453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.696084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:05.813425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:05.827232 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ee72ba9-e6c7-4d03-8d95-febdd9ffa691 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1471 microversion: 2.1 time: 0.966966 Oct 31 15:25:05.831033 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 970/2067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:04 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1471 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:05.843525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:05.845821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:05.858659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.859405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.861741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:05.862635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:05.863822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:05.867121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.056599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:06.065067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-36f3690f-5e5d-47c7-9f12-9e8d2da01cb9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1267 microversion: 2.1 time: 0.232944 Oct 31 15:25:06.077364 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 971/2068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:05 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:06.077364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-863857b9-f16a-4860-805f-3e36c01ebe2f req-4dd4619b-4c07-48fd-87d0-2cc6dc55436c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112e7afd-0280-4245-8d39-46c540af14e2", "name": "network-vif-deleted", "tag": "716e0d1b-2fef-4c26-a4d6-5c354e43d8eb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:06.097092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-863857b9-f16a-4860-805f-3e36c01ebe2f req-4dd4619b-4c07-48fd-87d0-2cc6dc55436c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.098166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-863857b9-f16a-4860-805f-3e36c01ebe2f req-4dd4619b-4c07-48fd-87d0-2cc6dc55436c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.098596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-863857b9-f16a-4860-805f-3e36c01ebe2f req-4dd4619b-4c07-48fd-87d0-2cc6dc55436c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.133949 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-863857b9-f16a-4860-805f-3e36c01ebe2f req-4dd4619b-4c07-48fd-87d0-2cc6dc55436c service nova] Creating event network-vif-deleted:716e0d1b-2fef-4c26-a4d6-5c354e43d8eb for instance 112e7afd-0280-4245-8d39-46c540af14e2 on n-h1-858384-17 Oct 31 15:25:06.142309 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-863857b9-f16a-4860-805f-3e36c01ebe2f req-4dd4619b-4c07-48fd-87d0-2cc6dc55436c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070902 Oct 31 15:25:06.143624 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 972/2069] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:06.162312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c905ce05-28d6-48e7-b1ea-6d777cd20c6e req-93a70077-6aaa-40cb-97bd-a9648c9ada5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be12352-a6e7-4e99-bc85-bd7d8ceccbe0", "name": "network-vif-plugged", "status": "completed", "tag": "c0a1ad8b-1588-4e71-bd34-b0864c01e4ac"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:06.179929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c905ce05-28d6-48e7-b1ea-6d777cd20c6e req-93a70077-6aaa-40cb-97bd-a9648c9ada5d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.190141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c905ce05-28d6-48e7-b1ea-6d777cd20c6e req-93a70077-6aaa-40cb-97bd-a9648c9ada5d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.190549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c905ce05-28d6-48e7-b1ea-6d777cd20c6e req-93a70077-6aaa-40cb-97bd-a9648c9ada5d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.217075 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c905ce05-28d6-48e7-b1ea-6d777cd20c6e req-93a70077-6aaa-40cb-97bd-a9648c9ada5d service nova] Creating event network-vif-plugged:c0a1ad8b-1588-4e71-bd34-b0864c01e4ac for instance 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 on n-h1-858384-17 Oct 31 15:25:06.224602 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c905ce05-28d6-48e7-b1ea-6d777cd20c6e req-93a70077-6aaa-40cb-97bd-a9648c9ada5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079344 Oct 31 15:25:06.226049 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 973/2070] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:06.232956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:06.233976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:06.242759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.243487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.244347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.246472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.247200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.248127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.399330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:06.408964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:06.413792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:06.415017 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9b2e4c83-fae0-4496-a173-067199f46d03 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.749497 Oct 31 15:25:06.421819 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1098/2071] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:05 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:06.427457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:06.438050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 112e7afd-0280-4245-8d39-46c540af14e2] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:06.451127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.451949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.452564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.453738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.454414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.455051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.498450 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] HTTP exception thrown: Instance 112e7afd-0280-4245-8d39-46c540af14e2 could not be found. Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Request method failure captured: Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 HTTP/1.1 Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cMhz5Bk_i_uznufFf4yJfBq3kYmzK81nDB2KVqt7g5fRpkZAU4c1uV1CBSb1cAVwcNuMoRvBAq_bUE69zpj3XJ3_8uq7Nj8DMYgyv0gPKkiOd9_F_OIF5EhQ8jtljGC_L9BukrJ1rsR3gef3stDHNCAL3TrJ26-dIBeyvV7J8KQzU Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 330c65ee73534d8080c0ec2441c55f16 Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-LiveMigrationTest-241057870 Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330c65ee73534d8080c0ec2441c55f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_330c65ee73534d8080c0ec2441c55f16", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330c65ee73534d8080c0ec2441c55f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/330c65ee73534d8080c0ec2441c55f16"}]}] Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-LiveMigrationTest-241057870 Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 330c65ee73534d8080c0ec2441c55f16 Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-LiveMigrationTest-241057870 Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-LiveMigrationTest-241057870-project Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 02e166a77a2c45ccab7a1f343e53542e Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-LiveMigrationTest-241057870-project Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 112e7afd-0280-4245-8d39-46c540af14e2 could not be found. Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '112e7afd-0280-4245-8d39-46c540af14e2'} Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 112e7afd-0280-4245-8d39-46c540af14e2 could not be found. Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 112e7afd-0280-4245-8d39-46c540af14e2 could not be found. Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:06.500514 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:06.504088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:06.504088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:06.504088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:06.504088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:06.504088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:06.504088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 112e7afd-0280-4245-8d39-46c540af14e2 could not be found. Oct 31 15:25:06.504088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:06.505719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Returning 404 to user: Instance 112e7afd-0280-4245-8d39-46c540af14e2 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:06.506779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e540e85b-2e14-4f79-851c-383154ad39d5 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2" status: 404 len: 111 microversion: 2.1 time: 0.083734 Oct 31 15:25:06.507530 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1099/2072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:06 2022] GET /compute/v2.1/servers/112e7afd-0280-4245-8d39-46c540af14e2 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:06.512871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:06.513776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:06.527770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.528272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.528713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.529615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.530083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.530509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.914705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:06.925525 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b3b8b787-baae-4252-8ee0-f968a1acfa63 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1318 microversion: 2.1 time: 0.416704 Oct 31 15:25:06.927007 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1100/2073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:06 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:06.936274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:06.936964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:06.959698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.960200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.960634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:06.963267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:06.963759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:06.964191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.058335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:07.231229 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d066b1c2-7507-4573-a3fc-6d94782347d6 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "DELETE /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 204 len: 0 microversion: 2.1 time: 0.302853 Oct 31 15:25:07.232720 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1101/2074] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:06 2022] DELETE /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:07.252804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:07.254511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:07.262566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.263400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.263974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.264830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.265899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.267763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.401282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:07.418138 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5459102f-48c9-4d74-8a71-5054c28005c6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 1.190583 Oct 31 15:25:07.422044 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 974/2075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:06 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:07.443170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:07.444795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:07.471095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.471599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.472045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.473422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.473886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.474310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.486438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3fa70260a7640f5b8fbb7eb9b75580e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95d5bc4f1cb64997a33609c07379cc60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:07.497607 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e03ee29c-c9c2-4a15-b015-ebb85a1f4441 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 200 len: 1429 microversion: 2.1 time: 0.263051 Oct 31 15:25:07.513157 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1102/2076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:07 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 1429 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:07.513157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:07.513157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:07.532177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.532686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.540733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:07.541732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:07.542230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:07.542680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:08.124680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:08.134741 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d562d4ac-78b2-48a0-8f7c-0479abdea403 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1500 microversion: 2.1 time: 0.634791 Oct 31 15:25:08.149220 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1103/2077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:07 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1500 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:08.159863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:08.161852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:08.176812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.178138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.179141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:08.180516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.183794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.184612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:08.272763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:08.285650 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ac92ff5-f2f1-4613-b28b-556af9a2fd6e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1273 microversion: 2.1 time: 0.858382 Oct 31 15:25:08.289409 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 975/2078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:07 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1273 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:08.318314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:08.319128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:08.341720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.343319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.345008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:08.347363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.355399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.359208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:08.813640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:08.825399 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a03bb3e-91a7-4cfe-9487-b1b5850f5b98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.674595 Oct 31 15:25:08.829576 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1104/2079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:08 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:08.836203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:08.837090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:08.884808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.886772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.888253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:08.892231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:08.892902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:08.894838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.329688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:09.344267 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34fb240f-b489-4ce6-ba35-1de885a8c48e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1318 microversion: 2.1 time: 0.513303 Oct 31 15:25:09.345178 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1105/2080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:08 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:09.351427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-85cd9595-81bf-4076-bb25-14e9de265d6d req-8c3b63c6-c333-441b-ad43-ba8d2b540320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57828c57-25f9-4820-abae-396b40b5db0a", "name": "network-vif-deleted", "tag": "77af5736-44c8-4ad7-b405-90164244d290"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:09.380751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-85cd9595-81bf-4076-bb25-14e9de265d6d req-8c3b63c6-c333-441b-ad43-ba8d2b540320 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.381221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-85cd9595-81bf-4076-bb25-14e9de265d6d req-8c3b63c6-c333-441b-ad43-ba8d2b540320 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.381657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-85cd9595-81bf-4076-bb25-14e9de265d6d req-8c3b63c6-c333-441b-ad43-ba8d2b540320 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.411432 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-85cd9595-81bf-4076-bb25-14e9de265d6d req-8c3b63c6-c333-441b-ad43-ba8d2b540320 service nova] Creating event network-vif-deleted:77af5736-44c8-4ad7-b405-90164244d290 for instance 57828c57-25f9-4820-abae-396b40b5db0a on n-h2-858384-17 Oct 31 15:25:09.421988 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-85cd9595-81bf-4076-bb25-14e9de265d6d req-8c3b63c6-c333-441b-ad43-ba8d2b540320 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075202 Oct 31 15:25:09.422800 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1106/2081] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:09.435465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:09.436752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] [instance: 57828c57-25f9-4820-abae-396b40b5db0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:09.445323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.446093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.447194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.448692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.449472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.450052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.482062 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] HTTP exception thrown: Instance 57828c57-25f9-4820-abae-396b40b5db0a could not be found. Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Request method failure captured: Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a HTTP/1.1 Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hqarFnMlbtD88ltC0buSfEUbtxgcGnknqAWfa8NjTm5sgSS96rFOCVMTp8SYp76-7V10BNsw9RLNHtLx4sn037o8ndkOiylsC9r9K1M99E4bx53wonhukIY7jMGNiLbo1G0xWAQdIw6GQIe61Zo0UIUz27izmxi_fy-SWHSFgdIhk Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 95d5bc4f1cb64997a33609c07379cc60 Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesOneServerTestJSON-1096504688 Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95d5bc4f1cb64997a33609c07379cc60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_95d5bc4f1cb64997a33609c07379cc60", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/95d5bc4f1cb64997a33609c07379cc60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/95d5bc4f1cb64997a33609c07379cc60"}]}] Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesOneServerTestJSON-1096504688 Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 95d5bc4f1cb64997a33609c07379cc60 Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1096504688 Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesOneServerTestJSON-1096504688-project Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d3fa70260a7640f5b8fbb7eb9b75580e Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesOneServerTestJSON-1096504688-project Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 57828c57-25f9-4820-abae-396b40b5db0a could not be found. Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '57828c57-25f9-4820-abae-396b40b5db0a'} Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57828c57-25f9-4820-abae-396b40b5db0a could not be found. Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57828c57-25f9-4820-abae-396b40b5db0a could not be found. Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:09.484590 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.487902 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:09.487902 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:09.487902 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:09.487902 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:09.487902 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:09.487902 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57828c57-25f9-4820-abae-396b40b5db0a could not be found. Oct 31 15:25:09.487902 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.490470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] Returning 404 to user: Instance 57828c57-25f9-4820-abae-396b40b5db0a could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:09.491884 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2ca8035-c564-4234-982c-97cfdd1d5b05 tempest-ImagesOneServerTestJSON-1096504688 tempest-ImagesOneServerTestJSON-1096504688-project] 10.222.0.20 "GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a" status: 404 len: 111 microversion: 2.1 time: 0.063094 Oct 31 15:25:09.492071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:09.497240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1107/2082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:09 2022] GET /compute/v2.1/servers/57828c57-25f9-4820-abae-396b40b5db0a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:09.504134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de6b1f4e-9c31-4f74-af92-9c09a0a9fae5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-249646604", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:09.521362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:09.539555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:09.549914 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2c6e033-2785-485e-bd88-609b8cfe8b7c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 1.250286 Oct 31 15:25:09.552930 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 976/2083] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:08 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:09.562606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:09.564477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:09.628228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.631767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.634810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.636389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.641601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.642921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.691742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-de6b1f4e-9c31-4f74-af92-9c09a0a9fae5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Neutron security group does_not_exist not found {{(pid=120587) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 31 15:25:09.692343 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-de6b1f4e-9c31-4f74-af92-9c09a0a9fae5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de6b1f4e-9c31-4f74-af92-9c09a0a9fae5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 257 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-249646604", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-249646604', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 31 15:25:09.701405 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:09.704816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de6b1f4e-9c31-4f74-af92-9c09a0a9fae5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:09.715278 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de6b1f4e-9c31-4f74-af92-9c09a0a9fae5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.203625 Oct 31 15:25:09.715278 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1108/2084] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:09 2022] POST /compute/v2.1/servers => generated 106 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:09.715278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:09.715278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:09.726803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.727304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.731601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.732532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.733016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.733490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.741252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.741879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.744803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.745373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lazy-loading 'fault' on Instance uuid 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:25:09.898317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:09.901692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:09.913971 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e66dfae-f6b8-4c67-a8cc-26696736ab1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1273 microversion: 2.1 time: 0.204343 Oct 31 15:25:09.915120 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1109/2085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:09 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:09.920769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:09.922281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:09.930670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.931389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.932033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.932876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:09.933580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:09.934404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:09.967861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e166a77a2c45ccab7a1f343e53542e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330c65ee73534d8080c0ec2441c55f16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:09.983796 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64fb6926-5599-46ff-8285-5a58462361d9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 200 len: 1301 microversion: 2.1 time: 0.429677 Oct 31 15:25:10.001168 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 977/2086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:09 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 1301 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:10.246138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:10.292681 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-04306c13-3616-4ab7-a3e9-ed0dac8364e7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.376088 Oct 31 15:25:10.296297 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1110/2087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:09 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:10.324538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:10.325676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:10.340197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.340696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.341155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.343993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.344660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.346315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.371471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:10.372400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:10.382832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:10.385426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.390477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.391401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.393265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.395618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.396586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.729533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:10.741412 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd40b778-0be1-4472-8a0b-621cced7f0de tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1508 microversion: 2.1 time: 0.373893 Oct 31 15:25:10.750852 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1111/2088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:10 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:10.759227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:10.759847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:10.779981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.780529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.782470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.785487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.786065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.789258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.862079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:10.876928 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-490c3472-2189-457c-9632-ec2b8bb09b89 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.556787 Oct 31 15:25:10.880156 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 978/2089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:10 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:10.906836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:10.910448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:10.921220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.922041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.923756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:10.927688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:10.932174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:10.935832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.392029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:11.401280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef21e36d-8a5f-4df7-abdc-08c0e55e00cc tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1508 microversion: 2.1 time: 0.519899 Oct 31 15:25:11.424386 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 979/2090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:10 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1508 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:11.432343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-608229ac-48f2-45c6-b3de-029ab3b768b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:11.435235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-608229ac-48f2-45c6-b3de-029ab3b768b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:11.449890 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-608229ac-48f2-45c6-b3de-029ab3b768b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a could not be found. Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-608229ac-48f2-45c6-b3de-029ab3b768b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a HTTP/1.1 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a could not be found. Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'd070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a'} Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a could not be found. Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a could not be found. Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.454950 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:11.459380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.459380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:11.459380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:11.459380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:11.459380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:11.459380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:11.459380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a could not be found. Oct 31 15:25:11.459380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.462236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-608229ac-48f2-45c6-b3de-029ab3b768b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:11.465242 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-608229ac-48f2-45c6-b3de-029ab3b768b7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a" status: 404 len: 111 microversion: 2.1 time: 0.039390 Oct 31 15:25:11.472565 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 980/2091] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:11 2022] DELETE /compute/v2.1/servers/d070c8d3-9ac7-4a9b-b5a4-84b0c1235c5a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:11.481090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:11.483176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:11.499731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.501581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.505574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.506507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.507344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.507974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.581794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:11.605230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:11.607658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:11.610812 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60d77dd4-be09-4bdf-b6b2-42c32181e1a6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.858846 Oct 31 15:25:11.615214 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1112/2092] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:10 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:11.622066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:11.637855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] [instance: 34c28632-29a8-4fd6-aef3-d4d5a0f22b72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:11.657800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.659770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.660983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.662782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.663272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.663711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.695735 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] HTTP exception thrown: Instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 could not be found. Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Request method failure captured: Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 HTTP/1.1 Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-cMhz5Bk_i_uznufFf4yJfBq3kYmzK81nDB2KVqt7g5fRpkZAU4c1uV1CBSb1cAVwcNuMoRvBAq_bUE69zpj3XJ3_8uq7Nj8DMYgyv0gPKkiOd9_F_OIF5EhQ8jtljGC_L9BukrJ1rsR3gef3stDHNCAL3TrJ26-dIBeyvV7J8KQzU Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 330c65ee73534d8080c0ec2441c55f16 Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-LiveMigrationTest-241057870 Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330c65ee73534d8080c0ec2441c55f16"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_330c65ee73534d8080c0ec2441c55f16", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330c65ee73534d8080c0ec2441c55f16"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/330c65ee73534d8080c0ec2441c55f16"}]}] Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-LiveMigrationTest-241057870 Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 330c65ee73534d8080c0ec2441c55f16 Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-LiveMigrationTest-241057870 Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-LiveMigrationTest-241057870-project Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 02e166a77a2c45ccab7a1f343e53542e Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-LiveMigrationTest-241057870-project Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 could not be found. Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '34c28632-29a8-4fd6-aef3-d4d5a0f22b72'} Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 could not be found. Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 could not be found. Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:11.697717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 could not be found. Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] Returning 404 to user: Instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2e4ac9c-c6e6-4b0b-81e0-27aaa1dd8ad9 tempest-LiveMigrationTest-241057870 tempest-LiveMigrationTest-241057870-project] 10.222.0.20 "GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72" status: 404 len: 111 microversion: 2.1 time: 0.082541 Oct 31 15:25:11.701786 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1113/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:11 2022] GET /compute/v2.1/servers/34c28632-29a8-4fd6-aef3-d4d5a0f22b72 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:11.704689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af1b5bd4-7749-4c9f-b8a6-4f52214d1132 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:11.707284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af1b5bd4-7749-4c9f-b8a6-4f52214d1132 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:11.717320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af1b5bd4-7749-4c9f-b8a6-4f52214d1132 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.717320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af1b5bd4-7749-4c9f-b8a6-4f52214d1132 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.717320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af1b5bd4-7749-4c9f-b8a6-4f52214d1132 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.717834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af1b5bd4-7749-4c9f-b8a6-4f52214d1132 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.718481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af1b5bd4-7749-4c9f-b8a6-4f52214d1132 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.718915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af1b5bd4-7749-4c9f-b8a6-4f52214d1132 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.849004 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af1b5bd4-7749-4c9f-b8a6-4f52214d1132 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "PUT /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1080 microversion: 2.1 time: 0.147264 Oct 31 15:25:11.850609 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1114/2094] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 15:25:11 2022] PUT /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1080 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:11.858104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4f076b3e-ca66-462d-9e07-e522cfb6fb3f req-81a7177e-9cbc-404a-8e51-f69172c38dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c28632-29a8-4fd6-aef3-d4d5a0f22b72", "name": "network-vif-deleted", "tag": "af2dcd80-0441-41c3-887e-cb8c0720e186"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:11.895601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4f076b3e-ca66-462d-9e07-e522cfb6fb3f req-81a7177e-9cbc-404a-8e51-f69172c38dba service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.896469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4f076b3e-ca66-462d-9e07-e522cfb6fb3f req-81a7177e-9cbc-404a-8e51-f69172c38dba service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.896928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4f076b3e-ca66-462d-9e07-e522cfb6fb3f req-81a7177e-9cbc-404a-8e51-f69172c38dba service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.915335 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4f076b3e-ca66-462d-9e07-e522cfb6fb3f req-81a7177e-9cbc-404a-8e51-f69172c38dba service nova] Creating event network-vif-deleted:af2dcd80-0441-41c3-887e-cb8c0720e186 for instance 34c28632-29a8-4fd6-aef3-d4d5a0f22b72 on n-h1-858384-17 Oct 31 15:25:11.924038 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4f076b3e-ca66-462d-9e07-e522cfb6fb3f req-81a7177e-9cbc-404a-8e51-f69172c38dba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072093 Oct 31 15:25:11.928797 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1115/2095] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:11.936388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:11.937188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:11.945575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.946070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.946505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.947654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:11.948134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:11.948382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:11.948816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:11.958671 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-646a0efe-903b-40d4-aa2b-8e945484b5b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1315 microversion: 2.1 time: 0.484600 Oct 31 15:25:11.960159 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 981/2096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:11 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:11.969589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:11.970416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:12.003921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.003921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.003921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.003921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.003921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.003921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.287519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:12.296580 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-235fffcd-a9eb-4a2c-ad53-e62d67d2005f tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1506 microversion: 2.1 time: 0.334448 Oct 31 15:25:12.310290 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 982/2097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:11 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:12.321969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:12.322826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:12.330025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.330721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.331338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.332259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.332894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.333790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.410755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:12.425067 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8308ba9-d487-45f9-9057-504146e315ef tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.494884 Oct 31 15:25:12.426571 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1116/2098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:11 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:12.454913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:12.455827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:12.459253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:12.465264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.466049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.466726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.467648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.468279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.469602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.841561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:12.851800 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2784fa60-d546-4a0d-abce-4faf3a937ac9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.400219 Oct 31 15:25:12.861825 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1117/2099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:12 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:12.866486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:12.866704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:12.868017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:12.883537 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fb1c0a4b-24a1-48c3-a1f6-47c77912c0aa tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1506 microversion: 2.1 time: 0.560354 Oct 31 15:25:12.884356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.885832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.897172 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 983/2100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:12 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:12.897838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1030d6f2-c71a-431e-85f6-0f2e6146a017 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:12.898749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.900966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.901478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.901917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.905472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1030d6f2-c71a-431e-85f6-0f2e6146a017 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:25:12.906288 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-1030d6f2-c71a-431e-85f6-0f2e6146a017 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1030d6f2-c71a-431e-85f6-0f2e6146a017 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9223372036854775808 could not be found. Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9223372036854775808'} Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:12.908128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:12.912001 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:12.912001 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:12.912001 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:12.912001 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 31 15:25:12.912001 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:12.917828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1030d6f2-c71a-431e-85f6-0f2e6146a017 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:12.924730 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1030d6f2-c71a-431e-85f6-0f2e6146a017 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.032707 Oct 31 15:25:12.931011 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 984/2101] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Oct 31 15:25:12 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:25:12.944230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ff02b55e-5116-4b05-a211-44772c0b132d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:12.952496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ff02b55e-5116-4b05-a211-44772c0b132d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:12.992060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff02b55e-5116-4b05-a211-44772c0b132d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.992566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff02b55e-5116-4b05-a211-44772c0b132d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.993003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff02b55e-5116-4b05-a211-44772c0b132d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:12.993754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff02b55e-5116-4b05-a211-44772c0b132d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:12.994210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff02b55e-5116-4b05-a211-44772c0b132d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:12.994632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff02b55e-5116-4b05-a211-44772c0b132d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.138807 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ff02b55e-5116-4b05-a211-44772c0b132d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "PUT /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1082 microversion: 2.1 time: 0.204736 Oct 31 15:25:13.153747 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 985/2102] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 15:25:12 2022] PUT /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1082 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:13.161533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:13.162313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:13.169165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:13.169864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:13.170482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.171411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:13.172030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:13.172659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.256493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:13.268974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:13.273321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:13.274805 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b36b3070-9f18-41ad-adb5-26b30522a39d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.419537 Oct 31 15:25:13.278328 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1118/2103] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:12 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:13.292008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-aaedf920-0c49-4146-8b7e-6cdbee308a47 req-d7bfa787-ee1a-4548-b76f-6e2e436e23f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129edccf-8357-446b-9c1b-13c2fc7c5f0d", "tag": "97fa87f2-e548-476e-90bc-605645bab3a9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:13.313429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aaedf920-0c49-4146-8b7e-6cdbee308a47 req-d7bfa787-ee1a-4548-b76f-6e2e436e23f2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:13.317924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aaedf920-0c49-4146-8b7e-6cdbee308a47 req-d7bfa787-ee1a-4548-b76f-6e2e436e23f2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:13.318661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aaedf920-0c49-4146-8b7e-6cdbee308a47 req-d7bfa787-ee1a-4548-b76f-6e2e436e23f2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.346943 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-aaedf920-0c49-4146-8b7e-6cdbee308a47 req-d7bfa787-ee1a-4548-b76f-6e2e436e23f2 service nova] Creating event network-changed:97fa87f2-e548-476e-90bc-605645bab3a9 for instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d on n-h2-858384-17 Oct 31 15:25:13.353909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-aaedf920-0c49-4146-8b7e-6cdbee308a47 req-d7bfa787-ee1a-4548-b76f-6e2e436e23f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073814 Oct 31 15:25:13.355091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1119/2104] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:13.361601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:13.363021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:13.371997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:13.372792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:13.373474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.374722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:13.375387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:13.376111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.633390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:13.646247 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50a08019-2feb-4906-bc70-90e0a0dae205 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.490617 Oct 31 15:25:13.661155 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 986/2105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:13 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:13.673638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:13.675189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:13.677067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:13.711868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:13.712396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:13.712844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.714514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:13.714895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:13.715292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:13.781868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:13.800078 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75d1d766-628e-4795-9821-b7101c34a0c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1315 microversion: 2.1 time: 0.443547 Oct 31 15:25:13.800672 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1120/2106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:13 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:13.987276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d12eb40c-514a-4e50-9440-6771ca2a8cf0 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Action: 'create', calling method: .version_select at 0x7f16e0dd8d30>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX3B5Vp6ssmDLad17Onuj28tTK+/IAqM1iKS2Wfyog1RW9yXgrZXuG3FL1r5/Q7II1+u0WDYFS1pVmind+EsjynN3ljI34CiVLi/Dlqxxs6CIvznGY/KT5nGlmeSIeK0Q=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d12eb40c-514a-4e50-9440-6771ca2a8cf0 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Request method failure captured: Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 257 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jZefpuC31k8Ho-KRQQL7F4piJ3zpg76So26d9gOWVNE4BECyMi3EPBwqgCwPOCmbwIv5mfxAKqECQL-rQ6Qk4cbWLEZl5XHMm2CUs8a6jdTOyn3hCIrfKn1g3DforCI1gjY-4MDQv9d0XMmBvdBJiiYEYDh0ME1nlKou7FEOipnRQ Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2267c1cb308949f88908559cd869bbe5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2267c1cb308949f88908559cd869bbe5"}]}] Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX3B5Vp6ssmDLad17Onuj28tTK+/IAqM1iKS2Wfyog1RW9yXgrZXuG3FL1r5/Q7II1+u0WDYFS1pVmind+EsjynN3ljI34CiVLi/Dlqxxs6CIvznGY/KT5nGlmeSIeK0Q=="}} Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCX3B5Vp6ssmDLad17Onuj28tTK+/IAqM1iKS2Wfyog1RW9yXgrZXuG3FL1r5/Q7II1+u0WDYFS1pVmind+EsjynN3ljI34CiVLi/Dlqxxs6CIvznGY/KT5nGlmeSIeK0Q=='}}} Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 31 15:25:13.993076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d12eb40c-514a-4e50-9440-6771ca2a8cf0 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:13.996245 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d12eb40c-514a-4e50-9440-6771ca2a8cf0 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.192919 Oct 31 15:25:14.001823 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1121/2107] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:25:13 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:14.007520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.007847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:14.016684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.017443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.017884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.018588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.019330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.020372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.087006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.104520 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b62a2dec-1632-45d8-aabd-86e97a816d10 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1508 microversion: 2.1 time: 0.452225 Oct 31 15:25:14.117620 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 987/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:13 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.131199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61a71271-989c-4669-90bd-a01dd1e8afa8 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Action: 'create', calling method: .version_select at 0x7f16e0e99dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-594097430", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:14.149057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61a71271-989c-4669-90bd-a01dd1e8afa8 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:14.157690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-61a71271-989c-4669-90bd-a01dd1e8afa8 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for user ddd7bbc0b72d4cb99c5215105aeaa5c7 and project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:14.200339 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-61a71271-989c-4669-90bd-a01dd1e8afa8 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61a71271-989c-4669-90bd-a01dd1e8afa8 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Request method failure captured: Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 2166 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jZefpuC31k8Ho-KRQQL7F4piJ3zpg76So26d9gOWVNE4BECyMi3EPBwqgCwPOCmbwIv5mfxAKqECQL-rQ6Qk4cbWLEZl5XHMm2CUs8a6jdTOyn3hCIrfKn1g3DforCI1gjY-4MDQv9d0XMmBvdBJiiYEYDh0ME1nlKou7FEOipnRQ Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2267c1cb308949f88908559cd869bbe5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2267c1cb308949f88908559cd869bbe5"}]}] Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-594097430", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:25:14.220654 n-d-858384-17 devstack@n-api.service[120588]: exception: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-594097430', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:14.222727 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.224774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61a71271-989c-4669-90bd-a01dd1e8afa8 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:14.225791 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61a71271-989c-4669-90bd-a01dd1e8afa8 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.105341 Oct 31 15:25:14.232950 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 988/2109] 10.222.0.20 () {60 vars in 1160 bytes} [Mon Oct 31 15:25:14 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:14.241573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.242749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:14.258120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.258801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.259426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.260943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.261845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.262423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.392147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.408035 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f6f25492-36af-441b-a85b-4cda645e36ac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.405529 Oct 31 15:25:14.409176 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1122/2110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:14 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.419502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d06a9b92-28f6-4f82-bc5b-0e1172e31765 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Action: 'create', calling method: .version_select at 0x7f16e0de5a60>, body: {"keypair": {"name": "tempest-keypair-436018075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1zH5Jw8O1OPM2ZrECnNrDOPZfPjFqs7ZRfik4FoP2nBwwrkdTDa+aT9sK+jmMY4y6/4ROHGdcO01Oo02no9G9019Lihll3Wk2SXz8so1LkRSz7Xnqgf6BNLRRy69Q5qw=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:14.446706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d06a9b92-28f6-4f82-bc5b-0e1172e31765 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:14.455376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d06a9b92-28f6-4f82-bc5b-0e1172e31765 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for user ddd7bbc0b72d4cb99c5215105aeaa5c7 and project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:14.476844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:14.496005 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d06a9b92-28f6-4f82-bc5b-0e1172e31765 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085204 Oct 31 15:25:14.501973 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1123/2111] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:25:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:14.510371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.511217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:14.520471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.520975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.521464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.522164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.522625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.523053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.593717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.603646 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eea79aaa-3d2a-4aa2-ba91-a803f7620efe tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1508 microversion: 2.1 time: 0.367886 Oct 31 15:25:14.604700 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 989/2112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:14 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.609424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-876b2367-e1fc-4b99-a875-036c8353ef96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.610172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-876b2367-e1fc-4b99-a875-036c8353ef96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Failed to fetch instance by id -1 {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:25:14.610912 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-876b2367-e1fc-4b99-a875-036c8353ef96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance -1 could not be found. Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-876b2367-e1fc-4b99-a875-036c8353ef96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance -1 could not be found. Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '-1'} Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:14.612603 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:14.616617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:14.616617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:14.616617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 31 15:25:14.616617 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.616617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-876b2367-e1fc-4b99-a875-036c8353ef96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:14.616617 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-876b2367-e1fc-4b99-a875-036c8353ef96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008301 Oct 31 15:25:14.616617 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 990/2113] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:25:14 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:25:14.624558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9418ba8f-8b63-48af-9966-d931066dbe7f tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Action: 'create', calling method: .version_select at 0x7f16e0e994c0>, body: {"keypair": {"name": "tempest-keypair-436018075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJztumLvpwMl/qgt4qzk80hY8AQStQMNI39q4fk4XW/W7NCz9NuWdt8DQfqD1G3C6fd3ItpXcYAgO9dMVEW0pDNwSw5KSvw7hoh2CnEenIFtxRhPR+5GtAdQQEkgis7kbA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:14.642645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9418ba8f-8b63-48af-9966-d931066dbe7f tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:14.649234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9418ba8f-8b63-48af-9966-d931066dbe7f tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for user ddd7bbc0b72d4cb99c5215105aeaa5c7 and project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:14.677483 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9418ba8f-8b63-48af-9966-d931066dbe7f tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] HTTP exception thrown: Key pair 'tempest-keypair-436018075' already exists. Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9418ba8f-8b63-48af-9966-d931066dbe7f tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Request method failure captured: Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 272 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jZefpuC31k8Ho-KRQQL7F4piJ3zpg76So26d9gOWVNE4BECyMi3EPBwqgCwPOCmbwIv5mfxAKqECQL-rQ6Qk4cbWLEZl5XHMm2CUs8a6jdTOyn3hCIrfKn1g3DforCI1gjY-4MDQv9d0XMmBvdBJiiYEYDh0ME1nlKou7FEOipnRQ Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2267c1cb308949f88908559cd869bbe5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2267c1cb308949f88908559cd869bbe5"}]}] Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: {"keypair": {"name": "tempest-keypair-436018075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJztumLvpwMl/qgt4qzk80hY8AQStQMNI39q4fk4XW/W7NCz9NuWdt8DQfqD1G3C6fd3ItpXcYAgO9dMVEW0pDNwSw5KSvw7hoh2CnEenIFtxRhPR+5GtAdQQEkgis7kbA=="}} Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: exception: Key pair 'tempest-keypair-436018075' already exists. Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-436018075', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJztumLvpwMl/qgt4qzk80hY8AQStQMNI39q4fk4XW/W7NCz9NuWdt8DQfqD1G3C6fd3ItpXcYAgO9dMVEW0pDNwSw5KSvw7hoh2CnEenIFtxRhPR+5GtAdQQEkgis7kbA=='}}} Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'ddd7bbc0b72d4cb99c5215105aeaa5c7-tempest-keypair-436018075' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 31 15:25:14.681542 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi session.flush() Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result.read() Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 31 15:25:14.684507 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'ddd7bbc0b72d4cb99c5215105aeaa5c7-tempest-keypair-436018075' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 31, 15, 25, 14, 668523), 'updated_at': None, 'name': 'tempest-keypair-436018075', 'user_id': 'ddd7bbc0b72d4cb99c5215105aeaa5c7', 'fingerprint': '90:df:30:23:90:96:00:73:65:2e:8a:08:82:e6:c7:ce', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJztumLvpwMl/qgt4qzk80hY8AQStQMNI39q4fk4XW/W7NCz9NuWdt8DQfqD1G3C6fd3ItpXcYAgO9dMVEW0pDNwSw5KSvw7hoh2CnEenIFtxRhPR+5GtAdQQEkgis7kbA==', 'type': 'ssh'}] Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6779, in import_key_pair Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi keypair.create() Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._create() Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-436018075' already exists. Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 31 15:25:14.687689 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-436018075' already exists. Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-436018075' already exists. Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9418ba8f-8b63-48af-9966-d931066dbe7f tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Returning 409 to user: Key pair 'tempest-keypair-436018075' already exists. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9418ba8f-8b63-48af-9966-d931066dbe7f tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.067313 Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 991/2114] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:25:14 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.693824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:14.700251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.700251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.700885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.701091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.701920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.702428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.915180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.929870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.933497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.938005 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b06cfe3b-cf8d-4522-b524-f25753af05c7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.434525 Oct 31 15:25:14.940912 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1124/2115] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:14 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:14.943148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:14.950426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.950927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:14.951840 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eccae9ad-1a85-49e2-bacd-6a4392d77282 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.266274 Oct 31 15:25:14.954538 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 992/2116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:14 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:14.966420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.966919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.967360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:14.967777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0229d599-fd13-49e3-b870-875b6980a019 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Calling method '.version_select at 0x7f16e0e455e0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:14.968067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:14.968528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:14.968952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.008315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:15.015888 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0229d599-fd13-49e3-b870-875b6980a019 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436018075" status: 202 len: 0 microversion: 2.1 time: 0.060216 Oct 31 15:25:15.016554 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 993/2117] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:25:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436018075 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:15.037883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:15.038544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.059063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.060267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.060949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.062190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.063110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.063743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.121941 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3ab5bd99-6c01-45f4-a770-e3d489c81ad3 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 204 len: 0 microversion: 2.1 time: 0.179350 Oct 31 15:25:15.122763 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1125/2118] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:14 2022] DELETE /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:15.139197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:15.139197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.147876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.148370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.149076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.149827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.150284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.150731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.268594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:15.282963 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25376fa4-ed84-40af-937a-555a95a733c7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1315 microversion: 2.1 time: 0.253844 Oct 31 15:25:15.297166 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 994/2119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:15 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:15.297166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c0129a6-25ea-489b-9a42-a08e153d8217 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Action: 'create', calling method: .version_select at 0x7f16e0e2ca60>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrlFicOvpSDS/tmH0IhjETylbRFb5QNRgVdC/7KnQ6SGAtfsVfvXjshA/uXGnn12rNfOQbfqCemR5IQVTMXyzvshHtCD+pbRQHYVVqDk/YkerQBpq5lNfKfbrsV+B0wGw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c0129a6-25ea-489b-9a42-a08e153d8217 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Request method failure captured: Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 247 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jZefpuC31k8Ho-KRQQL7F4piJ3zpg76So26d9gOWVNE4BECyMi3EPBwqgCwPOCmbwIv5mfxAKqECQL-rQ6Qk4cbWLEZl5XHMm2CUs8a6jdTOyn3hCIrfKn1g3DforCI1gjY-4MDQv9d0XMmBvdBJiiYEYDh0ME1nlKou7FEOipnRQ Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2267c1cb308949f88908559cd869bbe5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2267c1cb308949f88908559cd869bbe5"}]}] Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrlFicOvpSDS/tmH0IhjETylbRFb5QNRgVdC/7KnQ6SGAtfsVfvXjshA/uXGnn12rNfOQbfqCemR5IQVTMXyzvshHtCD+pbRQHYVVqDk/YkerQBpq5lNfKfbrsV+B0wGw=="}} Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrlFicOvpSDS/tmH0IhjETylbRFb5QNRgVdC/7KnQ6SGAtfsVfvXjshA/uXGnn12rNfOQbfqCemR5IQVTMXyzvshHtCD+pbRQHYVVqDk/YkerQBpq5lNfKfbrsV+B0wGw=='}}} Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '' Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:25:15.298746 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c0129a6-25ea-489b-9a42-a08e153d8217 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c0129a6-25ea-489b-9a42-a08e153d8217 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.014292 Oct 31 15:25:15.306142 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 995/2120] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:25:15 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:15.307813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:15.308334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.318144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.318655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.319958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.320683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.321195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.322816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.361399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:15.420224 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Instance is already in deleting state, ignoring this request Oct 31 15:25:15.421081 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c217a8d-d424-42eb-9718-4fc0dbb66823 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 204 len: 0 microversion: 2.1 time: 0.119746 Oct 31 15:25:15.421687 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 996/2121] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:15 2022] DELETE /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:15.427362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f851791e-10c8-4235-875c-631682f4c093 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Action: 'create', calling method: .version_select at 0x7f16e0e2c430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-504971398", "public_key": " "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:15.451757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f851791e-10c8-4235-875c-631682f4c093 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:15.459318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f851791e-10c8-4235-875c-631682f4c093 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for user ddd7bbc0b72d4cb99c5215105aeaa5c7 and project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:15.489552 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f851791e-10c8-4235-875c-631682f4c093 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f851791e-10c8-4235-875c-631682f4c093 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Request method failure captured: Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 94 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jZefpuC31k8Ho-KRQQL7F4piJ3zpg76So26d9gOWVNE4BECyMi3EPBwqgCwPOCmbwIv5mfxAKqECQL-rQ6Qk4cbWLEZl5XHMm2CUs8a6jdTOyn3hCIrfKn1g3DforCI1gjY-4MDQv9d0XMmBvdBJiiYEYDh0ME1nlKou7FEOipnRQ Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2267c1cb308949f88908559cd869bbe5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2267c1cb308949f88908559cd869bbe5"}]}] Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-504971398", "public_key": " "}} Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: exception: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-504971398', 'public_key': ' '}}} Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.498113 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.501477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.506033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f851791e-10c8-4235-875c-631682f4c093 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:15.507295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f851791e-10c8-4235-875c-631682f4c093 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.084516 Oct 31 15:25:15.508543 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 997/2122] 10.222.0.20 () {60 vars in 1158 bytes} [Mon Oct 31 15:25:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:15.529658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:15.530286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.530395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:15.539768 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bbfccc18-86ad-44e1-bdc6-5aa9a693ad7d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.408708 Oct 31 15:25:15.540684 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1126/2123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:15 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:15.551934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f6cc0b9-9ab7-4f1f-bdd4-af53899ec30e tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Action: 'create', calling method: .version_select at 0x7f16e0e39280>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILLoL4VbhQKHLrNX4g855cp6ppubKciNlDykYjcmqwDuVXoel8myVx9m7kSJwX5GHgFKs2ES0ne43QyVbteq1+OeCiP3ZjA1hzYJwaWOO3zLX/j9sbPzwNLdHWWv2qbQQ=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:15.562286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.562724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.563164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.563904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.564384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f6cc0b9-9ab7-4f1f-bdd4-af53899ec30e tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Request method failure captured: Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 507 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jZefpuC31k8Ho-KRQQL7F4piJ3zpg76So26d9gOWVNE4BECyMi3EPBwqgCwPOCmbwIv5mfxAKqECQL-rQ6Qk4cbWLEZl5XHMm2CUs8a6jdTOyn3hCIrfKn1g3DforCI1gjY-4MDQv9d0XMmBvdBJiiYEYDh0ME1nlKou7FEOipnRQ Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2267c1cb308949f88908559cd869bbe5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2267c1cb308949f88908559cd869bbe5"}]}] Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILLoL4VbhQKHLrNX4g855cp6ppubKciNlDykYjcmqwDuVXoel8myVx9m7kSJwX5GHgFKs2ES0ne43QyVbteq1+OeCiP3ZjA1hzYJwaWOO3zLX/j9sbPzwNLdHWWv2qbQQ=="}} Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILLoL4VbhQKHLrNX4g855cp6ppubKciNlDykYjcmqwDuVXoel8myVx9m7kSJwX5GHgFKs2ES0ne43QyVbteq1+OeCiP3ZjA1hzYJwaWOO3zLX/j9sbPzwNLdHWWv2qbQQ=='}}} Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 31 15:25:15.564772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 31 15:25:15.567327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.569680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.577747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f6cc0b9-9ab7-4f1f-bdd4-af53899ec30e tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:15.579243 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f6cc0b9-9ab7-4f1f-bdd4-af53899ec30e tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.031247 Oct 31 15:25:15.584829 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1127/2124] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:25:15 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:15.588772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7a9407d-1028-4e92-b1c8-c0e5ae0b6241 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:15.589359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a7a9407d-1028-4e92-b1c8-c0e5ae0b6241 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 214273f6-e72d-41be-b374-bd44d361dfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.613555 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-a7a9407d-1028-4e92-b1c8-c0e5ae0b6241 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 214273f6-e72d-41be-b374-bd44d361dfe8 could not be found. Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7a9407d-1028-4e92-b1c8-c0e5ae0b6241 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/214273f6-e72d-41be-b374-bd44d361dfe8/action HTTP/1.1 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 19 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: {"forceDelete": {}} Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 214273f6-e72d-41be-b374-bd44d361dfe8 could not be found. Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '214273f6-e72d-41be-b374-bd44d361dfe8', 'body': {'forceDelete': {}}} Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214273f6-e72d-41be-b374-bd44d361dfe8 could not be found. Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214273f6-e72d-41be-b374-bd44d361dfe8 could not be found. Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.627115 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.635162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:15.635162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:15.635162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214273f6-e72d-41be-b374-bd44d361dfe8 could not be found. Oct 31 15:25:15.635162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.635162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7a9407d-1028-4e92-b1c8-c0e5ae0b6241 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 214273f6-e72d-41be-b374-bd44d361dfe8 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:15.635162 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7a9407d-1028-4e92-b1c8-c0e5ae0b6241 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/214273f6-e72d-41be-b374-bd44d361dfe8/action" status: 404 len: 111 microversion: 2.1 time: 0.044627 Oct 31 15:25:15.635162 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1128/2125] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:15 2022] POST /compute/v2.1/servers/214273f6-e72d-41be-b374-bd44d361dfe8/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:15.636520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50302238-2703-49d3-bcb6-896762aacbf2 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Action: 'create', calling method: .version_select at 0x7f16e0de2b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1954096756", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:15.684242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-50302238-2703-49d3-bcb6-896762aacbf2 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:15.696007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-50302238-2703-49d3-bcb6-896762aacbf2 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Getting quotas for user ddd7bbc0b72d4cb99c5215105aeaa5c7 and project 2267c1cb308949f88908559cd869bbe5. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:15.752488 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-50302238-2703-49d3-bcb6-896762aacbf2 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50302238-2703-49d3-bcb6-896762aacbf2 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Request method failure captured: Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 118 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jZefpuC31k8Ho-KRQQL7F4piJ3zpg76So26d9gOWVNE4BECyMi3EPBwqgCwPOCmbwIv5mfxAKqECQL-rQ6Qk4cbWLEZl5XHMm2CUs8a6jdTOyn3hCIrfKn1g3DforCI1gjY-4MDQv9d0XMmBvdBJiiYEYDh0ME1nlKou7FEOipnRQ Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2267c1cb308949f88908559cd869bbe5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2267c1cb308949f88908559cd869bbe5"}]}] Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1954096756", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: exception: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1954096756', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6776, in import_key_pair Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6849, in _generate_fingerprint Oct 31 15:25:15.761877 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:15.765883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50302238-2703-49d3-bcb6-896762aacbf2 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:15.767917 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-50302238-2703-49d3-bcb6-896762aacbf2 tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.136137 Oct 31 15:25:15.772447 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1129/2126] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:25:15 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:25:15.791766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:15.794058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:15.820662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.821758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.822348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:15.823087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:15.823658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:15.824096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.162171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.175081 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8626d144-fa70-4968-8254-aad102b6e28d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1514 microversion: 2.1 time: 0.665329 Oct 31 15:25:16.175798 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 998/2127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:15 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1514 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:16.193347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21f316c5-c518-4c25-8db2-148d84cf1aba tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Calling method '.version_select at 0x7f16e5785c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:16.220903 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-21f316c5-c518-4c25-8db2-148d84cf1aba tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1481110615 not found for user ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21f316c5-c518-4c25-8db2-148d84cf1aba tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Request method failure captured: Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1481110615 HTTP/1.1 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jZefpuC31k8Ho-KRQQL7F4piJ3zpg76So26d9gOWVNE4BECyMi3EPBwqgCwPOCmbwIv5mfxAKqECQL-rQ6Qk4cbWLEZl5XHMm2CUs8a6jdTOyn3hCIrfKn1g3DforCI1gjY-4MDQv9d0XMmBvdBJiiYEYDh0ME1nlKou7FEOipnRQ Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2267c1cb308949f88908559cd869bbe5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2267c1cb308949f88908559cd869bbe5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2267c1cb308949f88908559cd869bbe5"}]}] Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 2267c1cb308949f88908559cd869bbe5 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-939238180 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-KeyPairsNegativeTestJSON-939238180-project Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: exception: Keypair tempest-keypair-non-existent-1481110615 not found for user ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'tempest-keypair-non-existent-1481110615'} Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6863, in delete_key_pair Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6884, in get_key_pair Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1481110615 not found for user ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:16.229868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1481110615 not found for user ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1481110615 not found for user ddd7bbc0b72d4cb99c5215105aeaa5c7 Oct 31 15:25:16.233382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:16.234926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21f316c5-c518-4c25-8db2-148d84cf1aba tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1481110615 not found for user ddd7bbc0b72d4cb99c5215105aeaa5c7 {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:16.238042 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21f316c5-c518-4c25-8db2-148d84cf1aba tempest-KeyPairsNegativeTestJSON-939238180 tempest-KeyPairsNegativeTestJSON-939238180-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1481110615" status: 404 len: 145 microversion: 2.1 time: 0.058018 Oct 31 15:25:16.241466 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 999/2128] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:25:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1481110615 => generated 145 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:16.260092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:16.272806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:16.298344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.299206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.301809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.302866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.308674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.315067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.398132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.411196 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b680ef8f-f1e3-4744-8611-d12122a323a6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.634073 Oct 31 15:25:16.421185 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1130/2129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:15 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:16.432291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:16.433387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:16.442342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.443553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.444264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.445589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.446256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.447012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.452608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:16.773046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.783341 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-552dc022-b802-405f-87c3-148a783be22b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1315 microversion: 2.1 time: 0.365397 Oct 31 15:25:16.787267 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1131/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:16 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:16.798683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:16.799527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:16.819289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.822258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.822882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.823910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:16.824518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:16.827158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:16.856574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.866180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.872684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:16.874592 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-438fde5d-40d7-4c9e-a6eb-0ce348ac849b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.630159 Oct 31 15:25:16.877760 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1000/2131] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:16 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:17.206153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:17.206778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:17.220128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.221982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.221982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.222536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.224203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.224822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.920565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:17.937344 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b2e27c5c-c235-4b0f-9435-d4b3b67e2e86 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 1.148520 Oct 31 15:25:17.938217 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1132/2132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:16 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:17.964888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:17.966452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:17.973916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.974642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.975234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:17.976146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:17.976744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:17.977366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.049521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:18.065727 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-306b1165-2c53-4c02-952c-324386888273 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1514 microversion: 2.1 time: 0.859165 Oct 31 15:25:18.069412 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1001/2133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:17 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1514 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:18.090065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:18.091033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:18.098990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.099676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.100441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.101448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.101974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.102479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.138519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:18.498641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:18.509557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:18.512640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:18.514507 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-488318ad-aa1e-4083-860f-d36a36042377 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.443121 Oct 31 15:25:18.534382 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1002/2134] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:18 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:18.561260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a168c122-8ce0-4d30-84bd-4082ca331c66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:18.563870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a168c122-8ce0-4d30-84bd-4082ca331c66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 5de94fe2-3b47-421d-ae74-96138d978d41] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:18.570125 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-a168c122-8ce0-4d30-84bd-4082ca331c66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 5de94fe2-3b47-421d-ae74-96138d978d41 could not be found. Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a168c122-8ce0-4d30-84bd-4082ca331c66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/5de94fe2-3b47-421d-ae74-96138d978d41/action HTTP/1.1 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 39 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: {"os-getConsoleOutput": {"length": 10}} Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 5de94fe2-3b47-421d-ae74-96138d978d41 could not be found. Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '5de94fe2-3b47-421d-ae74-96138d978d41', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5de94fe2-3b47-421d-ae74-96138d978d41 could not be found. Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5de94fe2-3b47-421d-ae74-96138d978d41 could not be found. Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:18.577647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:18.581978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:18.581978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:18.581978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:18.581978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:18.581978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5de94fe2-3b47-421d-ae74-96138d978d41 could not be found. Oct 31 15:25:18.581978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:18.584063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a168c122-8ce0-4d30-84bd-4082ca331c66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 5de94fe2-3b47-421d-ae74-96138d978d41 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:18.586378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a168c122-8ce0-4d30-84bd-4082ca331c66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/5de94fe2-3b47-421d-ae74-96138d978d41/action" status: 404 len: 111 microversion: 2.1 time: 0.044638 Oct 31 15:25:18.587193 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1003/2135] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:18 2022] POST /compute/v2.1/servers/5de94fe2-3b47-421d-ae74-96138d978d41/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:18.614498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:18.615819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:18.637360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.637901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.638337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.646207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:18.646700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:18.648888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:18.762449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:18.781810 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49c8a42f-3871-4f98-b782-ba3707fe0c70 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1315 microversion: 2.1 time: 0.820150 Oct 31 15:25:18.784039 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1133/2136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:17 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:19.029280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:19.043091 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99d85627-ce03-46ce-89f9-695ce7560199 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.448642 Oct 31 15:25:19.045349 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1004/2137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:18 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:19.072333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:19.074303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:19.094182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:19.096106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:19.098218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:19.100253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.109211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.109861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.110778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.111934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.112756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.116207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.120572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.121029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.121918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.122383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.122800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.212386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7de8009481e24fc7a113b58bb34a2eef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7687292298c5476dabe26115be2d1faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:19.222056 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00356b80-e597-4a03-b533-79e5447c141e tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 200 len: 1472 microversion: 2.1 time: 0.132923 Oct 31 15:25:19.222803 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1005/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:19 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 1472 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:19.482170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4e154718-331e-4216-ad5e-ca305b5607a5 req-97f7412d-f81f-4d71-b7e1-9185dcd22cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be12352-a6e7-4e99-bc85-bd7d8ceccbe0", "name": "network-vif-deleted", "tag": "c0a1ad8b-1588-4e71-bd34-b0864c01e4ac"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:19.508441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4e154718-331e-4216-ad5e-ca305b5607a5 req-97f7412d-f81f-4d71-b7e1-9185dcd22cdb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.515402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4e154718-331e-4216-ad5e-ca305b5607a5 req-97f7412d-f81f-4d71-b7e1-9185dcd22cdb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.518867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4e154718-331e-4216-ad5e-ca305b5607a5 req-97f7412d-f81f-4d71-b7e1-9185dcd22cdb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.553984 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4e154718-331e-4216-ad5e-ca305b5607a5 req-97f7412d-f81f-4d71-b7e1-9185dcd22cdb service nova] Creating event network-vif-deleted:c0a1ad8b-1588-4e71-bd34-b0864c01e4ac for instance 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 on n-h1-858384-17 Oct 31 15:25:19.563031 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4e154718-331e-4216-ad5e-ca305b5607a5 req-97f7412d-f81f-4d71-b7e1-9185dcd22cdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084879 Oct 31 15:25:19.564305 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1006/2139] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:19.571607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:19.572708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:19.587376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.588184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.588950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.589999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:19.590948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:19.592857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:19.998555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.007758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.011292 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1d6c208-a804-4e5b-a62f-08cde3fa5a96 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.942245 Oct 31 15:25:20.016722 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1134/2140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:19 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:20.030138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.031571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:20.033651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.035294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.037328 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ad9bd9b-23fb-41db-b120-9295f3f82527 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.471173 Oct 31 15:25:20.038223 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1007/2141] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:19 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:20.049382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.049382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.049382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.049382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.049382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.051909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32c2ea3b-317b-4a45-9782-1681d8a32342 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.053035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.056985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32c2ea3b-317b-4a45-9782-1681d8a32342 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 74f7b762-a431-4fcd-9287-d9168793fd48] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:20.075600 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-32c2ea3b-317b-4a45-9782-1681d8a32342 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 74f7b762-a431-4fcd-9287-d9168793fd48 could not be found. Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32c2ea3b-317b-4a45-9782-1681d8a32342 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/74f7b762-a431-4fcd-9287-d9168793fd48 HTTP/1.1 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 74f7b762-a431-4fcd-9287-d9168793fd48 could not be found. Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '74f7b762-a431-4fcd-9287-d9168793fd48'} Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f7b762-a431-4fcd-9287-d9168793fd48 could not be found. Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f7b762-a431-4fcd-9287-d9168793fd48 could not be found. Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.093967 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.098540 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.098540 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:20.098540 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:20.098540 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f7b762-a431-4fcd-9287-d9168793fd48 could not be found. Oct 31 15:25:20.098540 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.100970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32c2ea3b-317b-4a45-9782-1681d8a32342 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 74f7b762-a431-4fcd-9287-d9168793fd48 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:20.102162 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32c2ea3b-317b-4a45-9782-1681d8a32342 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/74f7b762-a431-4fcd-9287-d9168793fd48" status: 404 len: 111 microversion: 2.1 time: 0.062895 Oct 31 15:25:20.106913 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1008/2142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers/74f7b762-a431-4fcd-9287-d9168793fd48 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:20.113152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.115198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:20.124620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.125659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.126328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.127823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.128433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.129866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.523481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.541902 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23218d98-ffe6-4b40-b133-f9503ea8e3ec tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.433676 Oct 31 15:25:20.568106 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1009/2143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:20.578327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.581303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:20.605401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.606151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.607794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.611148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.612171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.616589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.636369 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] HTTP exception thrown: Instance 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 could not be found. Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Request method failure captured: Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 HTTP/1.1 Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-gmqzvLmbPhLwKcuYMN_hO0JdBwHr-3l39nkJ9n7Qr-wgNW55wRexBo8FF5rg5iep4Xg66NOy7gT5q1rpkv73KrXYJsVJ5y2CUXblXUBS_Fz2BhTG9K7JGMAM7q2zv4n8_vcZsqAw2n5CyCI2p0nfurbKqE9FEKH3jaHCWuWKAN68I Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7687292298c5476dabe26115be2d1faf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7687292298c5476dabe26115be2d1faf"}]}] Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 7de8009481e24fc7a113b58bb34a2eef Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 could not be found. Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '5be12352-a6e7-4e99-bc85-bd7d8ceccbe0'} Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 could not be found. Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 could not be found. Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:20.638658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.641929 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:20.641929 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:20.641929 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:20.641929 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:20.641929 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:20.641929 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 could not be found. Oct 31 15:25:20.641929 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:20.644298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Returning 404 to user: Instance 5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:20.646210 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c5ada570-4999-4199-a519-7e7bfc22af95 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0" status: 404 len: 111 microversion: 2.1 time: 0.076849 Oct 31 15:25:20.651890 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1010/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers/5be12352-a6e7-4e99-bc85-bd7d8ceccbe0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:20.657177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:20.658066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:20.670023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.670869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.671786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.672734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.673428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.674127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.920040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:20.932945 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-92e9da6b-14da-4ade-98c9-d93331302f16 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1315 microversion: 2.1 time: 0.911577 Oct 31 15:25:20.941642 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1135/2145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:20.952870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-24490bd5-16c2-4169-a7b6-3d4595bf5b38 req-588b158d-9061-41d4-ac58-8c5c4de694f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129edccf-8357-446b-9c1b-13c2fc7c5f0d", "name": "network-vif-plugged", "status": "completed", "tag": "97fa87f2-e548-476e-90bc-605645bab3a9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:20.965168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-24490bd5-16c2-4169-a7b6-3d4595bf5b38 req-588b158d-9061-41d4-ac58-8c5c4de694f0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:20.977919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-24490bd5-16c2-4169-a7b6-3d4595bf5b38 req-588b158d-9061-41d4-ac58-8c5c4de694f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:20.978621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-24490bd5-16c2-4169-a7b6-3d4595bf5b38 req-588b158d-9061-41d4-ac58-8c5c4de694f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:20.998709 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-24490bd5-16c2-4169-a7b6-3d4595bf5b38 req-588b158d-9061-41d4-ac58-8c5c4de694f0 service nova] Creating event network-vif-plugged:97fa87f2-e548-476e-90bc-605645bab3a9 for instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d on n-h2-858384-17 Oct 31 15:25:21.012752 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-24490bd5-16c2-4169-a7b6-3d4595bf5b38 req-588b158d-9061-41d4-ac58-8c5c4de694f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068745 Oct 31 15:25:21.013453 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1136/2146] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:21.019046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.021852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:21.038189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.038997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.039605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.040507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.041122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.041719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.069595 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] HTTP exception thrown: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Request method failure captured: Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c HTTP/1.1 Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gmqzvLmbPhLwKcuYMN_hO0JdBwHr-3l39nkJ9n7Qr-wgNW55wRexBo8FF5rg5iep4Xg66NOy7gT5q1rpkv73KrXYJsVJ5y2CUXblXUBS_Fz2BhTG9K7JGMAM7q2zv4n8_vcZsqAw2n5CyCI2p0nfurbKqE9FEKH3jaHCWuWKAN68I Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7687292298c5476dabe26115be2d1faf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7687292298c5476dabe26115be2d1faf"}]}] Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 7de8009481e24fc7a113b58bb34a2eef Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '14785246-ca49-46bc-a3be-a98cc68d6a5c'} Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:21.076706 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.080685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.082331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Returning 404 to user: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:21.084016 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7607035-570e-459d-bb24-9ad1d0d839d1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 404 len: 111 microversion: 2.1 time: 0.069245 Oct 31 15:25:21.085217 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1137/2147] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:21 2022] DELETE /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:21.090382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e5ddaab1-08be-46fa-a252-0e60a853b0bc req-cb3ce2ff-0150-4f7f-b289-2bf533a50608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ace9f23-0d08-4d3b-8c64-dd82142559be", "name": "network-vif-unplugged", "status": "completed", "tag": "c5178817-b9fc-4b5a-bd24-5ee1112ab04c"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:21.097323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:21.103791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e5ddaab1-08be-46fa-a252-0e60a853b0bc req-cb3ce2ff-0150-4f7f-b289-2bf533a50608 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.104610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e5ddaab1-08be-46fa-a252-0e60a853b0bc req-cb3ce2ff-0150-4f7f-b289-2bf533a50608 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.106036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e5ddaab1-08be-46fa-a252-0e60a853b0bc req-cb3ce2ff-0150-4f7f-b289-2bf533a50608 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.119131 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a4468a0d-a5f5-4cd4-bbe2-26b523a4996d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.465285 Oct 31 15:25:21.121050 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1011/2148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:20 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:21.152155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.155115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:21.159738 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e5ddaab1-08be-46fa-a252-0e60a853b0bc req-cb3ce2ff-0150-4f7f-b289-2bf533a50608 service nova] Creating event network-vif-unplugged:c5178817-b9fc-4b5a-bd24-5ee1112ab04c for instance 0ace9f23-0d08-4d3b-8c64-dd82142559be on n-h2-858384-17 Oct 31 15:25:21.180670 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e5ddaab1-08be-46fa-a252-0e60a853b0bc req-cb3ce2ff-0150-4f7f-b289-2bf533a50608 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088511 Oct 31 15:25:21.180670 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1138/2149] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:21.184320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.186919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.189184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.191120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.192632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.193780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.205051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.215289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 14785246-ca49-46bc-a3be-a98cc68d6a5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:21.240320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.241381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.244539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.245635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.247621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.248216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.301750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] HTTP exception thrown: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Request method failure captured: Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c HTTP/1.1 Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gmqzvLmbPhLwKcuYMN_hO0JdBwHr-3l39nkJ9n7Qr-wgNW55wRexBo8FF5rg5iep4Xg66NOy7gT5q1rpkv73KrXYJsVJ5y2CUXblXUBS_Fz2BhTG9K7JGMAM7q2zv4n8_vcZsqAw2n5CyCI2p0nfurbKqE9FEKH3jaHCWuWKAN68I Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7687292298c5476dabe26115be2d1faf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7687292298c5476dabe26115be2d1faf"}]}] Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 7de8009481e24fc7a113b58bb34a2eef Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '14785246-ca49-46bc-a3be-a98cc68d6a5c'} Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.313444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.317497 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.317497 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.317497 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.317497 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:21.317497 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:21.317497 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. Oct 31 15:25:21.317497 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.319298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Returning 404 to user: Instance 14785246-ca49-46bc-a3be-a98cc68d6a5c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:21.321906 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-93252455-520e-4385-83eb-ba1a8863e91d tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c" status: 404 len: 111 microversion: 2.1 time: 0.141974 Oct 31 15:25:21.327065 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1139/2150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers/14785246-ca49-46bc-a3be-a98cc68d6a5c => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:21.341680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.343663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:21.359174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.360062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.377758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.380317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.381787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.383552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.427446 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] HTTP exception thrown: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Request method failure captured: Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 HTTP/1.1 Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gmqzvLmbPhLwKcuYMN_hO0JdBwHr-3l39nkJ9n7Qr-wgNW55wRexBo8FF5rg5iep4Xg66NOy7gT5q1rpkv73KrXYJsVJ5y2CUXblXUBS_Fz2BhTG9K7JGMAM7q2zv4n8_vcZsqAw2n5CyCI2p0nfurbKqE9FEKH3jaHCWuWKAN68I Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7687292298c5476dabe26115be2d1faf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7687292298c5476dabe26115be2d1faf"}]}] Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 7de8009481e24fc7a113b58bb34a2eef Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '45c3e20a-338d-4dcb-946c-7012911f7928'} Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:21.429797 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.432898 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.435062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Returning 404 to user: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:21.444931 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-90bc7c67-02d5-4a3c-a316-9c4d9c9d5d20 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 404 len: 111 microversion: 2.1 time: 0.112373 Oct 31 15:25:21.446138 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1140/2151] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:21 2022] DELETE /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:21.453046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c038135-1dda-4fcc-917b-5914da1e2b99 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1204694593", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c038135-1dda-4fcc-917b-5914da1e2b99 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 238 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1204694593", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1204694593', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.480958 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 31 15:25:21.484458 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.491475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c038135-1dda-4fcc-917b-5914da1e2b99 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:21.492505 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c038135-1dda-4fcc-917b-5914da1e2b99 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.045224 Oct 31 15:25:21.493266 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1141/2152] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:21 2022] POST /compute/v2.1/servers => generated 139 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:21.498813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.499602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] [instance: 45c3e20a-338d-4dcb-946c-7012911f7928] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:21.515945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.516611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.517553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.520767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.521319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.521765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.532929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:21.546682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:21.548196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:21.549419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ba120e4-11d0-4d2d-8a56-123d6019bbcc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.425012 Oct 31 15:25:21.555642 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1012/2153] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:21.570746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.580931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:21.597303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.600365 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] HTTP exception thrown: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.605166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.605749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Request method failure captured: Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 HTTP/1.1 Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-gmqzvLmbPhLwKcuYMN_hO0JdBwHr-3l39nkJ9n7Qr-wgNW55wRexBo8FF5rg5iep4Xg66NOy7gT5q1rpkv73KrXYJsVJ5y2CUXblXUBS_Fz2BhTG9K7JGMAM7q2zv4n8_vcZsqAw2n5CyCI2p0nfurbKqE9FEKH3jaHCWuWKAN68I Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7687292298c5476dabe26115be2d1faf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7687292298c5476dabe26115be2d1faf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7687292298c5476dabe26115be2d1faf"}]}] Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7687292298c5476dabe26115be2d1faf Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2060393 Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 7de8009481e24fc7a113b58bb34a2eef Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerDiskConfigTestJSON-2060393-project Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '45c3e20a-338d-4dcb-946c-7012911f7928'} Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:21.606945 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.610804 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:21.610804 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:21.610804 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:21.610804 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:21.610804 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:21.610804 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. Oct 31 15:25:21.610804 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:21.611201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.611201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.611201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.622160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] Returning 404 to user: Instance 45c3e20a-338d-4dcb-946c-7012911f7928 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:21.626714 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b970c0ab-0a7d-492f-8b59-49b0deece9e1 tempest-ServerDiskConfigTestJSON-2060393 tempest-ServerDiskConfigTestJSON-2060393-project] 10.222.0.20 "GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928" status: 404 len: 111 microversion: 2.1 time: 0.130187 Oct 31 15:25:21.627566 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1142/2154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers/45c3e20a-338d-4dcb-946c-7012911f7928 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:21.861608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa147152-4169-4c2e-8a29-c6dab09fc6bf tempest-AbsoluteLimitsTestJSON-1718903207 tempest-AbsoluteLimitsTestJSON-1718903207-project] Calling method '.version_select at 0x7f16e1abd790>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.881634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa147152-4169-4c2e-8a29-c6dab09fc6bf tempest-AbsoluteLimitsTestJSON-1718903207 tempest-AbsoluteLimitsTestJSON-1718903207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.882523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa147152-4169-4c2e-8a29-c6dab09fc6bf tempest-AbsoluteLimitsTestJSON-1718903207 tempest-AbsoluteLimitsTestJSON-1718903207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.883112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa147152-4169-4c2e-8a29-c6dab09fc6bf tempest-AbsoluteLimitsTestJSON-1718903207 tempest-AbsoluteLimitsTestJSON-1718903207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.883982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa147152-4169-4c2e-8a29-c6dab09fc6bf tempest-AbsoluteLimitsTestJSON-1718903207 tempest-AbsoluteLimitsTestJSON-1718903207-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.884579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa147152-4169-4c2e-8a29-c6dab09fc6bf tempest-AbsoluteLimitsTestJSON-1718903207 tempest-AbsoluteLimitsTestJSON-1718903207-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.885333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa147152-4169-4c2e-8a29-c6dab09fc6bf tempest-AbsoluteLimitsTestJSON-1718903207 tempest-AbsoluteLimitsTestJSON-1718903207-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.918224 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa147152-4169-4c2e-8a29-c6dab09fc6bf tempest-AbsoluteLimitsTestJSON-1718903207 tempest-AbsoluteLimitsTestJSON-1718903207-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.284476 Oct 31 15:25:21.938259 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1143/2155] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/limits => generated 511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:21.958759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:21.959508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:21.968192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.969318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.969946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:21.972414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:21.974608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:21.978299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.309616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:22.320221 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-394beb59-a1e3-4606-ad68-594583a9efcf tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1315 microversion: 2.1 time: 0.367747 Oct 31 15:25:22.320815 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1144/2156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:22.346177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:22.365121 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1079bd04-aeb9-4ffa-8971-2f4f139a8e9d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.807683 Oct 31 15:25:22.369471 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1013/2157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:21 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:22.398303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:22.399059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:22.409347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.412938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.413522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.419383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.420036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.421058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.594894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:22.595597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:22.619097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.620819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.621506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:22.624188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:22.625634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:22.627621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.184277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:23.201450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:23.203531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:23.205028 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86353cc1-c4b3-47df-94e4-1abb2e7e9458 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.618144 Oct 31 15:25:23.228226 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1014/2158] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:22 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:25:23.246558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7bb6e5b5-f760-42b6-8e52-0aabbfc68353 req-6ca7e015-5409-4f6e-bdc8-cc0004853da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ace9f23-0d08-4d3b-8c64-dd82142559be", "tag": "c5178817-b9fc-4b5a-bd24-5ee1112ab04c"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:23.274285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7bb6e5b5-f760-42b6-8e52-0aabbfc68353 req-6ca7e015-5409-4f6e-bdc8-cc0004853da9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.277079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7bb6e5b5-f760-42b6-8e52-0aabbfc68353 req-6ca7e015-5409-4f6e-bdc8-cc0004853da9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.280887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7bb6e5b5-f760-42b6-8e52-0aabbfc68353 req-6ca7e015-5409-4f6e-bdc8-cc0004853da9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.330421 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7bb6e5b5-f760-42b6-8e52-0aabbfc68353 req-6ca7e015-5409-4f6e-bdc8-cc0004853da9 service nova] Creating event network-changed:c5178817-b9fc-4b5a-bd24-5ee1112ab04c for instance 0ace9f23-0d08-4d3b-8c64-dd82142559be on n-h2-858384-17 Oct 31 15:25:23.341528 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7bb6e5b5-f760-42b6-8e52-0aabbfc68353 req-6ca7e015-5409-4f6e-bdc8-cc0004853da9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097988 Oct 31 15:25:23.344712 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1015/2159] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:25:23.356690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:23.359209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:23.379734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.380472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.386780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.389428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.390104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.390565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.596343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:23.620762 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af869bff-68fd-4067-ac6f-1e811fef2062 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 1.221554 Oct 31 15:25:23.623968 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1145/2160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:22 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:23.877701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7fd9fef1-8bf8-4942-a8c7-3c59b45f6b84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1663635643", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7fd9fef1-8bf8-4942-a8c7-3c59b45f6b84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 235 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1663635643", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1663635643', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.887372 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 31 15:25:23.892763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:23.902344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7fd9fef1-8bf8-4942-a8c7-3c59b45f6b84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:23.905041 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7fd9fef1-8bf8-4942-a8c7-3c59b45f6b84 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.031668 Oct 31 15:25:23.908873 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1146/2161] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:23 2022] POST /compute/v2.1/servers => generated 133 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:25:23.926125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:23.928285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:23.951644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.953924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.954668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:23.960165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:23.964081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:23.964897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.120516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:24.131898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ad7be552-9a07-44d6-b4e1-27555a1a55d2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1501 microversion: 2.1 time: 0.785396 Oct 31 15:25:24.133019 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1016/2162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:23 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1501 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:24.232434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:24.233047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:24.246376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.246876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.247341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.248060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.248540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.248955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.620734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:24.643712 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13ff39c8-bcd2-48d5-9be6-113a055fd421 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.730753 Oct 31 15:25:24.644286 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1147/2163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:23 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:24.670458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:24.673304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:24.689559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.690480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.691465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:24.693684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:24.694536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:24.695300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:25.044010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:25.060331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:25.061821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:25.063030 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bce65d20-3b25-4b74-aea2-8a806649eac6 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.835046 Oct 31 15:25:25.063728 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1017/2164] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:24 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:25:25.338340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:25.352559 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d7c785b-7e2d-43f8-a1bb-bc95d0c833c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.687035 Oct 31 15:25:25.353178 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1148/2165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:24 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:25.379170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd843c54-ec7f-4ce6-934b-0e6cb1b22127 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:25.379666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd843c54-ec7f-4ce6-934b-0e6cb1b22127 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 4581f52d-84bc-4f7d-bd3b-ee6e04797b0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:25.389390 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-dd843c54-ec7f-4ce6-934b-0e6cb1b22127 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 4581f52d-84bc-4f7d-bd3b-ee6e04797b0e could not be found. Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd843c54-ec7f-4ce6-934b-0e6cb1b22127 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/4581f52d-84bc-4f7d-bd3b-ee6e04797b0e/action HTTP/1.1 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 13 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: {"pause": {}} Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 4581f52d-84bc-4f7d-bd3b-ee6e04797b0e could not be found. Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '4581f52d-84bc-4f7d-bd3b-ee6e04797b0e', 'body': {'pause': {}}} Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4581f52d-84bc-4f7d-bd3b-ee6e04797b0e could not be found. Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4581f52d-84bc-4f7d-bd3b-ee6e04797b0e could not be found. Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:25.400298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:25.407550 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:25.407550 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:25.407550 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4581f52d-84bc-4f7d-bd3b-ee6e04797b0e could not be found. Oct 31 15:25:25.407550 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:25.407550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd843c54-ec7f-4ce6-934b-0e6cb1b22127 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 4581f52d-84bc-4f7d-bd3b-ee6e04797b0e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:25.407550 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd843c54-ec7f-4ce6-934b-0e6cb1b22127 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/4581f52d-84bc-4f7d-bd3b-ee6e04797b0e/action" status: 404 len: 111 microversion: 2.1 time: 0.027976 Oct 31 15:25:25.407550 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1018/2166] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:25 2022] POST /compute/v2.1/servers/4581f52d-84bc-4f7d-bd3b-ee6e04797b0e/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:25.412132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:25.412814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:25.427380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:25.427881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:25.428328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:25.435485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:25.436005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:25.445439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:25.992380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:26.000560 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80217d61-c00e-4728-bf8f-b6109b78cf2d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.593171 Oct 31 15:25:26.012699 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1149/2167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:25 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:26.039022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:26.039637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:26.042066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:26.064261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:26.064898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:26.065216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:26.065939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:26.066397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:26.066866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:26.094700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:26.095724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:26.109551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:26.112006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:26.114879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:26.116561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:26.118983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:26.119761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:26.712138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:26.730048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:26.731823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:26.738339 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19401d03-a56e-48ed-9368-327663975419 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.647746 Oct 31 15:25:26.740845 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1150/2168] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:26 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:26.988288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:26.997427 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a000586-2a5e-4da5-a550-95b46fcb73a3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.962672 Oct 31 15:25:27.017470 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1019/2169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:26 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:27.025261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-359e4638-20db-42c3-b61f-779e4b79c32b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:27.025861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-359e4638-20db-42c3-b61f-779e4b79c32b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:27.042401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-359e4638-20db-42c3-b61f-779e4b79c32b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.042741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-359e4638-20db-42c3-b61f-779e4b79c32b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.043754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-359e4638-20db-42c3-b61f-779e4b79c32b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.044804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-359e4638-20db-42c3-b61f-779e4b79c32b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.045618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-359e4638-20db-42c3-b61f-779e4b79c32b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.046412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-359e4638-20db-42c3-b61f-779e4b79c32b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.174191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71caa103-36d4-41c4-ab78-1277789381dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12031d58-9c50-48cf-8ee6-c8918a4e47dd"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:27.177487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71caa103-36d4-41c4-ab78-1277789381dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:27.191858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71caa103-36d4-41c4-ab78-1277789381dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.192593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71caa103-36d4-41c4-ab78-1277789381dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.198739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71caa103-36d4-41c4-ab78-1277789381dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.203076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71caa103-36d4-41c4-ab78-1277789381dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.213895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71caa103-36d4-41c4-ab78-1277789381dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.214348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71caa103-36d4-41c4-ab78-1277789381dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.255091 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-359e4638-20db-42c3-b61f-779e4b79c32b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 202 len: 0 microversion: 2.1 time: 0.234638 Oct 31 15:25:27.256291 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1151/2170] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:27 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:27.273062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:27.275205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:27.285096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.286846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.287459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.288336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.288949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.289584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.791762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:27.803434 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f8c3bf66-7547-4e44-b537-250f8e0139e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1509 microversion: 2.1 time: 0.536716 Oct 31 15:25:27.807357 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71caa103-36d4-41c4-ab78-1277789381dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637461 Oct 31 15:25:27.808879 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1020/2171] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:25:27 2022] POST /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d/os-volume_attachments => generated 194 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:25:27.819395 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1152/2172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:27 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1509 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:27.851716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:27.857507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:27.878855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.879882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.880572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:27.887043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:27.890549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:27.893110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:28.831675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:28.832314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:28.856195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:28.856693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:28.857152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:28.857879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:28.858337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:28.858759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:28.903919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:28.962380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:29.007491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:29.012639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:29.018801 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e2c480d-4868-439a-adf9-1bae5a92eeb8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 1.208338 Oct 31 15:25:29.033113 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1021/2173] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:27 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:29.799399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:29.820242 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4429c1dc-5a87-4f1f-bef4-88189503877d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1489 microversion: 2.1 time: 0.988730 Oct 31 15:25:29.842511 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1153/2174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:28 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1489 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:29.849100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:29.849742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:29.867779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:29.868916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:29.869835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:29.870728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:29.871475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:29.872091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:29.927626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:29.935598 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Cannot 'pause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state paused Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action HTTP/1.1 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 13 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: {"pause": {}} Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: exception: Cannot 'pause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state paused Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65', 'body': {'pause': {}}} Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 in vm_state paused. Cannot pause while the instance is in this state. Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state paused Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:29.941299 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:29.947558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:29.947558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:29.947558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:29.947558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state paused Oct 31 15:25:29.947558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:29.947558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 409 to user: Cannot 'pause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state paused {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:29.947558 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-956fa815-a075-48de-b6f6-1d1bf1810e94 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 409 len: 143 microversion: 2.1 time: 0.102211 Oct 31 15:25:29.948671 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1022/2175] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:29 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 143 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:25:29.954993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce58d13f-73eb-401e-b749-169ec6890e23 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:29.955552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce58d13f-73eb-401e-b749-169ec6890e23 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:29.966476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce58d13f-73eb-401e-b749-169ec6890e23 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:29.966964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce58d13f-73eb-401e-b749-169ec6890e23 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:29.967501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce58d13f-73eb-401e-b749-169ec6890e23 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:29.968087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce58d13f-73eb-401e-b749-169ec6890e23 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:29.977582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce58d13f-73eb-401e-b749-169ec6890e23 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:29.978310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce58d13f-73eb-401e-b749-169ec6890e23 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.051010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:30.053157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:30.070287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.071452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.071937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.072727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.073221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.073623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.168570 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce58d13f-73eb-401e-b749-169ec6890e23 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 202 len: 0 microversion: 2.1 time: 0.213840 Oct 31 15:25:30.172655 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1154/2176] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:29 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:30.196655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:30.208368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:30.243530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.244568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.245268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.246262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:30.250219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:30.251093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:30.956392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:30.965239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a823c4e0-f2a4-4af3-9186-0ad6829c8a7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1496 microversion: 2.1 time: 0.786802 Oct 31 15:25:30.978329 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1155/2177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:30 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1496 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:31.263409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:31.279719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:31.282821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:31.290863 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b74a2a2-8bf6-40f4-8374-6bf1ec04cad2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 1.240215 Oct 31 15:25:31.292039 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1023/2178] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:30 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:31.337114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8176ef96-4406-4af9-82c4-4dc0b66a53c6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: .version_select at 0x7f16e0d150d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1534172799", "description": "tempest-description-803474406"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:31.878322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:31.904418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:31.945360 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8176ef96-4406-4af9-82c4-4dc0b66a53c6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.954013 Oct 31 15:25:31.946111 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1156/2179] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:25:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:31.963361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df0847fc-a7c7-4bc3-bb41-6c6d9e4c8af5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: .version_select at 0x7f16e577be50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-505608363", "description": "tempest-description-1655751052"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:32.009459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:32.010271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:32.035416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:32.041743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:32.042383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:32.043272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:32.043862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:32.044543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:32.588427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:32.598123 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24c386aa-b163-4183-abbc-a9d19e72bd55 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.595931 Oct 31 15:25:32.620849 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1157/2180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:32 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:32.638420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:32.639315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:32.646546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:32.647260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:32.652497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:32.653510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:32.654407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:32.655186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:32.977474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:32.995189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:32.996812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:32.998117 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4882790b-f4be-4c36-92fa-4b2bb7f98d61 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.375932 Oct 31 15:25:32.998799 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1158/2181] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:32 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:33.019601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:33.020381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:33.033470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.033987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.034437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.035172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.039372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.039929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.088186 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df0847fc-a7c7-4bc3-bb41-6c6d9e4c8af5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.132066 Oct 31 15:25:33.090002 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1024/2182] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:25:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:33.188500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1706294919", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fca842e3-60df-4fc3-b289-9b37020e59e1"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:33.315918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] validate_networks() for [('fca842e3-60df-4fc3-b289-9b37020e59e1', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:33.375252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:33.396728 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0e7281a1-d7d8-4810-bb95-fa5d88b94fab tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.394442 Oct 31 15:25:33.398233 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1159/2183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:32 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:33.430152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:33.432618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:33.446672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.447290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.449650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.450660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.453113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.453781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.532304 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff/action HTTP/1.1 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 28 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: {"reboot": {"type": "SOFT"}} Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '54ae2161-df7f-41c2-a0e7-e78be34827ff', 'body': {'reboot': {'type': 'SOFT'}}} Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:33.534360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:33.541367 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:33.543759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:33.544836 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef1eaf6d-26a0-44db-8acc-751d301aa9ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff/action" status: 404 len: 111 microversion: 2.1 time: 0.123728 Oct 31 15:25:33.546065 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1160/2184] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:33 2022] POST /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff/action => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:33.581569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:33.582947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:33.601425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.601425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.601425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.601425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.601425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.601425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.891236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:33.899782 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5575e276-c432-49ef-be53-1f609e467814 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.349482 Oct 31 15:25:33.902602 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1161/2185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:33 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:33.929876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:33.930921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:33.941873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.942568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.943224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:33.949518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:33.950935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:33.951545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:34.262038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:34.286420 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ebbad1c2-1efa-4d83-85d1-cb907af04e98 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.360262 Oct 31 15:25:34.295664 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1162/2186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:33 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:34.313369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:34.314134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:34.335043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:34.335692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:34.336226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:34.337073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:34.337662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:34.338185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:34.709966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:34.729364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:34.730986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:34.732202 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a08f367a-cde2-4e75-a5eb-9c21fb2e01de tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.435259 Oct 31 15:25:34.732782 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1163/2187] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:34 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:34.782180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4caca3d9-a14f-4bcd-8dac-c419f8c2a050 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:34.784559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4caca3d9-a14f-4bcd-8dac-c419f8c2a050 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 871d95ce-d7f6-4ae4-85f3-51c126c565ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:34.799145 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4caca3d9-a14f-4bcd-8dac-c419f8c2a050 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 871d95ce-d7f6-4ae4-85f3-51c126c565ff could not be found. Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4caca3d9-a14f-4bcd-8dac-c419f8c2a050 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/871d95ce-d7f6-4ae4-85f3-51c126c565ff/action HTTP/1.1 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 28 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: {"reboot": {"type": "SOFT"}} Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 871d95ce-d7f6-4ae4-85f3-51c126c565ff could not be found. Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '871d95ce-d7f6-4ae4-85f3-51c126c565ff', 'body': {'reboot': {'type': 'SOFT'}}} Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 871d95ce-d7f6-4ae4-85f3-51c126c565ff could not be found. Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 871d95ce-d7f6-4ae4-85f3-51c126c565ff could not be found. Oct 31 15:25:34.800757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 871d95ce-d7f6-4ae4-85f3-51c126c565ff could not be found. Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:34.805056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4caca3d9-a14f-4bcd-8dac-c419f8c2a050 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 871d95ce-d7f6-4ae4-85f3-51c126c565ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:34.805665 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4caca3d9-a14f-4bcd-8dac-c419f8c2a050 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/871d95ce-d7f6-4ae4-85f3-51c126c565ff/action" status: 404 len: 111 microversion: 2.1 time: 0.042823 Oct 31 15:25:34.811639 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1164/2188] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:34 2022] POST /compute/v2.1/servers/871d95ce-d7f6-4ae4-85f3-51c126c565ff/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:34.817351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:34.817992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:34.840784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:34.843356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:34.843812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:34.846370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:34.846867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:34.847308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:35.258271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:35.276738 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-08f9a2fa-93dd-46c7-9168-49d0d1dcb052 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.463528 Oct 31 15:25:35.279539 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1165/2189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:34 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:35.313082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:35.314645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:35.331847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:35.332754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:35.333991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:35.335628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:35.336912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:35.338274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:35.779268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:35.792895 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29952263-fde6-4e3d-ba73-b439a98ea245 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.482676 Oct 31 15:25:35.793982 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1166/2190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:35 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:35.810175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:35.812218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:35.833715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:35.835552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:35.836427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:35.837120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:35.838291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:35.839573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:35.840239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.355307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:36.375965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:36.376903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:36.392282 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-514abda8-11b7-442f-9693-ea7c6efeb1ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.597125 Oct 31 15:25:36.419109 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1167/2191] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:35 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:36.431332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:36.434470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:36.446879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.447508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.447952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.448678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.449228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.451535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.492565 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff/action HTTP/1.1 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 65 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '54ae2161-df7f-41c2-a0e7-e78be34827ff', 'body': {'rebuild': {'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6'}}} Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 31 15:25:36.494604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:25:36.498467 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:36.501774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:36.504946 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8145b192-1917-40d0-9ec4-566518dbc2ce tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff/action" status: 404 len: 111 microversion: 2.1 time: 0.084403 Oct 31 15:25:36.511166 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1168/2192] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:36 2022] POST /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff/action => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:36.519898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:36.523439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:36.538895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.542213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.542864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.547508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.548324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.548946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.570645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:36.571186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:36.571521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:36.571927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:36.572935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:36.606813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.607818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.609493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.610542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:36.612546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:36.614983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:36.672545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Getting quotas for project de2d818aea634d5a9e8d6eb3fd902f0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:36.691430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Getting quotas for user d9a767ae59374d86a52a519ab067b27d and project de2d818aea634d5a9e8d6eb3fd902f0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:36.720836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:25:36.727067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:25:36.857363 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc3b9336-39e2-44c3-a685-f4b2f0af6783 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.680630 Oct 31 15:25:36.870549 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1025/2193] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:25:36.884545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b60045a-b866-4f1e-94ae-c2a6f64ff1c1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:36.886082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b60045a-b866-4f1e-94ae-c2a6f64ff1c1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:37.023174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:37.037333 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8a96412-9505-4678-ad2c-d54c11454456 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.524546 Oct 31 15:25:37.038782 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1169/2194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:36 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:37.089374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:37.089374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:37.096870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:37.097437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:37.106898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:37.132473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:37.142947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:37.143624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:37.489958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:37.503462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8b60045a-b866-4f1e-94ae-c2a6f64ff1c1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:37.503644 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2dc08c1a-ce79-44d5-abcd-b640121b4742 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.433478 Oct 31 15:25:37.506093 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1170/2195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:37 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:37.520864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:37.521573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:37.539259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:37.539798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:37.540404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:37.544596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:37.545384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:37.545981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:37.546729 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b60045a-b866-4f1e-94ae-c2a6f64ff1c1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1216 microversion: 2.1 time: 0.669476 Oct 31 15:25:37.550832 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1026/2196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:36 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1216 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:37.564962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e782b62a-8d04-4350-b242-d179ca2ec5af tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:37.573612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e782b62a-8d04-4350-b242-d179ca2ec5af tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f51186e3-cce2-470a-affa-918e67d923bc] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:37.590596 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-e782b62a-8d04-4350-b242-d179ca2ec5af tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance f51186e3-cce2-470a-affa-918e67d923bc could not be found. Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e782b62a-8d04-4350-b242-d179ca2ec5af tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/f51186e3-cce2-470a-affa-918e67d923bc/action HTTP/1.1 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 65 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f51186e3-cce2-470a-affa-918e67d923bc could not be found. Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f51186e3-cce2-470a-affa-918e67d923bc', 'body': {'rebuild': {'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6'}}} Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51186e3-cce2-470a-affa-918e67d923bc could not be found. Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:25:37.597168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51186e3-cce2-470a-affa-918e67d923bc could not be found. Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51186e3-cce2-470a-affa-918e67d923bc could not be found. Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e782b62a-8d04-4350-b242-d179ca2ec5af tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance f51186e3-cce2-470a-affa-918e67d923bc could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:37.602460 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e782b62a-8d04-4350-b242-d179ca2ec5af tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f51186e3-cce2-470a-affa-918e67d923bc/action" status: 404 len: 111 microversion: 2.1 time: 0.046749 Oct 31 15:25:37.604933 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1027/2197] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:37 2022] POST /compute/v2.1/servers/f51186e3-cce2-470a-affa-918e67d923bc/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:37.619859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:37.623359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:37.663015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:37.668308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:37.676039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:37.677524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:37.678771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:37.679352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:37.900754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:37.915405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:37.919003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:37.925878 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c85e6946-bc56-40ca-aaa2-f70491161237 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.418336 Oct 31 15:25:37.942867 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1171/2198] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:37 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:38.577110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:38.578141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:38.624940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:38.625835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:38.628952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:38.635681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:38.636378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:38.636869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:38.641811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:38.653676 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fdfdba76-fbea-4677-8076-7079570b7618 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 1.045510 Oct 31 15:25:38.656973 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1028/2199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:37 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:38.691542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:38.692220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:38.708844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:38.709718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:38.711041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:38.712405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:38.715143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:38.716931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:38.732783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:38.899396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:38.914307 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-613edf8e-0cb8-4774-ac8f-846884e6e5f1 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1268 microversion: 2.1 time: 0.345094 Oct 31 15:25:38.916525 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1172/2200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:38 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1268 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:38.958400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:38.959203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:38.969035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:38.970908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:38.971356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:38.981000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:38.985844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:38.986287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:39.318195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:39.333292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:39.339177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:39.344207 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c3b733d-7cc3-4891-960e-a874f3b3e271 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.387258 Oct 31 15:25:39.345361 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1173/2201] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:38 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:25:39.481887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:39.501154 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0cd5aca-13cf-4047-b770-dc86e8285ccc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.807849 Oct 31 15:25:39.502408 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1029/2202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:38 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:39.533040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-229b8ec0-54e0-4f09-b82b-405974b4f9d4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:39.533860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-229b8ec0-54e0-4f09-b82b-405974b4f9d4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 1a4a2a5e-f107-45ff-af44-0b2f3f911102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:39.542448 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-229b8ec0-54e0-4f09-b82b-405974b4f9d4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 1a4a2a5e-f107-45ff-af44-0b2f3f911102 could not be found. Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-229b8ec0-54e0-4f09-b82b-405974b4f9d4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/1a4a2a5e-f107-45ff-af44-0b2f3f911102/action HTTP/1.1 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 15 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: {"restore": {}} Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 1a4a2a5e-f107-45ff-af44-0b2f3f911102 could not be found. Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '1a4a2a5e-f107-45ff-af44-0b2f3f911102', 'body': {'restore': {}}} Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a4a2a5e-f107-45ff-af44-0b2f3f911102 could not be found. Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a4a2a5e-f107-45ff-af44-0b2f3f911102 could not be found. Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:39.550935 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:39.555711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:39.555711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:39.555711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a4a2a5e-f107-45ff-af44-0b2f3f911102 could not be found. Oct 31 15:25:39.555711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:39.563882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-229b8ec0-54e0-4f09-b82b-405974b4f9d4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 1a4a2a5e-f107-45ff-af44-0b2f3f911102 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:39.565034 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-229b8ec0-54e0-4f09-b82b-405974b4f9d4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/1a4a2a5e-f107-45ff-af44-0b2f3f911102/action" status: 404 len: 111 microversion: 2.1 time: 0.036081 Oct 31 15:25:39.566153 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1174/2203] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:39 2022] POST /compute/v2.1/servers/1a4a2a5e-f107-45ff-af44-0b2f3f911102/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:39.574999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:39.575928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:39.584296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:39.595906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:39.596532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:39.599951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:39.600629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:39.601246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:39.948719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:39.950176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:39.968164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:39.970342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:39.970864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:39.972722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:39.975210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:39.975675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:40.210429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:40.221265 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea94297f-6566-48e7-8b19-da555f849b1c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.650052 Oct 31 15:25:40.223025 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1030/2204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:39 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:40.227320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:40.237622 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1d1cdda-16bf-4b3d-8198-425fac94864d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1274 microversion: 2.1 time: 0.291572 Oct 31 15:25:40.252991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:40.253653 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1175/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:39 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1274 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:40.253772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:40.287943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.291190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.291653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:40.294512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.295002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.295517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:40.380745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:40.381718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:40.396559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.397499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.398132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:40.399102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.399989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.401431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:40.883574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:40.908725 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-37fe5635-af54-4598-a63f-503a476a156c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.661641 Oct 31 15:25:40.911312 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1031/2206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:40 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:40.940877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:40.943075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:40.957981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.958168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.958605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:40.959322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:40.959803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:40.960218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:41.021650 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Cannot 'restore' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action HTTP/1.1 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 15 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: {"restore": {}} Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: exception: Cannot 'restore' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65', 'body': {'restore': {}}} Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 in vm_state active. Cannot restore while the instance is in this state. Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:41.025757 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:41.030246 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:41.030246 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:41.030246 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:41.030246 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:25:41.030246 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:41.033703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 409 to user: Cannot 'restore' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:41.034961 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d09860e3-c8f5-406c-b8b4-26196750ad7a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 409 len: 145 microversion: 2.1 time: 0.101583 Oct 31 15:25:41.038316 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1032/2207] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:40 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 145 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:25:41.052018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:41.052989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:41.065964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:41.068315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:41.068931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:41.071148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:41.073357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:41.073970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:41.080401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:41.125295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:41.129430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:41.134139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05fb9348-f81d-4e90-b6af-3f5b0fc005e4 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.757629 Oct 31 15:25:41.136925 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1176/2208] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:40 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:25:41.264502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:41.265890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:41.274371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:41.275042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:41.276097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:41.292341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:41.294819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:41.296376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:42.247469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:42.255251 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d6a718f-736b-49f2-bb21-d15aba07a88d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 1.212580 Oct 31 15:25:42.255837 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1033/2209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:41 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:42.267728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:42.284479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:42.306871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:42.307399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:42.311159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:42.314197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:42.314712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:42.320506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:42.590894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:42.600931 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-06e85cf1-b6d4-452b-8c91-1ac9b0c815eb tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1316 microversion: 2.1 time: 1.340890 Oct 31 15:25:42.606143 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1177/2210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:41 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1316 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:42.618835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:42.619633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:42.638367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:42.639536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:42.640239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:42.642765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:42.643798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:42.644745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:42.912167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:42.955751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:42.971822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:42.978144 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0aec577-35b0-4396-ae8e-a55351337efc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1814 microversion: 2.25 time: 0.716064 Oct 31 15:25:42.980059 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1034/2211] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:42 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1814 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:43.178203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:43.187101 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6a13506b-766b-4464-b63f-0a921fcddd2c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.579767 Oct 31 15:25:43.191751 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1178/2212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:42 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:43.216143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1ad6617-c1c7-42f3-93e5-68f83fbfdb7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:43.217540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e1ad6617-c1c7-42f3-93e5-68f83fbfdb7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 9ed9f5db-446e-48d7-ae47-107f8b6f810f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:43.226510 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-e1ad6617-c1c7-42f3-93e5-68f83fbfdb7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 9ed9f5db-446e-48d7-ae47-107f8b6f810f could not be found. Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1ad6617-c1c7-42f3-93e5-68f83fbfdb7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/9ed9f5db-446e-48d7-ae47-107f8b6f810f/action HTTP/1.1 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 14 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: {"resume": {}} Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9ed9f5db-446e-48d7-ae47-107f8b6f810f could not be found. Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9ed9f5db-446e-48d7-ae47-107f8b6f810f', 'body': {'resume': {}}} Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed9f5db-446e-48d7-ae47-107f8b6f810f could not be found. Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed9f5db-446e-48d7-ae47-107f8b6f810f could not be found. Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:43.235163 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:43.239275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:43.239275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:43.239275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed9f5db-446e-48d7-ae47-107f8b6f810f could not be found. Oct 31 15:25:43.239275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:43.244153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1ad6617-c1c7-42f3-93e5-68f83fbfdb7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 9ed9f5db-446e-48d7-ae47-107f8b6f810f could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:43.245701 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e1ad6617-c1c7-42f3-93e5-68f83fbfdb7c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/9ed9f5db-446e-48d7-ae47-107f8b6f810f/action" status: 404 len: 111 microversion: 2.1 time: 0.034160 Oct 31 15:25:43.256797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:43.258043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:43.263136 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1035/2213] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:43 2022] POST /compute/v2.1/servers/9ed9f5db-446e-48d7-ae47-107f8b6f810f/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:43.267237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:43.267964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:43.268639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:43.281338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:43.283466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:43.285297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:43.634037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:43.636091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:43.647567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:43.648789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:43.650601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:43.651690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:43.652484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:43.653890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:43.869415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:43.883477 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2b40cc2-5b60-4c39-98cb-dab8a78426f9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.632285 Oct 31 15:25:43.884364 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1179/2214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:43 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:43.911822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:43.912640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:43.930437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:43.930852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:43.934070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:43.936118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:43.936970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:43.939300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:44.078596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:44.096400 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e513ed3-54ee-4876-ad0b-c544c5b9bfb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1316 microversion: 2.1 time: 0.468565 Oct 31 15:25:44.116554 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1036/2215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:43 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:44.126484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:44.127110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:44.137716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:44.138517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:44.139306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:44.140341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:44.141744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:44.142436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:44.489938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:44.510450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:44.511898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:44.513158 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7566a8e0-cee0-4623-a164-c5bb181d757d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1804 microversion: 2.25 time: 0.394798 Oct 31 15:25:44.513868 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1037/2216] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:44 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1804 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:44.546257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a5d3a4ec-a6a8-4b77-877e-700a553b36ee req-6fa7c5e7-0772-46ff-9dce-b5f62fa60bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7346a65d-a674-41d1-a272-4102c41ae7e3", "tag": "6db2cbfb-2489-4798-a5f8-91df8d4226e3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:44.599300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a5d3a4ec-a6a8-4b77-877e-700a553b36ee req-6fa7c5e7-0772-46ff-9dce-b5f62fa60bd5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:44.599622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a5d3a4ec-a6a8-4b77-877e-700a553b36ee req-6fa7c5e7-0772-46ff-9dce-b5f62fa60bd5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:44.600065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a5d3a4ec-a6a8-4b77-877e-700a553b36ee req-6fa7c5e7-0772-46ff-9dce-b5f62fa60bd5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:44.636397 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a5d3a4ec-a6a8-4b77-877e-700a553b36ee req-6fa7c5e7-0772-46ff-9dce-b5f62fa60bd5 service nova] Creating event network-changed:6db2cbfb-2489-4798-a5f8-91df8d4226e3 for instance 7346a65d-a674-41d1-a272-4102c41ae7e3 on n-h1-858384-17 Oct 31 15:25:44.643058 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a5d3a4ec-a6a8-4b77-877e-700a553b36ee req-6fa7c5e7-0772-46ff-9dce-b5f62fa60bd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100248 Oct 31 15:25:44.646088 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1038/2217] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:44.934985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73f26769-49da-4461-8e3c-73771ec7c342 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Calling method '.version_select at 0x7f16e57a71f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:44.940515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:44.965845 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-767fe42c-69da-41db-ae24-54f0b7c5eef1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 1.057974 Oct 31 15:25:44.966445 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1180/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:43 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:44.974026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-63ccbaf4-1791-4e56-a54c-cea858867254 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '.version_select at 0x7f16e0cb8700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:44.981936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63ccbaf4-1791-4e56-a54c-cea858867254 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:44.982624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63ccbaf4-1791-4e56-a54c-cea858867254 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:44.983229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63ccbaf4-1791-4e56-a54c-cea858867254 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.022707 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-63ccbaf4-1791-4e56-a54c-cea858867254 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1532 microversion: 2.25 time: 0.050061 Oct 31 15:25:45.024960 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1181/2219] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Oct 31 15:25:44 2022] GET /compute/v2.1/os-migrations => generated 1532 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:45.034788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:45.051122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:45.074962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.075648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.076794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.080897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.081755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.083806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.116319 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73f26769-49da-4461-8e3c-73771ec7c342 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 200 len: 371 microversion: 2.1 time: 0.468261 Oct 31 15:25:45.121303 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1039/2220] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:25:44 2022] GET /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 371 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:45.130346 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Cannot 'resume' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action HTTP/1.1 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 14 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: {"resume": {}} Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: exception: Cannot 'resume' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65', 'body': {'resume': {}}} Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 in vm_state active. Cannot resume while the instance is in this state. Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:45.132441 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:45.136601 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:45.136601 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:45.136601 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:45.136601 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:45.136601 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:45.136601 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:25:45.136601 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:45.138434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:45.138542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 409 to user: Cannot 'resume' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:45.139362 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5d990b9-7167-4796-83d4-10ca43c5bb58 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 409 len: 144 microversion: 2.1 time: 0.112811 Oct 31 15:25:45.141851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:45.145748 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1182/2221] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:45 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 144 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:25:45.163490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:45.164280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:45.167694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.168194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.168637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.169407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.177699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.179390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.179818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.180496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.182502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.183428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.202970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.203601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.539258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid 0ace9f23-0d08-4d3b-8c64-dd82142559be {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:25:45.571194 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06bffba6-70a3-4799-a5ae-fbbedaec68ef tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 2425 microversion: 2.25 time: 0.445950 Oct 31 15:25:45.593222 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1040/2222] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:45 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 2425 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:45.599169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea667fc7-37a4-45ed-9ab1-97f8f9cc2cc6 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Action: 'update', calling method: .version_select at 0x7f16e5762430>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:45.731652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea667fc7-37a4-45ed-9ab1-97f8f9cc2cc6 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.732525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea667fc7-37a4-45ed-9ab1-97f8f9cc2cc6 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.737316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea667fc7-37a4-45ed-9ab1-97f8f9cc2cc6 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.738675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea667fc7-37a4-45ed-9ab1-97f8f9cc2cc6 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.742087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea667fc7-37a4-45ed-9ab1-97f8f9cc2cc6 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.746348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea667fc7-37a4-45ed-9ab1-97f8f9cc2cc6 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.856562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:45.889600 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a1e68fa2-34dc-4512-96ad-9426608d38ca tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1316 microversion: 2.1 time: 0.741405 Oct 31 15:25:45.893802 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1183/2223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:45 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1316 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:45.899739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:45.915519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:45.916580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:45.923448 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea667fc7-37a4-45ed-9ab1-97f8f9cc2cc6 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 200 len: 328 microversion: 2.1 time: 0.326225 Oct 31 15:25:45.924349 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1041/2224] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:25:45 2022] PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 328 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:45.935241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:45.937785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:45.953897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.957607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.960868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.961815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.962303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.964735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.974680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.977916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.980747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:45.983255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:45.986092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:45.987091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:46.415049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid 0ace9f23-0d08-4d3b-8c64-dd82142559be {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:25:46.433420 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b230896a-81ac-4e40-a6ee-0026062233b3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 2425 microversion: 2.25 time: 0.507145 Oct 31 15:25:46.450240 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1042/2225] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:25:45 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 2425 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:25:46.558628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:46.578864 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b55543e1-488f-4e23-a829-6d0779b8c043 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.681214 Oct 31 15:25:46.579463 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1184/2226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:45 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:46.584952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:46.589075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:46.605704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1941019669", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:46.606788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:46.609529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:46.610008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:46.610754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:46.611227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:46.611659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:46.704622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:46.887875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lazy-loading 'services' on Instance uuid 0ace9f23-0d08-4d3b-8c64-dd82142559be {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:25:47.016162 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1682bff-6d8d-4cf7-8ff4-4cd440209d8e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments/f564928f-1801-477d-976a-b470047f1747" status: 202 len: 0 microversion: 2.25 time: 0.434635 Oct 31 15:25:47.029681 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1185/2227] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Oct 31 15:25:46 2022] DELETE /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments/f564928f-1801-477d-976a-b470047f1747 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:47.040808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:47.042022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:47.051117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.052481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.053649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.060174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.061198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.061848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.250272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:47.250697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:47.251171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:47.251759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:47.252326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:47.267835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.268618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.271107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.272134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.274819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.275461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.309641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Getting quotas for project e829599ff3974af499f63f0094642e99. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:47.315659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Getting quotas for user 1f53e61699424ceeae8cd3a03ad3e30b and project e829599ff3974af499f63f0094642e99. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:47.332324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.utils [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] cores quota exceeded for e829599ff3974af499f63f0094642e99, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120588) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 31 15:25:47.333598 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Request method failure captured: Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 145 Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-j2JtCesZflO2O9e6lkHrWOGfLw5VbGYoDtJpGPKmwN2UvEQnQAnMzV5hVr_WM_JbjaYdZkK-x2pDkVfoFlTcvNXBgnHDfQZcPwitAT7OMu5x5Tt4-k6xcca8mPUyWsm_Cf8KTKlRCMP4gk224JpdkYyXERgJCQCvW0YYFbJ6yWaDA Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: e829599ff3974af499f63f0094642e99 Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e829599ff3974af499f63f0094642e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e829599ff3974af499f63f0094642e99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e829599ff3974af499f63f0094642e99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e829599ff3974af499f63f0094642e99"}]}] Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: e829599ff3974af499f63f0094642e99 Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-QuotasAdminNegativeTest-1032160504-project Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 1f53e61699424ceeae8cd3a03ad3e30b Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-QuotasAdminNegativeTest-1032160504-project Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1941019669", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1941019669', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452'}}} Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:25:47.349365 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 31 15:25:47.353530 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.358240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:47.360037 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3be370b0-027d-4bc5-86e4-d6d5dd84ad6d tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.908534 Oct 31 15:25:47.367627 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1043/2228] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:46 2022] POST /compute/v2.1/servers => generated 111 bytes in 917 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:47.375114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:47.376159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:47.388945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.389646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.390156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.391177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.391842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.399136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.657635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:47.682591 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8a000a3c-9840-4b08-bf31-ce332254c60b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1316 microversion: 2.1 time: 0.312516 Oct 31 15:25:47.683626 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1044/2229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:47 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:47.690406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43ae5d82-36cc-4af4-9c93-f8851ce6f186 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:47.694338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-43ae5d82-36cc-4af4-9c93-f8851ce6f186 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:47.702048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ae5d82-36cc-4af4-9c93-f8851ce6f186 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.702802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ae5d82-36cc-4af4-9c93-f8851ce6f186 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.703565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ae5d82-36cc-4af4-9c93-f8851ce6f186 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.704435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ae5d82-36cc-4af4-9c93-f8851ce6f186 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.705462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ae5d82-36cc-4af4-9c93-f8851ce6f186 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.706225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ae5d82-36cc-4af4-9c93-f8851ce6f186 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.729838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:47.744520 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69a8f395-1340-42ce-b029-eebf190553e8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.712515 Oct 31 15:25:47.745146 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1186/2230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:47 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:47.783664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-31d930e9-5e3f-49eb-ad14-4bbcb1331cbe tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0ceb280>, body: {"quota_set": {"cores": 20}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:47.793972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43ae5d82-36cc-4af4-9c93-f8851ce6f186 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.104049 Oct 31 15:25:47.795593 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1045/2231] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:25:47 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:25:47.957545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-55aabe75-1349-439c-95d0-6d089285e221 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-55aabe75-1349-439c-95d0-6d089285e221 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 160 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "ab7e23b0-155e-4226-9a15-6e50ea9a0142"}]}} Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': '', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'networks': [{'uuid': 'ab7e23b0-155e-4226-9a15-6e50ea9a0142'}]}}} Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '' Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:25:47.968686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:47.972285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-55aabe75-1349-439c-95d0-6d089285e221 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:47.974530 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-55aabe75-1349-439c-95d0-6d089285e221 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.026385 Oct 31 15:25:47.975311 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1046/2232] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:47 2022] POST /compute/v2.1/servers => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:25:47.976342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31d930e9-5e3f-49eb-ad14-4bbcb1331cbe tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.976842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31d930e9-5e3f-49eb-ad14-4bbcb1331cbe tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.977367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31d930e9-5e3f-49eb-ad14-4bbcb1331cbe tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.978064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31d930e9-5e3f-49eb-ad14-4bbcb1331cbe tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:47.986561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31d930e9-5e3f-49eb-ad14-4bbcb1331cbe tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:47.987351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31d930e9-5e3f-49eb-ad14-4bbcb1331cbe tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:47.995330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:47.995959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:48.036863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.044218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.047957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.049668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.050332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.050778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.217708 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-31d930e9-5e3f-49eb-ad14-4bbcb1331cbe tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 200 len: 329 microversion: 2.1 time: 0.463036 Oct 31 15:25:48.230017 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1187/2233] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:25:47 2022] PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 329 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:48.234856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6666d79f-ba3b-4fe2-816a-cbed1afca8ec tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Calling method '.version_select at 0x7f16e0d159d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:48.323493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:48.325707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:48.339691 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13bb500a-11c9-4678-9267-af3f598223d0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.358134 Oct 31 15:25:48.340748 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1047/2234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:47 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:48.366914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:48.367623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:48.377560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.380115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.380622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.382644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.383136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.383570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.400812 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6666d79f-ba3b-4fe2-816a-cbed1afca8ec tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 200 len: 371 microversion: 2.1 time: 0.169510 Oct 31 15:25:48.409583 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1188/2235] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:25:48 2022] GET /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:48.437008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d44e251-cbe2-4815-91fa-bfe11317b371 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0d15160>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:48.635235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:48.644433 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-530cccee-8233-417a-b032-eb6a2342bb97 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.282372 Oct 31 15:25:48.645666 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1048/2236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:48 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:48.651376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d44e251-cbe2-4815-91fa-bfe11317b371 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.652017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d44e251-cbe2-4815-91fa-bfe11317b371 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.655842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d44e251-cbe2-4815-91fa-bfe11317b371 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.658916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d44e251-cbe2-4815-91fa-bfe11317b371 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.660375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d44e251-cbe2-4815-91fa-bfe11317b371 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.660375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d44e251-cbe2-4815-91fa-bfe11317b371 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.662254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:48.663317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:48.682300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.682989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.686009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.687903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.688984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.689759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.758141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:25:48.826712 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d44e251-cbe2-4815-91fa-bfe11317b371 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 200 len: 328 microversion: 2.1 time: 0.415227 Oct 31 15:25:48.856200 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1189/2237] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:25:48 2022] PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 328 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:48.878376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e62cd48c-cb2d-4f9a-92de-6e055df494ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:48.878973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e62cd48c-cb2d-4f9a-92de-6e055df494ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f1e46a0c-36fe-4c90-b3e4-f9368854286c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:48.905716 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e62cd48c-cb2d-4f9a-92de-6e055df494ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance f1e46a0c-36fe-4c90-b3e4-f9368854286c could not be found. Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e62cd48c-cb2d-4f9a-92de-6e055df494ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/f1e46a0c-36fe-4c90-b3e4-f9368854286c/action HTTP/1.1 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 14 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: {"shelve": {}} Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f1e46a0c-36fe-4c90-b3e4-f9368854286c could not be found. Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f1e46a0c-36fe-4c90-b3e4-f9368854286c', 'body': {'shelve': {}}} Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1e46a0c-36fe-4c90-b3e4-f9368854286c could not be found. Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1e46a0c-36fe-4c90-b3e4-f9368854286c could not be found. Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:48.921633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:48.925063 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:48.925063 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:48.925063 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1e46a0c-36fe-4c90-b3e4-f9368854286c could not be found. Oct 31 15:25:48.925063 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:48.925063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e62cd48c-cb2d-4f9a-92de-6e055df494ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance f1e46a0c-36fe-4c90-b3e4-f9368854286c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:48.927337 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e62cd48c-cb2d-4f9a-92de-6e055df494ea tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f1e46a0c-36fe-4c90-b3e4-f9368854286c/action" status: 404 len: 111 microversion: 2.1 time: 0.067614 Oct 31 15:25:48.931393 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1190/2238] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:48 2022] POST /compute/v2.1/servers/f1e46a0c-36fe-4c90-b3e4-f9368854286c/action => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:48.946686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:48.949546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:48.971248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.972907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.974942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.976615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:48.976755 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e94d257-3a8e-488c-a01d-873ac092d361 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 204 len: 0 microversion: 2.1 time: 0.329373 Oct 31 15:25:48.982735 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1049/2239] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:25:48 2022] DELETE /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:25:48.982882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:48.983176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:48.992243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca8c8fe3-283c-48ce-b21c-af17390df164 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:48.994761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca8c8fe3-283c-48ce-b21c-af17390df164 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:49.004362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fe3-283c-48ce-b21c-af17390df164 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.006583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fe3-283c-48ce-b21c-af17390df164 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.007498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fe3-283c-48ce-b21c-af17390df164 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.009968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fe3-283c-48ce-b21c-af17390df164 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.010758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fe3-283c-48ce-b21c-af17390df164 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.011597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fe3-283c-48ce-b21c-af17390df164 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.072297 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca8c8fe3-283c-48ce-b21c-af17390df164 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.090723 Oct 31 15:25:49.077121 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1050/2240] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:25:48 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:25:49.100160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:49.101979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:49.108769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.110854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.113544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.114838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.117288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.120029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.353532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:49.364391 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ceaba366-5506-4aeb-ad8a-29858ec55838 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.288834 Oct 31 15:25:49.365975 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1051/2241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:49 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:49.388286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-938350032", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:49.463213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:49.466171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:49.476481 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba2440dc-054e-4c73-87b8-8a6380a4bbdf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1316 microversion: 2.1 time: 0.541876 Oct 31 15:25:49.485706 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1191/2242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:48 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:49.492964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:49.494201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:49.503418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.504097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.505496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.506572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.507170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.507911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.794272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:49.795216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:49.795833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:49.796384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:49.798330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:49.821090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.821873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.822614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.823635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.824346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.825610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.862642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Getting quotas for project e829599ff3974af499f63f0094642e99. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:49.896703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Getting quotas for user 1f53e61699424ceeae8cd3a03ad3e30b and project e829599ff3974af499f63f0094642e99. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:49.922438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.utils [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] instances quota exceeded for e829599ff3974af499f63f0094642e99, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120588) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 31 15:25:49.927388 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Request method failure captured: Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 144 Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-j2JtCesZflO2O9e6lkHrWOGfLw5VbGYoDtJpGPKmwN2UvEQnQAnMzV5hVr_WM_JbjaYdZkK-x2pDkVfoFlTcvNXBgnHDfQZcPwitAT7OMu5x5Tt4-k6xcca8mPUyWsm_Cf8KTKlRCMP4gk224JpdkYyXERgJCQCvW0YYFbJ6yWaDA Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: e829599ff3974af499f63f0094642e99 Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e829599ff3974af499f63f0094642e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e829599ff3974af499f63f0094642e99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e829599ff3974af499f63f0094642e99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e829599ff3974af499f63f0094642e99"}]}] Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: e829599ff3974af499f63f0094642e99 Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-QuotasAdminNegativeTest-1032160504-project Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 1f53e61699424ceeae8cd3a03ad3e30b Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-QuotasAdminNegativeTest-1032160504-project Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-938350032", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-938350032', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452'}}} Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:25:49.933605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:25:49.937720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:49.940149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:49.940251 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-febd6d07-0093-4178-b479-c3886a2d5d07 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.567563 Oct 31 15:25:49.944505 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1052/2243] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:49 2022] POST /compute/v2.1/servers => generated 119 bytes in 575 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:49.949643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:49.949833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-678bc0ce-d2a3-4536-a892-04f08eec4897 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1553 microversion: 2.1 time: 0.462567 Oct 31 15:25:49.950769 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1192/2244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:49 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1553 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:49.952685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:49.960775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b663e216-6396-4a6a-8c4f-4397fa021c59 req-f936a9d3-597d-4ccc-96dd-63b60e0212d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7346a65d-a674-41d1-a272-4102c41ae7e3", "name": "network-vif-plugged", "status": "completed", "tag": "6db2cbfb-2489-4798-a5f8-91df8d4226e3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:49.978542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.979069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.979505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.980232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.980703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.981416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:49.982040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b663e216-6396-4a6a-8c4f-4397fa021c59 req-f936a9d3-597d-4ccc-96dd-63b60e0212d5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:49.985526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b663e216-6396-4a6a-8c4f-4397fa021c59 req-f936a9d3-597d-4ccc-96dd-63b60e0212d5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:49.986155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b663e216-6396-4a6a-8c4f-4397fa021c59 req-f936a9d3-597d-4ccc-96dd-63b60e0212d5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.017792 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b663e216-6396-4a6a-8c4f-4397fa021c59 req-f936a9d3-597d-4ccc-96dd-63b60e0212d5 service nova] Creating event network-vif-plugged:6db2cbfb-2489-4798-a5f8-91df8d4226e3 for instance 7346a65d-a674-41d1-a272-4102c41ae7e3 on n-h1-858384-17 Oct 31 15:25:50.031912 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b663e216-6396-4a6a-8c4f-4397fa021c59 req-f936a9d3-597d-4ccc-96dd-63b60e0212d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079797 Oct 31 15:25:50.036142 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1193/2245] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:50.160642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24f45e05-70a1-4f69-8426-eb8414196257 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Action: 'create', calling method: .version_select at 0x7f16e0cd4ee0>, body: {"keypair": {"name": "tempest-keypair-152920860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNADlUauMvOXOKk8AZ34qT/aBJWN9a5am5K8lRKQUy6j4836HTrALeJqPZROHUfLj+/4j64URqnCyOogsSnfenvFqcrFP8kplk6BNJkhTtMD0/pvujtILF2uePmCelE1Eg=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:50.221204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-24f45e05-70a1-4f69-8426-eb8414196257 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Getting quotas for project e2393b8d8a3d4286be27881c980ffb48. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:50.245600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-24f45e05-70a1-4f69-8426-eb8414196257 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Getting quotas for user 6ea9e26278be42a191b6860b806d70ec and project e2393b8d8a3d4286be27881c980ffb48. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:50.316616 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24f45e05-70a1-4f69-8426-eb8414196257 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.278439 Oct 31 15:25:50.318825 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1194/2246] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:25:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:50.325392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f99656d0-87b5-4583-bea7-c94ecd6dfc0d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0d11940>, body: {"quota_set": {"instances": 10}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:50.347751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:50.383726 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0993f35b-a298-4395-a2d2-c62426aeed45 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.437793 Oct 31 15:25:50.388224 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1053/2247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:49 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:50.487670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99656d0-87b5-4583-bea7-c94ecd6dfc0d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.490276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99656d0-87b5-4583-bea7-c94ecd6dfc0d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.494773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99656d0-87b5-4583-bea7-c94ecd6dfc0d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.497326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99656d0-87b5-4583-bea7-c94ecd6dfc0d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.500404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99656d0-87b5-4583-bea7-c94ecd6dfc0d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.503315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99656d0-87b5-4583-bea7-c94ecd6dfc0d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.620698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:50.674947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-55021264-1b58-4148-b498-0a5badd1c81b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:50.679212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-55021264-1b58-4148-b498-0a5badd1c81b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:50.684753 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f99656d0-87b5-4583-bea7-c94ecd6dfc0d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 200 len: 329 microversion: 2.1 time: 0.364045 Oct 31 15:25:50.689893 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1195/2248] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:25:50 2022] PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 329 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:50.697258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55021264-1b58-4148-b498-0a5badd1c81b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.706002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55021264-1b58-4148-b498-0a5badd1c81b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.706470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55021264-1b58-4148-b498-0a5badd1c81b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.707219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55021264-1b58-4148-b498-0a5badd1c81b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.707722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55021264-1b58-4148-b498-0a5badd1c81b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.708292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55021264-1b58-4148-b498-0a5badd1c81b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.712306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:50.712974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:50.726851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.727349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.727784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.728493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.728942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.745909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.750393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:25:50.810275 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-55021264-1b58-4148-b498-0a5badd1c81b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.420318 Oct 31 15:25:50.810878 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1054/2249] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:25:50 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments => generated 197 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:25:50.825569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:50.826115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:50.831953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lazy-loading 'flavor' on Instance uuid f4faf82e-33b1-482e-a400-e57ebf462f65 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:25:50.849711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.850219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.850670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:50.851381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:50.851840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:50.861886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.357097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:51.374452 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-225398fc-d270-46d9-9ae2-b1a6dd7d803a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1316 microversion: 2.1 time: 0.562409 Oct 31 15:25:51.375109 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1055/2250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:50 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:51.392302 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-56c7d22e-b2c4-443d-abd8-905f19d247ee tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 202 len: 0 microversion: 2.1 time: 0.699755 Oct 31 15:25:51.392556 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1196/2251] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:50 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:51.400734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:51.406909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f75a8262-e286-4859-b594-a05e417a6125 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Calling method '.version_select at 0x7f16e5741ee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:51.416337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:51.441893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.452352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.453040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.455869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.459754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.465109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.580594 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f75a8262-e286-4859-b594-a05e417a6125 tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 200 len: 371 microversion: 2.1 time: 0.174423 Oct 31 15:25:51.581712 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1056/2252] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:25:51 2022] GET /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:51.594147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:51.595095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:51.613603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.615311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.616004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.617672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.618552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.619196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.791139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:51.800357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dda2676c-3814-4e52-92cd-5a57b96068d7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1553 microversion: 2.1 time: 0.406505 Oct 31 15:25:51.813955 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1197/2253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:51 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1553 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:51.820892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2dc88249-f626-4763-b804-858150ecb83b tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0cd43a0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:51.980669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc88249-f626-4763-b804-858150ecb83b tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.981187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc88249-f626-4763-b804-858150ecb83b tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.981628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc88249-f626-4763-b804-858150ecb83b tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:51.982354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc88249-f626-4763-b804-858150ecb83b tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:51.985761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc88249-f626-4763-b804-858150ecb83b tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:51.993894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc88249-f626-4763-b804-858150ecb83b tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.101921 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2dc88249-f626-4763-b804-858150ecb83b tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 200 len: 325 microversion: 2.1 time: 0.286494 Oct 31 15:25:52.115255 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1198/2254] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:25:51 2022] PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:52.125204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-12c11f50-7c95-4378-86eb-3076700f075c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:52.127956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-12c11f50-7c95-4378-86eb-3076700f075c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:52.149252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c11f50-7c95-4378-86eb-3076700f075c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.149995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c11f50-7c95-4378-86eb-3076700f075c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.150807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c11f50-7c95-4378-86eb-3076700f075c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.151761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c11f50-7c95-4378-86eb-3076700f075c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.152372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c11f50-7c95-4378-86eb-3076700f075c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.153081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c11f50-7c95-4378-86eb-3076700f075c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.234544 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-12c11f50-7c95-4378-86eb-3076700f075c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117944 Oct 31 15:25:52.235399 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1199/2255] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:25:52 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:25:52.241276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-566927029", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:52.298974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:52.309161 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d881bd0-cdb0-4fde-b8fc-b577ea58ded4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1510 microversion: 2.1 time: 0.718865 Oct 31 15:25:52.321955 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1057/2256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:51 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1510 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:52.371936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:52.399461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:52.400644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:52.414769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.419199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.419894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.421163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.421905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.422566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.734815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:25:52.735425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:25:52.736054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:25:52.736628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:25:52.737249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:25:52.756957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.759830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.760306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.761269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.761690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.762113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.810381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Getting quotas for project e829599ff3974af499f63f0094642e99. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:52.825073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Getting quotas for user 1f53e61699424ceeae8cd3a03ad3e30b and project e829599ff3974af499f63f0094642e99. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:52.856565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.utils [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] ram quota exceeded for e829599ff3974af499f63f0094642e99, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120587) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 31 15:25:52.857782 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Request method failure captured: Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 144 Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-j2JtCesZflO2O9e6lkHrWOGfLw5VbGYoDtJpGPKmwN2UvEQnQAnMzV5hVr_WM_JbjaYdZkK-x2pDkVfoFlTcvNXBgnHDfQZcPwitAT7OMu5x5Tt4-k6xcca8mPUyWsm_Cf8KTKlRCMP4gk224JpdkYyXERgJCQCvW0YYFbJ6yWaDA Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: e829599ff3974af499f63f0094642e99 Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e829599ff3974af499f63f0094642e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e829599ff3974af499f63f0094642e99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e829599ff3974af499f63f0094642e99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e829599ff3974af499f63f0094642e99"}]}] Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: e829599ff3974af499f63f0094642e99 Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-QuotasAdminNegativeTest-1032160504-project Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1f53e61699424ceeae8cd3a03ad3e30b Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-QuotasAdminNegativeTest-1032160504-project Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-566927029", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-566927029', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452'}}} Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 31 15:25:52.863997 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 31 15:25:52.868159 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:52.876607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:52.877748 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10ac3bca-70e5-449e-869f-2c3cb170c1c0 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.641205 Oct 31 15:25:52.879432 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1200/2257] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:52 2022] POST /compute/v2.1/servers => generated 110 bytes in 643 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:52.890574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:52.891696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:52.902129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.903287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.903910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:52.904807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:52.905552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:52.906153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.015210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:53.025645 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e946295-9cd4-4706-b707-e0a6310f4191 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1511 microversion: 2.1 time: 0.143883 Oct 31 15:25:53.026235 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1201/2258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:52 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1511 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:53.049077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1101152a-7147-4fac-9410-21429b377c3d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0cb8160>, body: {"quota_set": {"ram": 51200}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:53.059411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:53.081934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d4e3abf-e359-4bd5-95b0-c5aa64ece2fc tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1505 microversion: 2.1 time: 0.683641 Oct 31 15:25:53.085238 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1058/2259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:52 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:25:53.095356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9920c462-c052-4288-a3af-8a2ff485ad35 req-5c39e929-4a72-4f91-96f5-3ae5c0f27191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129edccf-8357-446b-9c1b-13c2fc7c5f0d", "name": "network-vif-deleted", "tag": "97fa87f2-e548-476e-90bc-605645bab3a9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:53.127891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9920c462-c052-4288-a3af-8a2ff485ad35 req-5c39e929-4a72-4f91-96f5-3ae5c0f27191 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.128378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9920c462-c052-4288-a3af-8a2ff485ad35 req-5c39e929-4a72-4f91-96f5-3ae5c0f27191 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.128807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9920c462-c052-4288-a3af-8a2ff485ad35 req-5c39e929-4a72-4f91-96f5-3ae5c0f27191 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.159435 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9920c462-c052-4288-a3af-8a2ff485ad35 req-5c39e929-4a72-4f91-96f5-3ae5c0f27191 service nova] Creating event network-vif-deleted:97fa87f2-e548-476e-90bc-605645bab3a9 for instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d on n-h2-858384-17 Oct 31 15:25:53.173060 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9920c462-c052-4288-a3af-8a2ff485ad35 req-5c39e929-4a72-4f91-96f5-3ae5c0f27191 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086002 Oct 31 15:25:53.175594 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1059/2260] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:53.188874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1534172799"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:53.189541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:53.191352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1101152a-7147-4fac-9410-21429b377c3d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.201796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1101152a-7147-4fac-9410-21429b377c3d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.202575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1101152a-7147-4fac-9410-21429b377c3d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.203582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1101152a-7147-4fac-9410-21429b377c3d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.205171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.205683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.206101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1101152a-7147-4fac-9410-21429b377c3d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.206211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.206826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.207285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.207730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1101152a-7147-4fac-9410-21429b377c3d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.207838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.460829 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1101152a-7147-4fac-9410-21429b377c3d tempest-QuotasAdminNegativeTest-637127719 tempest-QuotasAdminNegativeTest-637127719-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 200 len: 329 microversion: 2.1 time: 0.415255 Oct 31 15:25:53.463304 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1202/2261] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:25:53 2022] PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 329 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:53.476794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ac69873-e3c3-4e39-ae83-ca1c6b05fa0b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:53.483239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ac69873-e3c3-4e39-ae83-ca1c6b05fa0b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:53.503097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ac69873-e3c3-4e39-ae83-ca1c6b05fa0b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.505486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ac69873-e3c3-4e39-ae83-ca1c6b05fa0b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.507745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ac69873-e3c3-4e39-ae83-ca1c6b05fa0b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.511310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ac69873-e3c3-4e39-ae83-ca1c6b05fa0b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.513412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ac69873-e3c3-4e39-ae83-ca1c6b05fa0b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.514187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ac69873-e3c3-4e39-ae83-ca1c6b05fa0b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.597888 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ac69873-e3c3-4e39-ae83-ca1c6b05fa0b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.133232 Oct 31 15:25:53.606021 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1203/2262] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:25:53 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:25:53.619426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:53.620462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:53.644068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.644687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.645254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:53.646269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:53.646590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:53.647891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.226632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:54.260481 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11a71a9a-991f-4566-94b2-96aae856739c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1510 microversion: 2.1 time: 0.649577 Oct 31 15:25:54.266081 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1204/2263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:53 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1510 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:54.285384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05d6c55b-7cf6-439e-9cfd-a9a56bc937d3 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Action: 'update', calling method: .version_select at 0x7f16e0cb8670>, body: {"quota_set": {"ram": 0}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:54.294307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05d6c55b-7cf6-439e-9cfd-a9a56bc937d3 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '1f53e61699424ceeae8cd3a03ad3e30b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e829599ff3974af499f63f0094642e99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05d6c55b-7cf6-439e-9cfd-a9a56bc937d3 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Request method failure captured: Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 HTTP/1.1 Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 25 Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-j2JtCesZflO2O9e6lkHrWOGfLw5VbGYoDtJpGPKmwN2UvEQnQAnMzV5hVr_WM_JbjaYdZkK-x2pDkVfoFlTcvNXBgnHDfQZcPwitAT7OMu5x5Tt4-k6xcca8mPUyWsm_Cf8KTKlRCMP4gk224JpdkYyXERgJCQCvW0YYFbJ6yWaDA Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: e829599ff3974af499f63f0094642e99 Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e829599ff3974af499f63f0094642e99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e829599ff3974af499f63f0094642e99", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e829599ff3974af499f63f0094642e99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e829599ff3974af499f63f0094642e99"}]}] Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: e829599ff3974af499f63f0094642e99 Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1032160504 Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-QuotasAdminNegativeTest-1032160504-project Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1f53e61699424ceeae8cd3a03ad3e30b Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-QuotasAdminNegativeTest-1032160504-project Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: {"quota_set": {"ram": 0}} Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'e829599ff3974af499f63f0094642e99', 'body': {'quota_set': {'ram': 0}}} Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:25:54.301562 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 31 15:25:54.305347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:25:54.309297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05d6c55b-7cf6-439e-9cfd-a9a56bc937d3 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:25:54.310729 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05d6c55b-7cf6-439e-9cfd-a9a56bc937d3 tempest-QuotasAdminNegativeTest-1032160504 tempest-QuotasAdminNegativeTest-1032160504-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99" status: 403 len: 116 microversion: 2.1 time: 0.043118 Oct 31 15:25:54.311515 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1205/2264] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:25:54 2022] PUT /compute/v2.1/os-quota-sets/e829599ff3974af499f63f0094642e99 => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:25:54.317005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:54.327011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:54.345535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.351120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.353223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.358630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.359441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.360087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.390450 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.network.security_group_api [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Adding security group 7602e0fc-d15d-4936-a8c7-710b35143e55 to port 6db2cbfb-2489-4798-a5f8-91df8d4226e3 Oct 31 15:25:54.634166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:54.650392 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35ed06b1-615f-495a-ab84-aaa4877c08b7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1346 microversion: 2.1 time: 0.336975 Oct 31 15:25:54.652259 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1206/2265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:54 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1346 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:54.665764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f891e170-8bbe-4f5d-8dad-8e3e6428b931 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:54.672922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f891e170-8bbe-4f5d-8dad-8e3e6428b931 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:54.689930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f891e170-8bbe-4f5d-8dad-8e3e6428b931 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.693457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f891e170-8bbe-4f5d-8dad-8e3e6428b931 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.694382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f891e170-8bbe-4f5d-8dad-8e3e6428b931 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.696579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f891e170-8bbe-4f5d-8dad-8e3e6428b931 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:54.698424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f891e170-8bbe-4f5d-8dad-8e3e6428b931 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:54.700774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f891e170-8bbe-4f5d-8dad-8e3e6428b931 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:54.795744 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f891e170-8bbe-4f5d-8dad-8e3e6428b931 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140339 Oct 31 15:25:54.797008 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1207/2266] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:25:54 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:25:55.292946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:55.293894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:55.315371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:55.325858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:55.326308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:55.327065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:55.327519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:55.328154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:55.923095 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50827151-a04d-41eb-bb4a-e351c18decae tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3/action" status: 202 len: 0 microversion: 2.1 time: 2.746232 Oct 31 15:25:55.927761 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1060/2267] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:53 2022] POST /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3/action => generated 0 bytes in 2748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:55.930174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:55.932203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:55.954688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:55.957230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:55.959341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:55.960136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:55.960611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:55.963306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:56.399089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:56.413663 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3f4efca-63a5-4bee-ae27-f2e5f99aad30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1346 microversion: 2.1 time: 0.487456 Oct 31 15:25:56.417438 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1061/2268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:55 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1346 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:56.430633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3026bc8c-b9b7-4b1b-ab92-e41a5246f6c9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:56.436436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3026bc8c-b9b7-4b1b-ab92-e41a5246f6c9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:56.456777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3026bc8c-b9b7-4b1b-ab92-e41a5246f6c9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:56.459343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3026bc8c-b9b7-4b1b-ab92-e41a5246f6c9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:56.461960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3026bc8c-b9b7-4b1b-ab92-e41a5246f6c9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:56.463655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3026bc8c-b9b7-4b1b-ab92-e41a5246f6c9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:56.466866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3026bc8c-b9b7-4b1b-ab92-e41a5246f6c9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:56.467618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3026bc8c-b9b7-4b1b-ab92-e41a5246f6c9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:56.577765 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3026bc8c-b9b7-4b1b-ab92-e41a5246f6c9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.158827 Oct 31 15:25:56.585882 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1062/2269] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:25:56 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:25:56.591678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-505608363"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:56.593901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:56.611650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:56.613190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:56.617148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:56.618162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:56.620027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:56.622799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.058327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:57.068232 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-15a03359-25e7-410a-813b-6076f3033b4e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1510 microversion: 2.1 time: 1.779251 Oct 31 15:25:57.078090 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1208/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:55 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1510 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:57.095023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-87b9ce04-db5a-4efa-be2b-1cbb96a78e5f req-3a2f7bef-4cc9-4497-893e-9c1139e3d833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7346a65d-a674-41d1-a272-4102c41ae7e3", "tag": "6db2cbfb-2489-4798-a5f8-91df8d4226e3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:57.151455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-87b9ce04-db5a-4efa-be2b-1cbb96a78e5f req-3a2f7bef-4cc9-4497-893e-9c1139e3d833 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:57.156301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-87b9ce04-db5a-4efa-be2b-1cbb96a78e5f req-3a2f7bef-4cc9-4497-893e-9c1139e3d833 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:57.157052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-87b9ce04-db5a-4efa-be2b-1cbb96a78e5f req-3a2f7bef-4cc9-4497-893e-9c1139e3d833 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.189862 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-87b9ce04-db5a-4efa-be2b-1cbb96a78e5f req-3a2f7bef-4cc9-4497-893e-9c1139e3d833 service nova] Creating event network-changed:6db2cbfb-2489-4798-a5f8-91df8d4226e3 for instance 7346a65d-a674-41d1-a272-4102c41ae7e3 on n-h1-858384-17 Oct 31 15:25:57.198007 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-87b9ce04-db5a-4efa-be2b-1cbb96a78e5f req-3a2f7bef-4cc9-4497-893e-9c1139e3d833 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118306 Oct 31 15:25:57.200077 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1209/2271] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:25:57.442970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:57.444073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:57.458690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:57.459347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:57.467582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.468393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:57.468877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:57.469341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.713082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:57.719270 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.network.security_group_api [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Adding security group ea53016c-4352-4cd2-a02a-bf7a7d46bbfa to port 6db2cbfb-2489-4798-a5f8-91df8d4226e3 Oct 31 15:25:57.742607 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60ee9d74-1bd1-41eb-a272-68ecf91e0782 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1346 microversion: 2.1 time: 0.304371 Oct 31 15:25:57.745816 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1210/2272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:57 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1346 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:57.757770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49e075a2-d117-4363-8b8b-85f853211a15 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:57.764162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49e075a2-d117-4363-8b8b-85f853211a15 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:57.784212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e075a2-d117-4363-8b8b-85f853211a15 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:57.785286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e075a2-d117-4363-8b8b-85f853211a15 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:57.785936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e075a2-d117-4363-8b8b-85f853211a15 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.793576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e075a2-d117-4363-8b8b-85f853211a15 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:57.795638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e075a2-d117-4363-8b8b-85f853211a15 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:57.797460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49e075a2-d117-4363-8b8b-85f853211a15 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:57.878615 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49e075a2-d117-4363-8b8b-85f853211a15 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.131376 Oct 31 15:25:57.887428 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1211/2273] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:25:57 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be/os-volume_attachments => generated 25 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:57.925346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8a483cf-9412-4c70-900c-f72c8ff878f9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Action: 'create', calling method: .version_select at 0x7f16e0cb84c0>, body: {"keypair": {"name": "tempest-keypair-1023206213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN85JXe6DpwBYBiVopDYpuiTjHInadtLnxbB5ngHyZFjt1T83+RYYCt1f2+BlIOxi9Du5fo4S0CMWIPphWFKR2o61r1ziTTk6klnVo6eL8/yv7FMl5FnVmTm9qSjmilVPQ=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:57.983990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d8a483cf-9412-4c70-900c-f72c8ff878f9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Getting quotas for project 18ff0d809d824516a08568744e0ca176. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:25:58.009149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d8a483cf-9412-4c70-900c-f72c8ff878f9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Getting quotas for user 030780ff23d84175a364754b045c8083 and project 18ff0d809d824516a08568744e0ca176. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:25:58.081792 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8a483cf-9412-4c70-900c-f72c8ff878f9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.193038 Oct 31 15:25:58.087160 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1212/2274] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 31 15:25:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 196 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:25:58.110415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:58.111102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:58.119404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:58.119862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:58.120294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:58.127158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:58.128909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:58.133853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:58.851989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:58.869511 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cab86fde-e987-49f9-b1ff-a8519b1b4bb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1510 microversion: 2.1 time: 0.762374 Oct 31 15:25:58.889075 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1213/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:58 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1510 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:58.903742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:25:58.904787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:25:58.917857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:58.918649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:58.919980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:58.921156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:25:58.922485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:25:58.923190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:25:59.247580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:25:59.260490 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c3a5aaa-ec49-4d4f-8f07-ec16a85be2b0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1346 microversion: 2.1 time: 0.368590 Oct 31 15:25:59.262302 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1214/2276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:25:58 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1346 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:25:59.277663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "478e43b9-289a-4794-97cf-86745a96d4eb"}], "security_groups": [{"name": "tempest-securitygroup--1718431693"}], "key_name": "tempest-keypair-152920860", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:25:59.544144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] validate_networks() for [('478e43b9-289a-4794-97cf-86745a96d4eb', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:25:59.797093 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5dcb9e80-dacc-40bb-a669-b3442802fa29 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3/action" status: 202 len: 0 microversion: 2.1 time: 3.209120 Oct 31 15:25:59.799393 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1063/2277] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:25:56 2022] POST /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3/action => generated 0 bytes in 3213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:25:59.844508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:00.357086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:00.358258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:00.358750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:00.359161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:00.359570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:00.376956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:00.378124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:00.379502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:00.381119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:00.385435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:00.386594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:00.423655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Getting quotas for project e2393b8d8a3d4286be27881c980ffb48. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:00.432080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Getting quotas for user 6ea9e26278be42a191b6860b806d70ec and project e2393b8d8a3d4286be27881c980ffb48. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:00.436687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:00.465904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:00.470331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:00.478675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1647400296", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "e4acf0f5-75a5-4ae0-8df4-15424026288f"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:00.600127 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7fb8622f-71a3-4ed6-a085-99b6fac36679 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.336588 Oct 31 15:26:00.611352 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1215/2278] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:26:00.611531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] validate_networks() for [('e4acf0f5-75a5-4ae0-8df4-15424026288f', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:00.613897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39bb9d6e-03e1-4715-869e-56f0f458075a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:00.614531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-39bb9d6e-03e1-4715-869e-56f0f458075a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:00.636984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39bb9d6e-03e1-4715-869e-56f0f458075a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:00.637449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39bb9d6e-03e1-4715-869e-56f0f458075a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:00.637884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39bb9d6e-03e1-4715-869e-56f0f458075a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:00.638596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39bb9d6e-03e1-4715-869e-56f0f458075a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:00.639079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39bb9d6e-03e1-4715-869e-56f0f458075a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:00.639501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39bb9d6e-03e1-4715-869e-56f0f458075a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:00.651353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:00.999843 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-39bb9d6e-03e1-4715-869e-56f0f458075a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.390108 Oct 31 15:26:01.000860 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1216/2279] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 31 15:26:00 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3/os-security-groups => generated 1157 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:01.007260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:01.008004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:01.024629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.026095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.027520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.029976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.031640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.032859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.335311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:01.346026 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a40a5fbd-d958-43d0-a16f-b0da57fce96c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1510 microversion: 2.1 time: 0.343798 Oct 31 15:26:01.346838 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1217/2280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:01 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1510 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:01.352805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d2c00eb8-3bb5-4ff0-9952-7e2925cd8308 req-db8029c9-9b44-43c4-9cca-217866dcdeaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7346a65d-a674-41d1-a272-4102c41ae7e3", "tag": "6db2cbfb-2489-4798-a5f8-91df8d4226e3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:01.363823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2c00eb8-3bb5-4ff0-9952-7e2925cd8308 req-db8029c9-9b44-43c4-9cca-217866dcdeaf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.365738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2c00eb8-3bb5-4ff0-9952-7e2925cd8308 req-db8029c9-9b44-43c4-9cca-217866dcdeaf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.366391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2c00eb8-3bb5-4ff0-9952-7e2925cd8308 req-db8029c9-9b44-43c4-9cca-217866dcdeaf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.392447 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d2c00eb8-3bb5-4ff0-9952-7e2925cd8308 req-db8029c9-9b44-43c4-9cca-217866dcdeaf service nova] Creating event network-changed:6db2cbfb-2489-4798-a5f8-91df8d4226e3 for instance 7346a65d-a674-41d1-a272-4102c41ae7e3 on n-h1-858384-17 Oct 31 15:26:01.407417 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d2c00eb8-3bb5-4ff0-9952-7e2925cd8308 req-db8029c9-9b44-43c4-9cca-217866dcdeaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057868 Oct 31 15:26:01.410196 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1218/2281] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:01.423114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:01.424445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:01.470613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.471270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.473856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.479037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.481883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.483114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.557712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=32 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:01.757058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:01.775018 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e016bc8-3eeb-4bd4-884f-d0257b9c732e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1346 microversion: 2.1 time: 0.355678 Oct 31 15:26:01.779115 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1219/2282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:01 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1346 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:01.802804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:01.805883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:01.857792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.858479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.858932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:01.865855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:01.868640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:01.869099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:02.310332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:02.332291 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c740d88d-fdde-4586-8051-7a3a123a65bc tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1229 microversion: 2.1 time: 0.551287 Oct 31 15:26:02.332973 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1220/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:01 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1229 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:02.355909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-68c6d90f-e0fe-412f-9871-7aea2d0c8ce6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: .version_select at 0x7f16e0c04040>, body: {"security_group": {"name": " tempest-securitygroup -867591677 ", "description": "tempest-description-1217303896"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:02.988101 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-68c6d90f-e0fe-412f-9871-7aea2d0c8ce6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.650687 Oct 31 15:26:02.988884 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1221/2284] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:26:02 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:03.013782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:03.015328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:03.036881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:03.037734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:03.038352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:03.042604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:03.043295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:03.043755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:03.673164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:03.686909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-569acb67-693e-460d-8350-28a668722d6b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1531 microversion: 2.1 time: 0.683460 Oct 31 15:26:03.688460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1222/2285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:02 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1531 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:03.709714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:03.710338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:03.735325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:03.736444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:03.738401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:03.740522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:03.741002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:03.742790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:03.877520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:03.884221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:03.884719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:03.885692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:03.886110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:03.886645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:03.888614 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61e27333-5077-4df7-a45c-ce6b18d22c8a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1346 microversion: 2.1 time: 0.198204 Oct 31 15:26:03.889241 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1223/2286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:03 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1346 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:03.896222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-645e1b0b-afb4-4ef8-8dd4-6a7abbf71ce2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e0cd0820>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:03.905507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:03.909277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:03.909920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:03.911358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:03.913916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:03.914448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:03.961313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Getting quotas for project bfd8287b40b94c5c99fd7985bd997765. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:03.970785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Getting quotas for user 428b6c96ec914bb5ba452c1b198a55e2 and project bfd8287b40b94c5c99fd7985bd997765. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:03.997680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:04.001465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:04.023015 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-645e1b0b-afb4-4ef8-8dd4-6a7abbf71ce2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01" status: 200 len: 223 microversion: 2.1 time: 0.131091 Oct 31 15:26:04.027640 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1224/2287] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:26:03 2022] GET /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:04.032911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:04.033761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:04.058473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:04.059248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:04.061731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:04.062749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:04.063395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:04.064008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:04.104836 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c9ccd46-4efc-42fb-b81b-45dd1a98027e tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.304008 Oct 31 15:26:04.105541 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1064/2288] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:25:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 4305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:26:04.217870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:04.228839 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-806ec6fa-f876-4e0b-bf8e-e132c5c6b436 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1283 microversion: 2.1 time: 0.199770 Oct 31 15:26:04.229472 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1225/2289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:04 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1283 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:04.264049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-730d706f-157e-47c4-ad13-c0aa3ac09f36 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e0c168b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:04.524156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-434739944", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": "none"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:04.779007 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-730d706f-157e-47c4-ad13-c0aa3ac09f36 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01" status: 202 len: 0 microversion: 2.1 time: 0.524878 Oct 31 15:26:04.779795 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1226/2290] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:26:04 2022] DELETE /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01 => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:04.785537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9782db2d-0f84-406f-9b2d-ef64f7fecb81 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:04.786940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9782db2d-0f84-406f-9b2d-ef64f7fecb81 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:04.938433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9782db2d-0f84-406f-9b2d-ef64f7fecb81 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b6c96ec914bb5ba452c1b198a55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd8287b40b94c5c99fd7985bd997765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:04.959812 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9782db2d-0f84-406f-9b2d-ef64f7fecb81 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 200 len: 1225 microversion: 2.1 time: 0.178041 Oct 31 15:26:04.962009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:04.962457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:04.962908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:04.963317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:04.963892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:04.979301 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1227/2291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:04 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 1225 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:04.999989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:05.000626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:05.021276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.025754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.026542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.027409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.027913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.028138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.028356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.028943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.029069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.029588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.029887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.030221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.069304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Getting quotas for project eb752b227b2b4eb89fcbb70a6140df20. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:05.084170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Getting quotas for user 31814b32da6a421f805503567a66d420 and project eb752b227b2b4eb89fcbb70a6140df20. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:05.131666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:05.138392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:05.165804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:05.257449 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6af58a6e-b4ab-4663-baae-2850c1de41c4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.147545 Oct 31 15:26:05.258424 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1065/2292] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:26:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:26:05.273574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d79e44ba-38bc-438e-bdb9-e9645c9f9cb2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e5719ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:05.419841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG neutronclient.v2_0.client [None req-d79e44ba-38bc-438e-bdb9-e9645c9f9cb2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist", "detail": ""}} {{(pid=120588) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:26:05.420744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.security_group_api [None req-d79e44ba-38bc-438e-bdb9-e9645c9f9cb2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group e557f662-bdf7-4e78-85db-e98ea37a9d01 not found {{(pid=120588) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:26:05.421542 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d79e44ba-38bc-438e-bdb9-e9645c9f9cb2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:26:05.421542 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-ab4bcbfe-e2ad-4c23-a69e-634a707240f0'] Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d79e44ba-38bc-438e-bdb9-e9645c9f9cb2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01 HTTP/1.1 Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: exception: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-ab4bcbfe-e2ad-4c23-a69e-634a707240f0'] Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'e557f662-bdf7-4e78-85db-e98ea37a9d01'} Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:26:05.424662 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab4bcbfe-e2ad-4c23-a69e-634a707240f0'] Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab4bcbfe-e2ad-4c23-a69e-634a707240f0'] Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab4bcbfe-e2ad-4c23-a69e-634a707240f0'] Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ab4bcbfe-e2ad-4c23-a69e-634a707240f0'] Oct 31 15:26:05.428763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:05.432897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d79e44ba-38bc-438e-bdb9-e9645c9f9cb2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:26:05.432897 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-ab4bcbfe-e2ad-4c23-a69e-634a707240f0'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:05.434506 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d79e44ba-38bc-438e-bdb9-e9645c9f9cb2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01" status: 404 len: 194 microversion: 2.1 time: 0.174417 Oct 31 15:26:05.435611 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1066/2293] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:26:05 2022] GET /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01 => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:05.444152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:05.449998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:05.464005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.467147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.468701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.469958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.472183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.474514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.565944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:05.592416 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f742a0d-6580-4fac-842d-1c91aacac8bd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1526 microversion: 2.1 time: 0.609886 Oct 31 15:26:05.593596 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1228/2294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:04 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1526 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:05.636356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:05.644029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:05.672286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.674586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.675232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.676144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:05.678583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:05.683157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:05.846047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:05.855603 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a470ddb-2452-41be-895a-39f52afaaa3e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1346 microversion: 2.1 time: 0.418747 Oct 31 15:26:05.856196 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1067/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:05 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1346 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:05.860724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5cda0b8c-a5f1-445f-aa29-23ee08f4eded tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:05.874766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5cda0b8c-a5f1-445f-aa29-23ee08f4eded tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:05.914832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:05.927812 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6ce4291-9806-4f60-a509-91a1e4f04a99 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1283 microversion: 2.1 time: 0.308711 Oct 31 15:26:05.937257 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1229/2296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:05 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1283 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:05.972357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30ac0aa5-e80a-4d4d-ac37-88a22decd1e7 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: .version_select at 0x7f16e0d1b040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1713785633", "description": "tempest-description-1426071436"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:06.475556 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30ac0aa5-e80a-4d4d-ac37-88a22decd1e7 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.515451 Oct 31 15:26:06.486521 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1230/2297] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:26:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:06.492360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:06.494543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:06.511171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.511839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.512616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.513846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.514617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.515201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.702347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b6c96ec914bb5ba452c1b198a55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd8287b40b94c5c99fd7985bd997765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:06.718457 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5d65fb9-d637-4a32-811a-6af8e02e102a tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 200 len: 1221 microversion: 2.1 time: 0.230411 Oct 31 15:26:06.720282 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1231/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:06 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 1221 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:06.725250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cda0b8c-a5f1-445f-aa29-23ee08f4eded tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:06.745665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cda0b8c-a5f1-445f-aa29-23ee08f4eded tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:06.747381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cda0b8c-a5f1-445f-aa29-23ee08f4eded tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:06.750790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0dadf50b-b314-4d4e-ac2b-890f61334a9c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: .version_select at 0x7f16e0c151f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-27850267", "description": "tempest-description-628670544"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:06.772640 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5cda0b8c-a5f1-445f-aa29-23ee08f4eded tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1452 microversion: 2.91 time: 0.915199 Oct 31 15:26:06.793571 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1068/2299] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:05 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1452 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:06.808158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:06.824528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:06.852063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.852448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.852957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.853748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:06.854279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:06.854710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:06.908681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:07.331495 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0dadf50b-b314-4d4e-ac2b-890f61334a9c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.590735 Oct 31 15:26:07.332313 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1232/2300] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:26:06 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:07.350787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:07.353013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:07.390766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:07.391900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:07.392687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:07.398518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:07.399892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:07.407865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:07.543952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:07.555044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96d56c12-53c0-4df0-99c3-42d20a8048b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 200 len: 1346 microversion: 2.1 time: 0.209390 Oct 31 15:26:07.555653 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1233/2301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:07 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 1346 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:07.566855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:07.568162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:07.603937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:07.604530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:07.604990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:07.605778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:07.606247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:07.606679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:07.716219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:07.735085 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3104ab1-7894-4964-9c56-2805d1754c8f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1526 microversion: 2.1 time: 0.936852 Oct 31 15:26:07.741169 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1069/2302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:06 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1526 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:07.759172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03b325eb-6a53-486f-a22d-7575bdcce337 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: .version_select at 0x7f16e5719c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-600611636", "description": "tempest-description-448558827"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:07.788206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:07.801388 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a8a79d2-b7c9-4bb2-ba87-8d8e84c0716d tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1283 microversion: 2.1 time: 0.244365 Oct 31 15:26:07.802292 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1234/2303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:07 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1283 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:07.818308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1774187134", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9093c761-3520-4e4d-b6ce-988b5d63e945"}, {"port": "d6cf71ce-0b17-4158-9482-cf6b74f884a5", "tag": "port-1"}, {"port": "e99aa557-85c0-4573-88a4-2fe810a71e21", "tag": "port-2"}, {"uuid": "000c983c-c0d2-4ec3-936a-7e99dd3e3167", "tag": "net-1"}, {"uuid": "000c983c-c0d2-4ec3-936a-7e99dd3e3167"}, {"uuid": "40fe9dcf-5989-4507-b3e8-841f51772f4c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "40fe9dcf-5989-4507-b3e8-841f51772f4c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8c939b08-aa94-469b-a218-66ced7035af1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ba47ab15-f71d-490b-8546-c216367a04f8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f9e6c442-55b2-48bf-8573-8ba828e8d915", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--716858792"}], "key_name": "tempest-keypair-1023206213", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:08.808784 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03b325eb-6a53-486f-a22d-7575bdcce337 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.066225 Oct 31 15:26:08.809890 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1070/2304] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:26:07 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:08.815160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:08.816609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:08.862165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:08.867013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:08.868529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:08.869725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:08.871941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:08.873212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.106417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b6c96ec914bb5ba452c1b198a55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd8287b40b94c5c99fd7985bd997765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:09.129560 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3db68a8-0536-4986-953b-e1153ba53c51 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 200 len: 1283 microversion: 2.1 time: 0.318109 Oct 31 15:26:09.148115 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1071/2305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:08 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 1283 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:09.156490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:09.157718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:09.185021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.186072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.186820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.188741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.190432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.191594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.491257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:09.524903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:09.524903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:09.533924 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-78f1acfe-7b93-4eab-95c4-bd293240b558 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1510 microversion: 2.91 time: 0.380831 Oct 31 15:26:09.537639 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1072/2306] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:09 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1510 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:09.550077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-808c1dfd-62a0-463e-9a48-be514683f1bf req-c3ba580c-3bca-497a-b75d-5199e48bf62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4faf82e-33b1-482e-a400-e57ebf462f65", "name": "network-vif-plugged", "status": "completed", "tag": "5c17a2b4-0599-4cd9-ac6a-66a5a6df9448"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:09.590189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-808c1dfd-62a0-463e-9a48-be514683f1bf req-c3ba580c-3bca-497a-b75d-5199e48bf62f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.591342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-808c1dfd-62a0-463e-9a48-be514683f1bf req-c3ba580c-3bca-497a-b75d-5199e48bf62f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.592177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-808c1dfd-62a0-463e-9a48-be514683f1bf req-c3ba580c-3bca-497a-b75d-5199e48bf62f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.617645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-808c1dfd-62a0-463e-9a48-be514683f1bf req-c3ba580c-3bca-497a-b75d-5199e48bf62f service nova] Creating event network-vif-plugged:5c17a2b4-0599-4cd9-ac6a-66a5a6df9448 for instance f4faf82e-33b1-482e-a400-e57ebf462f65 on n-h2-858384-17 Oct 31 15:26:09.627130 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-808c1dfd-62a0-463e-9a48-be514683f1bf req-c3ba580c-3bca-497a-b75d-5199e48bf62f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087524 Oct 31 15:26:09.628560 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1073/2307] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:09.640038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:09.641191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:09.652961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.653716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.655016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.656565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.657684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.658346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.680551 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d HTTP/1.1 Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '129edccf-8357-446b-9c1b-13c2fc7c5f0d'} Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:09.682609 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:09.686931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:09.686931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:09.686931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:09.686931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:09.686931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:09.686931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:09.686931 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:09.686931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:09.688017 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c698bd28-886e-487a-a824-bf59886fb321 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 404 len: 111 microversion: 2.1 time: 0.057148 Oct 31 15:26:09.688730 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1074/2308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:09 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:09.700059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:09.701407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:09.733704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.735706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.736305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:09.738326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:09.742279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:09.744352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:10.219312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:10.237782 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fbb572c4-5a19-40b3-b285-cd0db8bc8a49 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1526 microversion: 2.1 time: 0.547765 Oct 31 15:26:10.238540 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1075/2309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:09 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1526 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:10.266173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99e804b0-2ca7-4bc9-b20d-190deb9f25da tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e56beee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:10.411619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=14 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:11.470592 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99e804b0-2ca7-4bc9-b20d-190deb9f25da tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 1.229174 Oct 31 15:26:11.488837 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1076/2310] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:26:10 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:11.504057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:11.508396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:11.523014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.524220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.527763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.530538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.531172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.531765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.913595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:11.922269 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dabf1dd1-8625-4dd6-995d-9855e2434586 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1351 microversion: 2.1 time: 0.429547 Oct 31 15:26:11.928162 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1077/2311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:11 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1351 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:11.933367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:11.940081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:11.965064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.967095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.968304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.969774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:11.970391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:11.970957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:11.994579 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d/os-volume_attachments HTTP/1.1 Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'server_id': '129edccf-8357-446b-9c1b-13c2fc7c5f0d'} Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:12.007552 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:26:12.012025 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:12.013806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:12.014972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92317ba2-0857-45ff-8a2c-2be8c2298007 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.085595 Oct 31 15:26:12.015855 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1078/2312] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:26:11 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d/os-volume_attachments => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:12.026571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:12.027324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:12.041056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.045248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.045842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.048997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.049100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.051278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.481256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b6c96ec914bb5ba452c1b198a55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd8287b40b94c5c99fd7985bd997765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:12.503220 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2d97a817-66d8-40f5-8a2b-167ccf0cdb0b tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 200 len: 1325 microversion: 2.1 time: 0.485819 Oct 31 15:26:12.510061 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1079/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:12 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 1325 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:12.514944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:12.515732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:12.539092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.539635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.540087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.540829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.541314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.541914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.873184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:12.888299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:12.891327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:12.898902 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6d5dfeae-7140-4a5a-88f8-ebb7bacbe224 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1531 microversion: 2.91 time: 0.387436 Oct 31 15:26:12.900024 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1080/2314] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:12 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1531 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:12.904877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:12.905754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:12.924505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.924994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.925486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:12.926153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:12.927371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:12.927936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:13.184312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:13.195320 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51c530aa-8d99-4be1-86a8-0fb7e3fa4fc0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1526 microversion: 2.1 time: 0.293257 Oct 31 15:26:13.198230 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1081/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:12 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1526 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:13.209452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7436245c-107d-4db8-acc9-cbc1af7007fd tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e56d2f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:13.522651 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7436245c-107d-4db8-acc9-cbc1af7007fd tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f803d64e-2453-4bde-91d4-2d6f5148666b" status: 202 len: 0 microversion: 2.1 time: 0.322694 Oct 31 15:26:13.528126 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1082/2316] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:26:13 2022] DELETE /compute/v2.1/os-security-groups/f803d64e-2453-4bde-91d4-2d6f5148666b => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:13.533385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-86e439f0-4078-4098-a70e-b4c65fada742 req-f9cf9c47-718a-400f-83cc-33b75f5dd5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b0b18c-6da5-43e6-8048-2ce0c8932f0a", "tag": "0a81f122-86b6-474f-8064-6c9a3bb36467"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:13.551187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-86e439f0-4078-4098-a70e-b4c65fada742 req-f9cf9c47-718a-400f-83cc-33b75f5dd5ea service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:13.552384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-86e439f0-4078-4098-a70e-b4c65fada742 req-f9cf9c47-718a-400f-83cc-33b75f5dd5ea service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:13.553436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-86e439f0-4078-4098-a70e-b4c65fada742 req-f9cf9c47-718a-400f-83cc-33b75f5dd5ea service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:13.570427 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-86e439f0-4078-4098-a70e-b4c65fada742 req-f9cf9c47-718a-400f-83cc-33b75f5dd5ea service nova] Creating event network-changed:0a81f122-86b6-474f-8064-6c9a3bb36467 for instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a on n-h2-858384-17 Oct 31 15:26:13.582816 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-86e439f0-4078-4098-a70e-b4c65fada742 req-f9cf9c47-718a-400f-83cc-33b75f5dd5ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053022 Oct 31 15:26:13.583645 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1083/2317] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:13.589948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2082265752", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "c356d61f-2e01-42fa-9c99-c94fb61838ec"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:14.943846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=64 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:15.043270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:16.732933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:17.798593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=71 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:17.804087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] validate_networks() for [('c356d61f-2e01-42fa-9c99-c94fb61838ec', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:17.858445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:17.882745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] validate_networks() for [('9093c761-3520-4e4d-b6ce-988b5d63e945', None, None, None, None, None), (None, None, 'd6cf71ce-0b17-4158-9482-cf6b74f884a5', None, None, None), (None, None, 'e99aa557-85c0-4573-88a4-2fe810a71e21', None, None, None), ('000c983c-c0d2-4ec3-936a-7e99dd3e3167', None, None, None, None, None), ('000c983c-c0d2-4ec3-936a-7e99dd3e3167', None, None, None, None, None), ('40fe9dcf-5989-4507-b3e8-841f51772f4c', '10.2.2.100', None, None, None, None), ('40fe9dcf-5989-4507-b3e8-841f51772f4c', '10.2.2.200', None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:18.389606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:18.390106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:18.390482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:18.391964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:18.392389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:18.407722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:18.408481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:18.409086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:18.410073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:18.410685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:18.412763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:18.435048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:18.443861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for user 93f77a1d41fd431d9da6587e0ca9cb1e and project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:18.461530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:18.464963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:18.544010 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3deca3b8-ba9e-489d-9dd9-4b98e33aa8a6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.958904 Oct 31 15:26:18.555905 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1084/2318] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:26:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:26:18.643831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:18.644528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:18.657982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:18.660336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:18.660970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:18.662173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:18.664354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:18.665514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:18.775683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lazy-loading 'services' on Instance uuid 7d83eacf-e291-41a0-9527-35e637519251 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:26:18.800471 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bdcdf751-dffe-484e-8e46-184114224221 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1938 microversion: 2.91 time: 0.243131 Oct 31 15:26:18.802553 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1085/2319] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:18 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1938 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:18.807325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:18.808711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:18.815573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:18.816302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:18.816974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:18.819424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:18.820155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:18.820821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.055890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:19.069006 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a267879f-23b3-4b1d-b80f-dd06651c2f95 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1351 microversion: 2.1 time: 0.265213 Oct 31 15:26:19.085190 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1086/2320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:18 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1351 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:19.085190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:19.085840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:19.102551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.103048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.103486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.104201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.104651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.105071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.342228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b6c96ec914bb5ba452c1b198a55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd8287b40b94c5c99fd7985bd997765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:19.369332 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd384f48-ede5-4198-beb9-b448861aba82 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 200 len: 1325 microversion: 2.1 time: 0.298553 Oct 31 15:26:19.381163 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1087/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:19 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:19.381163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9acfbcab-50db-4195-9a5e-65cdd2832608 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e5719af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:19.418107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG neutronclient.v2_0.client [None req-9acfbcab-50db-4195-9a5e-65cdd2832608 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist", "detail": ""}} {{(pid=120588) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:26:19.419130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.security_group_api [None req-9acfbcab-50db-4195-9a5e-65cdd2832608 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group f803d64e-2453-4bde-91d4-2d6f5148666b not found {{(pid=120588) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:26:19.419819 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9acfbcab-50db-4195-9a5e-65cdd2832608 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:26:19.419819 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-f8ff6e63-c39c-4391-a834-c2638c821a9a'] Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9acfbcab-50db-4195-9a5e-65cdd2832608 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-security-groups/f803d64e-2453-4bde-91d4-2d6f5148666b HTTP/1.1 Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: exception: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-f8ff6e63-c39c-4391-a834-c2638c821a9a'] Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f803d64e-2453-4bde-91d4-2d6f5148666b'} Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:26:19.422144 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8ff6e63-c39c-4391-a834-c2638c821a9a'] Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8ff6e63-c39c-4391-a834-c2638c821a9a'] Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8ff6e63-c39c-4391-a834-c2638c821a9a'] Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8ff6e63-c39c-4391-a834-c2638c821a9a'] Oct 31 15:26:19.426607 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:19.431394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9acfbcab-50db-4195-9a5e-65cdd2832608 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:26:19.431394 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-f8ff6e63-c39c-4391-a834-c2638c821a9a'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:19.435125 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9acfbcab-50db-4195-9a5e-65cdd2832608 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/f803d64e-2453-4bde-91d4-2d6f5148666b" status: 404 len: 194 microversion: 2.1 time: 0.061179 Oct 31 15:26:19.435890 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1088/2322] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:26:19 2022] GET /compute/v2.1/os-security-groups/f803d64e-2453-4bde-91d4-2d6f5148666b => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:19.445300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:19.449539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:19.470881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.472022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.472926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.475375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.476013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.477080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.719998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:19.735576 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd57a516-0ff1-42e9-86d1-df392eb83930 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1526 microversion: 2.1 time: 0.298410 Oct 31 15:26:19.751860 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1089/2323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:19 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1526 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:19.751860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-305a9da2-1001-4fd4-81b5-e48b0d688b43 req-127b9423-4ebb-4249-8c9c-af3f6663516c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc5e627e-059a-4cd3-81bd-b420813823d3", "tag": "6539b128-c8d2-4b52-b37c-4cbafb3c2877"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:19.754672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-305a9da2-1001-4fd4-81b5-e48b0d688b43 req-127b9423-4ebb-4249-8c9c-af3f6663516c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.755787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-305a9da2-1001-4fd4-81b5-e48b0d688b43 req-127b9423-4ebb-4249-8c9c-af3f6663516c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.756574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-305a9da2-1001-4fd4-81b5-e48b0d688b43 req-127b9423-4ebb-4249-8c9c-af3f6663516c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.781858 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-305a9da2-1001-4fd4-81b5-e48b0d688b43 req-127b9423-4ebb-4249-8c9c-af3f6663516c service nova] Creating event network-changed:6539b128-c8d2-4b52-b37c-4cbafb3c2877 for instance cc5e627e-059a-4cd3-81bd-b420813823d3 on n-h1-858384-17 Oct 31 15:26:19.798216 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-305a9da2-1001-4fd4-81b5-e48b0d688b43 req-127b9423-4ebb-4249-8c9c-af3f6663516c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060718 Oct 31 15:26:19.799936 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1090/2324] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:19.810407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b7083b55-2255-46e3-80aa-577cdff81d8d req-8e002383-888b-4a94-be14-4b445a82a2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5e627e-059a-4cd3-81bd-b420813823d3", "name": "network-vif-plugged", "status": "completed", "tag": "6539b128-c8d2-4b52-b37c-4cbafb3c2877"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:19.837363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b7083b55-2255-46e3-80aa-577cdff81d8d req-8e002383-888b-4a94-be14-4b445a82a2e1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.838834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b7083b55-2255-46e3-80aa-577cdff81d8d req-8e002383-888b-4a94-be14-4b445a82a2e1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.839707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b7083b55-2255-46e3-80aa-577cdff81d8d req-8e002383-888b-4a94-be14-4b445a82a2e1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.879308 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b7083b55-2255-46e3-80aa-577cdff81d8d req-8e002383-888b-4a94-be14-4b445a82a2e1 service nova] Creating event network-vif-plugged:6539b128-c8d2-4b52-b37c-4cbafb3c2877 for instance cc5e627e-059a-4cd3-81bd-b420813823d3 on n-h1-858384-17 Oct 31 15:26:19.885628 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b7083b55-2255-46e3-80aa-577cdff81d8d req-8e002383-888b-4a94-be14-4b445a82a2e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081990 Oct 31 15:26:19.886989 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1091/2325] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:19.894419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:19.895515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:19.910825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.911398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.911843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:19.912580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:19.913064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:19.913525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:20.100847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:20.112112 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e5446bc-282b-4640-a5f7-3a38965c9a30 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1267 microversion: 2.1 time: 0.221187 Oct 31 15:26:20.115911 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1092/2326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:19 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:20.133256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:20.134212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:20.146892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:20.150316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:20.150989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:20.155415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:20.156123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:20.156779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:20.290497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lazy-loading 'services' on Instance uuid 7d83eacf-e291-41a0-9527-35e637519251 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:26:20.309252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:20.333932 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01330374-51c7-48e3-8fd5-d5687afcfe54 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1938 microversion: 2.91 time: 0.214733 Oct 31 15:26:20.349155 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1093/2327] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:20 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1938 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:20.349155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-55eaf864-cc0a-4092-bb50-b5fdde641c75 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e56d2ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:21.058001 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-55eaf864-cc0a-4092-bb50-b5fdde641c75 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/48dbc41d-98e8-4c22-b921-e94223ab261f" status: 202 len: 0 microversion: 2.1 time: 0.718466 Oct 31 15:26:21.062863 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1094/2328] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:26:20 2022] DELETE /compute/v2.1/os-security-groups/48dbc41d-98e8-4c22-b921-e94223ab261f => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:21.069084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:21.070802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:21.081877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.085704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.089757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.090802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.091492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.092149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.343783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:21.344233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:21.345598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:21.346185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:21.347403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:21.361702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.362599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.367067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.370480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.374643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.375388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.401024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Getting quotas for project 18ff0d809d824516a08568744e0ca176. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:21.408640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Getting quotas for user 030780ff23d84175a364754b045c8083 and project 18ff0d809d824516a08568744e0ca176. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:21.683943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:21.687446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8c939b08-aa94-469b-a218-66ced7035af1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ba47ab15-f71d-490b-8546-c216367a04f8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9e6c442-55b2-48bf-8573-8ba828e8d915',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:21.866736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:21.874633 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4fa10ab6-843e-4272-a756-8b674f2453c0 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1351 microversion: 2.1 time: 0.810468 Oct 31 15:26:21.889772 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1095/2329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:21 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1351 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:21.897829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:21.898477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:21.906869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.907560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.908507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.909428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:21.910039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:21.910652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:21.986432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:26:22.117186 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b601163-ecc2-4592-ac58-8a1a4fc82f45 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 204 len: 0 microversion: 2.1 time: 0.225585 Oct 31 15:26:22.118673 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1096/2330] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:21 2022] DELETE /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:26:22.124446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ee41ff0-3630-477f-952a-8d88a6934ec9 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:22.128324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ee41ff0-3630-477f-952a-8d88a6934ec9 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.128808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ee41ff0-3630-477f-952a-8d88a6934ec9 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.129318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ee41ff0-3630-477f-952a-8d88a6934ec9 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.130561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ee41ff0-3630-477f-952a-8d88a6934ec9 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.131011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ee41ff0-3630-477f-952a-8d88a6934ec9 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.131428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ee41ff0-3630-477f-952a-8d88a6934ec9 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.151645 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e3b62950-483b-4f04-8f6f-e1a8ad707861 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 14.346274 Oct 31 15:26:22.153300 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1235/2331] 10.222.0.20 () {62 vars in 1189 bytes} [Mon Oct 31 15:26:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 14350 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:26:22.158302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:22.162704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:22.173519 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ee41ff0-3630-477f-952a-8d88a6934ec9 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.053269 Oct 31 15:26:22.179820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.181168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.181825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.182509 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1097/2332] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 31 15:26:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:26:22.184073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.185046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.185806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.199838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:22.200560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:22.218415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.218415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.219193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.219542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.219996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.220417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.373600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b6c96ec914bb5ba452c1b198a55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd8287b40b94c5c99fd7985bd997765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:22.386935 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3eec9664-3d01-4ed2-8ec8-1b04fae1afd7 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 200 len: 1522 microversion: 2.1 time: 0.232553 Oct 31 15:26:22.393512 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1236/2333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:22 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:22.399469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7684719b-730e-4859-8523-f1040e6b9775 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e0c04700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:22.447411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-7684719b-730e-4859-8523-f1040e6b9775 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:26:22.449797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-7684719b-730e-4859-8523-f1040e6b9775 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group 48dbc41d-98e8-4c22-b921-e94223ab261f not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:26:22.451237 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7684719b-730e-4859-8523-f1040e6b9775 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:26:22.451237 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-a808bfe0-7425-4075-a43e-e2d453e1db32'] Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7684719b-730e-4859-8523-f1040e6b9775 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-security-groups/48dbc41d-98e8-4c22-b921-e94223ab261f HTTP/1.1 Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-a808bfe0-7425-4075-a43e-e2d453e1db32'] Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '48dbc41d-98e8-4c22-b921-e94223ab261f'} Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:26:22.468757 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a808bfe0-7425-4075-a43e-e2d453e1db32'] Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a808bfe0-7425-4075-a43e-e2d453e1db32'] Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a808bfe0-7425-4075-a43e-e2d453e1db32'] Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a808bfe0-7425-4075-a43e-e2d453e1db32'] Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7684719b-730e-4859-8523-f1040e6b9775 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-a808bfe0-7425-4075-a43e-e2d453e1db32'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7684719b-730e-4859-8523-f1040e6b9775 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/48dbc41d-98e8-4c22-b921-e94223ab261f" status: 404 len: 194 microversion: 2.1 time: 0.076015 Oct 31 15:26:22.474347 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1237/2334] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:26:22 2022] GET /compute/v2.1/os-security-groups/48dbc41d-98e8-4c22-b921-e94223ab261f => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:22.478505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-71b17509-2a74-4d31-9402-2f55237ff4be req-1f3ae87e-46fd-4bbe-aea1-97f57ea73a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b0b18c-6da5-43e6-8048-2ce0c8932f0a", "name": "network-vif-plugged", "status": "completed", "tag": "0a81f122-86b6-474f-8064-6c9a3bb36467"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:22.503354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-71b17509-2a74-4d31-9402-2f55237ff4be req-1f3ae87e-46fd-4bbe-aea1-97f57ea73a47 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.504799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-71b17509-2a74-4d31-9402-2f55237ff4be req-1f3ae87e-46fd-4bbe-aea1-97f57ea73a47 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.505640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-71b17509-2a74-4d31-9402-2f55237ff4be req-1f3ae87e-46fd-4bbe-aea1-97f57ea73a47 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.525813 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-71b17509-2a74-4d31-9402-2f55237ff4be req-1f3ae87e-46fd-4bbe-aea1-97f57ea73a47 service nova] Creating event network-vif-plugged:0a81f122-86b6-474f-8064-6c9a3bb36467 for instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a on n-h2-858384-17 Oct 31 15:26:22.533157 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-71b17509-2a74-4d31-9402-2f55237ff4be req-1f3ae87e-46fd-4bbe-aea1-97f57ea73a47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058753 Oct 31 15:26:22.534748 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1238/2335] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:22.550340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:22.551248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:22.558947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.559618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.560231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.571716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.572444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.573040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.722659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:22.734965 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5ede3b49-c5a6-4eb8-9a6e-aab69ae0e2a9 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1508 microversion: 2.1 time: 0.551277 Oct 31 15:26:22.735891 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1098/2336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:22 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1508 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:22.740921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a45a5f15-acb2-4237-b599-82e71807c3b5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:22.741742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a45a5f15-acb2-4237-b599-82e71807c3b5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:22.840579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:22.850992 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41572259-c777-4b43-a7e2-655451c0b8b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1315 microversion: 2.1 time: 0.309649 Oct 31 15:26:22.851587 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1239/2337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:22 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:22.856480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:22.857825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:22.868129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.868884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.869660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.870592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.871234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.871914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:22.899665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lazy-loading 'flavor' on Instance uuid 7d83eacf-e291-41a0-9527-35e637519251 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:26:22.937611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a45a5f15-acb2-4237-b599-82e71807c3b5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:22.945773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a45a5f15-acb2-4237-b599-82e71807c3b5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:22.952120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a45a5f15-acb2-4237-b599-82e71807c3b5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:22.953602 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a45a5f15-acb2-4237-b599-82e71807c3b5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1286 microversion: 2.42 time: 0.216763 Oct 31 15:26:22.961543 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1099/2338] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:22 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1286 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:22.966340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:22.967090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:22.995228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:22.995810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:22.996459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.022341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.022844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.023291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.086585 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] HTTP exception thrown: Action 999 not found Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Request method failure captured: Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3/os-instance-actions/999 HTTP/1.1 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-kHWSHaB0UXypjW2Lp7OljqBa3QYg5JIorTqr0m3StrhFOnec5ntRUQJ5_mmWuPisDDQ6i9LVnnDJpEtEjmjTGSXaGKhKVC49aClHvUg632tJLHDxNrmYj_yrb6SQrfQMIz2fju78vSHvwHZV4fFqF7Xug4tJTlhRjR6-LsWmf3ALo Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: bfd8287b40b94c5c99fd7985bd997765 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1703747428 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfd8287b40b94c5c99fd7985bd997765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfd8287b40b94c5c99fd7985bd997765", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfd8287b40b94c5c99fd7985bd997765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfd8287b40b94c5c99fd7985bd997765"}]}] Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1703747428 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: bfd8287b40b94c5c99fd7985bd997765 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1703747428 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-InstanceActionsNegativeTestJSON-1703747428-project Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 428b6c96ec914bb5ba452c1b198a55e2 Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1703747428-project Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: exception: Action 999 not found Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'server_id': 'cc5e627e-059a-4cd3-81bd-b420813823d3', 'id': '999'} Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 31 15:26:23.092013 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:23.095101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Returning 404 to user: Action 999 not found {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:23.095101 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-176ab7f6-8704-4d6d-93ae-25e994994184 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.131065 Oct 31 15:26:23.095101 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1100/2339] 10.222.0.20 () {58 vars in 1308 bytes} [Mon Oct 31 15:26:22 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3/os-instance-actions/999 => generated 66 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:26:23.104566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9560e571-1062-4b82-9fa2-bca9ec31e789 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e0e45670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.237526 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bfe2369e-9f08-401a-a9e6-7f147941f042 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "POST /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251/action" status: 202 len: 0 microversion: 2.91 time: 0.384132 Oct 31 15:26:23.238809 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1240/2340] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:26:22 2022] POST /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:26:23.248537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.249707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.257903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.259774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.260386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.261655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.262335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.264663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.421937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.433646 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a1405101-4d58-4dca-af6d-c9deb8bdf7d4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1351 microversion: 2.1 time: 0.191669 Oct 31 15:26:23.436343 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1241/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:23.442603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06534a8e-7cd1-4fd6-ab91-2e4b824328a4 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '.version_select at 0x7f16e0c24c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.443088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-06534a8e-7cd1-4fd6-ab91-2e4b824328a4 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: c551ea7a-1774-403d-b0c1-56223dbd1113] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.449437 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-06534a8e-7cd1-4fd6-ab91-2e4b824328a4 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] HTTP exception thrown: Instance c551ea7a-1774-403d-b0c1-56223dbd1113 could not be found. Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06534a8e-7cd1-4fd6-ab91-2e4b824328a4 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Request method failure captured: Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/c551ea7a-1774-403d-b0c1-56223dbd1113/os-instance-actions HTTP/1.1 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-kHWSHaB0UXypjW2Lp7OljqBa3QYg5JIorTqr0m3StrhFOnec5ntRUQJ5_mmWuPisDDQ6i9LVnnDJpEtEjmjTGSXaGKhKVC49aClHvUg632tJLHDxNrmYj_yrb6SQrfQMIz2fju78vSHvwHZV4fFqF7Xug4tJTlhRjR6-LsWmf3ALo Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: bfd8287b40b94c5c99fd7985bd997765 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1703747428 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfd8287b40b94c5c99fd7985bd997765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfd8287b40b94c5c99fd7985bd997765", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfd8287b40b94c5c99fd7985bd997765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfd8287b40b94c5c99fd7985bd997765"}]}] Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1703747428 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: bfd8287b40b94c5c99fd7985bd997765 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1703747428 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-InstanceActionsNegativeTestJSON-1703747428-project Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 428b6c96ec914bb5ba452c1b198a55e2 Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1703747428-project Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance c551ea7a-1774-403d-b0c1-56223dbd1113 could not be found. Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': 'c551ea7a-1774-403d-b0c1-56223dbd1113'} Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c551ea7a-1774-403d-b0c1-56223dbd1113 could not be found. Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:23.451432 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c551ea7a-1774-403d-b0c1-56223dbd1113 could not be found. Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c551ea7a-1774-403d-b0c1-56223dbd1113 could not be found. Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06534a8e-7cd1-4fd6-ab91-2e4b824328a4 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Returning 404 to user: Instance c551ea7a-1774-403d-b0c1-56223dbd1113 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-06534a8e-7cd1-4fd6-ab91-2e4b824328a4 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/c551ea7a-1774-403d-b0c1-56223dbd1113/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.015122 Oct 31 15:26:23.455986 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1242/2342] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/c551ea7a-1774-403d-b0c1-56223dbd1113/os-instance-actions => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:23.467389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.468483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.478233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.478758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.479181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.479901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.480355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.480974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.554656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.571572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.588445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:23.596280 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce317401-7f56-4dba-bc42-0811214dd008 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.140713 Oct 31 15:26:23.616656 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1243/2343] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:23.623965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.624600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.644231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.646809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.647527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.648464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.649153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.649812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.706085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:26:23.831898 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b100106b-ac25-4e40-993e-c0ab41110e74 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 204 len: 0 microversion: 2.1 time: 0.217978 Oct 31 15:26:23.835642 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1244/2344] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:26:23 2022] DELETE /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:26:23.841203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.842098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.850815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.852027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.852556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.854434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.855430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.856687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.923652 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9560e571-1062-4b82-9fa2-bca9ec31e789 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6" status: 202 len: 0 microversion: 2.1 time: 0.828268 Oct 31 15:26:23.924592 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1101/2345] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:26:23 2022] DELETE /compute/v2.1/os-security-groups/4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:23.931937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:23.932781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:23.941910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.943257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.952375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:23.953377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:23.954279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:23.955059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.055479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.065307 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fbb6bc85-af1b-42f9-885e-d4cb638eed32 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1508 microversion: 2.1 time: 0.230109 Oct 31 15:26:24.066248 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1245/2346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:24.074187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.074378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:24.082014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.082495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.082984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.084018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.084226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.084615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.192192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b6c96ec914bb5ba452c1b198a55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd8287b40b94c5c99fd7985bd997765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.206271 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2fdac43b-c448-4cfc-879a-98fa1895bd77 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 200 len: 1528 microversion: 2.1 time: 0.280157 Oct 31 15:26:24.207105 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1102/2347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:23 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 1528 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:24.215993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b565e85d-c3a9-44b6-9016-21338888b31a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e0ded0d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.229652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.238185 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d38c84b2-4738-422c-8f67-dd55d94cdba4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1315 microversion: 2.1 time: 0.170903 Oct 31 15:26:24.238955 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1246/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:24.245162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.246025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:24.253110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.253908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.254788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.255544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.256005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.256429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.278717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG neutronclient.v2_0.client [None req-b565e85d-c3a9-44b6-9016-21338888b31a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist", "detail": ""}} {{(pid=120588) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:26:24.279853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.security_group_api [None req-b565e85d-c3a9-44b6-9016-21338888b31a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 not found {{(pid=120588) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:26:24.279853 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b565e85d-c3a9-44b6-9016-21338888b31a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:26:24.279853 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-e5fdfcd8-6680-4b97-b868-6b23c163ef99'] Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b565e85d-c3a9-44b6-9016-21338888b31a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-security-groups/4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 HTTP/1.1 Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: exception: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-e5fdfcd8-6680-4b97-b868-6b23c163ef99'] Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6'} Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:26:24.281682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5fdfcd8-6680-4b97-b868-6b23c163ef99'] Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5fdfcd8-6680-4b97-b868-6b23c163ef99'] Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5fdfcd8-6680-4b97-b868-6b23c163ef99'] Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5fdfcd8-6680-4b97-b868-6b23c163ef99'] Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b565e85d-c3a9-44b6-9016-21338888b31a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-e5fdfcd8-6680-4b97-b868-6b23c163ef99'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b565e85d-c3a9-44b6-9016-21338888b31a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6" status: 404 len: 194 microversion: 2.1 time: 0.074687 Oct 31 15:26:24.285009 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1103/2349] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/os-security-groups/4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:24.292262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77dab228-55a9-4e4d-a01f-95c5c22ff35c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e56da280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.342283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.352413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.353950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.355357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6db50a33-a4fb-4330-85e5-6614914a5edd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1576 microversion: 2.42 time: 0.114660 Oct 31 15:26:24.367586 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1247/2350] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1576 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:24.461334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.461987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:24.470973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.471911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.472038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.472699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.473510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.474403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.641403 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77dab228-55a9-4e4d-a01f-95c5c22ff35c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.352728 Oct 31 15:26:24.642399 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1104/2351] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:24.648623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.649532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:24.663304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:24.664050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.665670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.666881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.667544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.668697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.669371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.670075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.674284 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f9a4a13-66ae-4e95-b6f8-53ba7c83e4c1 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1541 microversion: 2.1 time: 0.218135 Oct 31 15:26:24.677761 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1248/2352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1541 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:24.682973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6032710-b176-4cde-a290-32fc84d2c1b0 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: .version_select at 0x7f16e0c1cc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1251872695", "description": "tempest-description-1333631001"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:24.772978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.788444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.790373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:24.796947 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd409e83-c448-4a6f-8b14-93baec69f1d0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.153087 Oct 31 15:26:24.797852 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1105/2353] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:24.892980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-20078da8-4ad2-4c32-9beb-defcbf315a0d req-04d9dede-951c-4cbe-8a95-9ba1720fa0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b578558c-004b-4234-86f9-66dde88aace5", "tag": "f8a46ca6-1cde-461e-a14d-5b3e4d00cc3d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:24.904115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-20078da8-4ad2-4c32-9beb-defcbf315a0d req-04d9dede-951c-4cbe-8a95-9ba1720fa0c9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.904596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-20078da8-4ad2-4c32-9beb-defcbf315a0d req-04d9dede-951c-4cbe-8a95-9ba1720fa0c9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.905321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-20078da8-4ad2-4c32-9beb-defcbf315a0d req-04d9dede-951c-4cbe-8a95-9ba1720fa0c9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.920539 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-20078da8-4ad2-4c32-9beb-defcbf315a0d req-04d9dede-951c-4cbe-8a95-9ba1720fa0c9 service nova] Creating event network-changed:f8a46ca6-1cde-461e-a14d-5b3e4d00cc3d for instance b578558c-004b-4234-86f9-66dde88aace5 on n-h2-858384-17 Oct 31 15:26:24.928283 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-20078da8-4ad2-4c32-9beb-defcbf315a0d req-04d9dede-951c-4cbe-8a95-9ba1720fa0c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117206 Oct 31 15:26:24.929232 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6032710-b176-4cde-a290-32fc84d2c1b0 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.249995 Oct 31 15:26:24.930157 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1106/2354] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:24.932777 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1249/2355] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:26:24 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:24.936379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7e65a68-a41a-4851-9f67-2cab94fd4c8f tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:24.937036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7e65a68-a41a-4851-9f67-2cab94fd4c8f tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:24.944079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7e65a68-a41a-4851-9f67-2cab94fd4c8f tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.944583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7e65a68-a41a-4851-9f67-2cab94fd4c8f tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.945114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7e65a68-a41a-4851-9f67-2cab94fd4c8f tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:24.946761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41e58f4c-42f5-4cab-ba83-22d2bf89145b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: .version_select at 0x7f16e0c049d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1264076097", "description": "tempest-description-1492695485"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:24.946942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7e65a68-a41a-4851-9f67-2cab94fd4c8f tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:24.946942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7e65a68-a41a-4851-9f67-2cab94fd4c8f tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:24.946942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7e65a68-a41a-4851-9f67-2cab94fd4c8f tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.082526 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7e65a68-a41a-4851-9f67-2cab94fd4c8f tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151010 Oct 31 15:26:25.084938 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1107/2356] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:26:24 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:25.096551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:25.097410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:25.104364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.105687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.106615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.108242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.109025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.109443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.492004 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41e58f4c-42f5-4cab-ba83-22d2bf89145b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.549990 Oct 31 15:26:25.507023 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1250/2357] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:26:24 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:26:25.515144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:25.515920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:25.525781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.526558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.527179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.529494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.530125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.530771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.583560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:25.597885 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ea70ab1-86b9-4d9e-8c7f-87aac61ba9ad tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1508 microversion: 2.1 time: 0.510107 Oct 31 15:26:25.600499 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1108/2358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:25 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1508 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:25.613517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:25.615187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:25.628206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.628958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.629808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:25.630938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:25.633076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:25.634340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:26.010069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b6c96ec914bb5ba452c1b198a55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd8287b40b94c5c99fd7985bd997765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:26.018546 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8576247f-9865-465c-b9a3-0b39e190fbbb tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 200 len: 1528 microversion: 2.1 time: 0.507925 Oct 31 15:26:26.022035 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1251/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:25 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 1528 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:26.033118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:26.034074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:26.049796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:26.051399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:26.053118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:26.055242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:26.055877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:26.058450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:26.189784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:26.213361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:26.215167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:26.216566 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5205c20a-73cb-4bca-8d1d-3328674726a8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1594 microversion: 2.42 time: 0.191736 Oct 31 15:26:26.217106 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1252/2360] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:26 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1594 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:26.225316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1474587745", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fca842e3-60df-4fc3-b289-9b37020e59e1"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:26.294803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:26.304346 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3455a6d0-7c3c-4304-bae4-2f69ae8b1f33 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1315 microversion: 2.1 time: 0.702548 Oct 31 15:26:26.314185 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1109/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:25 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:26.320876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:26.333847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:26.340368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:26.341084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:26.346358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:26.347517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:26.347795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:26.348326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:26.363460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] validate_networks() for [('fca842e3-60df-4fc3-b289-9b37020e59e1', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:26.515302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:26.533457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:26.536082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:26.553379 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9aa20394-9266-41be-bbe6-2fe3819e5372 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.233247 Oct 31 15:26:26.556271 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1110/2362] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:26 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:26.587777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b57a74e9-331d-4405-8a1d-57aaf2807610 req-99440aa1-52ff-466c-987f-5f4186f0fee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4faf82e-33b1-482e-a400-e57ebf462f65", "name": "network-vif-unplugged", "status": "completed", "tag": "5c17a2b4-0599-4cd9-ac6a-66a5a6df9448"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:26.601768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b57a74e9-331d-4405-8a1d-57aaf2807610 req-99440aa1-52ff-466c-987f-5f4186f0fee6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:26.603427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b57a74e9-331d-4405-8a1d-57aaf2807610 req-99440aa1-52ff-466c-987f-5f4186f0fee6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:26.604095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b57a74e9-331d-4405-8a1d-57aaf2807610 req-99440aa1-52ff-466c-987f-5f4186f0fee6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:26.617848 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b57a74e9-331d-4405-8a1d-57aaf2807610 req-99440aa1-52ff-466c-987f-5f4186f0fee6 service nova] Creating event network-vif-unplugged:5c17a2b4-0599-4cd9-ac6a-66a5a6df9448 for instance f4faf82e-33b1-482e-a400-e57ebf462f65 on n-h2-858384-17 Oct 31 15:26:26.626000 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b57a74e9-331d-4405-8a1d-57aaf2807610 req-99440aa1-52ff-466c-987f-5f4186f0fee6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066568 Oct 31 15:26:26.627136 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1111/2363] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:26.634747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:26.635535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:26.643061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:26.643560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:26.644001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:26.644759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:26.645240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:26.646237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.226364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:27.226364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:27.226364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:27.226364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:27.226364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:27.247866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.248362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.248800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.249569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.250197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.250781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.260997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:27.274385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Getting quotas for project de2d818aea634d5a9e8d6eb3fd902f0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:27.282161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Getting quotas for user d9a767ae59374d86a52a519ab067b27d and project de2d818aea634d5a9e8d6eb3fd902f0c. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:27.299737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:27.303201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:27.376678 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a266cbb7-7fa3-48c5-9ee9-fe51012668f3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.156291 Oct 31 15:26:27.378026 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1253/2364] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:26:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:26:27.389414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:27.401485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:27.415049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.417745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.418863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.420941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.425667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.426112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.465622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.486349 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e436047-2bc3-49c8-bf97-2c89f1a1baf4 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1511 microversion: 2.1 time: 0.857522 Oct 31 15:26:27.502802 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1112/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:26 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1511 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:27.502802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1097350015", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "bf5d2157-6069-42f8-b335-fc42f2652c58"}], "block_device_mapping_v2": [{"uuid": "30e7798d-a6c3-4ed2-92e9-fdbb15251bd8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:27.601215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] validate_networks() for [('bf5d2157-6069-42f8-b335-fc42f2652c58', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:27.622039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '428b6c96ec914bb5ba452c1b198a55e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd8287b40b94c5c99fd7985bd997765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.631489 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c21aaae-6a5f-4f0b-b499-662cab3cb507 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 200 len: 1486 microversion: 2.1 time: 0.252132 Oct 31 15:26:27.636045 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1254/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:27 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 1486 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:27.659905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:27.660594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:27.677973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.678482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.678926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.684948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.685433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.685997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.920138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.943310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.944936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:27.950634 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60de21c1-fdf1-454f-84eb-db00939d6204 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1661 microversion: 2.42 time: 0.301760 Oct 31 15:26:27.953091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1255/2367] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:27 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1661 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:27.966420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:27.968899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:27.990402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.993654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.997247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:27.998126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:27.998975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:27.999672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:28.458622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:28.485000 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d31d753-3823-4252-8cd8-09332fb753da tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1315 microversion: 2.1 time: 0.530463 Oct 31 15:26:28.494290 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1256/2368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:27 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:28.509937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:28.511981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:28.520698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:28.533386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:28.534367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:28.535368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:28.536219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:28.537241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:28.943932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:28.944477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:28.945667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:28.946121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:28.946537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:28.965789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:28.966284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:28.966721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:28.967474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:28.973750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:28.974374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.000810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:29.008337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Getting quotas for user 676d4f2214e848c0aa654f0863b9f4a4 and project 320e16c5c6ba43569e325ed2d7967f6a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:29.173711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:29.177280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30e7798d-a6c3-4ed2-92e9-fdbb15251bd8',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:29.186633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:29.197780 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c3897079-26d7-4e8a-b56d-1caab316e39a tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1212 microversion: 2.1 time: 0.701934 Oct 31 15:26:29.199027 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1257/2369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:28 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1212 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:29.217948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:29.218739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:29.238265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.238982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.240140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.241081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.241730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.242311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.416770 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-436cbafe-240d-44b0-bb68-143322b4378c tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.927409 Oct 31 15:26:29.417676 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1113/2370] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1930 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:26:29.430792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:29.431412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:29.449241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.449746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.450184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.450894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.451347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.451768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.585239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:29.594713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:29.598288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:29.618175 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ee4a6a9c-bc4f-4611-b99c-e9eed2d0cedb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.199387 Oct 31 15:26:29.634237 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1114/2371] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:29 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:29.644541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-80f42a15-97b8-4e44-9e24-18cde7c78e35 req-cf13504c-a5ba-4d5a-9d61-f49e606bf7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc5e627e-059a-4cd3-81bd-b420813823d3", "name": "network-vif-deleted", "tag": "6539b128-c8d2-4b52-b37c-4cbafb3c2877"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:29.667216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-80f42a15-97b8-4e44-9e24-18cde7c78e35 req-cf13504c-a5ba-4d5a-9d61-f49e606bf7d6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.667730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-80f42a15-97b8-4e44-9e24-18cde7c78e35 req-cf13504c-a5ba-4d5a-9d61-f49e606bf7d6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.668160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-80f42a15-97b8-4e44-9e24-18cde7c78e35 req-cf13504c-a5ba-4d5a-9d61-f49e606bf7d6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.697419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-80f42a15-97b8-4e44-9e24-18cde7c78e35 req-cf13504c-a5ba-4d5a-9d61-f49e606bf7d6 service nova] Creating event network-vif-deleted:6539b128-c8d2-4b52-b37c-4cbafb3c2877 for instance cc5e627e-059a-4cd3-81bd-b420813823d3 on n-h1-858384-17 Oct 31 15:26:29.709987 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-80f42a15-97b8-4e44-9e24-18cde7c78e35 req-cf13504c-a5ba-4d5a-9d61-f49e606bf7d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071637 Oct 31 15:26:29.710983 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1115/2372] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:29.728746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:29.729718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] [instance: cc5e627e-059a-4cd3-81bd-b420813823d3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:29.737550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.738298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.738897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.740883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.741629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.742473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.763479 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] HTTP exception thrown: Instance cc5e627e-059a-4cd3-81bd-b420813823d3 could not be found. Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Request method failure captured: Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 HTTP/1.1 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-kHWSHaB0UXypjW2Lp7OljqBa3QYg5JIorTqr0m3StrhFOnec5ntRUQJ5_mmWuPisDDQ6i9LVnnDJpEtEjmjTGSXaGKhKVC49aClHvUg632tJLHDxNrmYj_yrb6SQrfQMIz2fju78vSHvwHZV4fFqF7Xug4tJTlhRjR6-LsWmf3ALo Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: bfd8287b40b94c5c99fd7985bd997765 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1703747428 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfd8287b40b94c5c99fd7985bd997765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bfd8287b40b94c5c99fd7985bd997765", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bfd8287b40b94c5c99fd7985bd997765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bfd8287b40b94c5c99fd7985bd997765"}]}] Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1703747428 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: bfd8287b40b94c5c99fd7985bd997765 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1703747428 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-InstanceActionsNegativeTestJSON-1703747428-project Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 428b6c96ec914bb5ba452c1b198a55e2 Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1703747428-project Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance cc5e627e-059a-4cd3-81bd-b420813823d3 could not be found. Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'cc5e627e-059a-4cd3-81bd-b420813823d3'} Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc5e627e-059a-4cd3-81bd-b420813823d3 could not be found. Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc5e627e-059a-4cd3-81bd-b420813823d3 could not be found. Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:29.765444 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:29.769557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:29.769557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:29.769557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:29.769557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:29.769557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:29.769557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:29.769557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc5e627e-059a-4cd3-81bd-b420813823d3 could not be found. Oct 31 15:26:29.769557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:29.781400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] Returning 404 to user: Instance cc5e627e-059a-4cd3-81bd-b420813823d3 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:29.782522 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c37aae4d-a515-47a3-a9df-19ac3c4402f5 tempest-InstanceActionsNegativeTestJSON-1703747428 tempest-InstanceActionsNegativeTestJSON-1703747428-project] 10.222.0.20 "GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3" status: 404 len: 111 microversion: 2.1 time: 0.070450 Oct 31 15:26:29.787282 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1116/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:29 2022] GET /compute/v2.1/servers/cc5e627e-059a-4cd3-81bd-b420813823d3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:29.792791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:29.793650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:29.799813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.800897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.801666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.803517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:29.804132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:29.804708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:29.874689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:29.897589 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e59524da-7006-4f2a-a060-1e689ea29a37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1451 microversion: 2.1 time: 0.696784 Oct 31 15:26:29.899207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1258/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:29 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1451 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:29.939697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1cd76ccf-3e14-438c-8b27-b0cdd618833d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:29.940807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1cd76ccf-3e14-438c-8b27-b0cdd618833d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.145823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1cd76ccf-3e14-438c-8b27-b0cdd618833d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.167785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1cd76ccf-3e14-438c-8b27-b0cdd618833d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.175133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1cd76ccf-3e14-438c-8b27-b0cdd618833d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.179772 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1cd76ccf-3e14-438c-8b27-b0cdd618833d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1104 microversion: 2.25 time: 0.278678 Oct 31 15:26:30.183328 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1259/2375] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:29 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1104 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:30.197935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:30.199947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.222566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.223076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.229495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.232527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.235154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.237388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.498935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.518145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.519793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.520186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.522344 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04914891-20e5-411e-a9b7-de464896ccc2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1707 microversion: 2.42 time: 0.733578 Oct 31 15:26:30.527964 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1117/2376] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:29 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1707 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:30.533175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:30.538134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.550098 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bbecc6dd-eb35-4c23-bb06-5a967086e7f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1315 microversion: 2.1 time: 0.364832 Oct 31 15:26:30.551053 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1260/2377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:30 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:30.553160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.565571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.567382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.568253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.568811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.569212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:30.569340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.570153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.599638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.604092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.605221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.606184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.608300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:30.616157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.616618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.642775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lazy-loading 'flavor' on Instance uuid f4faf82e-33b1-482e-a400-e57ebf462f65 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:26:30.688710 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Cannot 'shelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state shelved_offloaded Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action HTTP/1.1 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 14 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: {"shelve": {}} Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: exception: Cannot 'shelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state shelved_offloaded Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65', 'body': {'shelve': {}}} Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:26:30.691028 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state shelved_offloaded Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state shelved_offloaded Oct 31 15:26:30.695735 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:26:30.699857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 409 to user: Cannot 'shelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state shelved_offloaded {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:30.702207 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f57f7ab2-3425-43ad-97f5-2d31353334dd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 409 len: 155 microversion: 2.1 time: 0.172832 Oct 31 15:26:30.705666 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1118/2378] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:26:30 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 155 bytes in 177 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:26:30.718521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:30.725748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.732687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.735471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.736242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.738090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.745735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.746525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.830560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:30.846130 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32103e78-286b-42e7-b444-f922d650c2f5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1268 microversion: 2.1 time: 0.293635 Oct 31 15:26:30.849660 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1261/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:30 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1268 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:30.873091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:30.873968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:30.890330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.893624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.894123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.894865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:30.902208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:30.902694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:30.998490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120587) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:26:31.128248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:31.141749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:31.144460 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-28771085-3222-4c38-ba6a-95d9f78fcb17 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 202 len: 0 microversion: 2.1 time: 0.293316 Oct 31 15:26:31.147607 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1262/2380] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:26:30 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:31.157452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:31.158009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:31.158863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:31.170560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.171482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.172066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.172923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.182866 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1b02a1db-8f1c-4e3c-b522-dc3647d7dbcf tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.468631 Oct 31 15:26:31.184214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.185348 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1119/2381] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:30 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:31.187824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.208197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:31.208863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:31.221613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.222599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.223077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.223946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.224401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.226239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.384964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:31.402438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:31.402800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:31.404511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:31.405934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4416c065-ec81-4bf8-bc5f-f4f9e3c87168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1233 microversion: 2.25 time: 0.201966 Oct 31 15:26:31.406719 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1120/2382] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:31 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1233 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:31.425606 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-79ce535a-20ba-4f59-aa38-7d9b931d5681 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1459 microversion: 2.1 time: 0.272384 Oct 31 15:26:31.427297 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1263/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:31 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1459 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:31.557714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:31.558651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:31.574942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.575617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.576160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.576975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.577571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.578086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.580663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:31.582142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:31.589637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.590332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.592737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:31.595084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:31.595866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:31.596701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.106134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.121825 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05307c79-4ed3-4c03-b9bc-6c563470e9e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1315 microversion: 2.1 time: 0.550343 Oct 31 15:26:32.128953 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1264/2384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:31 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:32.137650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d6c546b9-d42a-402c-b8c6-fa04bedfba58 req-4c0ed488-8807-41da-9e64-da0453670f88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b0b18c-6da5-43e6-8048-2ce0c8932f0a", "tag": "0a81f122-86b6-474f-8064-6c9a3bb36467"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:32.173464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d6c546b9-d42a-402c-b8c6-fa04bedfba58 req-4c0ed488-8807-41da-9e64-da0453670f88 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.176587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d6c546b9-d42a-402c-b8c6-fa04bedfba58 req-4c0ed488-8807-41da-9e64-da0453670f88 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.181006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d6c546b9-d42a-402c-b8c6-fa04bedfba58 req-4c0ed488-8807-41da-9e64-da0453670f88 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.234973 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d6c546b9-d42a-402c-b8c6-fa04bedfba58 req-4c0ed488-8807-41da-9e64-da0453670f88 service nova] Creating event network-changed:0a81f122-86b6-474f-8064-6c9a3bb36467 for instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a on n-h2-858384-17 Oct 31 15:26:32.254526 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d6c546b9-d42a-402c-b8c6-fa04bedfba58 req-4c0ed488-8807-41da-9e64-da0453670f88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123968 Oct 31 15:26:32.258325 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1265/2385] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:32.266823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:32.284299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:32.289002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:32.310444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.316748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.319297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.320982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.326239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.327761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.549695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.574138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.575609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.577684 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7bcad034-c236-490b-b4a6-a3bf009302f7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1753 microversion: 2.42 time: 1.026250 Oct 31 15:26:32.578244 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1121/2386] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:31 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1753 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:32.593491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:32.594278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:32.614241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.614892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.615064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.616827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.617656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.618275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.624199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.649750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f1dcf864-b8c3-4b43-8f4b-45be86a820a6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1274 microversion: 2.1 time: 0.386904 Oct 31 15:26:32.670820 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1266/2387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:32 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1274 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:32.679006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1b29f803-a326-429d-996b-05a872027172 req-5ae3a903-fb91-4107-98d3-c0d2f7f383a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b578558c-004b-4234-86f9-66dde88aace5", "name": "network-vif-plugged", "status": "completed", "tag": "f8a46ca6-1cde-461e-a14d-5b3e4d00cc3d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:32.711296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1b29f803-a326-429d-996b-05a872027172 req-5ae3a903-fb91-4107-98d3-c0d2f7f383a6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.712332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1b29f803-a326-429d-996b-05a872027172 req-5ae3a903-fb91-4107-98d3-c0d2f7f383a6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.712769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1b29f803-a326-429d-996b-05a872027172 req-5ae3a903-fb91-4107-98d3-c0d2f7f383a6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.735517 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1b29f803-a326-429d-996b-05a872027172 req-5ae3a903-fb91-4107-98d3-c0d2f7f383a6 service nova] Creating event network-vif-plugged:f8a46ca6-1cde-461e-a14d-5b3e4d00cc3d for instance b578558c-004b-4234-86f9-66dde88aace5 on n-h2-858384-17 Oct 31 15:26:32.745570 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1b29f803-a326-429d-996b-05a872027172 req-5ae3a903-fb91-4107-98d3-c0d2f7f383a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071826 Oct 31 15:26:32.750367 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1267/2388] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:32.768635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:32.770911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:32.785491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.786008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.786503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.787228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.787686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.788112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.889974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.898990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.900428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:32.916133 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c8ac83df-8ca7-4b4f-a72f-742d8debe1c6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.333340 Oct 31 15:26:32.916725 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1122/2389] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:32 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:32.925275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:32.929976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:32.955601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.956417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.956950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.957940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:32.958644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:32.959444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:32.985627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.006990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.008510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.014727 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2911abaf-d78d-4c23-b9e4-ec318b3353aa tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1251 microversion: 2.25 time: 0.262777 Oct 31 15:26:33.025167 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1268/2390] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:32 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1251 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:33.148439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:33.149097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:33.162172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.162924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.163577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.166023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.166718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.169310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.446016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.465514 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-362fa997-e7ff-4c7c-801d-efebffa3ebea tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1315 microversion: 2.1 time: 0.320807 Oct 31 15:26:33.466830 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1269/2391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:33 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:33.605831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:33.606590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:33.616058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.617565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.618301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.619224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.619881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.620499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.766294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.775237 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d198cfba-472a-4d43-9ddb-98bb4c0c1da6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1461 microversion: 2.1 time: 0.853767 Oct 31 15:26:33.776477 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1123/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:32 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1461 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:33.781816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:33.782682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:33.790338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.792632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.793325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.794271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.794943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.795588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.910376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.923651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.925449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:33.927609 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c14ccb8-566e-4652-913e-c7e79e6a2b83 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1799 microversion: 2.42 time: 0.324822 Oct 31 15:26:33.928842 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1270/2393] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:33 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1799 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:33.951309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:33.952443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:33.964579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.965458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.966516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:33.968123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:33.968797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:33.969729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.018290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.032279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-103cebb8-9882-4c33-90b1-7e20abb94269 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1274 microversion: 2.1 time: 0.253310 Oct 31 15:26:34.065839 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1124/2394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:33 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1274 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:34.078810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.083883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:34.084153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:34.086527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:34.096184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.097689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.105426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.107325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.108197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.111562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.112367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.112488 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f800903-e405-48b3-bb43-24540792c39d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.168048 Oct 31 15:26:34.129200 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1271/2395] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:33 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:34.129415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.336533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.353447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.365303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:34.381400 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61574f68-a913-405f-a0c7-89d30c1f4afb tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1251 microversion: 2.25 time: 0.300127 Oct 31 15:26:34.383762 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1125/2396] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:34 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1251 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:34.491607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:34.495338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:34.532445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.546253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.547075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.548544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.554352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.554993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.804080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:34.805506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:34.819559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.820053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.820490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:34.821237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:34.825768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:34.828400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.563771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:35.590263 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2090f5a-6109-4764-bc10-357d73dfe430 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1315 microversion: 2.1 time: 1.101261 Oct 31 15:26:35.592930 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1272/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:34 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1315 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:35.603246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:35.607204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:35.625730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.626901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.627566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.631468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.634693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.635160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.925216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:35.937176 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56a2dff1-478a-45dc-8478-622221353ebc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 1.138270 Oct 31 15:26:35.938371 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1126/2398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:34 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:26:35.945465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:35.946282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:35.953629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.954608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.955485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:35.956636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:35.957970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:35.960518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.029834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.040727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.054182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.055765 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4599f670-f9b4-4d46-960c-d10b4e159f1b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1845 microversion: 2.42 time: 0.461416 Oct 31 15:26:36.056439 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1273/2399] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:35 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1845 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:36.061287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:36.069489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:36.081624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.088875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.091167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.094528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.095482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.097344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.253167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.303774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.312631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.332747 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-579eed66-0729-42b7-903c-1085d2ee2045 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.274210 Oct 31 15:26:36.335718 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1274/2400] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:36 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:36.343833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:36.345879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:36.360149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.360826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.361357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.385010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.392763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.395489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.800633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.810225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.814928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.819074 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0198368c-ae99-49f8-b2fc-e0bb2ee19702 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1293 microversion: 2.25 time: 0.479354 Oct 31 15:26:36.821872 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1275/2401] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:36 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1293 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:36.831330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ae9dc179-b688-4860-a047-6eb6ce36dcf3 req-2503c3a7-a12a-4895-988e-050a3bdb6429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b578558c-004b-4234-86f9-66dde88aace5", "name": "network-vif-deleted", "tag": "f8a46ca6-1cde-461e-a14d-5b3e4d00cc3d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:36.854610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ae9dc179-b688-4860-a047-6eb6ce36dcf3 req-2503c3a7-a12a-4895-988e-050a3bdb6429 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.855581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ae9dc179-b688-4860-a047-6eb6ce36dcf3 req-2503c3a7-a12a-4895-988e-050a3bdb6429 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.855900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ae9dc179-b688-4860-a047-6eb6ce36dcf3 req-2503c3a7-a12a-4895-988e-050a3bdb6429 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.868906 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ae9dc179-b688-4860-a047-6eb6ce36dcf3 req-2503c3a7-a12a-4895-988e-050a3bdb6429 service nova] Creating event network-vif-deleted:f8a46ca6-1cde-461e-a14d-5b3e4d00cc3d for instance b578558c-004b-4234-86f9-66dde88aace5 on n-h2-858384-17 Oct 31 15:26:36.874509 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ae9dc179-b688-4860-a047-6eb6ce36dcf3 req-2503c3a7-a12a-4895-988e-050a3bdb6429 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050972 Oct 31 15:26:36.874661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:36.875716 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1276/2402] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:36.884427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:36.885548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:36.893619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.894357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.895035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.896332 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c80727d-cd84-4ade-81f5-5493997e9e9f tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1316 microversion: 2.1 time: 0.955061 Oct 31 15:26:36.896976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.897769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.898107 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1127/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:35 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1316 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:36.910217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.966124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:36.967357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:36.987576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.988276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.988897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:36.989904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:36.990393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:36.990818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.201829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:37.217310 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a396cd79-50e9-4ae1-aa64-25362bf9a346 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1294 microversion: 2.1 time: 0.339349 Oct 31 15:26:37.220905 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1277/2404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:36 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1294 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:37.232112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.233425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.242521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.246840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.247502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.249153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.250163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.250778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.284286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:37.632166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:37.650104 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b94afdef-cfa9-4442-8d7d-b21fdb1cf5a8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.687957 Oct 31 15:26:37.651607 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1128/2405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:36 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:37.658594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.659486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.670155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.670953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.674168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.691484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:37.710356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.710969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.711424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.717952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:37.722887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:37.724364 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd1a2ca8-2864-42e1-9d85-2c943fb571c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1845 microversion: 2.42 time: 0.500736 Oct 31 15:26:37.727795 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1278/2406] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1845 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:37.848502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:37.849819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:37.856172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.856938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.858208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:37.859107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:37.861070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:37.861723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.052781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.061943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.066942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.082067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-685653bc-83ef-4e50-ba25-b80fd6c08b7c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.428988 Oct 31 15:26:38.084073 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1129/2407] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:38.095787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:38.096668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:38.115946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.116915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.117546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.119032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.119686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.120276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.319151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.329079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.331610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.332979 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a883ff14-c740-42ce-8cb8-2f86727d7cd3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1293 microversion: 2.25 time: 0.488400 Oct 31 15:26:38.349249 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1279/2408] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:37 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1293 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:38.364707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:38.367254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:38.374985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.375762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.376488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.377572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.378249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.378886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.504841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.515380 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99abf42a-ff99-4727-a7bd-4674d05438c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1294 microversion: 2.1 time: 0.164687 Oct 31 15:26:38.530346 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1280/2409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:38 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1294 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:38.679337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:38.680304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:38.691171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.695862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.696483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.697846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.701015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.701832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.790514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.799585 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1484fcea-b45f-46f4-bb9f-c949f5b5b345 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1316 microversion: 2.1 time: 0.714237 Oct 31 15:26:38.805280 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1130/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:38 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1316 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:38.810204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:38.819723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:38.835367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.836079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.836684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.837643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:38.838325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:38.839449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:38.954510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:38.965382 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-239f34ac-1b4d-4e82-a828-eff1e83fcc38 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.291147 Oct 31 15:26:38.979954 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1281/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:38 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:38.987408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:38.995228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-08433bc0-da52-496e-9960-8a649ffcabd5 req-f2722e69-d1ca-446d-9c0d-7f71f903a693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4faf82e-33b1-482e-a400-e57ebf462f65", "tag": "5c17a2b4-0599-4cd9-ac6a-66a5a6df9448"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:39.006836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-08433bc0-da52-496e-9960-8a649ffcabd5 req-f2722e69-d1ca-446d-9c0d-7f71f903a693 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.007326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-08433bc0-da52-496e-9960-8a649ffcabd5 req-f2722e69-d1ca-446d-9c0d-7f71f903a693 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.007765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-08433bc0-da52-496e-9960-8a649ffcabd5 req-f2722e69-d1ca-446d-9c0d-7f71f903a693 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.016891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:39.025000 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-08433bc0-da52-496e-9960-8a649ffcabd5 req-f2722e69-d1ca-446d-9c0d-7f71f903a693 service nova] Creating event network-changed:5c17a2b4-0599-4cd9-ac6a-66a5a6df9448 for instance f4faf82e-33b1-482e-a400-e57ebf462f65 on n-h1-858384-17 Oct 31 15:26:39.031436 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-08433bc0-da52-496e-9960-8a649ffcabd5 req-f2722e69-d1ca-446d-9c0d-7f71f903a693 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049731 Oct 31 15:26:39.032596 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1282/2412] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:39.043479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6a3270d5-08eb-42f4-a586-eed4d480994c req-37434704-51a3-4d74-80af-40a1ccef895c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "tag": "09848140-2371-4ed5-87cf-2d323d065746"}, {"name": "network-changed", "server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "tag": "d6cf71ce-0b17-4158-9482-cf6b74f884a5"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:39.058822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6a3270d5-08eb-42f4-a586-eed4d480994c req-37434704-51a3-4d74-80af-40a1ccef895c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.059942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6a3270d5-08eb-42f4-a586-eed4d480994c req-37434704-51a3-4d74-80af-40a1ccef895c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.060388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6a3270d5-08eb-42f4-a586-eed4d480994c req-37434704-51a3-4d74-80af-40a1ccef895c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.075292 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6a3270d5-08eb-42f4-a586-eed4d480994c req-37434704-51a3-4d74-80af-40a1ccef895c service nova] Creating event network-changed:09848140-2371-4ed5-87cf-2d323d065746 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:26:39.075807 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6a3270d5-08eb-42f4-a586-eed4d480994c req-37434704-51a3-4d74-80af-40a1ccef895c service nova] Creating event network-changed:d6cf71ce-0b17-4158-9482-cf6b74f884a5 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:26:39.083114 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6a3270d5-08eb-42f4-a586-eed4d480994c req-37434704-51a3-4d74-80af-40a1ccef895c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048892 Oct 31 15:26:39.084032 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1283/2413] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:39.132273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:39.133483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:39.141083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.142451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.143254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.144207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.144883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.146271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.279279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.291309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.293859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.301805 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d1feae5-d2c9-47e1-89a1-7911dfe5d1ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1558 microversion: 2.91 time: 0.179236 Oct 31 15:26:39.304345 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1284/2414] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:39 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:39.366422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:39.367279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:39.374710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.375494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.375944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.376844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.377394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.377827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.761629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.771744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.778584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.781841 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02b80f57-64f2-4a1d-a954-4c58d228cdab tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1293 microversion: 2.25 time: 0.419978 Oct 31 15:26:39.782566 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1285/2415] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:39 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1293 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:26:39.788709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:39.794116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:39.807521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.807521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.808154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.808987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.809742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.810173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.848571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.849997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.850677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.851239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lazy-loading 'fault' on Instance uuid b578558c-004b-4234-86f9-66dde88aace5 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:26:39.922116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:39.939081 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f210fd45-0e64-49aa-ae16-4d2ce872a3ba tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 200 len: 1305 microversion: 2.1 time: 0.155351 Oct 31 15:26:39.939689 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1286/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:39 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 1305 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:39.954059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:39.954688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:39.967222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.968052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.968741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:39.970430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:39.971103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:39.971737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.046353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:40.068622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:40.070838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:40.073035 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a9b93d69-cd46-403e-a1ab-91aa942369f4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1866 microversion: 2.42 time: 1.266659 Oct 31 15:26:40.073818 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1131/2417] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:38 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1866 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:40.084505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:40.085249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:40.116536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.117115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.117644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.121869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.122555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.123309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.168210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=14 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:40.608329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:40.616682 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ac2d94b-51e7-4c7b-8354-722771ca0448 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1316 microversion: 2.1 time: 0.674012 Oct 31 15:26:40.638200 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1287/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:39 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1316 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:40.648544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:40.650386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:40.670112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.670609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.671042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.671958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.672555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.673299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.736486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:40.751447 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e86f6ed9-9951-4f71-8a87-00329b349eb5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.674507 Oct 31 15:26:40.755916 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1132/2419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:40 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:40.808760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:40.809524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:40.818128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.819314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.819806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:40.824164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:40.824859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:40.825520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.002654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.031097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.045550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.061787 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de3510f4-835c-4531-a6f2-f258194ec288 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.422190 Oct 31 15:26:41.063326 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1288/2420] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:40 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:41.072883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:41.073566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:41.098642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.099456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.100046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.100865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.101400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.101834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.139471 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 HTTP/1.1 Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b578558c-004b-4234-86f9-66dde88aace5'} Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:26:41.148103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:41.153104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:26:41.153104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:26:41.153104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:26:41.153104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:26:41.153104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:26:41.153104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:26:41.153104 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:26:41.153104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:26:41.153104 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-47e5fc40-6818-44d7-a165-4738dd8c1cfa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 404 len: 111 microversion: 2.1 time: 0.085748 Oct 31 15:26:41.172535 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1289/2421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:41 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:26:41.179493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:41.184565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:41.192394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.193860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.194709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.195593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.195880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.196310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.845805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.865355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.873049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:41.878536 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3ca73a6-9b49-435d-bec4-1f47a2064ac2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1293 microversion: 2.25 time: 1.074003 Oct 31 15:26:41.893204 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1133/2422] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:40 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1293 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:41.915375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-33131049-48ea-4b36-8ba7-a906135f9c0d req-8caa01a4-2e53-4afb-a0d7-f934b7cf76b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea428e40-0e1d-48e6-94b9-d8da0769dd5f", "tag": "43b69508-97d3-44f8-9057-8554a2155279"}, {"name": "network-changed", "server_uuid": "dda8a8fb-a7fe-40c6-a043-4ab745171b12", "tag": "0676a67e-c7b2-4713-bb5b-a960b92c3471"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:41.969790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-33131049-48ea-4b36-8ba7-a906135f9c0d req-8caa01a4-2e53-4afb-a0d7-f934b7cf76b0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:41.974046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-33131049-48ea-4b36-8ba7-a906135f9c0d req-8caa01a4-2e53-4afb-a0d7-f934b7cf76b0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:41.976686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-33131049-48ea-4b36-8ba7-a906135f9c0d req-8caa01a4-2e53-4afb-a0d7-f934b7cf76b0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:41.997888 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-33131049-48ea-4b36-8ba7-a906135f9c0d req-8caa01a4-2e53-4afb-a0d7-f934b7cf76b0 service nova] Creating event network-changed:43b69508-97d3-44f8-9057-8554a2155279 for instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f on n-h2-858384-17 Oct 31 15:26:41.998770 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-33131049-48ea-4b36-8ba7-a906135f9c0d req-8caa01a4-2e53-4afb-a0d7-f934b7cf76b0 service nova] Creating event network-changed:0676a67e-c7b2-4713-bb5b-a960b92c3471 for instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 on n-h1-858384-17 Oct 31 15:26:42.011954 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-33131049-48ea-4b36-8ba7-a906135f9c0d req-8caa01a4-2e53-4afb-a0d7-f934b7cf76b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.131063 Oct 31 15:26:42.018917 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1134/2423] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:42.038675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1977145095", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "c356d61f-2e01-42fa-9c99-c94fb61838ec"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:42.224808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:42.229084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:42.251553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:42.261485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:42.263145 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-06ab8bae-e009-4d33-93ce-9da87eb761e0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1887 microversion: 2.42 time: 1.089066 Oct 31 15:26:42.270065 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1290/2424] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:41 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1887 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:42.293544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:42.294829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:42.316462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.324437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.330437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:42.340294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:42.344546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:42.345316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.291068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:43.300237 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5cc7694-eb79-4e6c-9d9a-8c2210ea6fa3 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1316 microversion: 2.1 time: 1.028132 Oct 31 15:26:43.306119 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1291/2425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:42 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1316 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:43.318958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:43.320027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:43.339078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.339929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.340621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:43.341615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:43.347909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:43.353294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.370644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:44.385663 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bcfc7a0c-75ff-4abe-be5c-5c5b81230982 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 1.078099 Oct 31 15:26:44.386258 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1292/2426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:43 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:44.402731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:44.406627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:44.424064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.424573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.425022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.434202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.436162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.436675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.774389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:44.801497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:44.804929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:44.826846 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae2b7e7e-c1ef-4d06-b9a9-eb725d98dc09 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.437320 Oct 31 15:26:44.831512 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1293/2427] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:44 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:44.855591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-453f2453-c81b-4957-a3e7-23ef58dd782e req-2d4fc3fa-4eac-4da5-b565-aa2601dac24b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "tag": "e99aa557-85c0-4573-88a4-2fe810a71e21"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:44.906136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-453f2453-c81b-4957-a3e7-23ef58dd782e req-2d4fc3fa-4eac-4da5-b565-aa2601dac24b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:44.907033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-453f2453-c81b-4957-a3e7-23ef58dd782e req-2d4fc3fa-4eac-4da5-b565-aa2601dac24b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:44.907930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-453f2453-c81b-4957-a3e7-23ef58dd782e req-2d4fc3fa-4eac-4da5-b565-aa2601dac24b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:44.961770 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-453f2453-c81b-4957-a3e7-23ef58dd782e req-2d4fc3fa-4eac-4da5-b565-aa2601dac24b service nova] Creating event network-changed:e99aa557-85c0-4573-88a4-2fe810a71e21 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:26:44.978908 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-453f2453-c81b-4957-a3e7-23ef58dd782e req-2d4fc3fa-4eac-4da5-b565-aa2601dac24b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145203 Oct 31 15:26:44.984418 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1294/2428] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:45.012500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:45.015678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:45.041854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.046342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.046989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:45.051212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.053349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.059417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:45.559215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:45.586886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:45.588630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:45.589769 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f65a80b4-a599-41cb-9357-f08843e55ccc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1293 microversion: 2.25 time: 0.597557 Oct 31 15:26:45.615088 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1295/2429] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:44 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1293 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:45.620796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:45.623743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:45.640302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.641039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.641680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:45.642542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:45.643142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:45.643729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:46.696564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:46.766180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:46.780733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:46.785989 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b4423d6-fab8-4bcb-87a2-9f4188ef0318 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1887 microversion: 2.42 time: 1.169558 Oct 31 15:26:46.787423 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1296/2430] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:45 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1887 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:46.798020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:46.800561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:46.815722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:46.817739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:46.818229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:46.819049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:46.819517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:46.819942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.732239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:47.750450 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1d7cb420-66b9-4792-b690-1c0374936377 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1316 microversion: 2.1 time: 0.960016 Oct 31 15:26:47.779405 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1297/2431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:46 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1316 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:47.791269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:47.791877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:47.824567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.824985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.825490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:47.826217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:47.833010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:47.834251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.631151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:48.640114 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e5243866-f056-4da5-b79b-e21701b2934b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.853205 Oct 31 15:26:48.653715 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1298/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:47 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:48.664975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:48.666053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:48.672997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.673982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.674593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.675530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.676200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.676850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.788889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:48.806156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:48.810067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:48.828058 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80c8994b-d1c8-4843-9c5a-1d75ce02e461 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.172818 Oct 31 15:26:48.828956 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1299/2433] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:48 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:48.837568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:48.838187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:48.865350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.866253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.866821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:48.870700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:48.872856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:48.872856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:49.237634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:49.260023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:49.264188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:49.270379 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34f1f26f-000b-4118-996c-e806151c8be5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1281 microversion: 2.25 time: 0.435345 Oct 31 15:26:49.290486 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1300/2434] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:48 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1281 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:49.303504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d521fda4-1f95-4112-986e-498930877410 req-77d85005-34ce-4491-b464-1b523f5079c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "tag": "c2a80bb3-9c3f-48a0-9d1e-6beeb88fd04e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:49.322710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d521fda4-1f95-4112-986e-498930877410 req-77d85005-34ce-4491-b464-1b523f5079c8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:49.323454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d521fda4-1f95-4112-986e-498930877410 req-77d85005-34ce-4491-b464-1b523f5079c8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.324219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d521fda4-1f95-4112-986e-498930877410 req-77d85005-34ce-4491-b464-1b523f5079c8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:49.358957 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d521fda4-1f95-4112-986e-498930877410 req-77d85005-34ce-4491-b464-1b523f5079c8 service nova] Creating event network-changed:c2a80bb3-9c3f-48a0-9d1e-6beeb88fd04e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:26:49.371273 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d521fda4-1f95-4112-986e-498930877410 req-77d85005-34ce-4491-b464-1b523f5079c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078978 Oct 31 15:26:49.372663 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1301/2435] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:49.548470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4343c3ed-cb3d-4dda-8bd3-1487fb6c3fb7 req-374ff181-7a89-4879-afd4-8308d218b730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea428e40-0e1d-48e6-94b9-d8da0769dd5f", "name": "network-vif-plugged", "status": "completed", "tag": "43b69508-97d3-44f8-9057-8554a2155279"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:49.571150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4343c3ed-cb3d-4dda-8bd3-1487fb6c3fb7 req-374ff181-7a89-4879-afd4-8308d218b730 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:49.572016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4343c3ed-cb3d-4dda-8bd3-1487fb6c3fb7 req-374ff181-7a89-4879-afd4-8308d218b730 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.572797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4343c3ed-cb3d-4dda-8bd3-1487fb6c3fb7 req-374ff181-7a89-4879-afd4-8308d218b730 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:49.628730 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4343c3ed-cb3d-4dda-8bd3-1487fb6c3fb7 req-374ff181-7a89-4879-afd4-8308d218b730 service nova] Creating event network-vif-plugged:43b69508-97d3-44f8-9057-8554a2155279 for instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f on n-h2-858384-17 Oct 31 15:26:49.671020 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4343c3ed-cb3d-4dda-8bd3-1487fb6c3fb7 req-374ff181-7a89-4879-afd4-8308d218b730 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.278508 Oct 31 15:26:49.672655 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1302/2436] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:49.696620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:49.700998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:49.717943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:49.728466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.729162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:49.730568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:49.736228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:49.736814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:50.433533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:50.480090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:50.484325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:50.499217 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee4b0d6a-630e-4284-8191-c45f429886d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1887 microversion: 2.42 time: 0.814133 Oct 31 15:26:50.502770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1303/2437] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:49 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1887 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:50.530963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:50.533122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:50.564406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:50.571820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:50.578474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:50.578474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:50.578474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:50.578474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:50.947872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:50.976261 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25f31b3e-cdfd-4893-a8fd-b3d7ca374727 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1316 microversion: 2.1 time: 0.472366 Oct 31 15:26:50.996809 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1304/2438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:50 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:51.044052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:51.046263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:51.070628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:51.071464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:51.072253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:51.073774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:51.074421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:51.075123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:51.619659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.628778 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-edf7550f-1b00-48a2-ba5a-e12b05c14e13 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.601244 Oct 31 15:26:51.631862 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1305/2439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:50 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:51.667645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:51.670747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:51.706896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:51.728414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:51.728971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:51.729788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:51.730281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:51.730722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:51.959985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.979026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.980754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:51.986530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:51.987934 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e8e19ef-9b76-4225-87c6-d6aa2b8bee6c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.353527 Oct 31 15:26:51.988753 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1306/2440] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:51 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:51.999559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:52.000437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:52.025535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.026525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.027824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.030361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.031047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.032385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.089688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:52.378804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.391935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.394841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:52.398245 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f249b706-d55d-4617-8215-fc0d29dd0ba5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1281 microversion: 2.25 time: 0.402519 Oct 31 15:26:52.414424 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1307/2441] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:51 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1281 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:52.421173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b90354b5-68a9-436d-9329-01c3ff7d8c7e req-6366953a-761a-4af5-a9b0-b54f2ebf6f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "tag": "f7b1863f-6b3c-4899-8a17-846c72b01a0e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:52.445857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:52.448028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b90354b5-68a9-436d-9329-01c3ff7d8c7e req-6366953a-761a-4af5-a9b0-b54f2ebf6f60 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.448682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b90354b5-68a9-436d-9329-01c3ff7d8c7e req-6366953a-761a-4af5-a9b0-b54f2ebf6f60 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.456259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b90354b5-68a9-436d-9329-01c3ff7d8c7e req-6366953a-761a-4af5-a9b0-b54f2ebf6f60 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.482400 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b90354b5-68a9-436d-9329-01c3ff7d8c7e req-6366953a-761a-4af5-a9b0-b54f2ebf6f60 service nova] Creating event network-changed:f7b1863f-6b3c-4899-8a17-846c72b01a0e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:26:52.496307 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b90354b5-68a9-436d-9329-01c3ff7d8c7e req-6366953a-761a-4af5-a9b0-b54f2ebf6f60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079956 Oct 31 15:26:52.497521 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1308/2442] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:52.514967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:52.515959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:52.531266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.533725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.535274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:52.537374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:52.538040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:52.541705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.295051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:53.318236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:53.322353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:53.327044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32a3f722-be8e-4228-832e-03f80d8e82e2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1887 microversion: 2.42 time: 0.826907 Oct 31 15:26:53.328269 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1309/2443] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:52 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1887 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:53.342513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:53.345481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:53.365507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.366627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.368907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.369901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.370529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.372718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.386443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:26:53.770379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:53.782978 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f811299-60b0-4a54-bb98-d3e7b2fecf72 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1504 microversion: 2.1 time: 0.451713 Oct 31 15:26:53.799488 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1310/2444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:53 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:53.813654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:53.814780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:53.824347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.825236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.825916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:53.826913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:53.827577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:53.828211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.319634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:54.332171 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b91ec27b-d5a5-4867-a506-57f39409e967 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.530530 Oct 31 15:26:54.351173 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1311/2445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:53 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:54.375610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:54.376737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:54.397393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.398191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.398809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.399693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.400492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.401089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.585326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:54.596234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:54.609914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:54.616255 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bcee54b-ee0b-4553-b856-40f599e2f04d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.255035 Oct 31 15:26:54.628266 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1312/2446] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:54 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:54.632729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:54.642226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:54.657246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.657858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.658368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:54.659325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:54.659854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:54.660411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:55.166828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:55.180472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:55.186182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:55.187398 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89f81106-3ec0-4a31-b25e-a628ae6892b1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1281 microversion: 2.25 time: 0.569054 Oct 31 15:26:55.194439 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1313/2447] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:54 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1281 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:55.205528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1251872695"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:55.206070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:55.219942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:55.220385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:55.220818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:55.225782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:55.227133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:55.227625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:55.732880 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Adding security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 to port 43b69508-97d3-44f8-9057-8554a2155279 Oct 31 15:26:57.379446 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b01cd347-363d-42b8-9bc4-63b02ed3b2cf tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f/action" status: 202 len: 0 microversion: 2.1 time: 2.161709 Oct 31 15:26:57.379446 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1314/2448] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:26:55 2022] POST /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f/action => generated 0 bytes in 2163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:26:57.379446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:57.379446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:57.393193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:57.394208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:57.395561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:57.397964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:57.398580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:57.399597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:57.537617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] validate_networks() for [('c356d61f-2e01-42fa-9c99-c94fb61838ec', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:26:58.125948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:58.142232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:58.149591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:58.153821 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d903477-5346-4a5b-82cf-90babc68df92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1887 microversion: 2.42 time: 0.793366 Oct 31 15:26:58.161185 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1315/2449] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:57 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1887 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:58.174105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ff73631c-55b6-44d5-b563-b57b84d86c2c req-e3d5a096-38dc-4de2-9386-b5ebb022d8be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "tag": "1e16090b-0a3b-4c92-81fa-daf4885f848e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:26:58.202042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ff73631c-55b6-44d5-b563-b57b84d86c2c req-e3d5a096-38dc-4de2-9386-b5ebb022d8be service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:58.203714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ff73631c-55b6-44d5-b563-b57b84d86c2c req-e3d5a096-38dc-4de2-9386-b5ebb022d8be service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:58.215069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ff73631c-55b6-44d5-b563-b57b84d86c2c req-e3d5a096-38dc-4de2-9386-b5ebb022d8be service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:58.247388 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ff73631c-55b6-44d5-b563-b57b84d86c2c req-e3d5a096-38dc-4de2-9386-b5ebb022d8be service nova] Creating event network-changed:1e16090b-0a3b-4c92-81fa-daf4885f848e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:26:58.260015 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ff73631c-55b6-44d5-b563-b57b84d86c2c req-e3d5a096-38dc-4de2-9386-b5ebb022d8be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096234 Oct 31 15:26:58.268317 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1316/2450] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:26:58.278335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:58.285886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:58.302568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:58.303076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:58.307695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:58.308674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:58.309187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:58.309635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:58.800962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:26:58.802663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:26:58.803537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:26:58.804107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:26:58.806082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:26:58.827639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:58.829096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:58.832000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:58.833008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:58.836289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:58.836968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:58.892871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:26:58.917631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for user 93f77a1d41fd431d9da6587e0ca9cb1e and project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:26:58.957790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:26:58.971242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:26:59.139242 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0454dc54-d029-49f5-9a79-9bf77b64fcd1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 17.119084 Oct 31 15:26:59.151808 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1135/2451] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 17126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:26:59.169677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:59.170567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:59.202885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:59.203541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:59.206916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:59.212384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:59.215526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:59.216551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:59.660773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:59.669934 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e3b30f7-2141-4f5c-9e9c-e7e5cc5c7b4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 1.399913 Oct 31 15:26:59.673480 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1317/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:26:58 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:26:59.685093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:26:59.686824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:26:59.708737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:59.711697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:59.713638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:59.715680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:26:59.716331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:26:59.718221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:26:59.831924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:59.843605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:59.856928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:26:59.872799 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0e82588-a410-4a97-9bc7-bae1ad045dda tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1535 microversion: 2.91 time: 0.719705 Oct 31 15:26:59.879457 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1136/2453] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:59 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1535 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:26:59.890484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9d5765c-8dfc-4923-a633-ff33075411e6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e566ea60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:00.085087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.107056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.116844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.120095 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f18ee69b-923d-4da2-a5a5-168791c25ca1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1281 microversion: 2.25 time: 0.443528 Oct 31 15:27:00.137225 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1318/2454] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:26:59 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1281 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:00.151589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7114634-6831-400c-b535-54542ebb1705 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:00.152263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f7114634-6831-400c-b535-54542ebb1705 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:00.221442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f7114634-6831-400c-b535-54542ebb1705 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.230348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7114634-6831-400c-b535-54542ebb1705 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1215 microversion: 2.1 time: 0.090847 Oct 31 15:27:00.246740 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1319/2455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:00 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:00.252103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:00.253505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:00.259719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG neutronclient.v2_0.client [None req-e9d5765c-8dfc-4923-a633-ff33075411e6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group cd0ca71e-d201-4ea9-95e4-e284e0e13558 in use.", "detail": ""}} {{(pid=120588) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:27:00.260443 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-e9d5765c-8dfc-4923-a633-ff33075411e6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security Group cd0ca71e-d201-4ea9-95e4-e284e0e13558 in use. Oct 31 15:27:00.260443 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-c0d93903-1f57-4b59-b373-0a663d4cf9d7'] Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9d5765c-8dfc-4923-a633-ff33075411e6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-security-groups/cd0ca71e-d201-4ea9-95e4-e284e0e13558 HTTP/1.1 Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: exception: Security Group cd0ca71e-d201-4ea9-95e4-e284e0e13558 in use. Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-c0d93903-1f57-4b59-b373-0a663d4cf9d7'] Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'cd0ca71e-d201-4ea9-95e4-e284e0e13558'} Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:27:00.262458 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group cd0ca71e-d201-4ea9-95e4-e284e0e13558 in use. Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0d93903-1f57-4b59-b373-0a663d4cf9d7'] Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group cd0ca71e-d201-4ea9-95e4-e284e0e13558 in use. Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0d93903-1f57-4b59-b373-0a663d4cf9d7'] Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group cd0ca71e-d201-4ea9-95e4-e284e0e13558 in use. Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0d93903-1f57-4b59-b373-0a663d4cf9d7'] Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group cd0ca71e-d201-4ea9-95e4-e284e0e13558 in use. Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0d93903-1f57-4b59-b373-0a663d4cf9d7'] Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9d5765c-8dfc-4923-a633-ff33075411e6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 400 to user: Security Group cd0ca71e-d201-4ea9-95e4-e284e0e13558 in use. Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-c0d93903-1f57-4b59-b373-0a663d4cf9d7'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9d5765c-8dfc-4923-a633-ff33075411e6 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cd0ca71e-d201-4ea9-95e4-e284e0e13558" status: 400 len: 185 microversion: 2.1 time: 0.381551 Oct 31 15:27:00.266549 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1137/2456] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:26:59 2022] DELETE /compute/v2.1/os-security-groups/cd0ca71e-d201-4ea9-95e4-e284e0e13558 => generated 185 bytes in 383 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:27:00.269023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.269023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.269023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.269023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.269023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.269023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.269435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-73de19e2-c16c-44e0-9250-2dec427ead60 req-93c28688-d534-4cc3-8ca8-73d4c37c78a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda8a8fb-a7fe-40c6-a043-4ab745171b12", "name": "network-vif-plugged", "status": "completed", "tag": "0676a67e-c7b2-4713-bb5b-a960b92c3471"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:00.301280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73de19e2-c16c-44e0-9250-2dec427ead60 req-93c28688-d534-4cc3-8ca8-73d4c37c78a5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.301827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73de19e2-c16c-44e0-9250-2dec427ead60 req-93c28688-d534-4cc3-8ca8-73d4c37c78a5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.302564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73de19e2-c16c-44e0-9250-2dec427ead60 req-93c28688-d534-4cc3-8ca8-73d4c37c78a5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.328897 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-73de19e2-c16c-44e0-9250-2dec427ead60 req-93c28688-d534-4cc3-8ca8-73d4c37c78a5 service nova] Creating event network-vif-plugged:0676a67e-c7b2-4713-bb5b-a960b92c3471 for instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 on n-h1-858384-17 Oct 31 15:27:00.351809 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-73de19e2-c16c-44e0-9250-2dec427ead60 req-93c28688-d534-4cc3-8ca8-73d4c37c78a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086035 Oct 31 15:27:00.357743 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1138/2457] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:00.373997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2d855710-12bb-49ec-9a8e-0569ae97b0b9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:00.376961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d855710-12bb-49ec-9a8e-0569ae97b0b9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:00.395669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d855710-12bb-49ec-9a8e-0569ae97b0b9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.396781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d855710-12bb-49ec-9a8e-0569ae97b0b9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.397493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d855710-12bb-49ec-9a8e-0569ae97b0b9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.398253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d855710-12bb-49ec-9a8e-0569ae97b0b9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.398722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d855710-12bb-49ec-9a8e-0569ae97b0b9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.399160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d855710-12bb-49ec-9a8e-0569ae97b0b9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.567597 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2d855710-12bb-49ec-9a8e-0569ae97b0b9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f/action" status: 202 len: 0 microversion: 2.1 time: 0.208152 Oct 31 15:27:00.572662 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1139/2458] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:00 2022] POST /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:00.597096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-239a5ae3-9b0a-45cf-891a-4c3cce05c426 req-e7b5eb27-b6c7-4a38-9387-66ed3befe65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea428e40-0e1d-48e6-94b9-d8da0769dd5f", "tag": "43b69508-97d3-44f8-9057-8554a2155279"}, {"name": "network-changed", "server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "tag": "2a4a9196-b5c2-4e85-9d1b-ff3182ce40bd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:00.630922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-239a5ae3-9b0a-45cf-891a-4c3cce05c426 req-e7b5eb27-b6c7-4a38-9387-66ed3befe65b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.642029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-239a5ae3-9b0a-45cf-891a-4c3cce05c426 req-e7b5eb27-b6c7-4a38-9387-66ed3befe65b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.642755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-239a5ae3-9b0a-45cf-891a-4c3cce05c426 req-e7b5eb27-b6c7-4a38-9387-66ed3befe65b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.669452 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-239a5ae3-9b0a-45cf-891a-4c3cce05c426 req-e7b5eb27-b6c7-4a38-9387-66ed3befe65b service nova] Creating event network-changed:43b69508-97d3-44f8-9057-8554a2155279 for instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f on n-h2-858384-17 Oct 31 15:27:00.670047 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-239a5ae3-9b0a-45cf-891a-4c3cce05c426 req-e7b5eb27-b6c7-4a38-9387-66ed3befe65b service nova] Creating event network-changed:2a4a9196-b5c2-4e85-9d1b-ff3182ce40bd for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:27:00.686829 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-239a5ae3-9b0a-45cf-891a-4c3cce05c426 req-e7b5eb27-b6c7-4a38-9387-66ed3befe65b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112112 Oct 31 15:27:00.689669 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1140/2459] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:00.707197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:00.708226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:00.708741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.722745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.728173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.728986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.729625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.730501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.731092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.731635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.734999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:00.737450 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-68d7022a-a8a2-4d9c-b900-ed831f5b787c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1887 microversion: 2.42 time: 0.499575 Oct 31 15:27:00.741702 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1320/2460] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:00 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1887 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:00.755793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:00.759896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:00.781954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.782531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.782989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:00.783736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:00.784200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:00.784636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.212206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.235237 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c273c78-d95b-4be4-9e88-de66da015386 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1575 microversion: 2.1 time: 0.542904 Oct 31 15:27:01.259454 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1141/2461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:00 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1575 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:01.265424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:01.270472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:01.280768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.289902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.292405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.294513 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71d58576-2656-4744-b19d-c66dc2667e3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.551866 Oct 31 15:27:01.295123 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1321/2462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:00 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:01.295251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.299955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:01.311738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.313508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:01.317217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.318623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.343623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.344445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.348774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.354050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.357988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.358770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.492240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.514992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.520236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.541931 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26efe2ac-8ebd-4683-91f3-6286bd0e2ec0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1535 microversion: 2.91 time: 0.279421 Oct 31 15:27:01.557164 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1142/2463] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:01 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1535 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:01.574608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:01.575845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:01.589605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.590125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.590667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.596034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.596609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.598763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.853204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:01.863475 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f90322cd-e14b-4240-b375-11c2737f6235 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1219 microversion: 2.1 time: 0.317429 Oct 31 15:27:01.864201 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1143/2464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:01 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1219 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:01.887427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:01.888111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:01.931261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.931867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.932316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:01.933044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:01.933845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:01.938081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:02.085314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.101811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.108942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.110158 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-837dc561-30e4-4883-8c58-4f7fe7cfe367 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1281 microversion: 2.25 time: 0.813837 Oct 31 15:27:02.137666 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1322/2465] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:01 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1281 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:02.268235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:02.270661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:02.301375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:02.302620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:02.303087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:02.303846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:02.304316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:02.304752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:02.673101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.691978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.706246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:02.707889 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-39780016-8f63-4dcc-8190-f402eb4fa865 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1887 microversion: 2.42 time: 0.834897 Oct 31 15:27:02.713721 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1144/2466] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:01 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1887 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:02.737768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:02.749675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:02.764347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:02.770473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:02.778482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:02.779604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:02.780300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:02.780959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:02.991942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.004646 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0bcfca46-e403-49d4-ae25-01d6d282fb34 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1575 microversion: 2.1 time: 0.742066 Oct 31 15:27:03.008229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1323/2467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:02 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1575 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:03.017945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:03.018784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:03.033593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.034497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.037932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.039585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.040272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.040913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.183099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.230238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.232834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.246666 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc57c512-0cad-4731-ab90-ee8694d8e544 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1538 microversion: 2.91 time: 0.236771 Oct 31 15:27:03.277344 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1324/2468] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:03 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1538 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:03.278110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.291947 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0637941-10da-47f5-a9cd-4e7fd2ab15c8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.557603 Oct 31 15:27:03.294052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:03.294662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:03.295935 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1145/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:02 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:03.310221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:03.313167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.317813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:03.318380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.318380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.318380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.320655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.321408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.331114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.332522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.334400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.336955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.337917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.339429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.530006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.540687 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-27d5450f-c637-4cd9-9291-00c8af45e848 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1211 microversion: 2.1 time: 0.260551 Oct 31 15:27:03.542403 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1325/2470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:03 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1211 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:03.579059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-858384-17"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:03.582049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:03.604514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.605453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.605908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.606644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.607110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.607537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.729892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-858384-17". {{(pid=120587) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:27:03.842805 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e5a892f-d726-4be5-b2ca-6a8eeccbab26 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251/action" status: 202 len: 0 microversion: 2.91 time: 0.299495 Oct 31 15:27:03.846401 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1326/2471] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:27:03 2022] POST /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:27:03.858166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:03.858834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:03.876626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.877162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.877606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.886789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:03.887690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:03.888366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:03.929106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:03.972031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.985113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.990461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:03.993701 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-17c91304-b6b6-4a72-84cc-e089054323f0 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1281 microversion: 2.25 time: 0.696595 Oct 31 15:27:03.997025 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1146/2472] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:03 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1281 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:04.015038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.016307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:04.044095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.044929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.045617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.046557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.047197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.047786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.168361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:04.190833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:04.196028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:04.211032 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ad8535a-bc19-43c5-8072-7e1daa902bc1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1546 microversion: 2.91 time: 0.212061 Oct 31 15:27:04.211665 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1147/2473] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:03 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:04.235314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.236325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:04.246418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.246923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.247356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.248259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.249329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.249984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.291179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:27:04.462190 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-772a6c72-d2f5-4437-9001-057eb14d0dce tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 204 len: 0 microversion: 2.1 time: 0.244527 Oct 31 15:27:04.462884 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1148/2474] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:27:04 2022] DELETE /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:27:04.472380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.473283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:04.499617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.500240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.500703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.501529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.502003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.502463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.713241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:04.735366 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5719bd57-c5ea-45e5-8152-7bb87ac6ff8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1573 microversion: 2.1 time: 0.270963 Oct 31 15:27:04.736213 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1149/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:04 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1573 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:04.755782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.757965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:04.765008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.765699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.766399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.767379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.767912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.768414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.924065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:04.933365 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bdad36e9-b9ed-47dc-8441-457c91a46850 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.195889 Oct 31 15:27:04.941274 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1150/2476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:04 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:04.941274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:04.941274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:04.951645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.952259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.952762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.953578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:04.954142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:04.954665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:04.986992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.003873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.005464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.006865 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe1bbdb9-e62c-45ec-81a8-d5443f96a7f8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1887 microversion: 2.42 time: 1.159207 Oct 31 15:27:05.031391 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1327/2477] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:03 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1887 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:05.038646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:05.039541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:05.047759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.048509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.049640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.050787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.051472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.053150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.111461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.116424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:05.121952 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2211b737-7c12-4563-8f9e-3862247b76fa tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1666 microversion: 2.1 time: 0.186321 Oct 31 15:27:05.123264 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1151/2478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:04 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1666 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:05.128181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1264076097"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:05.128890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:05.142814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.143149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.144862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.145269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.149554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.150288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.150906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.153082 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd554adc-340a-4cf4-ad07-95b24a892679 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1267 microversion: 2.1 time: 0.119844 Oct 31 15:27:05.154203 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1328/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:05 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1267 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:05.160371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:05.160943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:05.176832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.177977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.178418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.179128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.179580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.180121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.341639 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.network.security_group_api [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Adding security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 to port 43b69508-97d3-44f8-9057-8554a2155279 Oct 31 15:27:05.801875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.811796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.817784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.819389 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-82747f6d-699f-4711-8828-c60785955b46 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1281 microversion: 2.25 time: 0.663923 Oct 31 15:27:05.820925 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1329/2480] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:05 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1281 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:05.826348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:05.827069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:05.839208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.842266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.842830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.843676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:05.847313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:05.848274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:05.981447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.991419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:05.993623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:06.001190 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-438a389d-2015-4c41-b415-e56887875294 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1488 microversion: 2.91 time: 0.178817 Oct 31 15:27:06.001887 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1330/2481] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:05 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1488 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:06.014270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:06.014270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:06.032725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.036236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.037459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.038513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.039243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.039690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.574326 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc6df3a4-84fe-49b4-8a66-2fc7305bf622 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f/action" status: 202 len: 0 microversion: 2.1 time: 1.449726 Oct 31 15:27:06.578543 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1152/2482] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:05 2022] POST /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f/action => generated 0 bytes in 1454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:06.583641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:06.584253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:06.588015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:06.598821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.599576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.599712 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-44f6c04a-7e7b-41af-8583-536c60b20f3c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.595578 Oct 31 15:27:06.600480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.601392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.601732 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1331/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:06 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:06.612109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:06.615386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:06.622023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.622661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.628166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.641968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.643220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:06.648076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:06.648577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:06.649029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:07.076781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:07.098973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:07.112756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:07.114506 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-224f175a-bced-4a60-8830-49898db5b601 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.534892 Oct 31 15:27:07.134248 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1153/2484] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:06 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:07.161838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:07.165056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:07.173726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:07.188770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:07.196886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:07.200968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:07.201305 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01c2703a-74cc-4afd-bf3b-371ae2137640 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1666 microversion: 2.1 time: 0.598435 Oct 31 15:27:07.202305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:07.204215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:07.207429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:07.217977 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1332/2485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:06 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1666 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:07.247564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45175dd0-d32e-4cde-bb12-6136c6e35605 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e0df3a60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:07.380375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:07.391842 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54c4680c-620e-4de1-a9ee-5f3fb178f8a0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1273 microversion: 2.1 time: 0.256150 Oct 31 15:27:07.393081 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1154/2486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:07 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:07.399358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-661350a6-b74d-4052-b51e-a36b1f84986e req-03dedc7a-f296-4336-8524-10d4f0a88c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea428e40-0e1d-48e6-94b9-d8da0769dd5f", "tag": "43b69508-97d3-44f8-9057-8554a2155279"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:07.415037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-661350a6-b74d-4052-b51e-a36b1f84986e req-03dedc7a-f296-4336-8524-10d4f0a88c3e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:07.415764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-661350a6-b74d-4052-b51e-a36b1f84986e req-03dedc7a-f296-4336-8524-10d4f0a88c3e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:07.418412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-661350a6-b74d-4052-b51e-a36b1f84986e req-03dedc7a-f296-4336-8524-10d4f0a88c3e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:07.435654 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-661350a6-b74d-4052-b51e-a36b1f84986e req-03dedc7a-f296-4336-8524-10d4f0a88c3e service nova] Creating event network-changed:43b69508-97d3-44f8-9057-8554a2155279 for instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f on n-h2-858384-17 Oct 31 15:27:07.442642 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-661350a6-b74d-4052-b51e-a36b1f84986e req-03dedc7a-f296-4336-8524-10d4f0a88c3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048117 Oct 31 15:27:07.443505 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1155/2487] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:07.450363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:07.451240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:07.482214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:07.482807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:07.483253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:07.483987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:07.484522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:07.484954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:07.751826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-45175dd0-d32e-4cde-bb12-6136c6e35605 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b9e1b7c8-16a1-4f93-be10-2973af5cf353 in use.", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:27:07.752490 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-45175dd0-d32e-4cde-bb12-6136c6e35605 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security Group b9e1b7c8-16a1-4f93-be10-2973af5cf353 in use. Oct 31 15:27:07.752490 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-a4a7cf29-0b4c-456e-a329-b09a9a694be2'] Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45175dd0-d32e-4cde-bb12-6136c6e35605 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-security-groups/b9e1b7c8-16a1-4f93-be10-2973af5cf353 HTTP/1.1 Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: exception: Security Group b9e1b7c8-16a1-4f93-be10-2973af5cf353 in use. Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-a4a7cf29-0b4c-456e-a329-b09a9a694be2'] Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b9e1b7c8-16a1-4f93-be10-2973af5cf353'} Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:27:07.754827 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b9e1b7c8-16a1-4f93-be10-2973af5cf353 in use. Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4a7cf29-0b4c-456e-a329-b09a9a694be2'] Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b9e1b7c8-16a1-4f93-be10-2973af5cf353 in use. Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4a7cf29-0b4c-456e-a329-b09a9a694be2'] Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b9e1b7c8-16a1-4f93-be10-2973af5cf353 in use. Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4a7cf29-0b4c-456e-a329-b09a9a694be2'] Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b9e1b7c8-16a1-4f93-be10-2973af5cf353 in use. Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a4a7cf29-0b4c-456e-a329-b09a9a694be2'] Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45175dd0-d32e-4cde-bb12-6136c6e35605 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 400 to user: Security Group b9e1b7c8-16a1-4f93-be10-2973af5cf353 in use. Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-a4a7cf29-0b4c-456e-a329-b09a9a694be2'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45175dd0-d32e-4cde-bb12-6136c6e35605 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b9e1b7c8-16a1-4f93-be10-2973af5cf353" status: 400 len: 185 microversion: 2.1 time: 0.535089 Oct 31 15:27:07.760653 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1333/2488] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:07 2022] DELETE /compute/v2.1/os-security-groups/b9e1b7c8-16a1-4f93-be10-2973af5cf353 => generated 185 bytes in 540 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:27:07.782485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:07.783241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:07.800871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:07.801399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:07.808951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:07.809758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:07.819234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:07.820091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:08.097346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:08.113814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:08.123526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:08.143576 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-051dbb7d-e195-4cec-b13e-c136f50a109d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.384248 Oct 31 15:27:08.149921 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1334/2489] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:07 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:08.208906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:08.229096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:08.234227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:08.235991 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4f26d3f4-4378-4916-b04d-e57ce5d535f5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1477 microversion: 2.25 time: 0.791111 Oct 31 15:27:08.237745 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1156/2490] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:07 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1477 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:08.256962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:08.257883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:08.280014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:08.281444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:08.287282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:08.290444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:08.293840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:08.296273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:08.355121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1598966038", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "53b15f0c-4ce3-478e-8b7d-e3fd8dbb81fa"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:08.539164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] validate_networks() for [('53b15f0c-4ce3-478e-8b7d-e3fd8dbb81fa', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:27:08.859576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:08.867727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:08.870892 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f6a6bdf-abec-4eb7-88f3-9169cc6010dc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.629763 Oct 31 15:27:08.871487 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1157/2491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:08 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:08.876030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:08.889508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:08.957215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:08.960585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:08.961807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:08.969429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:08.970311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:08.974958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:08.975811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:09.084438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:27:09.294378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-29cc8f57-d276-4c6a-92d5-df411f337a51 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 204 len: 0 microversion: 2.1 time: 0.419682 Oct 31 15:27:09.298308 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1158/2492] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:27:08 2022] DELETE /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:27:09.316389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:09.317455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:09.331628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:09.332654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:09.334016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:09.335601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:09.336233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:09.336819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.229334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:10.278584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:10.312963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:10.315375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:10.316777 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7cd7ac6d-5128-444e-93e7-4e98d721bbd3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 1.014925 Oct 31 15:27:10.321487 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1159/2493] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:09 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:10.344658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:10.345793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:10.383269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.384084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.384916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.391716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.392472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.393092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.476024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:10.487426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:10.488098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:10.488750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lazy-loading 'fault' on Instance uuid b2b0b18c-6da5-43e6-8048-2ce0c8932f0a {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:10.610042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea9e26278be42a191b6860b806d70ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2393b8d8a3d4286be27881c980ffb48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:10.622377 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fb7afcf3-350c-4478-ab3e-257e0bed9175 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 200 len: 1315 microversion: 2.1 time: 0.299474 Oct 31 15:27:10.623368 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1160/2494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:10 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:11.013030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:11.013675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:11.029777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.030513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.031172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:11.032135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.046039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.046833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:11.393963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:27:11.395134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:27:11.396389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:27:11.396985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:27:11.397599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:27:11.415414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.416182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.416800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:11.424746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.425796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.426402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:11.471760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Getting quotas for project 8b001e79f3ba45c8bbbc5e0dac9d45ba. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:27:11.489197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Getting quotas for user cbe013cdd93245519bead8d5e8fa00af and project 8b001e79f3ba45c8bbbc5e0dac9d45ba. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:27:11.514985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:27:11.519817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:27:11.628514 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09bbc9c2-8b51-47fa-b5dc-90c0d88f162f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.472899 Oct 31 15:27:11.629220 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1335/2495] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:27:11.649210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:11.653993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:11.666051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.667017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.667629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:11.668572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.671501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.674642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:11.703874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid dda8a8fb-a7fe-40c6-a043-4ab745171b12 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:11.757746 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c75dd86-8f93-47b5-8005-04940b3c7152 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1972 microversion: 2.25 time: 1.133086 Oct 31 15:27:11.758350 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1161/2496] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:10 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1972 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:11.763238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:11.763875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:11.815235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.815661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.816115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:11.816849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:11.821644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:11.822171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:12.107216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:12.119881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:12.121796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:12.134268 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a10f845d-68e2-4472-a1fd-437e70edc250 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.374847 Oct 31 15:27:12.135117 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1162/2497] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:11 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:12.144554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:12.148581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:12.156312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:12.157197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:12.157909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:12.158863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:12.172394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:12.173842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:12.408099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:12.431420 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c3b94310-c974-48a3-836a-3b41dc801485 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.793989 Oct 31 15:27:12.454643 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1336/2498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:11 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:12.464966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-01ac0209-c0fe-4597-9bfc-30e4327790a2 req-3ea575fb-767a-4975-beb8-9002c67d4ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b0b18c-6da5-43e6-8048-2ce0c8932f0a", "name": "network-vif-deleted", "tag": "0a81f122-86b6-474f-8064-6c9a3bb36467"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:12.506566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-01ac0209-c0fe-4597-9bfc-30e4327790a2 req-3ea575fb-767a-4975-beb8-9002c67d4ca0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:12.507044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-01ac0209-c0fe-4597-9bfc-30e4327790a2 req-3ea575fb-767a-4975-beb8-9002c67d4ca0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:12.507471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-01ac0209-c0fe-4597-9bfc-30e4327790a2 req-3ea575fb-767a-4975-beb8-9002c67d4ca0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:12.567178 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-01ac0209-c0fe-4597-9bfc-30e4327790a2 req-3ea575fb-767a-4975-beb8-9002c67d4ca0 service nova] Creating event network-vif-deleted:0a81f122-86b6-474f-8064-6c9a3bb36467 for instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a on n-h2-858384-17 Oct 31 15:27:12.591298 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-01ac0209-c0fe-4597-9bfc-30e4327790a2 req-3ea575fb-767a-4975-beb8-9002c67d4ca0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125823 Oct 31 15:27:12.595309 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1337/2499] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:12.616947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:12.617572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:12.635512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:12.641218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:12.642383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:12.644624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:12.654343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:12.656284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:12.820757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:12.835375 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c4c6555-d6ce-4964-8616-40354ef55961 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1648 microversion: 2.1 time: 0.698868 Oct 31 15:27:12.845906 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1163/2500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:12 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1648 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:12.855040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:12.855040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:12.888508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:12.889054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:12.889544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:12.890493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:12.891152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:12.891621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.226045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.249874 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a0d46d7-0cf3-4082-92c8-ed0e6ee2469c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.653094 Oct 31 15:27:13.250569 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1338/2501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:12 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:13.284141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:13.285188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:13.305947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.306766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.307462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.308447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.309175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.309815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.530089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.541701 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-705e11f5-9792-4f0b-a207-53d15ef3c11a tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1277 microversion: 2.1 time: 0.282163 Oct 31 15:27:13.557167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.557808 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1339/2502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:13 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:13.557808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:13.557808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] [instance: b2b0b18c-6da5-43e6-8048-2ce0c8932f0a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:13.570292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.573451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.573901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.574686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.575138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.575568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.595601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.603248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.607162 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bef2e6e3-557e-4fda-858a-fb3ef83125e8 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.767750 Oct 31 15:27:13.613628 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1164/2503] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:12 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:13.630905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:13.631856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:13.636855 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] HTTP exception thrown: Instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a could not be found. Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Request method failure captured: Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a HTTP/1.1 Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-j9D_hUmSsJBttxkh2uFOL5V0jd7C_hoybRK5OxrDyXG3FNs7PXV4isZzaj0kNLy28t6ltmI7l8bSlRRSTCyaCqpShKKPbZdjUzt5ciGX9nLoG54p3v2CNFu6ySg6t4wifnbB2LUBWdmF2R9KR-uXSPAo3JzZBxuVZDfLpJ-fXh9lo Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: e2393b8d8a3d4286be27881c980ffb48 Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestFqdnHostnames-1259838637 Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2393b8d8a3d4286be27881c980ffb48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e2393b8d8a3d4286be27881c980ffb48", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e2393b8d8a3d4286be27881c980ffb48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e2393b8d8a3d4286be27881c980ffb48"}]}] Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestFqdnHostnames-1259838637 Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: e2393b8d8a3d4286be27881c980ffb48 Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1259838637 Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestFqdnHostnames-1259838637-project Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 6ea9e26278be42a191b6860b806d70ec Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestFqdnHostnames-1259838637-project Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a could not be found. Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b2b0b18c-6da5-43e6-8048-2ce0c8932f0a'} Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a could not be found. Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a could not be found. Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:13.638979 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:13.643775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:13.643775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:13.643775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:13.643775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:13.643775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:13.643775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a could not be found. Oct 31 15:27:13.643775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:13.644389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Returning 404 to user: Instance b2b0b18c-6da5-43e6-8048-2ce0c8932f0a could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:13.645474 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8fef3c57-6398-4392-811a-994d494f12f4 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a" status: 404 len: 111 microversion: 2.1 time: 0.098629 Oct 31 15:27:13.646705 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1340/2504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:13 2022] GET /compute/v2.1/servers/b2b0b18c-6da5-43e6-8048-2ce0c8932f0a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:13.655088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:13.655834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:13.659212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.660616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.661271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.662402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.665869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.666496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.671656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.672331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.672796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.673623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.674178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.674625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.846223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.868319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.871751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:13.884632 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6eb339bd-1635-47fc-a709-7148d77a728c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.233684 Oct 31 15:27:13.911843 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1341/2505] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:13 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:13.917544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:13.918732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:13.933504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.939332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.940290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:13.941249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:13.942050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:13.942742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:14.615913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:14.627994 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d67f5741-cd97-4caa-9faa-8f34a0267043 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.714303 Oct 31 15:27:14.650511 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1342/2506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:13 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:14.655561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4fd20f4-7559-455d-b1a9-cb462abc0289 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] Calling method '.version_select at 0x7f16e0d85af0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:14.670925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:14.695445 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4fd20f4-7559-455d-b1a9-cb462abc0289 tempest-ServersTestFqdnHostnames-1259838637 tempest-ServersTestFqdnHostnames-1259838637-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-152920860" status: 202 len: 0 microversion: 2.1 time: 0.043573 Oct 31 15:27:14.696844 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1343/2507] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:27:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-152920860 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:14.709377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a80710dc-a90b-4498-b313-8c30679eda8d req-4ef11ea2-1153-465d-b5f4-157f1d1506f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4faf82e-33b1-482e-a400-e57ebf462f65", "name": "network-vif-plugged", "status": "completed", "tag": "5c17a2b4-0599-4cd9-ac6a-66a5a6df9448"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:14.730921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a80710dc-a90b-4498-b313-8c30679eda8d req-4ef11ea2-1153-465d-b5f4-157f1d1506f7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:14.731558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a80710dc-a90b-4498-b313-8c30679eda8d req-4ef11ea2-1153-465d-b5f4-157f1d1506f7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:14.732116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a80710dc-a90b-4498-b313-8c30679eda8d req-4ef11ea2-1153-465d-b5f4-157f1d1506f7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:14.763162 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a80710dc-a90b-4498-b313-8c30679eda8d req-4ef11ea2-1153-465d-b5f4-157f1d1506f7 service nova] Creating event network-vif-plugged:5c17a2b4-0599-4cd9-ac6a-66a5a6df9448 for instance f4faf82e-33b1-482e-a400-e57ebf462f65 on n-h1-858384-17 Oct 31 15:27:14.777522 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a80710dc-a90b-4498-b313-8c30679eda8d req-4ef11ea2-1153-465d-b5f4-157f1d1506f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078541 Oct 31 15:27:14.781762 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1344/2508] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:14.797548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:14.798527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:14.815768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:14.820266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:14.820848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:14.822369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:14.822958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:14.823496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:14.914613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:14.920106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:14.921506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:14.923910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lazy-loading 'fault' on Instance uuid ea428e40-0e1d-48e6-94b9-d8da0769dd5f {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:15.052512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid dda8a8fb-a7fe-40c6-a043-4ab745171b12 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:15.060412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:15.077259 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e544749-41b6-40b0-b466-c445ee348ec1 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1972 microversion: 2.25 time: 1.460174 Oct 31 15:27:15.077493 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-38bfd33c-2fca-42a2-9ab5-2aa0a17d71f2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 200 len: 1306 microversion: 2.1 time: 0.293653 Oct 31 15:27:15.093161 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1345/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:14 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 1306 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:15.093161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:15.093161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:15.095138 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1165/2510] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:13 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1972 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:15.104816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.104816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.104816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.106933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:15.107780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:15.110663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.111357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.111609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.115214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.116174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.116833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.117940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.118589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.119198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.252790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:15.257303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:15.269002 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61c5c2cb-07f6-4032-a752-263326d2241f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1283 microversion: 2.1 time: 0.172407 Oct 31 15:27:15.273376 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1166/2511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:15 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:15.292368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:15.294175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:15.301048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.301873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.302572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.303748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.304471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.305144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.744404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:15.753710 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db4d404a-c026-4bd3-bc45-349b17fa3bd6 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.674082 Oct 31 15:27:15.760169 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1346/2512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:15 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:15.770561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2e5d867f-4b9a-4211-9059-01d8e549a291 req-f16c53c8-9835-4caa-84f8-97d54f047fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea428e40-0e1d-48e6-94b9-d8da0769dd5f", "name": "network-vif-deleted", "tag": "43b69508-97d3-44f8-9057-8554a2155279"}, {"name": "network-changed", "server_uuid": "22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6", "tag": "e9a470bf-58bf-48fd-87d9-6c394ab1fd88"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:15.789848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2e5d867f-4b9a-4211-9059-01d8e549a291 req-f16c53c8-9835-4caa-84f8-97d54f047fb5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.790345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2e5d867f-4b9a-4211-9059-01d8e549a291 req-f16c53c8-9835-4caa-84f8-97d54f047fb5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.790874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2e5d867f-4b9a-4211-9059-01d8e549a291 req-f16c53c8-9835-4caa-84f8-97d54f047fb5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.807641 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2e5d867f-4b9a-4211-9059-01d8e549a291 req-f16c53c8-9835-4caa-84f8-97d54f047fb5 service nova] Creating event network-vif-deleted:43b69508-97d3-44f8-9057-8554a2155279 for instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f on n-h2-858384-17 Oct 31 15:27:15.808301 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2e5d867f-4b9a-4211-9059-01d8e549a291 req-f16c53c8-9835-4caa-84f8-97d54f047fb5 service nova] Creating event network-changed:e9a470bf-58bf-48fd-87d9-6c394ab1fd88 for instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 on n-h1-858384-17 Oct 31 15:27:15.823346 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2e5d867f-4b9a-4211-9059-01d8e549a291 req-f16c53c8-9835-4caa-84f8-97d54f047fb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059934 Oct 31 15:27:15.824231 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1347/2513] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:15.832046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:15.836106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:15.843485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.844162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.844606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.845420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.845921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.846950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.945095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:15.956776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:15.958843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:15.960317 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a19ff4f-28c9-4b76-8ba0-dc05ba98d174 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.685526 Oct 31 15:27:15.961087 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1167/2514] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:15 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:15.986537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f50bef4-0c14-457e-86b5-104531f0db4f tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:15.991113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f50bef4-0c14-457e-86b5-104531f0db4f tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.991564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f50bef4-0c14-457e-86b5-104531f0db4f tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.991959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f50bef4-0c14-457e-86b5-104531f0db4f tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:15.992726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f50bef4-0c14-457e-86b5-104531f0db4f tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:15.993223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f50bef4-0c14-457e-86b5-104531f0db4f tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:15.993801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f50bef4-0c14-457e-86b5-104531f0db4f tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.012685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:16.029048 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f50bef4-0c14-457e-86b5-104531f0db4f tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.050633 Oct 31 15:27:16.030115 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1168/2515] 10.222.0.20 () {60 vars in 1217 bytes} [Mon Oct 31 15:27:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:27:16.044218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:16.045264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:16.053329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.054753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.055435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.056331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.057003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.057618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.270012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:16.280118 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-378ba67c-8b72-40db-88d3-ae631234353e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.248870 Oct 31 15:27:16.281451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1169/2516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:16 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:16.286998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-858384-17", "block_migration": "auto"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:16.290893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:16.298671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.299404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.300053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.300931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.301768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.302993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.332436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'flavor' on Instance uuid dda8a8fb-a7fe-40c6-a043-4ab745171b12 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:16.345814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Going to try to live migrate instance to n-h2-858384-17 {{(pid=120588) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:27:16.400214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:16.415554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:16.416017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:16.437338 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0d22bf9-887d-413f-8a84-96df4d364e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.611188 Oct 31 15:27:16.438388 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1348/2517] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:15 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:16.444770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:16.445603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:16.466408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.466977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.467410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.468137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.468626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.469067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.517155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:16.523604 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f HTTP/1.1 Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ea428e40-0e1d-48e6-94b9-d8da0769dd5f'} Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:16.526745 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:16.531443 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:16.531443 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:16.531443 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:16.531443 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:16.531443 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:16.531443 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:16.531443 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:16.531443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:16.531443 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-12c6b731-3cba-442d-9bc7-4b6d76e5fb31 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 404 len: 111 microversion: 2.1 time: 0.088892 Oct 31 15:27:16.536168 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1349/2518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:16 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:16.544156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:16.544874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:16.560118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.560621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.561075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.561835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:16.562392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:16.562779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:16.693275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:16.702253 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae102b1d-6fa6-41c0-aacc-e548fb7d2ea6 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1283 microversion: 2.1 time: 0.165276 Oct 31 15:27:16.725654 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1350/2519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:16 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:16.734534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4b6deb5-4eb9-45fe-8b6d-adaed7ce35a5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e181d700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:17.431042 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4b6deb5-4eb9-45fe-8b6d-adaed7ce35a5 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cd0ca71e-d201-4ea9-95e4-e284e0e13558" status: 202 len: 0 microversion: 2.1 time: 0.704018 Oct 31 15:27:17.432846 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1351/2520] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:16 2022] DELETE /compute/v2.1/os-security-groups/cd0ca71e-d201-4ea9-95e4-e284e0e13558 => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:17.440075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:17.440919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:17.461517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:17.462023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:17.462462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:17.463178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:17.463659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:17.464063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:17.814075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:17.827408 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0fd19bd7-8f4a-4512-a5f1-264fa0ba660a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.392671 Oct 31 15:27:17.828299 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1352/2521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:17 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:17.834205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:17.835059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:17.842413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:17.842982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:17.853366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:17.854306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:17.858379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:17.859097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:18.196922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:18.210574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:18.213517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:18.215568 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-43491acb-ded9-46f1-a8ba-fb8ca74a2886 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.386127 Oct 31 15:27:18.216635 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1353/2522] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:17 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:18.224903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:18.225627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:18.233061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:18.233896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:18.236393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:18.237493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:18.238131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:18.238725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:18.551119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:18.571584 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5868b75-d62c-40ed-b5ff-fb5103a16560 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.352487 Oct 31 15:27:18.589323 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1354/2523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:18 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:18.589323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-299233c2-6d3f-40ea-a0b0-d7c7ff71e77b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e0dd8280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:18.982290 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-299233c2-6d3f-40ea-a0b0-d7c7ff71e77b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b9e1b7c8-16a1-4f93-be10-2973af5cf353" status: 202 len: 0 microversion: 2.1 time: 0.404344 Oct 31 15:27:18.983467 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1355/2524] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:18 2022] DELETE /compute/v2.1/os-security-groups/b9e1b7c8-16a1-4f93-be10-2973af5cf353 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:18.988498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:18.989360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:19.001152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.002322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.003119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:19.006035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.006912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.007741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:19.179735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.212779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.215871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.244806 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b2bba00-cd03-46b1-8efc-505fe8abf860 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.257549 Oct 31 15:27:19.245810 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1356/2525] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:18 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:19.259390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:19.260914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:19.275203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.276379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.277006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:19.277919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.278614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.279327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:19.647028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:19.656865 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-57eb86d7-e48a-4cb5-90f2-c2925f80674c tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1325 microversion: 2.1 time: 0.408642 Oct 31 15:27:19.657762 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1357/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:19 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:19.663622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:19.664470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:19.682504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.684347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.684957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:19.686008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:19.686709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:19.687311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:20.042584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:20.065154 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f64f56f-5cca-430c-b9c9-991f14092ee0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.406106 Oct 31 15:27:20.065798 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1358/2527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:19 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:20.075277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35fa7a40-8e23-431a-a5e9-0a1cb5b9bc38 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'create', calling method: .version_select at 0x7f16e575d310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1341726983", "description": "tempest-description-305147108"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:20.321481 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35fa7a40-8e23-431a-a5e9-0a1cb5b9bc38 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.254531 Oct 31 15:27:20.322673 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1359/2528] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:27:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:20.327993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e2b39dd6-9e3e-49d7-8ee5-f0f1ef108704 req-b60cdf91-920b-4706-9fe9-dbcd09e8bf7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ddbbb03-fd46-4943-8e32-64278adae602", "tag": "124bfded-3480-4081-99bd-a1f17ba2fa14"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:20.339301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e2b39dd6-9e3e-49d7-8ee5-f0f1ef108704 req-b60cdf91-920b-4706-9fe9-dbcd09e8bf7d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:20.339780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e2b39dd6-9e3e-49d7-8ee5-f0f1ef108704 req-b60cdf91-920b-4706-9fe9-dbcd09e8bf7d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:20.340204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e2b39dd6-9e3e-49d7-8ee5-f0f1ef108704 req-b60cdf91-920b-4706-9fe9-dbcd09e8bf7d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:20.355517 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e2b39dd6-9e3e-49d7-8ee5-f0f1ef108704 req-b60cdf91-920b-4706-9fe9-dbcd09e8bf7d service nova] Creating event network-changed:124bfded-3480-4081-99bd-a1f17ba2fa14 for instance 6ddbbb03-fd46-4943-8e32-64278adae602 on n-h2-858384-17 Oct 31 15:27:20.362372 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e2b39dd6-9e3e-49d7-8ee5-f0f1ef108704 req-b60cdf91-920b-4706-9fe9-dbcd09e8bf7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038137 Oct 31 15:27:20.363226 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1360/2529] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:20.372346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:20.372519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:20.379592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:20.381248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:20.381706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:20.382530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:20.383342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:20.383681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:20.648746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:20.659385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:20.661382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:20.663053 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f9872cf-fea6-4c6e-bb57-79bb671570bb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.298587 Oct 31 15:27:20.664149 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1361/2530] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:20 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:20.678713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:20.679801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:20.686454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:20.687012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:20.687512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:20.688276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:20.688818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:20.689342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:20.919725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:20.930192 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db2fea0c-268a-42ab-8c9c-dcc12fd54bc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.260345 Oct 31 15:27:20.931157 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1362/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:20 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:20.936497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:20.937227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:20.944002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:20.944569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:20.945077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:20.945906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:20.946382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:20.946877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.015111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.024266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.025881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.030791 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-97873a2e-2005-4aae-86ba-8731f21d5a40 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.098467 Oct 31 15:27:21.031373 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1363/2532] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:20 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:21.036133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b7cdaa4-40c2-44bf-bb7f-741ec829082d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Action: 'update', calling method: .version_select at 0x7f16e55a1d30>, body: {"security_group": {"name": "tempest-sg-hth-873256274", "description": "tempest-description-hth-1063668758"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:21.194608 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b7cdaa4-40c2-44bf-bb7f-741ec829082d tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/127ae6c9-0eee-4192-ab3d-3cc8e13774bb" status: 200 len: 217 microversion: 2.1 time: 0.161914 Oct 31 15:27:21.195626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1364/2533] 10.222.0.20 () {60 vars in 1290 bytes} [Mon Oct 31 15:27:21 2022] PUT /compute/v2.1/os-security-groups/127ae6c9-0eee-4192-ab3d-3cc8e13774bb => generated 217 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:21.211145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:21.212344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:21.226464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:21.227347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:21.228068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.250921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:21.251749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:21.252579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.442029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:21.503703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:21.541272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:21.549849 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85304cda-06d3-415e-a531-4a13890457ed tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1325 microversion: 2.1 time: 0.343722 Oct 31 15:27:21.550809 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1365/2534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:21 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1325 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:21.555811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:21.556668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:21.578552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:21.579300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:21.580151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.581406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:21.581860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:21.582705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:21.942002 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-213e9037-cd0a-4fd8-93bd-4d21032e6842 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12/action" status: 202 len: 0 microversion: 2.25 time: 5.659172 Oct 31 15:27:21.945954 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1170/2535] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:27:16 2022] POST /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12/action => generated 0 bytes in 5661 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:27:21.949731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73a4f0cd-c5be-4147-acd7-09f27a684801 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e573e1f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.016169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.020002 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73a4f0cd-c5be-4147-acd7-09f27a684801 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/127ae6c9-0eee-4192-ab3d-3cc8e13774bb" status: 200 len: 217 microversion: 2.1 time: 0.075653 Oct 31 15:27:22.022249 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1171/2536] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:27:21 2022] GET /compute/v2.1/os-security-groups/127ae6c9-0eee-4192-ab3d-3cc8e13774bb => generated 217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:22.028404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.028751 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df8d6b87-7cb1-4872-b755-42063598e562 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1517 microversion: 2.1 time: 0.476669 Oct 31 15:27:22.029460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:22.031211 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1366/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:21 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1517 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:22.039462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.040600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.041257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.042312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.042925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.043505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.049314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.050176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:22.070609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.071108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.071547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.072264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.072721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.073169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.329709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.345063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.347186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.348562 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6d183c54-7e6b-4524-8355-7cdd2347cefd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.325218 Oct 31 15:27:22.369412 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1172/2538] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:22 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:22.376489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.377222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:22.384974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.385509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.386117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.386898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.387422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.388138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.436889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.450674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.455640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.458200 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e86874ae-0c94-49a6-93d0-0ccc80521330 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.422269 Oct 31 15:27:22.459458 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1367/2539] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:22 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:22.466245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-337d9191-d588-4cbd-9ee3-c6194f1df3f0 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e0df6280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.548819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.557320 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-468e3a5b-5fe3-4e3b-9ebb-067e987747c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.186693 Oct 31 15:27:22.558179 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1173/2540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:22 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:22.580120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.581097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:22.588945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.589948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.590735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.591640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.592351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.592946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.664487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.673096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.674565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.680764 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eca872fd-69bb-47a9-b513-b2ae0f197d55 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.121352 Oct 31 15:27:22.691786 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1174/2541] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:22 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:22.691786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:22.691786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:22.695057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.695665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.696109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.696856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:22.697359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:22.698166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:22.842673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:22.851013 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c18ad95e-28e4-498b-8d4d-7ddce9ea390d tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1325 microversion: 2.1 time: 0.168363 Oct 31 15:27:22.851607 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1175/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:22 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1325 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:23.059376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.059987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:23.066345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.066822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.067253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.068881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.069378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.069800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.107281 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-337d9191-d588-4cbd-9ee3-c6194f1df3f0 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/127ae6c9-0eee-4192-ab3d-3cc8e13774bb" status: 202 len: 0 microversion: 2.1 time: 0.646056 Oct 31 15:27:23.107931 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1368/2543] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:22 2022] DELETE /compute/v2.1/os-security-groups/127ae6c9-0eee-4192-ab3d-3cc8e13774bb => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:23.117050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.117338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:23.123937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.124424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.124910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.125705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.126160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.126582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.144080 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f HTTP/1.1 Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ea428e40-0e1d-48e6-94b9-d8da0769dd5f'} Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:23.146052 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17dcf8dd-51b6-4e63-b872-4c199326c445 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 404 len: 111 microversion: 2.1 time: 0.035512 Oct 31 15:27:23.150200 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1369/2544] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:27:23 2022] DELETE /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:23.164323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.169459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: ea428e40-0e1d-48e6-94b9-d8da0769dd5f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:23.178868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.179673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.180340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.181587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.182272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.183009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.207629 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f HTTP/1.1 Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ea428e40-0e1d-48e6-94b9-d8da0769dd5f'} Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.210825 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.215136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.215136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.215136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.215136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:23.215136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:23.215136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. Oct 31 15:27:23.215136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.216178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Instance ea428e40-0e1d-48e6-94b9-d8da0769dd5f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:23.217242 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab6ffef9-7647-4043-abf7-b74567579fe8 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f" status: 404 len: 111 microversion: 2.1 time: 0.058916 Oct 31 15:27:23.219012 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1370/2545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:23 2022] GET /compute/v2.1/servers/ea428e40-0e1d-48e6-94b9-d8da0769dd5f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:23.230445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-411dfedd-fcc5-4d18-97b4-b820e1b0dc71 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e21100d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.262099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-411dfedd-fcc5-4d18-97b4-b820e1b0dc71 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:27:23.262842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-411dfedd-fcc5-4d18-97b4-b820e1b0dc71 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:27:23.263532 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-411dfedd-fcc5-4d18-97b4-b820e1b0dc71 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 does not exist Oct 31 15:27:23.263532 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-18831ef4-f80d-45d8-972c-92287ec81d4e'] Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-411dfedd-fcc5-4d18-97b4-b820e1b0dc71 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-security-groups/b9e1b7c8-16a1-4f93-be10-2973af5cf353 HTTP/1.1 Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 does not exist Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-18831ef4-f80d-45d8-972c-92287ec81d4e'] Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b9e1b7c8-16a1-4f93-be10-2973af5cf353'} Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:27:23.267024 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 does not exist Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18831ef4-f80d-45d8-972c-92287ec81d4e'] Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 does not exist Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18831ef4-f80d-45d8-972c-92287ec81d4e'] Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 does not exist Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18831ef4-f80d-45d8-972c-92287ec81d4e'] Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 does not exist Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-18831ef4-f80d-45d8-972c-92287ec81d4e'] Oct 31 15:27:23.271259 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.275395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-411dfedd-fcc5-4d18-97b4-b820e1b0dc71 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group b9e1b7c8-16a1-4f93-be10-2973af5cf353 does not exist Oct 31 15:27:23.275395 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-18831ef4-f80d-45d8-972c-92287ec81d4e'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:23.275395 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-411dfedd-fcc5-4d18-97b4-b820e1b0dc71 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b9e1b7c8-16a1-4f93-be10-2973af5cf353" status: 404 len: 194 microversion: 2.1 time: 0.052013 Oct 31 15:27:23.278770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1371/2546] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:23 2022] DELETE /compute/v2.1/os-security-groups/b9e1b7c8-16a1-4f93-be10-2973af5cf353 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:23.281311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:23.287792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71ac396a-ffa3-4d48-928a-93872dbdf6c2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e0e80040>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.295084 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-31c9434d-5819-47d5-9c65-170e673ffbcc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.239363 Oct 31 15:27:23.309159 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1176/2547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:23 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:23.321254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.322702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:23.336614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.337716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.338288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.339465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.341327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.342063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.345419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-71ac396a-ffa3-4d48-928a-93872dbdf6c2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:27:23.346264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-71ac396a-ffa3-4d48-928a-93872dbdf6c2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:27:23.347466 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-71ac396a-ffa3-4d48-928a-93872dbdf6c2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 does not exist Oct 31 15:27:23.347466 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-707cedd4-e9ee-43f7-9968-1dee5bf21fba'] Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71ac396a-ffa3-4d48-928a-93872dbdf6c2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-security-groups/cd0ca71e-d201-4ea9-95e4-e284e0e13558 HTTP/1.1 Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 does not exist Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-707cedd4-e9ee-43f7-9968-1dee5bf21fba'] Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'cd0ca71e-d201-4ea9-95e4-e284e0e13558'} Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:27:23.350273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 does not exist Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-707cedd4-e9ee-43f7-9968-1dee5bf21fba'] Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 does not exist Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-707cedd4-e9ee-43f7-9968-1dee5bf21fba'] Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 does not exist Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-707cedd4-e9ee-43f7-9968-1dee5bf21fba'] Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 does not exist Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-707cedd4-e9ee-43f7-9968-1dee5bf21fba'] Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71ac396a-ffa3-4d48-928a-93872dbdf6c2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group cd0ca71e-d201-4ea9-95e4-e284e0e13558 does not exist Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-707cedd4-e9ee-43f7-9968-1dee5bf21fba'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71ac396a-ffa3-4d48-928a-93872dbdf6c2 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cd0ca71e-d201-4ea9-95e4-e284e0e13558" status: 404 len: 194 microversion: 2.1 time: 0.071371 Oct 31 15:27:23.354457 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1372/2548] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:23 2022] DELETE /compute/v2.1/os-security-groups/cd0ca71e-d201-4ea9-95e4-e284e0e13558 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:23.387932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb7ba686-0272-45be-8f14-602fde2d05df tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e181d0d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.507120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-eb7ba686-0272-45be-8f14-602fde2d05df tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:27:23.507991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-eb7ba686-0272-45be-8f14-602fde2d05df tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:27:23.508724 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-eb7ba686-0272-45be-8f14-602fde2d05df tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:27:23.508724 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-1ca4bae6-c47d-4f1e-b283-3e55b73006d0'] Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb7ba686-0272-45be-8f14-602fde2d05df tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-security-groups/4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 HTTP/1.1 Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-1ca4bae6-c47d-4f1e-b283-3e55b73006d0'] Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6'} Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:27:23.510978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ca4bae6-c47d-4f1e-b283-3e55b73006d0'] Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ca4bae6-c47d-4f1e-b283-3e55b73006d0'] Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ca4bae6-c47d-4f1e-b283-3e55b73006d0'] Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ca4bae6-c47d-4f1e-b283-3e55b73006d0'] Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb7ba686-0272-45be-8f14-602fde2d05df tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group 4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 does not exist Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-1ca4bae6-c47d-4f1e-b283-3e55b73006d0'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eb7ba686-0272-45be-8f14-602fde2d05df tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6" status: 404 len: 194 microversion: 2.1 time: 0.133162 Oct 31 15:27:23.519395 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1373/2549] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:23 2022] DELETE /compute/v2.1/os-security-groups/4d2ff1c9-2d1e-45c5-bcca-f21bbaf0caa6 => generated 194 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:23.530593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.531566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:23.548187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.548873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.549690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.557964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.558459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.559189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.755897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:23.766487 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aef2ef16-eeaa-4147-86fe-0b33508347f7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.450675 Oct 31 15:27:23.767069 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1177/2550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:23 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:23.774826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:23.778329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:23.788481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.789457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.796361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.796361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:23.796361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:23.796361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:23.934346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:23.944422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:23.945879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:23.947154 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dcb7c8fd-ae22-4330-93c4-9942fd58f244 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.178970 Oct 31 15:27:23.947724 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1178/2551] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:23 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:23.952851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6ab3ee9-acba-4627-84ff-dcd82032c58b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e5696f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.037118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG neutronclient.v2_0.client [None req-d6ab3ee9-acba-4627-84ff-dcd82032c58b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist", "detail": ""}} {{(pid=120588) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:27:24.039500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.security_group_api [None req-d6ab3ee9-acba-4627-84ff-dcd82032c58b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group 48dbc41d-98e8-4c22-b921-e94223ab261f not found {{(pid=120588) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:27:24.040950 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d6ab3ee9-acba-4627-84ff-dcd82032c58b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:27:24.040950 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-d6ac7d07-a4b4-4ebd-a112-230a9ccf1b18'] Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6ab3ee9-acba-4627-84ff-dcd82032c58b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-security-groups/48dbc41d-98e8-4c22-b921-e94223ab261f HTTP/1.1 Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: exception: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-d6ac7d07-a4b4-4ebd-a112-230a9ccf1b18'] Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '48dbc41d-98e8-4c22-b921-e94223ab261f'} Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:27:24.048018 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ac7d07-a4b4-4ebd-a112-230a9ccf1b18'] Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ac7d07-a4b4-4ebd-a112-230a9ccf1b18'] Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ac7d07-a4b4-4ebd-a112-230a9ccf1b18'] Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d6ac7d07-a4b4-4ebd-a112-230a9ccf1b18'] Oct 31 15:27:24.053955 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.059255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6ab3ee9-acba-4627-84ff-dcd82032c58b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group 48dbc41d-98e8-4c22-b921-e94223ab261f does not exist Oct 31 15:27:24.059255 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-d6ac7d07-a4b4-4ebd-a112-230a9ccf1b18'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:24.060321 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6ab3ee9-acba-4627-84ff-dcd82032c58b tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/48dbc41d-98e8-4c22-b921-e94223ab261f" status: 404 len: 194 microversion: 2.1 time: 0.111488 Oct 31 15:27:24.061756 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1179/2552] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:23 2022] DELETE /compute/v2.1/os-security-groups/48dbc41d-98e8-4c22-b921-e94223ab261f => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:24.072138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.073081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:24.083884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.084732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.085562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.086784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.087496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.088418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.127473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.140353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.142048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.143750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-54a271b5-3a1a-466f-baa2-9356fca907b3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.629877 Oct 31 15:27:24.144533 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1374/2553] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:23 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:24.157357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.159189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:24.167539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.168274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.168846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.169691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.170345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.171510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.274088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.282512 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0540447-a2a1-415a-b86c-052d5b3224c8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.218797 Oct 31 15:27:24.284772 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1180/2554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:24 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:24.290682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.291539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:24.297579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.298524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.299250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.300223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.300839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.301458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.357454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.377654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.379402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.387469 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b3f41a8a-83b7-4d0c-a159-937bde4135be tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.241602 Oct 31 15:27:24.388727 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1375/2555] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:24 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:24.393657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.394542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:24.405844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.406548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.407191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.408118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.409002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.409678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.434862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:24.609006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.619768 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1d1e912b-8fdc-47d3-b41a-9637d2bd89e3 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.333389 Oct 31 15:27:24.621015 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1181/2556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:24 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:24.631482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab2aed21-36b4-4264-9b77-ebe3eac08871 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e56c31f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.726816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:24.742310 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2b9ee1e-788d-4ed6-81d1-2c8875f876f1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1325 microversion: 2.1 time: 0.352204 Oct 31 15:27:24.772935 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1376/2557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:24 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:24.784026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e9eaa0a-34b9-4bd7-9005-db1fa1d91990 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:24.804738 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9e9eaa0a-34b9-4bd7-9005-db1fa1d91990 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 2e5ab3fc-50be-47ff-9694-289b73417bf4 has no mapping to a cell. Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e9eaa0a-34b9-4bd7-9005-db1fa1d91990 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/2e5ab3fc-50be-47ff-9694-289b73417bf4/action HTTP/1.1 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 15 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: {"os-stop": {}} Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 2e5ab3fc-50be-47ff-9694-289b73417bf4 has no mapping to a cell. Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '2e5ab3fc-50be-47ff-9694-289b73417bf4', 'body': {'os-stop': {}}} Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 2e5ab3fc-50be-47ff-9694-289b73417bf4 has no mapping to a cell. Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:24.814994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e5ab3fc-50be-47ff-9694-289b73417bf4 has no mapping to a cell. Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e5ab3fc-50be-47ff-9694-289b73417bf4 has no mapping to a cell. Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e9eaa0a-34b9-4bd7-9005-db1fa1d91990 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 2e5ab3fc-50be-47ff-9694-289b73417bf4 has no mapping to a cell. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:24.820412 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e9eaa0a-34b9-4bd7-9005-db1fa1d91990 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/2e5ab3fc-50be-47ff-9694-289b73417bf4/action" status: 404 len: 117 microversion: 2.1 time: 0.042006 Oct 31 15:27:24.823020 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1377/2558] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:24 2022] POST /compute/v2.1/servers/2e5ab3fc-50be-47ff-9694-289b73417bf4/action => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:24.837102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:24.839425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:24.862725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.865605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.866594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:24.867901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:24.868627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:24.869298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.054678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG neutronclient.v2_0.client [None req-ab2aed21-36b4-4264-9b77-ebe3eac08871 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist", "detail": ""}} {{(pid=120588) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:27:25.055715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.security_group_api [None req-ab2aed21-36b4-4264-9b77-ebe3eac08871 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group f803d64e-2453-4bde-91d4-2d6f5148666b not found {{(pid=120588) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:27:25.056703 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-ab2aed21-36b4-4264-9b77-ebe3eac08871 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:27:25.056703 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-adeba273-8f9f-49f2-8c62-fed014e6fc4e'] Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab2aed21-36b4-4264-9b77-ebe3eac08871 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-security-groups/f803d64e-2453-4bde-91d4-2d6f5148666b HTTP/1.1 Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: exception: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-adeba273-8f9f-49f2-8c62-fed014e6fc4e'] Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f803d64e-2453-4bde-91d4-2d6f5148666b'} Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:27:25.059681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adeba273-8f9f-49f2-8c62-fed014e6fc4e'] Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adeba273-8f9f-49f2-8c62-fed014e6fc4e'] Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adeba273-8f9f-49f2-8c62-fed014e6fc4e'] Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-adeba273-8f9f-49f2-8c62-fed014e6fc4e'] Oct 31 15:27:25.064646 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.069720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab2aed21-36b4-4264-9b77-ebe3eac08871 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group f803d64e-2453-4bde-91d4-2d6f5148666b does not exist Oct 31 15:27:25.069720 n-d-858384-17 devstack@n-api.service[120588]: Neutron server returns request_ids: ['req-adeba273-8f9f-49f2-8c62-fed014e6fc4e'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:25.070842 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab2aed21-36b4-4264-9b77-ebe3eac08871 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/f803d64e-2453-4bde-91d4-2d6f5148666b" status: 404 len: 194 microversion: 2.1 time: 0.448356 Oct 31 15:27:25.071568 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1182/2559] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:24 2022] DELETE /compute/v2.1/os-security-groups/f803d64e-2453-4bde-91d4-2d6f5148666b => generated 194 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:25.084751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:25.086443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:25.106848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.107346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.107780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.111074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.113063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.113528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.265972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:25.276624 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02c78ff7-f02c-4e22-b576-6b9ac27584b1 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.451883 Oct 31 15:27:25.280783 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1378/2560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:24 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:25.286117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-173f697f-0727-4309-9948-ed16610d4ae9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e55d3550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:25.314347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG neutronclient.v2_0.client [None req-173f697f-0727-4309-9948-ed16610d4ae9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist", "detail": ""}} {{(pid=120587) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:27:25.315387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.security_group_api [None req-173f697f-0727-4309-9948-ed16610d4ae9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Neutron security group e557f662-bdf7-4e78-85db-e98ea37a9d01 not found {{(pid=120587) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 31 15:27:25.315615 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-173f697f-0727-4309-9948-ed16610d4ae9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:27:25.315615 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-cc4ec0ad-508f-4aa4-b2cc-d3f69d132145'] Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-173f697f-0727-4309-9948-ed16610d4ae9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01 HTTP/1.1 Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: exception: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-cc4ec0ad-508f-4aa4-b2cc-d3f69d132145'] Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'e557f662-bdf7-4e78-85db-e98ea37a9d01'} Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:27:25.317646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc4ec0ad-508f-4aa4-b2cc-d3f69d132145'] Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc4ec0ad-508f-4aa4-b2cc-d3f69d132145'] Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc4ec0ad-508f-4aa4-b2cc-d3f69d132145'] Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc4ec0ad-508f-4aa4-b2cc-d3f69d132145'] Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-173f697f-0727-4309-9948-ed16610d4ae9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Security group e557f662-bdf7-4e78-85db-e98ea37a9d01 does not exist Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: Neutron server returns request_ids: ['req-cc4ec0ad-508f-4aa4-b2cc-d3f69d132145'] {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:25.323286 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-173f697f-0727-4309-9948-ed16610d4ae9 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01" status: 404 len: 194 microversion: 2.1 time: 0.038419 Oct 31 15:27:25.327769 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1379/2561] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:25 2022] DELETE /compute/v2.1/os-security-groups/e557f662-bdf7-4e78-85db-e98ea37a9d01 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:25.330778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:25.331392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:25.341025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.341719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.342337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.343426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.344034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.344613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.354234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:25.363371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:25.370426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:25.371797 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-95a10bfc-e5aa-43cd-89de-f32fab33f7e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.296110 Oct 31 15:27:25.373871 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1183/2562] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:25 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:25.378542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:25.379149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:25.390276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.390775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.391312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.392195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.392501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.392786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.590035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:25.604583 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-795109b4-1153-4524-92f0-4aefc68dba66 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.229594 Oct 31 15:27:25.605847 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1184/2563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:25 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:25.634788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:25.635463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:25.650625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.651211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.651688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.652486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.653983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.654428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.690452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:25.751909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:25.764615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:25.768885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:25.770282 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a38c703d-d7df-4680-b94d-c4d285eb1ec0 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.443890 Oct 31 15:27:25.788577 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1380/2564] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:25 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:25.797439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:25.798194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:25.804809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.805533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.806135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.807087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.807738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.808381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.840800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:27:25.937662 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c407aeb0-7859-459d-af1e-6cc3c5f12a87 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 204 len: 0 microversion: 2.1 time: 0.147661 Oct 31 15:27:25.941238 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1381/2565] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:27:25 2022] DELETE /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:27:25.947082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:25.947847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:25.955740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.956591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.957374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.958113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:25.958693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:25.959129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:25.975975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:25.985668 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c9fca1d-d0e8-4595-b388-e8470fd9b01d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.378657 Oct 31 15:27:25.988970 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1185/2566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:25 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:26.001410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7200f267-830d-41be-a71c-e34a95ef5bc9 req-d75dbf5f-cbe5-4a02-a2a2-c071970a0e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6", "name": "network-vif-plugged", "status": "completed", "tag": "e9a470bf-58bf-48fd-87d9-6c394ab1fd88"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:26.008647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:26.022260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7200f267-830d-41be-a71c-e34a95ef5bc9 req-d75dbf5f-cbe5-4a02-a2a2-c071970a0e9d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.023129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7200f267-830d-41be-a71c-e34a95ef5bc9 req-d75dbf5f-cbe5-4a02-a2a2-c071970a0e9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.023786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7200f267-830d-41be-a71c-e34a95ef5bc9 req-d75dbf5f-cbe5-4a02-a2a2-c071970a0e9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.036743 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7200f267-830d-41be-a71c-e34a95ef5bc9 req-d75dbf5f-cbe5-4a02-a2a2-c071970a0e9d service nova] Creating event network-vif-plugged:e9a470bf-58bf-48fd-87d9-6c394ab1fd88 for instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 on n-h1-858384-17 Oct 31 15:27:26.043664 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7200f267-830d-41be-a71c-e34a95ef5bc9 req-d75dbf5f-cbe5-4a02-a2a2-c071970a0e9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052131 Oct 31 15:27:26.045077 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1186/2567] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:26.053316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fbf6b11d-97d0-4e96-b509-9ee973518dac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:26.054946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fbf6b11d-97d0-4e96-b509-9ee973518dac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 900d656f-7acb-40f7-9617-7eebae56f223] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.056750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.062091 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-fbf6b11d-97d0-4e96-b509-9ee973518dac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 900d656f-7acb-40f7-9617-7eebae56f223 could not be found. Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fbf6b11d-97d0-4e96-b509-9ee973518dac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/900d656f-7acb-40f7-9617-7eebae56f223/action HTTP/1.1 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 15 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: {"suspend": {}} Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 900d656f-7acb-40f7-9617-7eebae56f223 could not be found. Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '900d656f-7acb-40f7-9617-7eebae56f223', 'body': {'suspend': {}}} Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900d656f-7acb-40f7-9617-7eebae56f223 could not be found. Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900d656f-7acb-40f7-9617-7eebae56f223 could not be found. Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:26.064147 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:26.068687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:26.068687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:26.068687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900d656f-7acb-40f7-9617-7eebae56f223 could not be found. Oct 31 15:27:26.068687 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:26.068687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fbf6b11d-97d0-4e96-b509-9ee973518dac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 900d656f-7acb-40f7-9617-7eebae56f223 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:26.068687 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fbf6b11d-97d0-4e96-b509-9ee973518dac tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/900d656f-7acb-40f7-9617-7eebae56f223/action" status: 404 len: 111 microversion: 2.1 time: 0.018024 Oct 31 15:27:26.069119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.070446 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1187/2568] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:26 2022] POST /compute/v2.1/servers/900d656f-7acb-40f7-9617-7eebae56f223/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:26.073768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.076110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:26.077086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.080907 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-287aa32f-ef82-44d2-ba3c-e1cc52db2be4 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.140379 Oct 31 15:27:26.081971 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1382/2569] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:25 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:26.087064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.087362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:26.087991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.088139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.088830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.089772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.090426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.091378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.110505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.111063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.111629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.112368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.113018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.113478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.322007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.327834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.337862 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5996a276-f19d-45f5-be64-230dd6a0d2fb tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1325 microversion: 2.1 time: 0.265985 Oct 31 15:27:26.339175 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1188/2570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:26 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:26.344779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:26.345728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.360476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.361320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.361975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.362724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.363200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.363636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.367329 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d10be0e7-ab52-49e0-90a7-09bdf0cb8c13 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1648 microversion: 2.1 time: 0.283715 Oct 31 15:27:26.368379 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1383/2571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:26 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1648 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:26.399240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:26.399859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.411114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.411631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.412987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.414139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.414618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.415051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.593394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.603131 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c8710a15-9fe6-4db6-bdac-06313979772c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.262560 Oct 31 15:27:26.603735 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1189/2572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:26 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:26.628286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:26.628942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.635940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.636656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.637311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.638181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.638651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.639081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.669716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.686778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.689457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.690905 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-add88278-4a3d-4df1-b602-0d7fa9d83e79 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.297002 Oct 31 15:27:26.693639 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1384/2573] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:26 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:26.790069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:26.798864 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9ff80c1-f0ff-412a-a534-07e20871251b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.174351 Oct 31 15:27:26.813150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:26.816145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.818354 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1190/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:26 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:26.827708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:26.828253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.829458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.829891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.830896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.831247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.831696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.833352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.842252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.843366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.844032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.845265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.846137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.846795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:26.883137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lazy-loading 'flavor' on Instance uuid f4faf82e-33b1-482e-a400-e57ebf462f65 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:26.970374 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63417a1a-f228-4f8e-b6a1-597ad8d24c5a tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 202 len: 0 microversion: 2.1 time: 0.149850 Oct 31 15:27:26.974402 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1191/2575] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:26 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:26.980099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:26.980999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:26.998275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:26.998770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:26.999211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.000016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.000553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.001003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.135561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.186753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.190436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.197527 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e6c239f-0aaf-4416-98a7-83472cb1060c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.396019 Oct 31 15:27:27.199996 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1385/2576] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:26 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:27.218368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:27.219496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:27.229618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.230493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.231160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.232139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.232818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.233515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.397028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.412992 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4f72cab-302d-428d-abb0-0a7a7c62a63f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1512 microversion: 2.1 time: 0.435786 Oct 31 15:27:27.415948 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1192/2577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:26 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1512 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:27.425373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:27.427946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.429562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:27.442602 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed5f2536-9b91-464a-be90-e99524cdc910 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.241224 Oct 31 15:27:27.453162 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1386/2578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:27 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:27.454877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.459772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:27.460833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:27.465461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.467186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.470805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.471353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.475405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.486004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.486481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.487220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.489438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.491103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.493053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.668099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.683605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.685112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.710430 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13f690cd-e766-4516-b8db-bfe72d1672b5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1531 microversion: 2.91 time: 0.292192 Oct 31 15:27:27.712040 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1193/2579] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:27 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1531 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:27.722412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:27.723355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:27.733753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.734752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.735417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.736335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.737073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.738720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.779359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:27.789403 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6322914b-fe6c-4d88-8c13-0b24b5f1adc4 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1325 microversion: 2.1 time: 0.344085 Oct 31 15:27:27.803498 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1387/2580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:27 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:27.813088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:27.813738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:27.821244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.821952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.822639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.823517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:27.824141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:27.824572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:27.995562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.004684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.006284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.007470 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a499690-c90d-487f-aea2-8f6eaf6ebda3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.202919 Oct 31 15:27:28.008236 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1388/2581] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:27 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:28.013214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:28.013914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:28.020121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.020616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.021554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.022256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.022716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.023130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.174640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lazy-loading 'services' on Instance uuid 7d83eacf-e291-41a0-9527-35e637519251 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:28.215136 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85cca5c1-713f-49e1-a0d1-3bbcd5c611f4 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1938 microversion: 2.91 time: 0.206005 Oct 31 15:27:28.215936 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1389/2582] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:28 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1938 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:28.224029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ebc9043a-0dad-4e2e-b0d9-f7ee6fc1158f req-af415b4a-5513-4fa3-8729-3feb02e299e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddbbb03-fd46-4943-8e32-64278adae602", "name": "network-vif-plugged", "status": "completed", "tag": "124bfded-3480-4081-99bd-a1f17ba2fa14"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:28.243692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ebc9043a-0dad-4e2e-b0d9-f7ee6fc1158f req-af415b4a-5513-4fa3-8729-3feb02e299e8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.244201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ebc9043a-0dad-4e2e-b0d9-f7ee6fc1158f req-af415b4a-5513-4fa3-8729-3feb02e299e8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.244631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ebc9043a-0dad-4e2e-b0d9-f7ee6fc1158f req-af415b4a-5513-4fa3-8729-3feb02e299e8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.257219 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ebc9043a-0dad-4e2e-b0d9-f7ee6fc1158f req-af415b4a-5513-4fa3-8729-3feb02e299e8 service nova] Creating event network-vif-plugged:124bfded-3480-4081-99bd-a1f17ba2fa14 for instance 6ddbbb03-fd46-4943-8e32-64278adae602 on n-h2-858384-17 Oct 31 15:27:28.262241 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ebc9043a-0dad-4e2e-b0d9-f7ee6fc1158f req-af415b4a-5513-4fa3-8729-3feb02e299e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045271 Oct 31 15:27:28.263057 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1390/2583] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:28.272282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:28.272977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:28.289384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:28.291436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.292725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.293297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.293934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.294673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.295141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.295578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.301670 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b422ae8-75db-489b-90af-dac225045cb4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1648 microversion: 2.1 time: 0.584101 Oct 31 15:27:28.305502 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1194/2584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:27 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1648 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:28.310421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:28.310987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:28.329556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.330055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.334091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.335218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.339100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.339751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.376080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lazy-loading 'flavor' on Instance uuid 7d83eacf-e291-41a0-9527-35e637519251 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:28.732041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.743621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.747266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.750103 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-303d195c-9f44-4cad-a0d2-e8fe065b76ad tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.482460 Oct 31 15:27:28.751143 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1391/2585] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:28 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:28.756605 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b0faad13-450e-49f6-97a8-3b4e2eae317a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "POST /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251/action" status: 202 len: 0 microversion: 2.91 time: 0.448696 Oct 31 15:27:28.758272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:28.759051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:28.760769 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1195/2586] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:27:28 2022] POST /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:27:28.766163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.766657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.767091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.767793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.768237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.768801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:28.768977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.769697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:28.780381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.781327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.781968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.783059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:28.783719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:28.784695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:28.972460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:28.982990 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea6212f9-79a1-4294-8a6c-ee8f730c1114 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1495 microversion: 2.1 time: 0.230580 Oct 31 15:27:28.983964 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1392/2587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:28 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1495 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:29.008146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:29.008771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:29.015088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.015610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.016073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.016759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.017291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.017979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.089055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.099826 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e6945af-5a7c-4c93-b95c-80a478ce2c7f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1315 microversion: 2.1 time: 0.337030 Oct 31 15:27:29.106048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.109805 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1196/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:28 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:29.123327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:29.123945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:29.139957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.140549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.141028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.145586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:29.152886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.153460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.153982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.189588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.197667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.217074 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-74b56a4c-37d9-4f42-b3ec-f172c29c1baa tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.219830 Oct 31 15:27:29.219116 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1393/2589] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:28 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:29.234625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:29.236039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:29.258740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.259498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.260199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.261320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.261975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.264526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.353168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lazy-loading 'flavor' on Instance uuid f4faf82e-33b1-482e-a400-e57ebf462f65 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:29.406761 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Cannot 'suspend' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state suspended Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action HTTP/1.1 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 15 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: {"suspend": {}} Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: exception: Cannot 'suspend' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state suspended Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65', 'body': {'suspend': {}}} Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 31 15:27:29.417643 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state suspended Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state suspended Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:29.421677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 409 to user: Cannot 'suspend' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state suspended {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:29.423845 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-178ce48d-e5a1-49f7-aa84-518b2e33eca7 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 409 len: 148 microversion: 2.1 time: 0.201132 Oct 31 15:27:29.426473 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1394/2590] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:29 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 148 bytes in 206 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:27:29.439715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:29.441942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:29.456826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.459620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.464290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.465582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.472207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.472957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.621234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.634797 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87e0f8f5-d99a-4d3f-9e5e-f8a0fe95472b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1325 microversion: 2.1 time: 0.522308 Oct 31 15:27:29.637948 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1197/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:29 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1325 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:29.648770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4d12a6be-70c2-4fc4-ac9f-12d78039c0fb req-cc5f5893-3808-4da6-b0d6-292ea36acefc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7346a65d-a674-41d1-a272-4102c41ae7e3", "name": "network-vif-deleted", "tag": "6db2cbfb-2489-4798-a5f8-91df8d4226e3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:29.672462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4d12a6be-70c2-4fc4-ac9f-12d78039c0fb req-cc5f5893-3808-4da6-b0d6-292ea36acefc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.673156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4d12a6be-70c2-4fc4-ac9f-12d78039c0fb req-cc5f5893-3808-4da6-b0d6-292ea36acefc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.673742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4d12a6be-70c2-4fc4-ac9f-12d78039c0fb req-cc5f5893-3808-4da6-b0d6-292ea36acefc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.700663 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4d12a6be-70c2-4fc4-ac9f-12d78039c0fb req-cc5f5893-3808-4da6-b0d6-292ea36acefc service nova] Creating event network-vif-deleted:6db2cbfb-2489-4798-a5f8-91df8d4226e3 for instance 7346a65d-a674-41d1-a272-4102c41ae7e3 on n-h1-858384-17 Oct 31 15:27:29.706108 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4d12a6be-70c2-4fc4-ac9f-12d78039c0fb req-cc5f5893-3808-4da6-b0d6-292ea36acefc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066489 Oct 31 15:27:29.707009 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1198/2592] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:29.717969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:29.719582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:29.733434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.733866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.734230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.734945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.735403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.741453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.844177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.844743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.845207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.845867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lazy-loading 'fault' on Instance uuid 7346a65d-a674-41d1-a272-4102c41ae7e3 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:29.881677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.904883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.906779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.908018 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-840b2188-2c5e-430a-94da-787049a5237e tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.478584 Oct 31 15:27:29.914626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1395/2593] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:29 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:29.919456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aa2b885c-9fc8-41e8-9c1e-ca869870d4f8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:29.919992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aa2b885c-9fc8-41e8-9c1e-ca869870d4f8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:29.926945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa2b885c-9fc8-41e8-9c1e-ca869870d4f8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.928046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa2b885c-9fc8-41e8-9c1e-ca869870d4f8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.928427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa2b885c-9fc8-41e8-9c1e-ca869870d4f8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.929492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa2b885c-9fc8-41e8-9c1e-ca869870d4f8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:29.930152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa2b885c-9fc8-41e8-9c1e-ca869870d4f8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:29.930926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa2b885c-9fc8-41e8-9c1e-ca869870d4f8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:29.950489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a767ae59374d86a52a519ab067b27d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de2d818aea634d5a9e8d6eb3fd902f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:29.963023 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60d6b655-e6eb-4e82-a57f-c43af456f73c tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 200 len: 1306 microversion: 2.1 time: 0.254312 Oct 31 15:27:29.971050 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1199/2594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:29 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 1306 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:29.987644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:29.990886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:30.004148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.004862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.008053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.009049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.011295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.012759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.026205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:30.095400 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aa2b885c-9fc8-41e8-9c1e-ca869870d4f8 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 202 len: 0 microversion: 2.1 time: 0.179480 Oct 31 15:27:30.100222 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1396/2595] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:29 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:30.106036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:30.106764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:30.113228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.113720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.114140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.115392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.115852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.116481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.282014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:30.293792 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e37c6a88-25f0-4454-b953-82cbadc15f6e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1501 microversion: 2.1 time: 0.191807 Oct 31 15:27:30.311147 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1397/2596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:30 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:30.311147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:30.311147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:30.327943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.328456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.328901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.329652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.330114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.334786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.622268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:30.626631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:30.638052 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f5c6278-82dc-4b29-bb95-9a19b242ddb0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1502 microversion: 2.1 time: 0.335036 Oct 31 15:27:30.638911 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1398/2597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:30 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1502 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:30.640167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:30.642081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:30.643429 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ffd44eac-00b8-43ac-ac76-29756dfd23be tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.670171 Oct 31 15:27:30.644665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:30.645478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:30.667004 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1200/2598] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:29 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:30.671196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.672596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.673687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.674570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.675220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.675798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.675920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:30.676478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:30.692719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.693302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.693745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.697592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.698156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.698626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.776113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:30.784748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:30.786227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:30.791859 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8fe379bb-757b-49d4-b7f5-73d09d6c5f18 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.151667 Oct 31 15:27:30.792462 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1399/2599] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:30 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:30.809450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8d10b9f-4558-4f3d-9e98-226f6f501e65 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:30.810660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8d10b9f-4558-4f3d-9e98-226f6f501e65 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:30.820147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d10b9f-4558-4f3d-9e98-226f6f501e65 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.821006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d10b9f-4558-4f3d-9e98-226f6f501e65 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.821733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d10b9f-4558-4f3d-9e98-226f6f501e65 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.822449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d10b9f-4558-4f3d-9e98-226f6f501e65 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.823040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d10b9f-4558-4f3d-9e98-226f6f501e65 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.823488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d10b9f-4558-4f3d-9e98-226f6f501e65 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.901019 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8d10b9f-4558-4f3d-9e98-226f6f501e65 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6/action" status: 202 len: 0 microversion: 2.1 time: 0.101830 Oct 31 15:27:30.905326 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1400/2600] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:30 2022] POST /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:30.913072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:30.913834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:30.922710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.923826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.924485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:30.925454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:30.926078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:30.926897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.006945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.015212 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5876d97e-8e3d-49ad-8d18-5736e4edf27f tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1521 microversion: 2.1 time: 0.347047 Oct 31 15:27:31.015804 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1201/2601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:30 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:31.020579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.021418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:31.027708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.028591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.029238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.032118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.032826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.033343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.133333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.147078 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a66e61f1-2a2f-4fe2-b9f9-69b65eac9434 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1507 microversion: 2.1 time: 0.238144 Oct 31 15:27:31.147988 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1401/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:30 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:31.168336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.178766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] [instance: 7346a65d-a674-41d1-a272-4102c41ae7e3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:31.196543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.197178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.197588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.198324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.198781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.199260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.222777 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] HTTP exception thrown: Instance 7346a65d-a674-41d1-a272-4102c41ae7e3 could not be found. Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Request method failure captured: Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 HTTP/1.1 Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-jqz6AGjqviycWAlFa34Gq0VPOrNEcK7Jur8hrZKX7WShj3Yn__6XDlXsFhjXqiu2aEJ6ZNJRngT-Vdkq3BIsamUl8c6Q4PC3PixN3JyHof13OhLwa-tq-PaDKkdZUKZZHjAbFFoebSn3HIC9qNo6l8w1fVz3KLSAHYrDPdPyw2qcg Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de2d818aea634d5a9e8d6eb3fd902f0c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de2d818aea634d5a9e8d6eb3fd902f0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de2d818aea634d5a9e8d6eb3fd902f0c"}]}] Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: de2d818aea634d5a9e8d6eb3fd902f0c Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1919057311 Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: d9a767ae59374d86a52a519ab067b27d Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-SecurityGroupsTestJSON-1919057311-project Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 7346a65d-a674-41d1-a272-4102c41ae7e3 could not be found. Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '7346a65d-a674-41d1-a272-4102c41ae7e3'} Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7346a65d-a674-41d1-a272-4102c41ae7e3 could not be found. Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7346a65d-a674-41d1-a272-4102c41ae7e3 could not be found. Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:31.225351 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.230610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:31.230610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:31.230610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:31.230610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:31.230610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:31.230610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7346a65d-a674-41d1-a272-4102c41ae7e3 could not be found. Oct 31 15:27:31.230610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.230610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Returning 404 to user: Instance 7346a65d-a674-41d1-a272-4102c41ae7e3 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:31.231679 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-77ff89a9-4679-4563-97b9-965db964eaf4 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3" status: 404 len: 111 microversion: 2.1 time: 0.078318 Oct 31 15:27:31.235835 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1402/2603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/servers/7346a65d-a674-41d1-a272-4102c41ae7e3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:31.241441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.242076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:31.249663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.250282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.250839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.251653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.252214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.252751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.281073 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] HTTP exception thrown: Instance is not a member of specified network Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Request method failure captured: Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602/ips/invalid HTTP/1.1 Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-lKqznWlgcCijfI7dPuJwlWWF4mTA9h32dWox4X-RW51u2ErzykY6EnS-UU1ZHekItuYeEpCC-28UjOrSA3fEwk40vBOAl2kyiegvt9YngWf_aDbNCGb8lno4z4UQzu9nVpCOAYL5hGkHnXzM-hQLAGQc7IX-PbF22Ofh9mmPuQDTc Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 8b001e79f3ba45c8bbbc5e0dac9d45ba Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1704968657 Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b001e79f3ba45c8bbbc5e0dac9d45ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b001e79f3ba45c8bbbc5e0dac9d45ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b001e79f3ba45c8bbbc5e0dac9d45ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b001e79f3ba45c8bbbc5e0dac9d45ba"}]}] Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1704968657 Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 8b001e79f3ba45c8bbbc5e0dac9d45ba Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1704968657 Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerAddressesNegativeTestJSON-1704968657-project Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: cbe013cdd93245519bead8d5e8fa00af Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1704968657-project Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance is not a member of specified network Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': '6ddbbb03-fd46-4943-8e32-64278adae602', 'id': 'invalid'} Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 31 15:27:31.286450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.291885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:31.292186 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-146c54a3-8cce-460c-891c-a5798f560e53 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.054437 Oct 31 15:27:31.293199 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1403/2604] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602/ips/invalid => generated 91 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:27:31.298302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-68380e3f-5501-426d-b4ba-b9e9188a2b8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e17cd9d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.483272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.501360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.502839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.504035 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c193e3f1-f964-4ebf-8d3f-2d2fdb78a50a tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.487127 Oct 31 15:27:31.504620 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1202/2605] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:31.530945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8edf673-9893-4354-ad26-1795da387d00 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.534156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8edf673-9893-4354-ad26-1795da387d00 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Failed to fetch instance by id 999 {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:27:31.534654 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d8edf673-9893-4354-ad26-1795da387d00 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] HTTP exception thrown: Instance 999 could not be found. Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8edf673-9893-4354-ad26-1795da387d00 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Request method failure captured: Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lKqznWlgcCijfI7dPuJwlWWF4mTA9h32dWox4X-RW51u2ErzykY6EnS-UU1ZHekItuYeEpCC-28UjOrSA3fEwk40vBOAl2kyiegvt9YngWf_aDbNCGb8lno4z4UQzu9nVpCOAYL5hGkHnXzM-hQLAGQc7IX-PbF22Ofh9mmPuQDTc Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 8b001e79f3ba45c8bbbc5e0dac9d45ba Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1704968657 Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b001e79f3ba45c8bbbc5e0dac9d45ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b001e79f3ba45c8bbbc5e0dac9d45ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b001e79f3ba45c8bbbc5e0dac9d45ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b001e79f3ba45c8bbbc5e0dac9d45ba"}]}] Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1704968657 Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 8b001e79f3ba45c8bbbc5e0dac9d45ba Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1704968657 Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerAddressesNegativeTestJSON-1704968657-project Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: cbe013cdd93245519bead8d5e8fa00af Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1704968657-project Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 999 could not be found. Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'server_id': '999'} Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 31 15:27:31.537271 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:31.541765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8edf673-9893-4354-ad26-1795da387d00 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:31.542217 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8edf673-9893-4354-ad26-1795da387d00 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.019593 Oct 31 15:27:31.544044 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1203/2606] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:27:31.556776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.557063 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-68380e3f-5501-426d-b4ba-b9e9188a2b8e tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ea53016c-4352-4cd2-a02a-bf7a7d46bbfa" status: 202 len: 0 microversion: 2.1 time: 0.262406 Oct 31 15:27:31.557858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:31.558261 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1404/2607] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:31 2022] DELETE /compute/v2.1/os-security-groups/ea53016c-4352-4cd2-a02a-bf7a7d46bbfa => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:31.566600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.572555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:31.573977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.580877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.581583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.582779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.584094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.585478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.591648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.593752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.594316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.596353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.596970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.598041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.628919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:27:31.770909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8113f329-77d8-4016-954a-782c83d53a7b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 204 len: 0 microversion: 2.1 time: 0.207440 Oct 31 15:27:31.775181 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1405/2608] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:27:31 2022] DELETE /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:27:31.786006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f766b546-a87f-42aa-9e1f-0eb630327c33 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] Calling method '.version_select at 0x7f16e55d3550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.830806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:31.843855 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01ed0c4c-2d69-4287-99f9-43e38a508016 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1501 microversion: 2.1 time: 0.298549 Oct 31 15:27:31.844456 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1204/2609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1501 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:31.863098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:31.863987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:31.878276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.879134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.886788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:31.888207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:31.888856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:31.890766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.195843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.207688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.210447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.211921 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-037693b9-5db8-49f0-ae4e-642d9a61013d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.363923 Oct 31 15:27:32.213181 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1205/2610] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:31 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:32.218698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:32.221003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:32.227780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.228619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.229288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.230301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.230912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.231767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.546042 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f766b546-a87f-42aa-9e1f-0eb630327c33 tempest-SecurityGroupsTestJSON-1919057311 tempest-SecurityGroupsTestJSON-1919057311-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/7602e0fc-d15d-4936-a8c7-710b35143e55" status: 202 len: 0 microversion: 2.1 time: 0.767001 Oct 31 15:27:32.550732 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1406/2611] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:27:31 2022] DELETE /compute/v2.1/os-security-groups/7602e0fc-d15d-4936-a8c7-710b35143e55 => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:27:32.558379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:32.559556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:32.572888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.573792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.574471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.575388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.576109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.576789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.737218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.753673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.756818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.767837 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f312d54d-5c3b-41a8-9da5-53ede7594cd9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.215510 Oct 31 15:27:32.768874 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1407/2612] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:32 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:32.774797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:32.775413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:32.798996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.799520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.799993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.800775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.814010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.814466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.851042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:32.887025 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67cf7f94-a1af-46c0-8af8-8894f9358272 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1527 microversion: 2.1 time: 0.670477 Oct 31 15:27:32.888057 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1206/2613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:32 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1527 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:32.893698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:32.895127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:32.907674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.925987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.929869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:32.931781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:32.933682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:32.935255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.132590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.142183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.144142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.145644 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-841af5e0-f807-4f9a-bd26-2f711b33dd66 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.256206 Oct 31 15:27:33.147107 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1207/2614] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:32 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:33.152342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:33.153294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.177915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.178550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.180599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.182009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.182493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.182935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.269468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.278968 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dceeba7c-5b65-439a-9aea-5a60a4e9d788 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1487 microversion: 2.1 time: 0.507915 Oct 31 15:27:33.283222 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1408/2615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:32 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1487 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:33.291512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:33.291512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.301528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.301798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.305605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.309074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.309074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.309074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.361190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.372743 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-29f54128-b61b-47d8-aae2-3ba959b3d216 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.224350 Oct 31 15:27:33.373376 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1208/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:33 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:33.379293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:33.379884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.388531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.389032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.389619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.391456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.392173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.393381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.433358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:27:33.593664 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99b0011b-16bc-40b9-8229-e040e3c8937b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 204 len: 0 microversion: 2.1 time: 0.218782 Oct 31 15:27:33.594552 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1209/2617] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:27:33 2022] DELETE /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:27:33.603563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:33.604295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.616250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.616815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.617243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.617988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.618602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.619040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.772428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.780675 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-759ac123-3f9e-4078-9b03-e66f050f0dbc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.185091 Oct 31 15:27:33.781321 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1210/2618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:33 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:33.786099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:33.787337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.793870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.795233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.795847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.796885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.797527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.798142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.920892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.926411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:33.938198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.940403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.942009 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3531a043-6a56-4bcd-88d4-9d5779f3506b tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.657746 Oct 31 15:27:33.943552 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1409/2619] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:33 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:33.949196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:33.950009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:33.958256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.959787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.960424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.961608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:33.962232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:33.963088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:33.966819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:33.975903 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-490dc67f-3e44-4b43-bdcf-e6f7fd35b5d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1493 microversion: 2.1 time: 0.193331 Oct 31 15:27:33.980412 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1211/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:33 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1493 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:33.987891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7355124-1a4f-4df2-b9b6-a8f4fe82df1e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:33.988652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b7355124-1a4f-4df2-b9b6-a8f4fe82df1e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 5968238f-aea2-45a8-9b77-c222beb6e6b7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.008760 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b7355124-1a4f-4df2-b9b6-a8f4fe82df1e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 5968238f-aea2-45a8-9b77-c222beb6e6b7 could not be found. Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7355124-1a4f-4df2-b9b6-a8f4fe82df1e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/5968238f-aea2-45a8-9b77-c222beb6e6b7/action HTTP/1.1 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 15 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: {"unpause": {}} Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 5968238f-aea2-45a8-9b77-c222beb6e6b7 could not be found. Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '5968238f-aea2-45a8-9b77-c222beb6e6b7', 'body': {'unpause': {}}} Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5968238f-aea2-45a8-9b77-c222beb6e6b7 could not be found. Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5968238f-aea2-45a8-9b77-c222beb6e6b7 could not be found. Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:34.010820 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:34.015277 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:34.015277 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:34.015277 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5968238f-aea2-45a8-9b77-c222beb6e6b7 could not be found. Oct 31 15:27:34.015277 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:34.017101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7355124-1a4f-4df2-b9b6-a8f4fe82df1e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 5968238f-aea2-45a8-9b77-c222beb6e6b7 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:34.018238 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b7355124-1a4f-4df2-b9b6-a8f4fe82df1e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/5968238f-aea2-45a8-9b77-c222beb6e6b7/action" status: 404 len: 111 microversion: 2.1 time: 0.036618 Oct 31 15:27:34.018987 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1212/2621] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:33 2022] POST /compute/v2.1/servers/5968238f-aea2-45a8-9b77-c222beb6e6b7/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:34.028762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.029428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.038530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.039091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.039571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.040254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.040718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.041349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.122823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.140520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.142397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.149593 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6646ab0-a07c-4b0f-87b6-61b7ca3751b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.204708 Oct 31 15:27:34.150966 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1410/2622] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:33 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:34.157104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.157747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.167703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.167703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.167703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.167703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.168094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.168425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.195161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.204081 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61d07ac6-9e7b-4b6d-9dc3-891383267912 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1527 microversion: 2.1 time: 0.179994 Oct 31 15:27:34.207646 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1213/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1527 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:34.216309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.217422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.220856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:34.225323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.225576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.226026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.226850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.227321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.227765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.384455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.393956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.395636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.397301 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d336b00e-d538-46de-a060-25d7d531ada9 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.186843 Oct 31 15:27:34.398271 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1214/2624] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:34.850488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:34.873033 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a68443f3-6a48-4d47-8eda-8027d64a62b2 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.720059 Oct 31 15:27:34.874169 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1411/2625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:34.901811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.902432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.909625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.910235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.910773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.912096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.913600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.914108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.974628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:34.975396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:34.981804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.982304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.982744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:34.983733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:34.983930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:34.984335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.141767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.153708 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-94c0ff81-e682-433e-b849-a855d1ca4c37 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.255635 Oct 31 15:27:35.157328 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1215/2626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:35.160860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:35.162282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:35.175614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.179476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.180487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.183960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.184463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.185075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.410374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.422597 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c6d41d3e-e751-457d-9138-1a0cd1ba9cec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1493 microversion: 2.1 time: 0.266743 Oct 31 15:27:35.431351 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1216/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:35 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1493 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:35.431351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3c6d7c81-7dfe-4b91-ba2a-fb582977068b req-18324511-cb82-411a-9632-ae285c3c44e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddbbb03-fd46-4943-8e32-64278adae602", "name": "network-vif-deleted", "tag": "124bfded-3480-4081-99bd-a1f17ba2fa14"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:35.445780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3c6d7c81-7dfe-4b91-ba2a-fb582977068b req-18324511-cb82-411a-9632-ae285c3c44e0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.446349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3c6d7c81-7dfe-4b91-ba2a-fb582977068b req-18324511-cb82-411a-9632-ae285c3c44e0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.446844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3c6d7c81-7dfe-4b91-ba2a-fb582977068b req-18324511-cb82-411a-9632-ae285c3c44e0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.451009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:35.460441 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3c6d7c81-7dfe-4b91-ba2a-fb582977068b req-18324511-cb82-411a-9632-ae285c3c44e0 service nova] Creating event network-vif-deleted:124bfded-3480-4081-99bd-a1f17ba2fa14 for instance 6ddbbb03-fd46-4943-8e32-64278adae602 on n-h2-858384-17 Oct 31 15:27:35.465582 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3c6d7c81-7dfe-4b91-ba2a-fb582977068b req-18324511-cb82-411a-9632-ae285c3c44e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041218 Oct 31 15:27:35.466605 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1217/2628] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:35.472603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:35.473517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:35.481572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.482071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.482515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.483419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.483642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.484146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.569338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.581926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.584179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.590408 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-79a5bbff-1a56-4adf-8c9c-3ee011a8378f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.122440 Oct 31 15:27:35.599409 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1218/2629] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:35 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:35.605088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:35.605669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:35.619479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.620033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.620474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.621237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.621696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.622181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.658776 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Cannot 'unpause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action HTTP/1.1 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 15 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: {"unpause": {}} Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: exception: Cannot 'unpause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65', 'body': {'unpause': {}}} Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 in vm_state active. Cannot unpause while the instance is in this state. Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:35.659862 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:35.664106 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:35.664106 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:35.664106 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:35.664106 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:27:35.664106 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:35.664106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 409 to user: Cannot 'unpause' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:35.664106 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a2d3377-d1cb-4cf3-b2a5-fec61a5b92fd tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 409 len: 145 microversion: 2.1 time: 0.061359 Oct 31 15:27:35.666607 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1219/2630] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:35 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 145 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:27:35.671379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:35.672076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:35.679720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.680206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.680667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.681421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.681873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.682295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.690219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.702130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.704756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.706521 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-94f49429-8124-43a1-814a-d17fdac4d7b7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.739596 Oct 31 15:27:35.717982 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1412/2631] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:34 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:35.729577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.730056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.730488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.730933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lazy-loading 'fault' on Instance uuid 6ddbbb03-fd46-4943-8e32-64278adae602 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:35.734643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:35.735735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:35.742511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.743262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.743926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.744632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.745086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.745526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.796416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbe013cdd93245519bead8d5e8fa00af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b001e79f3ba45c8bbbc5e0dac9d45ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:35.804986 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21683618-cd41-49c0-b648-2cac845ec0d1 tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 200 len: 1315 microversion: 2.1 time: 0.137272 Oct 31 15:27:35.817155 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1220/2632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:35 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:35.817155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:35.817155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:35.821212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.821754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.822156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:35.822872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:35.823336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:35.823824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.099662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.107735 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91e75332-1e71-46c5-b508-fa228da9002b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.297858 Oct 31 15:27:36.108496 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1221/2633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:35 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:36.132511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:36.133403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:36.141251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.141654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.142171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.143468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.144213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.144511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.159759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.173441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.175144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.176594 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d7be3cf5-065e-4081-ab73-03ec12c0b509 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.457443 Oct 31 15:27:36.190194 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1413/2634] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:35 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:36.400901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c9e263e6-c025-49b5-b117-157b4510df4f req-dfa07ca0-d8f1-452e-99d8-3bc6d7874a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6", "name": "network-vif-deleted", "tag": "e9a470bf-58bf-48fd-87d9-6c394ab1fd88"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:36.403879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.415943 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d1c8dfc-c811-4c2b-a91c-3dc6639d3dc5 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.287749 Oct 31 15:27:36.417820 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1222/2635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:36 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:36.429453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c9e263e6-c025-49b5-b117-157b4510df4f req-dfa07ca0-d8f1-452e-99d8-3bc6d7874a2b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.429453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c9e263e6-c025-49b5-b117-157b4510df4f req-dfa07ca0-d8f1-452e-99d8-3bc6d7874a2b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.429704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c9e263e6-c025-49b5-b117-157b4510df4f req-dfa07ca0-d8f1-452e-99d8-3bc6d7874a2b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.445278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-995a510b-e082-43a9-aebe-2fcf329dcb10 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:36.446132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-995a510b-e082-43a9-aebe-2fcf329dcb10 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f708e76a-d3bd-401d-9b6c-ab1ae2346417] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:36.448991 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c9e263e6-c025-49b5-b117-157b4510df4f req-dfa07ca0-d8f1-452e-99d8-3bc6d7874a2b service nova] Creating event network-vif-deleted:e9a470bf-58bf-48fd-87d9-6c394ab1fd88 for instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 on n-h1-858384-17 Oct 31 15:27:36.454067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-995a510b-e082-43a9-aebe-2fcf329dcb10 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance f708e76a-d3bd-401d-9b6c-ab1ae2346417 could not be found. Oct 31 15:27:36.454844 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c9e263e6-c025-49b5-b117-157b4510df4f req-dfa07ca0-d8f1-452e-99d8-3bc6d7874a2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061908 Oct 31 15:27:36.455555 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1414/2636] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-995a510b-e082-43a9-aebe-2fcf329dcb10 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/f708e76a-d3bd-401d-9b6c-ab1ae2346417/action HTTP/1.1 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 18 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: {"unshelve": null} Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f708e76a-d3bd-401d-9b6c-ab1ae2346417 could not be found. Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f708e76a-d3bd-401d-9b6c-ab1ae2346417', 'body': {'unshelve': None}} Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f708e76a-d3bd-401d-9b6c-ab1ae2346417 could not be found. Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f708e76a-d3bd-401d-9b6c-ab1ae2346417 could not be found. Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:36.461477 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f708e76a-d3bd-401d-9b6c-ab1ae2346417 could not be found. Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-995a510b-e082-43a9-aebe-2fcf329dcb10 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance f708e76a-d3bd-401d-9b6c-ab1ae2346417 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:36.466430 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-995a510b-e082-43a9-aebe-2fcf329dcb10 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f708e76a-d3bd-401d-9b6c-ab1ae2346417/action" status: 404 len: 111 microversion: 2.1 time: 0.023556 Oct 31 15:27:36.467994 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1223/2637] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:36 2022] POST /compute/v2.1/servers/f708e76a-d3bd-401d-9b6c-ab1ae2346417/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:36.470218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:36.471148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:36.472243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:36.473019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:36.479299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.480883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.481610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.481901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.483724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.483852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.483963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.484058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.484058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.484363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.484363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.484578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.652973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.656261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.666588 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6abd34a4-c948-416b-8cf0-a1246d274664 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.198380 Oct 31 15:27:36.667369 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1224/2638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:36 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:36.668912 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30979ca3-6f6a-46c1-9bb9-b50980cee832 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 200 len: 1285 microversion: 2.1 time: 0.211829 Oct 31 15:27:36.672537 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1415/2639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:36 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 1285 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:36.695000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:36.695721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:36.699147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:36.699994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:36.707059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.709902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.710038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.710405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.710818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.710942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.711545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.712890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.713403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.713837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.716423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.717256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.806805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.815792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.817589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:36.824898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-137bb2cc-f2db-46d9-abfc-6c1f9a60720f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.134764 Oct 31 15:27:36.824898 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1225/2640] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:36 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:36.829580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:36.830119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:36.847022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.848054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.848643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:36.850457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:36.851181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:36.851771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.075390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:37.088564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:37.090306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:37.091827 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-41d35fdb-9421-4050-92f3-3f32c39ce3fb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.266490 Oct 31 15:27:37.106490 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1226/2641] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:36 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:37.106490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:37.106490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] [instance: 6ddbbb03-fd46-4943-8e32-64278adae602] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:37.112923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.113481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.113975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.114739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.115252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.115774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.131469 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] HTTP exception thrown: Instance 6ddbbb03-fd46-4943-8e32-64278adae602 could not be found. Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Request method failure captured: Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 HTTP/1.1 Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lKqznWlgcCijfI7dPuJwlWWF4mTA9h32dWox4X-RW51u2ErzykY6EnS-UU1ZHekItuYeEpCC-28UjOrSA3fEwk40vBOAl2kyiegvt9YngWf_aDbNCGb8lno4z4UQzu9nVpCOAYL5hGkHnXzM-hQLAGQc7IX-PbF22Ofh9mmPuQDTc Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 8b001e79f3ba45c8bbbc5e0dac9d45ba Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1704968657 Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b001e79f3ba45c8bbbc5e0dac9d45ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8b001e79f3ba45c8bbbc5e0dac9d45ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8b001e79f3ba45c8bbbc5e0dac9d45ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8b001e79f3ba45c8bbbc5e0dac9d45ba"}]}] Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1704968657 Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 8b001e79f3ba45c8bbbc5e0dac9d45ba Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1704968657 Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerAddressesNegativeTestJSON-1704968657-project Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: cbe013cdd93245519bead8d5e8fa00af Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1704968657-project Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 6ddbbb03-fd46-4943-8e32-64278adae602 could not be found. Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '6ddbbb03-fd46-4943-8e32-64278adae602'} Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ddbbb03-fd46-4943-8e32-64278adae602 could not be found. Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ddbbb03-fd46-4943-8e32-64278adae602 could not be found. Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.133048 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ddbbb03-fd46-4943-8e32-64278adae602 could not be found. Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] Returning 404 to user: Instance 6ddbbb03-fd46-4943-8e32-64278adae602 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8cfcd136-c4f0-4964-98dc-9b68faf3639b tempest-ServerAddressesNegativeTestJSON-1704968657 tempest-ServerAddressesNegativeTestJSON-1704968657-project] 10.222.0.20 "GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602" status: 404 len: 111 microversion: 2.1 time: 0.041430 Oct 31 15:27:37.137584 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1227/2642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:37 2022] GET /compute/v2.1/servers/6ddbbb03-fd46-4943-8e32-64278adae602 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:37.205987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:37.206602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:37.216757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.217335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.217781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.218518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.218979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.219409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.387671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:37.401163 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13eea56f-7f45-427a-a4cc-0a917879fc4c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.708811 Oct 31 15:27:37.424793 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1416/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:36 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:37.467655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:37.470116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:37.507854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.508398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.508843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.514788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.519269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.520365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.565409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:37.577237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:37.591270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:37.592489 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e2c4192-1f29-481c-8f70-87169d58c4fd tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.390875 Oct 31 15:27:37.603375 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1228/2644] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:37 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:37.608958 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Cannot 'unshelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action HTTP/1.1 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 18 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: {"unshelve": null} Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: exception: Cannot 'unshelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65', 'body': {'unshelve': None}} Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 in vm_state active. Cannot unshelve while the instance is in this state. Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:27:37.610717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 409 to user: Cannot 'unshelve' instance f4faf82e-33b1-482e-a400-e57ebf462f65 while it is in vm_state active {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ced34e7-d7d5-4b34-b30a-0219c40fdf52 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action" status: 409 len: 146 microversion: 2.1 time: 0.160967 Oct 31 15:27:37.619385 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1417/2645] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:27:37 2022] POST /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65/action => generated 146 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:27:37.625526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:37.626372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:37.641939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.642697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.644511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.645446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.646115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.646701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.696699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:37.697500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:37.720685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.721461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.722246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.723136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:37.723854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:37.725302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:37.759983 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 HTTP/1.1 Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6'} Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:37.763400 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.769807 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:37.769807 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:37.769807 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:37.769807 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:37.769807 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:37.769807 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:27:37.769807 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:37.771769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:37.773470 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ecc70a18-1480-47d0-8bee-c10f0a5cd369 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 404 len: 111 microversion: 2.1 time: 0.082091 Oct 31 15:27:37.784005 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1418/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:37 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:37.991938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-2049998965", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "2b5355db-9171-4de8-abb5-5f94412a242a"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:38.050092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:38.063765 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-15dda2cd-a633-4435-b7ce-c4756813358c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.442148 Oct 31 15:27:38.085110 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1229/2647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:37 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:38.091037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] validate_networks() for [('2b5355db-9171-4de8-abb5-5f94412a242a', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:27:38.093559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:38.094396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:38.105671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:38.107938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:38.110396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:38.112808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:38.113568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:38.114204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:38.271213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:38.285646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:38.292224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:38.306358 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30b2fb7d-5e8e-4e84-960e-5c506004cf0b tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.219406 Oct 31 15:27:38.307336 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1230/2648] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:38 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:38.318516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1568343853", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "c356d61f-2e01-42fa-9c99-c94fb61838ec"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:38.431643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] validate_networks() for [('c356d61f-2e01-42fa-9c99-c94fb61838ec', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:27:39.031128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:27:39.031824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:27:39.032121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:27:39.032501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:27:39.032914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:27:39.043064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:39.043824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:39.044440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:39.045417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:39.046280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:39.046625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:39.067592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:27:39.074907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for user 31cd28d777ac40eda1a7abefb5a3256d and project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:27:39.090658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:27:39.091158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:27:39.091570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:27:39.091988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:27:39.092406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:27:39.093143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:27:39.095767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:27:39.108319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:39.108762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:39.111114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:39.111923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:39.114082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:39.123413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:39.167552 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0259e12d-ecb3-4c19-abb6-da2cde7824fa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.377867 Oct 31 15:27:39.173821 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1419/2649] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:27:39.186838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:39.187888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:39.192598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:27:39.216166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for user 93f77a1d41fd431d9da6587e0ca9cb1e and project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:27:39.245925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:39.247163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:39.249707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:39.250851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:39.251410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:39.253957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:39.260952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:27:39.277981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:27:39.407264 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-15d91896-8f18-4511-991d-cf5cbfd38b4e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098716 Oct 31 15:27:39.407938 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1231/2650] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:27:39.451987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:39.452681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:39.467961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:39.468515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:39.468898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:39.469667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:39.470122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:39.470545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:39.986664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.005231 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c0d54bc-c8b3-4e19-ab29-ad6e1b20c42b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.829876 Oct 31 15:27:40.012685 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1420/2651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:39 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:40.028912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:40.030193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:40.053551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.055812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.056437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.058479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.070533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.071738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.373112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.394879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.398205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.399569 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc80fb28-5274-4abd-9369-d7dd0a30450d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.989525 Oct 31 15:27:40.400598 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1232/2652] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:39 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:40.405940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:40.406740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:40.412870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.413756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.414488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.415539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.416222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.417014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.539338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.543374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.550171 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eba4fc86-f6d0-44e8-abf6-0457f4613c19 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1189 microversion: 2.1 time: 0.148348 Oct 31 15:27:40.553284 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1233/2653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:40 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1189 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:40.558483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.562554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.565310 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af4c1452-e1ed-411f-a73e-37fd627cf9ae tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.551054 Oct 31 15:27:40.566091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1421/2654] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:40 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:40.579335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:40.582988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:40.589037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:40.589831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:40.600967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.601755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.601969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.602387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.603278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.603893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.604475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.604988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.605583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.606375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.607996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.608440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.738717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.751278 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a2a9f6f-ea81-4d78-bed2-3192ba17f184 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1219 microversion: 2.1 time: 0.183901 Oct 31 15:27:40.751948 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1422/2655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:40 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:40.758136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ef3a891-27b7-4017-aeac-7425b50cf57f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1837520675_updated"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:40.761795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4ef3a891-27b7-4017-aeac-7425b50cf57f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 031cbf88-2715-4c52-be7f-b076073bbcfb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:40.767944 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4ef3a891-27b7-4017-aeac-7425b50cf57f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 031cbf88-2715-4c52-be7f-b076073bbcfb could not be found. Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ef3a891-27b7-4017-aeac-7425b50cf57f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/servers/031cbf88-2715-4c52-be7f-b076073bbcfb HTTP/1.1 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 81 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1837520675_updated"}} Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 031cbf88-2715-4c52-be7f-b076073bbcfb could not be found. Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '031cbf88-2715-4c52-be7f-b076073bbcfb', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1837520675_updated'}}} Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 031cbf88-2715-4c52-be7f-b076073bbcfb could not be found. Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 31 15:27:40.770001 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 031cbf88-2715-4c52-be7f-b076073bbcfb could not be found. Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 031cbf88-2715-4c52-be7f-b076073bbcfb could not be found. Oct 31 15:27:40.778772 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:40.787143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ef3a891-27b7-4017-aeac-7425b50cf57f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 031cbf88-2715-4c52-be7f-b076073bbcfb could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:40.789581 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4ef3a891-27b7-4017-aeac-7425b50cf57f tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "PUT /compute/v2.1/servers/031cbf88-2715-4c52-be7f-b076073bbcfb" status: 404 len: 111 microversion: 2.1 time: 0.036199 Oct 31 15:27:40.793693 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1423/2656] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 15:27:40 2022] PUT /compute/v2.1/servers/031cbf88-2715-4c52-be7f-b076073bbcfb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:40.800182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8da8a276-f2a1-458c-bdb4-d1331aaf2b37 req-9f166ddb-fdc8-447c-b53b-4b53e20fe75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda8a8fb-a7fe-40c6-a043-4ab745171b12", "name": "network-vif-unplugged", "status": "completed", "tag": "0676a67e-c7b2-4713-bb5b-a960b92c3471"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:40.820858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8da8a276-f2a1-458c-bdb4-d1331aaf2b37 req-9f166ddb-fdc8-447c-b53b-4b53e20fe75d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.821375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8da8a276-f2a1-458c-bdb4-d1331aaf2b37 req-9f166ddb-fdc8-447c-b53b-4b53e20fe75d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.822050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8da8a276-f2a1-458c-bdb4-d1331aaf2b37 req-9f166ddb-fdc8-447c-b53b-4b53e20fe75d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.835806 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8da8a276-f2a1-458c-bdb4-d1331aaf2b37 req-9f166ddb-fdc8-447c-b53b-4b53e20fe75d service nova] Creating event network-vif-unplugged:0676a67e-c7b2-4713-bb5b-a960b92c3471 for instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 on n-h1-858384-17 Oct 31 15:27:40.841545 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8da8a276-f2a1-458c-bdb4-d1331aaf2b37 req-9f166ddb-fdc8-447c-b53b-4b53e20fe75d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045992 Oct 31 15:27:40.842730 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1424/2657] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:40.849117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:40.850266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:40.856817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.869082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.869737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.870421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.871231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:40.871757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.871899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:40.872392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:40.876598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:40.887733 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91e00074-6a20-484d-84a5-dd0485e82aa7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.333313 Oct 31 15:27:40.888636 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1234/2658] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:40 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:41.150267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:41.158972 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f82308f-8dca-48dd-8158-4e59b76b3e30 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.314631 Oct 31 15:27:41.159662 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1425/2659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:40 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:41.191727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:41.200898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:41.240526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:41.241207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:41.241676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:41.254719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:41.256530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:41.257268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:41.426866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:41.429621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:41.467384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:41.471942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:41.475335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:41.476425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:41.478320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:41.483823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.081556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:42.095403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:42.096973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:42.102766 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-336fe439-b4a5-48b9-b42f-138e0372ec2e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.680213 Oct 31 15:27:42.104387 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1426/2660] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:41 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:42.111198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:42.112448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:42.143421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.144286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.145433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.146624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.152590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.153409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.274294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:42.297867 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9ad5f3f4-07bd-465d-968e-51b8991aaf4f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1251 microversion: 2.1 time: 0.191729 Oct 31 15:27:42.300306 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1427/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:42 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1251 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:42.317241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:42.318404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:42.331886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.332955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.333784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.334829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.335355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.335850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.652162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:42.672123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:42.675852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:42.679648 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9390c38-c88a-4711-b958-1b436e159390 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.378117 Oct 31 15:27:42.684165 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1428/2662] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:42 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:42.693121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:42.695065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:42.709656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:42.711583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.714851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.718292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.719335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.720281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.720985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.878414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:42.892384 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ade45bd-432e-420e-a0cb-7e93065b0941 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 1.708020 Oct 31 15:27:42.896237 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1235/2663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:41 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:42.901979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:42.906784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:42.926165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.927022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.927849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.928730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:42.929610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:42.930347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:42.994438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.014797 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7357f38a-2f76-4443-ac3c-04a7f582ce73 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1273 microversion: 2.1 time: 0.326750 Oct 31 15:27:43.016760 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1429/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:42 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:43.028894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5cb1a0b2-a256-4801-9f26-47347d0c659e req-49fa90e0-3bf0-4539-b9c6-105e95b24cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda8a8fb-a7fe-40c6-a043-4ab745171b12", "tag": "0676a67e-c7b2-4713-bb5b-a960b92c3471"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:43.047934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5cb1a0b2-a256-4801-9f26-47347d0c659e req-49fa90e0-3bf0-4539-b9c6-105e95b24cf2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.050129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5cb1a0b2-a256-4801-9f26-47347d0c659e req-49fa90e0-3bf0-4539-b9c6-105e95b24cf2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.051313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5cb1a0b2-a256-4801-9f26-47347d0c659e req-49fa90e0-3bf0-4539-b9c6-105e95b24cf2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.078526 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5cb1a0b2-a256-4801-9f26-47347d0c659e req-49fa90e0-3bf0-4539-b9c6-105e95b24cf2 service nova] Creating event network-changed:0676a67e-c7b2-4713-bb5b-a960b92c3471 for instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 on n-h1-858384-17 Oct 31 15:27:43.088119 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5cb1a0b2-a256-4801-9f26-47347d0c659e req-49fa90e0-3bf0-4539-b9c6-105e95b24cf2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069155 Oct 31 15:27:43.089508 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1430/2665] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:43.096145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66164a22-25df-49a7-a733-2e33a6db507b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66164a22-25df-49a7-a733-2e33a6db507b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 HTTP/1.1 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 280 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:43.101386 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 31 15:27:43.104989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:43.108712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66164a22-25df-49a7-a733-2e33a6db507b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:43.109950 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66164a22-25df-49a7-a733-2e33a6db507b tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "PUT /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 400 len: 619 microversion: 2.1 time: 0.019008 Oct 31 15:27:43.111091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1431/2666] 10.222.0.20 () {60 vars in 1257 bytes} [Mon Oct 31 15:27:43 2022] PUT /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:27:43.120607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:43.121917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:43.140593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.141397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.142059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.143050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.143700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.144318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.152195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:43.293293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.297740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:43.306469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.310262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.322981 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-404a7ac3-d93c-4974-84ad-3873a5608ab2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.424583 Oct 31 15:27:43.323902 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1236/2667] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:42 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:43.347587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:43.348271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:43.367712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.368643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.369428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.370579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.371200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.372216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.488085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.498108 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-814bc4f7-1622-48af-b47d-5be753695d8e tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.382668 Oct 31 15:27:43.499290 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1432/2668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:43 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:43.504369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:43.505309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:43.516418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.517465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.518227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.519263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.519875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.520975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.654997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:43.672666 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4fdd5978-5f25-4d8a-b6cc-bccdfb786394 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1251 microversion: 2.1 time: 0.171128 Oct 31 15:27:43.686227 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1433/2669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:43 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1251 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:43.699124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:43.699759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:43.719430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.719979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.720429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.721186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:43.721647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:43.722066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:43.991595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.023015 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b55eed3-417c-4ac8-b936-0409897aa83c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.332833 Oct 31 15:27:44.025179 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1434/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:43 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:44.034226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:44.036128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:44.051617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.052579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.053722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.055435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.058502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.060266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.190882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.234413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.242733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.257785 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3ef64a1-92a5-4bca-83d0-30f011bdc9d5 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.931854 Oct 31 15:27:44.260175 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1237/2671] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:43 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:44.271663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:44.272615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:44.286542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.288309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.289073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.290185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.290891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.291574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.330368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.353987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.374970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.381494 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db26d194-c7dd-4100-a68d-808c76eb0b8d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.353857 Oct 31 15:27:44.391413 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1435/2672] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:44 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:44.410536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d65ef3a-097d-4a10-8202-6502d125facc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d65ef3a-097d-4a10-8202-6502d125facc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 HTTP/1.1 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 24 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": ""}} Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65', 'body': {'server': {'name': ''}}} Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi '' Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:27:44.438604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 31 15:27:44.443764 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:44.451340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d65ef3a-097d-4a10-8202-6502d125facc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:44.454645 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d65ef3a-097d-4a10-8202-6502d125facc tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "PUT /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 400 len: 108 microversion: 2.1 time: 0.060781 Oct 31 15:27:44.455248 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1436/2673] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 15:27:44 2022] PUT /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 108 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:27:44.465937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:44.466552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:44.487123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.487628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.489481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.491203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.499178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.500019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.865695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.894109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.898903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:44.915750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c38fb7c-9230-402a-a6bb-b7f8c6a3221a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.455734 Oct 31 15:27:44.919098 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1437/2674] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:44 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:44.931206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:44.931731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:44.978684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.979398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.982918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:44.988839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:44.989339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:44.990321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.057445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.077098 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-979f4c86-7635-4140-a0b9-d90c793f283f tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1315 microversion: 2.1 time: 0.814671 Oct 31 15:27:45.078566 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1238/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:44 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:45.095746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:45.096427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:45.123813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.125970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.126505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.127274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.135600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.136189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.400911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.419279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c34457e8-a03c-49ae-bdfa-47ed3bddb1e5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1251 microversion: 2.1 time: 0.338352 Oct 31 15:27:45.423700 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1239/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:45 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1251 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:45.431773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:45.444371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:45.469968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.470493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.473492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.477384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.479835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.481641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.556362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:45.572475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0cd1ea95-d8e6-41d9-99dd-d1467cc6649c tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1504 microversion: 2.1 time: 0.652024 Oct 31 15:27:45.574379 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1438/2677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:44 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1504 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:45.589108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:45.594868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:45.609513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.612032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.612733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:45.613797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:45.616971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:45.620420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:46.312276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:46.323062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:46.332124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:46.334712 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0846b357-1342-47ba-84ba-3a857a262591 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.909515 Oct 31 15:27:46.340332 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1240/2678] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:45 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:46.351940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:46.356178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:46.369533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.371046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.374780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:46.375721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.376351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.377142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:46.611233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:46.624918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:46.631364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:46.658437 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-423fd3ab-8dd0-41ef-93a4-9bc4bd3b73eb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.316556 Oct 31 15:27:46.659044 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1241/2679] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:46 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:46.673719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:46.674346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:46.696844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.697407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.697859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:46.701501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:46.710485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:46.712412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:47.446401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.456691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.459734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:47.462750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5fd2b16e-ba65-4c6a-bf6d-2e12cfccc068 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 1.886589 Oct 31 15:27:47.478344 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1439/2680] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:45 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:47.492927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:47.494549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:47.508561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:47.509690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:47.510346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:47.511228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:47.512354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:47.513711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.242176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.256633 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f150171a-eeb1-488f-bb1d-61d286afb789 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1293 microversion: 2.1 time: 0.771694 Oct 31 15:27:48.260689 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1440/2681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:47 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1293 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:48.265607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-80187710-0f3b-455a-8d35-a20a3b1ea31c req-6efaa96b-58e5-41bd-98aa-6d0d658a4211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30932182-ff62-4e04-a97c-d0c80577089f", "tag": "ef93582f-e5e2-493d-b6c4-4b6f4f126e30"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:48.307059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-80187710-0f3b-455a-8d35-a20a3b1ea31c req-6efaa96b-58e5-41bd-98aa-6d0d658a4211 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.315361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-80187710-0f3b-455a-8d35-a20a3b1ea31c req-6efaa96b-58e5-41bd-98aa-6d0d658a4211 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.319225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-80187710-0f3b-455a-8d35-a20a3b1ea31c req-6efaa96b-58e5-41bd-98aa-6d0d658a4211 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.352328 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-80187710-0f3b-455a-8d35-a20a3b1ea31c req-6efaa96b-58e5-41bd-98aa-6d0d658a4211 service nova] Creating event network-changed:ef93582f-e5e2-493d-b6c4-4b6f4f126e30 for instance 30932182-ff62-4e04-a97c-d0c80577089f on n-h2-858384-17 Oct 31 15:27:48.359386 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-80187710-0f3b-455a-8d35-a20a3b1ea31c req-6efaa96b-58e5-41bd-98aa-6d0d658a4211 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097224 Oct 31 15:27:48.361423 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1441/2682] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:48.373947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:48.375181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:48.382680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.383455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.384782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.385786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.386538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.387937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.405659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.414608 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7504ba00-0373-4469-ae4e-0686c52ec6d4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1315 microversion: 2.1 time: 1.754322 Oct 31 15:27:48.431082 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1242/2683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:46 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1315 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:48.446915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:48.447931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:48.463558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.468604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.469459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.470443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.471065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.471676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.665744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.675794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.677642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.679087 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7628fe0e-466e-41c5-97eb-9cd17f408fab tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.315014 Oct 31 15:27:48.680182 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1442/2684] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:48 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:48.693045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:48.694293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:48.701382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.702289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.702964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.704150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:48.704872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:48.705768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:48.739082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.758519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.762475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.789853 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce426330-bdf0-4965-9dea-fcf708aeb000 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.357318 Oct 31 15:27:48.792060 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1243/2685] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:48 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:48.909617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.923698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.925759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:48.927730 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46cb5178-0a7c-41a5-ba86-66c9fbd7a672 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.245545 Oct 31 15:27:48.928917 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1443/2686] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:48 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:49.282048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:49.282776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:49.285874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:49.290020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:49.301230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:49.305852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:49.306304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:49.307224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:49.307845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:49.309965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:49.365870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d45d2523-95b8-456a-af0a-b4ac8d56307c req-48c5268e-9e97-4c25-9a5a-e77377988b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f854e7e8-6a2c-4fe0-9317-f17fa81d3243", "tag": "8e7814a5-2149-4218-a84c-b967864f8da7"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:49.378732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:49.380261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:49.383513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d45d2523-95b8-456a-af0a-b4ac8d56307c req-48c5268e-9e97-4c25-9a5a-e77377988b58 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:49.385504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d45d2523-95b8-456a-af0a-b4ac8d56307c req-48c5268e-9e97-4c25-9a5a-e77377988b58 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:49.386747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d45d2523-95b8-456a-af0a-b4ac8d56307c req-48c5268e-9e97-4c25-9a5a-e77377988b58 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:49.401681 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d45d2523-95b8-456a-af0a-b4ac8d56307c req-48c5268e-9e97-4c25-9a5a-e77377988b58 service nova] Creating event network-changed:8e7814a5-2149-4218-a84c-b967864f8da7 for instance f854e7e8-6a2c-4fe0-9317-f17fa81d3243 on n-h2-858384-17 Oct 31 15:27:49.407082 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d45d2523-95b8-456a-af0a-b4ac8d56307c req-48c5268e-9e97-4c25-9a5a-e77377988b58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045819 Oct 31 15:27:49.408297 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1444/2687] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:49.440122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:49.441233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:49.459147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:49.459977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:49.460436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:49.461201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:49.461663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:49.462087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.086165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.098605 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9e4472c3-4387-495b-9b28-5048f3c52d54 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1293 microversion: 2.1 time: 0.822319 Oct 31 15:27:50.124697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1244/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:49 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1293 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:50.150512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:50.156091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:50.204462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.209709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.214241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.220263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.221537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.222258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.222636 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5c6c934-b6d5-4f34-a631-d5a9339d695a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1315 microversion: 2.1 time: 0.783091 Oct 31 15:27:50.223316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.224982 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1445/2689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:49 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1315 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:50.244842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:50.249504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:50.267203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.268898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.269981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.274132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.278845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.279562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.626791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.643011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.647214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.663498 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-954b0d6f-2982-4c9d-92b4-1e29882b2656 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.430248 Oct 31 15:27:50.664193 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1446/2690] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:50 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:50.675632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:50.679559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:50.692951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.693860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.694339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.702072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.702508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.702952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:50.862551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.899077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.901685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:50.903580 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d36ef5f-9638-45bb-8659-a7b4e67d72d6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.775969 Oct 31 15:27:50.920597 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1245/2691] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:50 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:50.947549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e98a31c2-3dde-4a73-a82c-53afc4ea1edc req-dfaec519-a13c-44d9-8b01-7e0a54f2d56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-plugged", "status": "completed", "tag": "e99aa557-85c0-4573-88a4-2fe810a71e21"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:50.985723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e98a31c2-3dde-4a73-a82c-53afc4ea1edc req-dfaec519-a13c-44d9-8b01-7e0a54f2d56c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:50.986655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e98a31c2-3dde-4a73-a82c-53afc4ea1edc req-dfaec519-a13c-44d9-8b01-7e0a54f2d56c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:50.987756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e98a31c2-3dde-4a73-a82c-53afc4ea1edc req-dfaec519-a13c-44d9-8b01-7e0a54f2d56c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.036830 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e98a31c2-3dde-4a73-a82c-53afc4ea1edc req-dfaec519-a13c-44d9-8b01-7e0a54f2d56c service nova] Creating event network-vif-plugged:e99aa557-85c0-4573-88a4-2fe810a71e21 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:27:51.053313 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e98a31c2-3dde-4a73-a82c-53afc4ea1edc req-dfaec519-a13c-44d9-8b01-7e0a54f2d56c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118895 Oct 31 15:27:51.054076 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1246/2692] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:51.101414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.121172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.123543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.126794 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a49cf264-44c4-4035-ad56-99500a7126ec tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.459774 Oct 31 15:27:51.127619 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1447/2693] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:50 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:51.152712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:51.153768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:51.163979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.164482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.164932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.165677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.166148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.166596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.254456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:51.255792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:51.262195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.263023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.263658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.264583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.265318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.266448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.831177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.873823 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-29d052c9-97b6-465f-bf2f-da0ee63c6de1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1293 microversion: 2.1 time: 0.721711 Oct 31 15:27:51.889597 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1247/2694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:51 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1293 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:51.889597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:51.889597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:51.893462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:51.898277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.899292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.900318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.901638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.902644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.903338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.908355 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a733feb8-2f0a-439e-b46e-0b5dfc36d29a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1315 microversion: 2.1 time: 0.659446 Oct 31 15:27:51.915972 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1448/2695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:51 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:51.937987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:51.938828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:51.957156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.960171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.960726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:51.962064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:51.963858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:51.966110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.099255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.114946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.116401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.120149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:52.129044 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a8ec6b9d-3e53-4a5d-bdc8-448364533333 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.249418 Oct 31 15:27:52.132525 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1248/2696] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:51 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:52.161174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:52.162654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:52.174743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.179027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.179713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.180618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.183318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.184149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.555506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.579865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.586778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.592713 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a75d3138-dd30-4b72-8766-e7b3aa248309 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.658651 Oct 31 15:27:52.593776 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1449/2697] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:51 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:27:52.651907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.660636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.667302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:52.673513 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0928e61f-68da-4bd8-9ee8-0041127be473 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.516277 Oct 31 15:27:52.674144 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1249/2698] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:52 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:52.905430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:52.906426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:52.919705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.920866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.922012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.924447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.925390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.929874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.938813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:52.939815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:52.952660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.955064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.955734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:52.959713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:52.960555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:52.963109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:53.183242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:53.195150 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1b34f56-d3ae-4f70-860c-b2ef6739ce03 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1293 microversion: 2.1 time: 0.294570 Oct 31 15:27:53.211292 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1450/2699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:52 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1293 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:53.220383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-43a0ff28-cab3-4fcc-b86a-183b5edac26c req-dd8b7bbc-1c40-40e4-bada-5487e33a2276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-plugged", "status": "completed", "tag": "d6cf71ce-0b17-4158-9482-cf6b74f884a5"}, {"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-plugged", "status": "completed", "tag": "09848140-2371-4ed5-87cf-2d323d065746"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:53.234197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-43a0ff28-cab3-4fcc-b86a-183b5edac26c req-dd8b7bbc-1c40-40e4-bada-5487e33a2276 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.234942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-43a0ff28-cab3-4fcc-b86a-183b5edac26c req-dd8b7bbc-1c40-40e4-bada-5487e33a2276 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.235572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-43a0ff28-cab3-4fcc-b86a-183b5edac26c req-dd8b7bbc-1c40-40e4-bada-5487e33a2276 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:53.240999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:53.261063 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-43a0ff28-cab3-4fcc-b86a-183b5edac26c req-dd8b7bbc-1c40-40e4-bada-5487e33a2276 service nova] Creating event network-vif-plugged:d6cf71ce-0b17-4158-9482-cf6b74f884a5 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:27:53.261621 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-43a0ff28-cab3-4fcc-b86a-183b5edac26c req-dd8b7bbc-1c40-40e4-bada-5487e33a2276 service nova] Creating event network-vif-plugged:09848140-2371-4ed5-87cf-2d323d065746 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:27:53.279062 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-43a0ff28-cab3-4fcc-b86a-183b5edac26c req-dd8b7bbc-1c40-40e4-bada-5487e33a2276 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065974 Oct 31 15:27:53.280219 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1451/2700] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:53.294040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:53.294889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:53.310588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.313924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.314394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:53.315144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.315613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.321210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:53.513061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:53.524789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:53.526291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:53.545687 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f3453abf-131d-4274-8ced-e640ec53ba25 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.263793 Oct 31 15:27:53.546782 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1452/2701] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:53 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:53.628924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:53.629609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:53.642303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.642820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.643314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:53.644071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:53.644595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:53.645054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.041319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.054777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.056813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.058603 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02b3c5c1-6618-4523-a513-f00b01f22620 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.434467 Oct 31 15:27:54.058884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.067331 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9d295e3-2650-48a5-ad02-bef2378781e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1315 microversion: 2.1 time: 1.132636 Oct 31 15:27:54.069742 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1453/2702] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:53 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:54.072697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1250/2703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:52 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1315 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:27:54.087134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:54.087931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:54.096521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:54.097407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:54.098180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.099916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:54.100601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:54.101285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.224877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:54.225793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:54.234849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:54.235805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:54.241322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.243555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:54.245244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:54.247802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.321421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.338433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.340905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.342475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0f399640-c864-46cf-88fe-7bf58520c8cf tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1487 microversion: 2.25 time: 0.271490 Oct 31 15:27:54.363163 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1454/2704] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:54 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1487 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:54.581490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:54.582035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:54.604525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:54.607595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:54.608315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.610727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:54.611395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:54.613557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:54.815099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.832419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06f1f892-4f45-4835-92f0-90361f98b731 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1293 microversion: 2.1 time: 0.612030 Oct 31 15:27:54.833419 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1251/2705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:54 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1293 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:54.846215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.869977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.873588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:54.886047 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6eb73dea-7bad-405d-a651-59fefadb065a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.313393 Oct 31 15:27:54.890061 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1455/2706] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:54 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:54.996944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:54.997775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:55.016508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.020818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.023342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.024404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.025362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.026046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.046566 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff HTTP/1.1 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '54ae2161-df7f-41c2-a0e7-e78be34827ff'} Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:55.049165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.055083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.058575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:55.059695 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-66e4ab1e-37b4-45f8-92ff-a00e4e8e6240 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 404 len: 111 microversion: 2.1 time: 0.073787 Oct 31 15:27:55.061830 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1252/2707] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:27:54 2022] DELETE /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:55.072463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:55.074703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: 54ae2161-df7f-41c2-a0e7-e78be34827ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:55.085248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.086009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.086664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.097448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:55.101172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:55.102826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.103838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.105050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.117343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.118127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.121794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.123674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.125384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.126488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.154344 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff HTTP/1.1 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '54ae2161-df7f-41c2-a0e7-e78be34827ff'} Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:27:55.162530 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.166377 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:27:55.166377 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:27:55.166377 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:27:55.166377 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:27:55.166377 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:27:55.166377 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. Oct 31 15:27:55.166377 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:27:55.170866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance 54ae2161-df7f-41c2-a0e7-e78be34827ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:27:55.173893 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae03a79e-8ef6-48c7-a1c9-b7d829e946c0 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff" status: 404 len: 111 microversion: 2.1 time: 0.108002 Oct 31 15:27:55.175030 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1456/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:55 2022] GET /compute/v2.1/servers/54ae2161-df7f-41c2-a0e7-e78be34827ff => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:27:55.181605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:55.184489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:55.197627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.198540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.199389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.200332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.201211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.201861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.681981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:55.697357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c52407f1-96b9-40c8-b21b-f2c8885830cd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1315 microversion: 2.1 time: 0.518764 Oct 31 15:27:55.698004 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1457/2709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:55 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:55.713873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:55.715154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:55.733732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.734237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.734676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.735387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:55.735848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:55.736275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:55.820648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:27:55.987552 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-42c4dcd8-87ef-4718-b78f-1eb69daf4d78 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 204 len: 0 microversion: 2.1 time: 0.287235 Oct 31 15:27:55.990530 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1458/2710] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:27:55 2022] DELETE /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:27:55.999775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-341f383d-6c62-455a-86fa-07a9c121a2bf req-6555ab2c-2534-40b8-ade3-aa7c60d983b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-plugged", "status": "completed", "tag": "1e16090b-0a3b-4c92-81fa-daf4885f848e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:56.011265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.013179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-341f383d-6c62-455a-86fa-07a9c121a2bf req-6555ab2c-2534-40b8-ade3-aa7c60d983b9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.013906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-341f383d-6c62-455a-86fa-07a9c121a2bf req-6555ab2c-2534-40b8-ade3-aa7c60d983b9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.014579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-341f383d-6c62-455a-86fa-07a9c121a2bf req-6555ab2c-2534-40b8-ade3-aa7c60d983b9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.027806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.029304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.030504 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50d32a42-9eb9-408b-9952-b2738e07ff82 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.938947 Oct 31 15:27:56.033607 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1253/2711] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:55 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:56.042615 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-341f383d-6c62-455a-86fa-07a9c121a2bf req-6555ab2c-2534-40b8-ade3-aa7c60d983b9 service nova] Creating event network-vif-plugged:1e16090b-0a3b-4c92-81fa-daf4885f848e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:27:56.046787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:56.048611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:56.057719 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-341f383d-6c62-455a-86fa-07a9c121a2bf req-6555ab2c-2534-40b8-ade3-aa7c60d983b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065353 Oct 31 15:27:56.058963 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1459/2712] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:56.063263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.063851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.064225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.065858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:56.066792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:56.068559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.069394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.070002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.075596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.076457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.077258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.078493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.079214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.079852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.365886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.374960 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26777642-fb00-4c0c-a6b7-bfefc621d666 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1293 microversion: 2.1 time: 0.314585 Oct 31 15:27:56.393964 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1460/2713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:56 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1293 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:56.400243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:56.404080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:56.412286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.413273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.413744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.414545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.415020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.415451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.503146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.523786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.525737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.531887 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1920e094-09eb-4943-97f1-b7249ffe7cc2 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.136643 Oct 31 15:27:56.544421 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1461/2714] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:56 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:56.564408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:56.565061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:56.578884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.579433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.583539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.584305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.584784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.585285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.633375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.637498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:56.643997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.647279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:56.648793 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca2d5211-1e9c-49e3-86da-b92aa358a089 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1477 microversion: 2.25 time: 0.612339 Oct 31 15:27:56.674366 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1254/2715] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:56 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1477 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:56.680256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-227215cb-3624-4b79-b8a2-0a65177571c3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '.version_select at 0x7f16e0f59550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:56.684892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-227215cb-3624-4b79-b8a2-0a65177571c3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.685684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-227215cb-3624-4b79-b8a2-0a65177571c3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.686318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-227215cb-3624-4b79-b8a2-0a65177571c3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.698185 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-227215cb-3624-4b79-b8a2-0a65177571c3 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.25 time: 0.022162 Oct 31 15:27:56.699085 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1255/2716] 10.222.0.20 () {60 vars in 1184 bytes} [Mon Oct 31 15:27:56 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:56.719717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:56.720339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:56.731513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.732271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.732880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:56.733943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:56.734563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:56.735171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.014193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] Lazy-loading 'services' on Instance uuid dda8a8fb-a7fe-40c6-a043-4ab745171b12 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:27:57.044349 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d943211d-2276-44b4-8eda-19afa5171763 tempest-LiveAutoBlockMigrationV225Test-2139518318 tempest-LiveAutoBlockMigrationV225Test-2139518318-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1972 microversion: 2.25 time: 0.329390 Oct 31 15:27:57.069906 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1256/2717] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:56 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1972 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:57.086973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:57.086973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:57.122031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.123918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.124540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.126072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.126813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.127608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.252219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:57.261623 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-97063d5b-7489-49a8-b9b5-00d030c424fe tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1510 microversion: 2.1 time: 0.715764 Oct 31 15:27:57.265619 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1462/2718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:56 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1510 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:57.287049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:57.287983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:57.294997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.295921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.296520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.297425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.298033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.298617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.463589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:57.472649 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-912df515-5cf2-4813-9d98-837030798f79 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1315 microversion: 2.1 time: 0.400903 Oct 31 15:27:57.476224 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1257/2719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:57 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:57.484072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:57.486572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:57.510623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.512599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.513392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.515526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.517868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.519301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.596607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:27:57.749692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:57.777338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:57.783626 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8ddb19a-f685-4b96-b48b-9e746a9061d7 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 204 len: 0 microversion: 2.25 time: 0.304416 Oct 31 15:27:57.784703 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1258/2720] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:27:57 2022] DELETE /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:27:57.801903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:57.804311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:57.811073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:57.812218 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ffb32736-140b-4662-9a9e-68b3e2907fd9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.533788 Oct 31 15:27:57.821931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.822447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.822897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.823626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.826418 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1463/2721] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:57 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:57.827872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.828417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.831367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:57.831911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:57.880794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.881381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.881836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:57.882578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:57.883042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:57.883474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.300336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.313891 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dab9df53-5a63-4e6a-a9fa-11c6cb3f817b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1293 microversion: 2.1 time: 0.527322 Oct 31 15:27:58.314762 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1259/2722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:57 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1293 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:58.344061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:58.344947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:58.353287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:58.354103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:58.354735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.356331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:58.356992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:58.357645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.404763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.416248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.420963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.431257 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7bb818b6-e0db-4a19-a5d0-70bbcb54c264 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.603695 Oct 31 15:27:58.431868 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1464/2723] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:57 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:58.436545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3e37b352-6752-4b40-aa9a-1d2f66f3e7c6 req-2fa2c179-6c01-4087-a486-fe223afd5a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30932182-ff62-4e04-a97c-d0c80577089f", "name": "network-vif-plugged", "status": "completed", "tag": "ef93582f-e5e2-493d-b6c4-4b6f4f126e30"}, {"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-plugged", "status": "completed", "tag": "c2a80bb3-9c3f-48a0-9d1e-6beeb88fd04e"}, {"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-plugged", "status": "completed", "tag": "2a4a9196-b5c2-4e85-9d1b-ff3182ce40bd"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:27:58.471376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e37b352-6752-4b40-aa9a-1d2f66f3e7c6 req-2fa2c179-6c01-4087-a486-fe223afd5a7e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:58.472179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e37b352-6752-4b40-aa9a-1d2f66f3e7c6 req-2fa2c179-6c01-4087-a486-fe223afd5a7e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:58.472298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e37b352-6752-4b40-aa9a-1d2f66f3e7c6 req-2fa2c179-6c01-4087-a486-fe223afd5a7e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.503830 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3e37b352-6752-4b40-aa9a-1d2f66f3e7c6 req-2fa2c179-6c01-4087-a486-fe223afd5a7e service nova] Creating event network-vif-plugged:ef93582f-e5e2-493d-b6c4-4b6f4f126e30 for instance 30932182-ff62-4e04-a97c-d0c80577089f on n-h2-858384-17 Oct 31 15:27:58.504371 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3e37b352-6752-4b40-aa9a-1d2f66f3e7c6 req-2fa2c179-6c01-4087-a486-fe223afd5a7e service nova] Creating event network-vif-plugged:c2a80bb3-9c3f-48a0-9d1e-6beeb88fd04e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:27:58.504885 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3e37b352-6752-4b40-aa9a-1d2f66f3e7c6 req-2fa2c179-6c01-4087-a486-fe223afd5a7e service nova] Creating event network-vif-plugged:2a4a9196-b5c2-4e85-9d1b-ff3182ce40bd for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:27:58.516347 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3e37b352-6752-4b40-aa9a-1d2f66f3e7c6 req-2fa2c179-6c01-4087-a486-fe223afd5a7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.082644 Oct 31 15:27:58.516994 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1465/2724] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:27:58.527495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:58.528211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:58.542699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:58.543153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:58.543599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.544588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:58.547995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:58.549067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.851203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.861706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.863625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:58.866290 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a230cc8-5112-459f-96d3-a8bb6527ef1b tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1483 microversion: 2.25 time: 0.527682 Oct 31 15:27:58.889290 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1260/2725] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:58 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1483 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:58.898408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:58.899504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:58.907557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:58.908611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:58.909485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:58.911104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:58.912341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:58.913156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.118647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:59.129599 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c5ca3cf-e6c7-4cab-9c96-80af1253503d tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1510 microversion: 2.1 time: 0.611275 Oct 31 15:27:59.133460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1466/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:58 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1510 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:59.138291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:59.138903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:59.154943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.155438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.155875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.156604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.157050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.162495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.420602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:59.434455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce5c475f-bfcb-4028-9050-8ac2c62f1449 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1315 microversion: 2.1 time: 0.543346 Oct 31 15:27:59.435634 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1261/2727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:58 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:27:59.443124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:59.444481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:59.456902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.458024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.459145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.460846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.461680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.462317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.570437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:59.588063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:59.589533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:59.590714 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e281b83-3594-4131-ac72-ed0a243c4ca7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.456220 Oct 31 15:27:59.601766 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1467/2728] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:59 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:27:59.607357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:27:59.612251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:27:59.631923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.632425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.632927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.638101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:27:59.638697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:27:59.639102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:27:59.911316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:59.918666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:27:59.935720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:59.949144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:27:59.971221 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09c77785-90d9-44d4-a46b-d6bc567818df tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.367824 Oct 31 15:28:00.000457 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1468/2729] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:27:59 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:00.018844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fe876048-96c2-4e0d-a6b1-208fb728c98e req-72fa0845-b357-4cfd-80e7-419ad861f941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4faf82e-33b1-482e-a400-e57ebf462f65", "name": "network-vif-deleted", "tag": "5c17a2b4-0599-4cd9-ac6a-66a5a6df9448"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:00.034443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fe876048-96c2-4e0d-a6b1-208fb728c98e req-72fa0845-b357-4cfd-80e7-419ad861f941 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.035519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fe876048-96c2-4e0d-a6b1-208fb728c98e req-72fa0845-b357-4cfd-80e7-419ad861f941 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.036178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fe876048-96c2-4e0d-a6b1-208fb728c98e req-72fa0845-b357-4cfd-80e7-419ad861f941 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.061184 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fe876048-96c2-4e0d-a6b1-208fb728c98e req-72fa0845-b357-4cfd-80e7-419ad861f941 service nova] Creating event network-vif-deleted:5c17a2b4-0599-4cd9-ac6a-66a5a6df9448 for instance f4faf82e-33b1-482e-a400-e57ebf462f65 on n-h1-858384-17 Oct 31 15:28:00.069904 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fe876048-96c2-4e0d-a6b1-208fb728c98e req-72fa0845-b357-4cfd-80e7-419ad861f941 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055435 Oct 31 15:28:00.071994 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1469/2730] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:00.080273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:00.081325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:00.096034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.097372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.098738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.100937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.101697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.102882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.320999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.331922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.334238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.354508 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-016d8ce3-b2e5-4ee1-b49a-3d5785f2cf01 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1483 microversion: 2.25 time: 0.279606 Oct 31 15:28:00.355188 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1470/2731] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:00 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1483 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:00.395722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:00.396530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:00.415942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:00.417780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.418245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.418688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.419404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.419869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.420301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.495522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.496470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.496914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.498148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lazy-loading 'fault' on Instance uuid f4faf82e-33b1-482e-a400-e57ebf462f65 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:00.581905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.594105 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-472a5c33-beb1-4c71-87fe-3063de1303da tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1293 microversion: 2.1 time: 1.154937 Oct 31 15:28:00.605978 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1262/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:27:59 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1293 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:00.608705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b058345f19944e0880a4552d6add5ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e81a4d86ac64eef904bb82724322c40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:00.611465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:00.612280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:00.619617 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-506d8a63-fe8f-4609-aba3-37c34b6fd855 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 200 len: 1306 microversion: 2.1 time: 0.263799 Oct 31 15:28:00.623231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.625401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.626009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.627761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.632257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.633407 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1471/2733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:00 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 1306 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:00.633827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.641822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-18a002b6-c00c-438d-ab12-8250694ae5bc req-5188f95d-d10f-4d37-baca-fbddd79ecb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-plugged", "status": "completed", "tag": "f7b1863f-6b3c-4899-8a17-846c72b01a0e"}, {"server_uuid": "f854e7e8-6a2c-4fe0-9317-f17fa81d3243", "name": "network-vif-plugged", "status": "completed", "tag": "8e7814a5-2149-4218-a84c-b967864f8da7"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:00.655273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-18a002b6-c00c-438d-ab12-8250694ae5bc req-5188f95d-d10f-4d37-baca-fbddd79ecb1f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.655967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-18a002b6-c00c-438d-ab12-8250694ae5bc req-5188f95d-d10f-4d37-baca-fbddd79ecb1f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.656621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-18a002b6-c00c-438d-ab12-8250694ae5bc req-5188f95d-d10f-4d37-baca-fbddd79ecb1f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.672124 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-18a002b6-c00c-438d-ab12-8250694ae5bc req-5188f95d-d10f-4d37-baca-fbddd79ecb1f service nova] Creating event network-vif-plugged:f7b1863f-6b3c-4899-8a17-846c72b01a0e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:28:00.672976 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-18a002b6-c00c-438d-ab12-8250694ae5bc req-5188f95d-d10f-4d37-baca-fbddd79ecb1f service nova] Creating event network-vif-plugged:8e7814a5-2149-4218-a84c-b967864f8da7 for instance f854e7e8-6a2c-4fe0-9317-f17fa81d3243 on n-h2-858384-17 Oct 31 15:28:00.689640 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-18a002b6-c00c-438d-ab12-8250694ae5bc req-5188f95d-d10f-4d37-baca-fbddd79ecb1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054886 Oct 31 15:28:00.690519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1472/2734] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:00.697771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:00.698678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:00.709062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.710211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.710901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:00.712092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:00.712758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:00.713404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.107201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.134524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.136189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.137551 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e0d43ed-9f8e-4ec7-94ad-1ca2c3b49171 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.445897 Oct 31 15:28:01.138220 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1473/2735] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:00 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:01.143082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:01.147952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:01.158618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.160619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.162392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.164247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.164727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.165185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.262891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.272197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.274956 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f19b048b-6a1d-4cb6-bf9b-307e57229282 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1501 microversion: 2.1 time: 0.667553 Oct 31 15:28:01.276693 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1263/2736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:00 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1501 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:01.294152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.296193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.302721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:01.303308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:01.304507 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-061ef914-f624-4fc5-9ff9-6b91aa045099 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.164853 Oct 31 15:28:01.305716 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1474/2737] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:01 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:01.351048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.353746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.354412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.355376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.356021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.356615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.388244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:01.388861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:01.405003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lazy-loading 'flavor' on Instance uuid 30932182-ff62-4e04-a97c-d0c80577089f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:01.408218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.409689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.410278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.411093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.411725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.412161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.500745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.512517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.515130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.516449 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4244234c-945c-483f-bf79-046d437ca6e8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1441 microversion: 2.25 time: 0.132082 Oct 31 15:28:01.529171 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1475/2738] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:01 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1441 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:01.638187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:01.640151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:01.649813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.650553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.653541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.654454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.655076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.655502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.856971 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5df3279-6363-4787-a2c4-b67855ce57a9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f/action" status: 202 len: 0 microversion: 2.1 time: 0.557808 Oct 31 15:28:01.858668 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1264/2739] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:28:01 2022] POST /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:28:01.883167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:01.884374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] [instance: f4faf82e-33b1-482e-a400-e57ebf462f65] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:01.894102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.894994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.896443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.897883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:01.898806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:01.899635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:01.954031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:01.959702 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] HTTP exception thrown: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 could not be found. Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Request method failure captured: Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 HTTP/1.1 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-hwCOOLDp6TM_LQ9ewEZmLeEpMs7YhsKHzwXvEm7d-FohHoXNbYfrLtxlGLCo_PJD_uFOyHziY6nrL-mPrXMpUeJxPlcfCkuMQ3iP9vZYBGbRiJmnotWcmL5ZgVTi7_byaJ0JEGV6VFlu3fVFmaO15pdqpxaqbUo_r7YukISioZ-pA Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6e81a4d86ac64eef904bb82724322c40", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6e81a4d86ac64eef904bb82724322c40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6e81a4d86ac64eef904bb82724322c40"}]}] Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6e81a4d86ac64eef904bb82724322c40 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2138790302 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b058345f19944e0880a4552d6add5ba7 Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2138790302-project Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 could not be found. Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f4faf82e-33b1-482e-a400-e57ebf462f65'} Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 could not be found. Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 could not be found. Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:01.961645 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:01.965998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:01.965998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:01.965998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:01.965998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:01.965998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:01.965998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 could not be found. Oct 31 15:28:01.965998 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:01.965998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] Returning 404 to user: Instance f4faf82e-33b1-482e-a400-e57ebf462f65 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:01.965998 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-36542e22-aeae-449b-a71e-8b72eeb6a351 tempest-ServersNegativeTestJSON-2138790302 tempest-ServersNegativeTestJSON-2138790302-project] 10.222.0.20 "GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65" status: 404 len: 111 microversion: 2.1 time: 0.102994 Oct 31 15:28:01.974674 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1265/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:01 2022] GET /compute/v2.1/servers/f4faf82e-33b1-482e-a400-e57ebf462f65 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:28:01.981647 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0f49574-9122-4df9-aea1-4407fed36241 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1293 microversion: 2.1 time: 0.344917 Oct 31 15:28:01.983573 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1476/2741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:01 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1293 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:01.990281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:01.991379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:02.006693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.011084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.011593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.015173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.016186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.016814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.170144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:02.170910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:02.180728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.182537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.185189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.188327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.189203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.190006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.925598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:02.939617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:02.947412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:02.951621 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aeb2bf97-da46-4313-97ef-4e2423ee9e36 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1875 microversion: 2.42 time: 0.786884 Oct 31 15:28:02.952755 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1477/2742] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:02 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1875 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:02.964001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:02.964952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:02.981565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.982971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.983640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:02.984586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:02.988306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:02.989034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:03.123959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:03.133186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:03.136998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:03.152215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3ff8176c-1b9e-46a4-b967-ce55b0c9dc76 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.198115 Oct 31 15:28:03.161007 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1478/2743] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:02 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:03.168100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-aabca3e1-d399-4c85-bec1-62ba6fd55f5a req-b0108bac-93c4-460e-a241-1338ab936a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda8a8fb-a7fe-40c6-a043-4ab745171b12", "name": "network-vif-deleted", "tag": "0676a67e-c7b2-4713-bb5b-a960b92c3471"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:03.187867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aabca3e1-d399-4c85-bec1-62ba6fd55f5a req-b0108bac-93c4-460e-a241-1338ab936a9d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:03.190042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aabca3e1-d399-4c85-bec1-62ba6fd55f5a req-b0108bac-93c4-460e-a241-1338ab936a9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:03.192373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aabca3e1-d399-4c85-bec1-62ba6fd55f5a req-b0108bac-93c4-460e-a241-1338ab936a9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:03.224696 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-aabca3e1-d399-4c85-bec1-62ba6fd55f5a req-b0108bac-93c4-460e-a241-1338ab936a9d service nova] Creating event network-vif-deleted:0676a67e-c7b2-4713-bb5b-a960b92c3471 for instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 on n-h2-858384-17 Oct 31 15:28:03.233615 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-aabca3e1-d399-4c85-bec1-62ba6fd55f5a req-b0108bac-93c4-460e-a241-1338ab936a9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070133 Oct 31 15:28:03.234592 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1479/2744] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:03.249286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:03.250337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:03.262416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:03.268232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:03.268900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:03.269881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:03.270548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:03.273988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:03.379867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:03.390657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:03.392285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:03.394158 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-833b80dc-bc5b-47dd-b0eb-c4d1e98ed812 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1266 microversion: 2.25 time: 0.155594 Oct 31 15:28:03.396259 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1480/2745] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:03 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:03.405181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:03.409171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:03.423822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:03.424551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:03.426138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:03.429672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:03.430314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:03.430847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:03.469645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:03.495251 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6190d49-6e76-4094-a5f4-e61caee00835 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 1.516223 Oct 31 15:28:03.509167 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1266/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:01 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:03.982213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:03.983140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:04.014715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.017713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.024020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.025040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.025981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.027048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.469012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.483927 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f323924-d02f-42ef-b1ab-b2cc68356e1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1473 microversion: 2.1 time: 1.081042 Oct 31 15:28:04.484905 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1481/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:03 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1473 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:04.496542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:04.500709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:04.514969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.516016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.516475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.517453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.517951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.518421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.726869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.741738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.742843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.769408 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de0163bd-a51c-43be-81ce-3cc4e0030bb1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.283259 Oct 31 15:28:04.774518 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1482/2748] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:04 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:04.788486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:04.789390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:04.803237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.804390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.805764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.806865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:04.807728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:04.809779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:04.965900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.981891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.985913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:04.987503 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03f9865d-f1f5-4edc-8f9e-19c670589d12 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1266 microversion: 2.25 time: 0.205904 Oct 31 15:28:04.997404 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1483/2749] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:04 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:05.008682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:05.009368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:05.022515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:05.022901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:05.023278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:05.024008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:05.024587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:05.024891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:05.501245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:05.515037 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-703a65cf-4b8c-48bd-a509-f2d524e528c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.526241 Oct 31 15:28:05.529471 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1484/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:04 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:05.535826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1591923070", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:05.555721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:05.569464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:05.597510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:05.599775 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a73f3e19-7beb-4fad-8afc-dd0449b9f64a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2831 microversion: 2.42 time: 1.621919 Oct 31 15:28:05.606141 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1267/2751] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:03 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2831 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:05.633892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] validate_networks() for [('2b5355db-9171-4de8-abb5-5f94412a242a', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:28:05.640984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-713921a8-6c89-4fcd-bad9-3593c73e43d4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:05.641766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-713921a8-6c89-4fcd-bad9-3593c73e43d4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:05.652920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713921a8-6c89-4fcd-bad9-3593c73e43d4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:05.654015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713921a8-6c89-4fcd-bad9-3593c73e43d4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:05.654644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713921a8-6c89-4fcd-bad9-3593c73e43d4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:05.657454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713921a8-6c89-4fcd-bad9-3593c73e43d4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:05.658184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713921a8-6c89-4fcd-bad9-3593c73e43d4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:05.658808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713921a8-6c89-4fcd-bad9-3593c73e43d4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.166114 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-713921a8-6c89-4fcd-bad9-3593c73e43d4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.528958 Oct 31 15:28:06.169456 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1268/2752] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 31 15:28:05 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da/os-interface => generated 1831 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:06.178028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:06.179073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:06.203017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.207857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.209721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.215818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.217609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.218222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.233613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:06.548957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.563744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.577869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.588916 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9d05532-4004-41a9-be64-369c5e6aa651 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.418062 Oct 31 15:28:06.589564 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1269/2753] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:06 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:06.627982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:06.628859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:06.641296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.641801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.642243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.642960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:06.643419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:06.643850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:06.923743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.936349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.942094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:06.943552 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c12b58d1-7171-4b94-8bda-e5cf2e91dd0d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1266 microversion: 2.25 time: 0.329321 Oct 31 15:28:06.953039 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1270/2754] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:06 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:07.010034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:28:07.010854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:28:07.011681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:28:07.011967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:28:07.012488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:28:07.037386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.042933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.043871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:07.046287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.049759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.057829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:07.132050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:07.154244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for user 31cd28d777ac40eda1a7abefb5a3256d and project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:07.192035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:28:07.200502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: fffda748-45ff-484d-953f-29c26869d8ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:28:07.357011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3debbac-9d24-440c-9495-3a3a043aed8f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Action: 'create', calling method: .version_select at 0x7f16e0f86d30>, body: {"keypair": {"name": "tempest-keypair-451473178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUGirEVZrALH05Ra+/ojRJvz+rUA8BTXD+/kVbWGouSMkFS7yhHrO/jeIbpiQw0x+R2fD4eH2Hwc8RpDwl53bzS1tpUzzUTOUwvVFqqKdkTxfESwcIKI5hUDZFnjcttCg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:07.359382 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7dfa1546-d37d-4af1-a65f-73e744250f5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.828587 Oct 31 15:28:07.360658 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1485/2755] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:28:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:28:07.366130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:07.367425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:07.376532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.384674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.385518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:07.386495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:07.387204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:07.387859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:07.438397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c3debbac-9d24-440c-9495-3a3a043aed8f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Getting quotas for project 64267a3a68804df186c862f2a2ab052e. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:07.459984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c3debbac-9d24-440c-9495-3a3a043aed8f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Getting quotas for user 4e36ab46973945e98ebee270c794be87 and project 64267a3a68804df186c862f2a2ab052e. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:07.523140 n-d-858384-17 devstack@n-api.service[120588]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c3debbac-9d24-440c-9495-3a3a043aed8f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [5029fb4f-96b9-4765-872f-c1cdceccae56] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 15:28:07.811895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:07.822171 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8eadcbd-d65d-4e91-afa4-6798de9965f4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.460166 Oct 31 15:28:07.822783 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1486/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:07 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:07.836748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86b45b62-bb8c-47fb-b459-34d1d9f283db tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:07.837307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-86b45b62-bb8c-47fb-b459-34d1d9f283db tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: fffda748-45ff-484d-953f-29c26869d8ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:07.902923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-86b45b62-bb8c-47fb-b459-34d1d9f283db tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: fffda748-45ff-484d-953f-29c26869d8ff] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:08.538445 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [None req-c3debbac-9d24-440c-9495-3a3a043aed8f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [5029fb4f-96b9-4765-872f-c1cdceccae56] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 58164. Oct 31 15:28:08.565987 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3debbac-9d24-440c-9495-3a3a043aed8f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.611862 Oct 31 15:28:08.566930 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1271/2757] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:28:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:08.609217 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.compute.api [None req-86b45b62-bb8c-47fb-b459-34d1d9f283db tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: fffda748-45ff-484d-953f-29c26869d8ff] Instance Mapping does not exist while attempting local delete cleanup. Oct 31 15:28:08.610139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-86b45b62-bb8c-47fb-b459-34d1d9f283db tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff" status: 204 len: 0 microversion: 2.1 time: 0.786386 Oct 31 15:28:08.611847 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1487/2758] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:28:07 2022] DELETE /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:08.617933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:08.618695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:08.633424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:08.644360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:08.653218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.654653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.655417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.656362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.657533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.658157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.667112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.673492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.674212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.675456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.676313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.680105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.811337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:08.815314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:08.827259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:08.830839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:08.835377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e52223e-bfca-4feb-bea2-57799f32f2fc tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1266 microversion: 2.25 time: 0.220630 Oct 31 15:28:08.838298 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1488/2759] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:08 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:08.854225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90d1e040-c037-4c54-967d-f3766ed941b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:08.856279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-90d1e040-c037-4c54-967d-f3766ed941b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: fffda748-45ff-484d-953f-29c26869d8ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:08.870035 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-90d1e040-c037-4c54-967d-f3766ed941b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90d1e040-c037-4c54-967d-f3766ed941b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff HTTP/1.1 Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'fffda748-45ff-484d-953f-29c26869d8ff'} Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:08.875619 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:08.881013 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:08.881013 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:08.881013 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:08.881013 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:28:08.881013 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:08.882423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90d1e040-c037-4c54-967d-f3766ed941b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:08.887370 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-90d1e040-c037-4c54-967d-f3766ed941b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff" status: 404 len: 111 microversion: 2.1 time: 0.047716 Oct 31 15:28:08.889288 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1489/2760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:08 2022] GET /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:28:08.900083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:08.918385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:08.952945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.968138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.968138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:08.968138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:08.968138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:08.968138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:09.277029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:09.295427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:09.297000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:09.325965 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-647a66bf-1486-4fe6-ac63-23b364c8c740 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.755074 Oct 31 15:28:09.326825 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1272/2761] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:08 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:09.345676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1347486992", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "2b5355db-9171-4de8-abb5-5f94412a242a"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:09.484875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] validate_networks() for [('2b5355db-9171-4de8-abb5-5f94412a242a', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:28:09.517636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:09.527689 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-54c4bdb6-7255-4ba8-b16f-d08ca947fb02 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.636055 Oct 31 15:28:09.545732 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1490/2762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:08 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:09.864096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:09.865448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:09.884206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:09.889420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:09.890425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:09.893593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:09.898539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:09.901329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.120907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.134424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.137106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.144135 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7000185-2992-4b2c-a61d-867c632fb6f1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1266 microversion: 2.25 time: 0.284006 Oct 31 15:28:10.145048 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1491/2763] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:09 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:10.367222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:10.368624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:10.382168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.382671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.383417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.384146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.384598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.385024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.592470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.602213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.609854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.619111 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b53545c-d2ed-48a4-83c3-82969a8e238f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.261617 Oct 31 15:28:10.624621 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1492/2764] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:10 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:10.635070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:10.635801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:10.654842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.656075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.656520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.657292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:10.657743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:10.661776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:10.887451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:10.896435 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-54ca94b5-fd77-4f51-bde2-d2be1f6958e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.270069 Oct 31 15:28:10.900554 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1493/2765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:10 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:11.174159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:11.174783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:11.194231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.194455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.195284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.196010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.196470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.196894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.447007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:11.469078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:11.473449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:11.482134 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c16b5d6f-5978-4f84-92b8-9335320ee3a1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1266 microversion: 2.25 time: 0.312339 Oct 31 15:28:11.486870 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1494/2766] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:11 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:11.663689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:11.664222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:11.676501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.677678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.681521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.682275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:11.685394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:11.686024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:11.944365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:11.964832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:11.969368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:11.996966 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c342b7fa-ef78-4ff9-bae2-c538c18c7752 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.339837 Oct 31 15:28:11.997905 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1495/2767] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:11 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:12.006256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:12.007300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:12.021219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:12.023451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:12.024346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:12.026633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:12.031102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:12.034498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:12.639237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:12.651206 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee066e07-bacf-4bfe-9a92-a93d1ed50160 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.651956 Oct 31 15:28:12.654212 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1496/2768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:11 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:12.666675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:12.667261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:12.689966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:12.691664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:12.692135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:12.693799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:12.694228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:12.700751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:12.843082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:12.854146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:12.856993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:12.858357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cea197f1-1d7a-454a-8da4-ec7df346d346 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 200 len: 1266 microversion: 2.25 time: 0.203010 Oct 31 15:28:12.859071 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1497/2769] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:12 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:12.908836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:28:12.909325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:28:12.909757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:28:12.910164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:28:12.910575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:28:12.932028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:12.933674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:12.935030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:12.937480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:12.938282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:12.940214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:13.011396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:13.027825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:13.028943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for user 31cd28d777ac40eda1a7abefb5a3256d and project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:13.029234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:13.049189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:13.049799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:13.053858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:13.054733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:13.055334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:13.060346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:13.093054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:28:13.105253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:28:13.227734 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-772d5b80-0332-4196-a942-b44d4edab647 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.890663 Oct 31 15:28:13.239123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:13.248989 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1273/2770] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:28:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:28:13.260658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:13.263357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37ecf77d-528f-49f8-bbd6-56ac79b7ce79 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:13.263736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:13.264593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-37ecf77d-528f-49f8-bbd6-56ac79b7ce79 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:13.282808 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0693d2a5-0eb3-4985-9442-7cbfbdd9429f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.254928 Oct 31 15:28:13.287774 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1498/2771] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:13 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:13.689243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:13.691883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:13.718403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:13.727738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:13.730603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:13.731608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:13.732354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:13.733014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:14.221266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-37ecf77d-528f-49f8-bbd6-56ac79b7ce79 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:14.239093 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-37ecf77d-528f-49f8-bbd6-56ac79b7ce79 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1221 microversion: 2.1 time: 0.983002 Oct 31 15:28:14.243722 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1274/2772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:13 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1221 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:14.267010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:14.267692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: dda8a8fb-a7fe-40c6-a043-4ab745171b12] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:14.296016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:14.296619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:14.300230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:14.303654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:14.310737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:14.312033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:14.312496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:14.337102 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d46c5db-b784-4dbc-b6f9-bdea45a46ace tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.657554 Oct 31 15:28:14.340343 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1499/2773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:13 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:14.356899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:14.358978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:14.375508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:14.379025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:14.379722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:14.382580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:14.384493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:14.385107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:14.393497 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] HTTP exception thrown: Instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 could not be found. Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Request method failure captured: Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 HTTP/1.1 Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-e9WZODaL3jOVWR_h3Cy0MM-JCvy6_AvWP4aSqzmR9KdKXXyuWl6QaE6g3ZJ34LyIp1gDAMN6LJJP68ZYP2rzQAl7pU_GSuRo0y9Dbn2pKX8HER41z-xZ8Sy8aOIquBx2qLlwzPNdhCWdQqi9enR7YBjt_jhZUK5PXy4-YjS__nQ3k Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 320e16c5c6ba43569e325ed2d7967f6a Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e16c5c6ba43569e325ed2d7967f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_320e16c5c6ba43569e325ed2d7967f6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e16c5c6ba43569e325ed2d7967f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/320e16c5c6ba43569e325ed2d7967f6a"}]}] Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 320e16c5c6ba43569e325ed2d7967f6a Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-LiveAutoBlockMigrationV225Test-1174511701-project Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 676d4f2214e848c0aa654f0863b9f4a4 Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701-project Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 could not be found. Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'dda8a8fb-a7fe-40c6-a043-4ab745171b12'} Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 could not be found. Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 could not be found. Oct 31 15:28:14.395187 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 could not be found. Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Returning 404 to user: Instance dda8a8fb-a7fe-40c6-a043-4ab745171b12 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-356a0e38-f60f-4c7c-99bd-8377deaab24d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12" status: 404 len: 111 microversion: 2.25 time: 0.152322 Oct 31 15:28:14.401738 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1275/2774] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:14 2022] GET /compute/v2.1/servers/dda8a8fb-a7fe-40c6-a043-4ab745171b12 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:28:14.581557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:14.593903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:14.596237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:14.603308 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-772bfe48-f634-434c-9024-13aed73af284 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.260748 Oct 31 15:28:14.604460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1500/2775] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:14 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:15.186818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-68380f01-debe-4017-afcc-dbff23e6a4a6 req-f5b0d4d4-3bac-4b1a-8401-23756ec0ed74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "tag": "09848140-2371-4ed5-87cf-2d323d065746"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:15.203000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-68380f01-debe-4017-afcc-dbff23e6a4a6 req-f5b0d4d4-3bac-4b1a-8401-23756ec0ed74 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.203516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-68380f01-debe-4017-afcc-dbff23e6a4a6 req-f5b0d4d4-3bac-4b1a-8401-23756ec0ed74 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.204040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-68380f01-debe-4017-afcc-dbff23e6a4a6 req-f5b0d4d4-3bac-4b1a-8401-23756ec0ed74 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.226016 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-68380f01-debe-4017-afcc-dbff23e6a4a6 req-f5b0d4d4-3bac-4b1a-8401-23756ec0ed74 service nova] Creating event network-changed:09848140-2371-4ed5-87cf-2d323d065746 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:28:15.233994 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-68380f01-debe-4017-afcc-dbff23e6a4a6 req-f5b0d4d4-3bac-4b1a-8401-23756ec0ed74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051171 Oct 31 15:28:15.234973 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1276/2776] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:15.272060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:15.273026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:15.306899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:15.312407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.316099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.316674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.319729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.322546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.323063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.370020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:15.370734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:15.387056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.387572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.388024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.416313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.417067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.422249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.846794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:15.870924 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da3aa8ae-e547-4e54-87df-ad3a85862667 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1273 microversion: 2.1 time: 0.598225 Oct 31 15:28:15.894364 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1501/2777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:15 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1273 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:15.921815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:15.923619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:15.955403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.957300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.961418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:15.964555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:15.964909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:15.969382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:16.478189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.494156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.496371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.523511 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba374056-983c-4286-a53f-f65855a91606 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.627882 Oct 31 15:28:16.543538 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1502/2778] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:15 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:16.701439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-365536748", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:16.853060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:16.879066 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5898752b-093f-4072-b11d-7e26b89af9b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 1.514642 Oct 31 15:28:16.884352 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1277/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:15 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:16.908508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:16.911106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:16.956860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:16.958766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:16.965502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:16.970789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:16.980619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:16.983059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:17.065011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:17.343975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:17.357580 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1545b1a6-b399-4443-8362-3f581ad3ec89 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1279 microversion: 2.1 time: 0.453411 Oct 31 15:28:17.358179 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1278/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:16 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1279 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:17.560120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:17.561237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:17.570545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:17.576340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:17.582339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:17.584290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:17.590392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:17.591682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:17.974354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:17.985351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:17.986796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:18.012635 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27dce047-4386-4274-9d42-207a912935d7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.456588 Oct 31 15:28:18.013289 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1279/2781] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:17 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:18.025326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:18.034064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:18.041559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:18.059136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:18.060726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:18.061218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:18.061965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:18.062429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:18.065525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:18.126690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:18.988511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:19.007446 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-828893bc-3e9f-4acf-a507-e287f86118d8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.990195 Oct 31 15:28:19.024952 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1280/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:18 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:19.026674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:19.032553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:19.060142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:19.066159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:19.066893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:19.072624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:19.074852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:19.076526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:19.646500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:19.660296 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ac4a85e-8d47-49a0-9fbc-341b7136180c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1321 microversion: 2.1 time: 0.644387 Oct 31 15:28:19.662275 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1281/2783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:19 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1321 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:19.674655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:19.675615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:19.707550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:19.718237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:19.718960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:19.727215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:19.731708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:19.733477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:20.038629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.059924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.069203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.101093 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e48aec46-4f7a-4c2a-86de-caa11eef2b56 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.431069 Oct 31 15:28:20.105535 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1282/2784] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:19 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:20.119606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:20.139480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:20.167689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:20.171421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:20.174478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:20.176273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:20.180113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:20.181438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:20.763729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:20.777381 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a45f2fcd-beb5-4fc7-bd59-60c1c8321294 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.666822 Oct 31 15:28:20.780301 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1283/2785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:20 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:20.790450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:20.793686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:20.804571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:20.805527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:20.806188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:20.807696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:20.808392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:20.809039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.233999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:21.273458 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-48e36de4-d8b2-4c3b-9dd5-4f2c3f2d921e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1321 microversion: 2.1 time: 0.483376 Oct 31 15:28:21.274160 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1284/2786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:20 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:21.289520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:21.295470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:21.315865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:21.317121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:21.318803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.321088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:21.321784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:21.323532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:21.523077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:21.537684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:21.547683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:21.555934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43b02395-6e26-41d3-8965-1d4df16c7a74 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.277555 Oct 31 15:28:21.570187 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1285/2787] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:21 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:22.158986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-29e43bad-260a-4352-8bf5-473c6c3a715f req-1058bad4-fe41-4f4b-a09b-f0549fa9b4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "575595cc-5dda-42f5-9b0e-9f9fe15606cd", "tag": "d44f0e3a-5755-4aab-afaa-891874ed54af"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:22.205171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-29e43bad-260a-4352-8bf5-473c6c3a715f req-1058bad4-fe41-4f4b-a09b-f0549fa9b4a2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.205785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-29e43bad-260a-4352-8bf5-473c6c3a715f req-1058bad4-fe41-4f4b-a09b-f0549fa9b4a2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.210310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-29e43bad-260a-4352-8bf5-473c6c3a715f req-1058bad4-fe41-4f4b-a09b-f0549fa9b4a2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.267920 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-29e43bad-260a-4352-8bf5-473c6c3a715f req-1058bad4-fe41-4f4b-a09b-f0549fa9b4a2 service nova] Creating event network-changed:d44f0e3a-5755-4aab-afaa-891874ed54af for instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd on n-h1-858384-17 Oct 31 15:28:22.298837 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-29e43bad-260a-4352-8bf5-473c6c3a715f req-1058bad4-fe41-4f4b-a09b-f0549fa9b4a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.706538 Oct 31 15:28:22.301730 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1286/2788] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:22.323065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:22.323827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:22.353335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.354503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.359347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.361813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.362051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.366297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.839212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:22.848095 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c77a878-f27a-452c-b08d-29e1b74fddc4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.541291 Oct 31 15:28:22.858499 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1287/2789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:22 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:22.863672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:22.867216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:22.880403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.880403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.885093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.886071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:22.887124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:22.887345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:22.979853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:23.174601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:23.185802 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca95d21c-d57f-4060-8c95-4960d7f958aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1321 microversion: 2.1 time: 0.325889 Oct 31 15:28:23.187238 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1288/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:22 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:23.192505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:23.195309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:23.207479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:23.212656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:23.214092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:23.216352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:23.217004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:23.223199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:23.363570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:23.378960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:23.381943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:23.389389 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fbffec9c-e5c8-47fd-b2a8-4f56df32038c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.200754 Oct 31 15:28:23.390766 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1289/2791] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:23 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:23.594268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14a87969-221b-467c-a25c-82659255cdb7 tempest-ExtensionsTest-1086600044 tempest-ExtensionsTest-1086600044-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:23.596184 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14a87969-221b-467c-a25c-82659255cdb7 tempest-ExtensionsTest-1086600044 tempest-ExtensionsTest-1086600044-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.204275 Oct 31 15:28:23.597492 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1290/2792] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 31 15:28:23 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:23.610176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b4ca62b-3b42-4b40-9e43-5e97f1f09095 tempest-ExtensionsTest-1086600044 tempest-ExtensionsTest-1086600044-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:23.612870 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b4ca62b-3b42-4b40-9e43-5e97f1f09095 tempest-ExtensionsTest-1086600044 tempest-ExtensionsTest-1086600044-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.007050 Oct 31 15:28:23.614552 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1291/2793] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 31 15:28:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:28:23.888512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:23.889331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:23.915427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:23.916100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:23.916553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:23.917346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:23.917790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:23.918217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:24.038443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:24.228993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:24.406920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:24.419002 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c8b4216a-b71a-477a-b8ec-8ccae4a8d5a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.534815 Oct 31 15:28:24.420253 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1292/2794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:23 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:24.436379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:24.437593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:24.450458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:24.451361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:24.452486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:24.453667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:24.454623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:24.455271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:24.991305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:25.016861 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0699df2-8a83-4a21-8592-d2e940da51e3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1321 microversion: 2.1 time: 0.594873 Oct 31 15:28:25.037155 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1293/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:24 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:25.054082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:25.054321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:25.089395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.094978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.096964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.100483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.104324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.110235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.310804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:25.323937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:25.328924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:25.338461 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e11f39f-946b-4e19-bbc8-92e46a70db6d tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.310559 Oct 31 15:28:25.340132 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1294/2796] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:25 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:25.346912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:25.347851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:25.380158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.386782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.387668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.389731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.390792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.392955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.469636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:25.697507 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4e87ff5-b82e-4e32-a23d-42f6366d71e5 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 204 len: 0 microversion: 2.25 time: 0.348465 Oct 31 15:28:25.698191 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1295/2797] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:28:25 2022] DELETE /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:28:25.716499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:25.717248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:25.734528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.735027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.735504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:25.736277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:25.736748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:25.740512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.027006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:26.046626 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ad63f3f-94c7-4b11-9500-5e13d31d0e28 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.332867 Oct 31 15:28:26.048088 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1296/2798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:25 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:26.075571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:26.076847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:26.100165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.103186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.105088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.105930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.109637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.110162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.485663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=78 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:26.510614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:26.528806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:26.530123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:26.548719 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-78e59bf0-b773-4b28-8149-4db6d10ffe02 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1732 microversion: 2.25 time: 0.489542 Oct 31 15:28:26.554775 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1297/2799] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:26 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1732 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:26.590752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:26.591307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:26.618671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.620020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.620461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.621201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:26.621662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:26.625270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:26.781261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:26.970699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:26.985093 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d767f4b-6880-4523-b129-484369980f5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1321 microversion: 2.1 time: 0.429097 Oct 31 15:28:26.986478 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1298/2800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:26 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:26.996466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:26.998145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:27.004818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.006611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.007420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.008432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.009204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.009929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.153900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.167338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.169521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.182204 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8289e747-4649-4ba8-bd5d-5aa67cb4abff tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.192752 Oct 31 15:28:27.186623 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1299/2801] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:26 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:27.196129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a86bdbf9-b962-4370-8848-7e7566228a24 req-fb00ee66-2e18-44a4-8b88-6ef3c31fb49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575595cc-5dda-42f5-9b0e-9f9fe15606cd", "name": "network-vif-plugged", "status": "completed", "tag": "d44f0e3a-5755-4aab-afaa-891874ed54af"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:27.222657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a86bdbf9-b962-4370-8848-7e7566228a24 req-fb00ee66-2e18-44a4-8b88-6ef3c31fb49a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.233796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a86bdbf9-b962-4370-8848-7e7566228a24 req-fb00ee66-2e18-44a4-8b88-6ef3c31fb49a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.234528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a86bdbf9-b962-4370-8848-7e7566228a24 req-fb00ee66-2e18-44a4-8b88-6ef3c31fb49a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.254579 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a86bdbf9-b962-4370-8848-7e7566228a24 req-fb00ee66-2e18-44a4-8b88-6ef3c31fb49a service nova] Creating event network-vif-plugged:d44f0e3a-5755-4aab-afaa-891874ed54af for instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd on n-h1-858384-17 Oct 31 15:28:27.271490 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a86bdbf9-b962-4370-8848-7e7566228a24 req-fb00ee66-2e18-44a4-8b88-6ef3c31fb49a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082108 Oct 31 15:28:27.272864 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1300/2802] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:27.284656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:27.287159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:27.294900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.296018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.297076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.298251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.298956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.300315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.630130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:27.646875 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-baf5bc3b-f669-4961-95fa-af8c25de7ff7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1507 microversion: 2.1 time: 0.372452 Oct 31 15:28:27.647479 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1301/2803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:27 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:27.661262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:27.669970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:27.687144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.687648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.688230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:27.688797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:27.689275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:27.689707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.591632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:28.603407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:28.605379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:28.606811 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c10a5d66-08e2-433f-91ee-60980297dcd8 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1732 microversion: 2.25 time: 0.955986 Oct 31 15:28:28.607865 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1302/2804] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:27 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1732 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:28.614269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:28.615308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:28.623370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.624422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.625024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.625947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:28.626716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:28.627355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:28.969024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:28.979645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c665df8-9716-4bd5-aff9-c46971b0eba7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1321 microversion: 2.1 time: 0.370400 Oct 31 15:28:28.999551 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1303/2805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:28 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:29.016129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:29.021607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:29.039172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.041789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.042492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.043531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.045329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.046314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.212141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.223130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.224872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.231791 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a8c24990-c593-48ed-b411-902a307f1bd7 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.222321 Oct 31 15:28:29.232902 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1304/2806] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:29 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:29.252302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:29.254646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:29.273973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.274488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.274936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.275660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.276119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.282100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.645100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.657064 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-62a7ee6d-e235-48ae-a4fa-c745caf08c3b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.422333 Oct 31 15:28:29.657911 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1305/2807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:29 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:29.663649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a7469762-fdf8-4952-bc14-df8904660248 req-2956fdf2-56da-4cec-9fa9-eca8d373c227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ace9f23-0d08-4d3b-8c64-dd82142559be", "name": "network-vif-deleted", "tag": "c5178817-b9fc-4b5a-bd24-5ee1112ab04c"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:29.674928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7469762-fdf8-4952-bc14-df8904660248 req-2956fdf2-56da-4cec-9fa9-eca8d373c227 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.675646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7469762-fdf8-4952-bc14-df8904660248 req-2956fdf2-56da-4cec-9fa9-eca8d373c227 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.676270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7469762-fdf8-4952-bc14-df8904660248 req-2956fdf2-56da-4cec-9fa9-eca8d373c227 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.711801 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a7469762-fdf8-4952-bc14-df8904660248 req-2956fdf2-56da-4cec-9fa9-eca8d373c227 service nova] Creating event network-vif-deleted:c5178817-b9fc-4b5a-bd24-5ee1112ab04c for instance 0ace9f23-0d08-4d3b-8c64-dd82142559be on n-h1-858384-17 Oct 31 15:28:29.725318 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a7469762-fdf8-4952-bc14-df8904660248 req-2956fdf2-56da-4cec-9fa9-eca8d373c227 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065309 Oct 31 15:28:29.730759 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1306/2808] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:29.738654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:29.740490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:29.747779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.748508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.749214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.750483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.751145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.751798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.799582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:29.800842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:29.801596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:29.803339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lazy-loading 'fault' on Instance uuid 0ace9f23-0d08-4d3b-8c64-dd82142559be {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:29.918781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.935559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.940458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:29.946805 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9286688-0393-4139-8829-a9ee9893c125 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 200 len: 1376 microversion: 2.25 time: 0.214772 Oct 31 15:28:29.950844 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1307/2809] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:29 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 1376 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:30.004621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:30.005609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:30.016659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.017172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.018252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.019494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.022076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.023278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.060818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:30.241095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.250639 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-660f9307-8636-452e-a35a-7935dd725b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1501 microversion: 2.1 time: 0.250324 Oct 31 15:28:30.251558 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1308/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:29 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1501 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:30.268103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:30.269171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:30.290899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.292611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.293119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.294016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.294762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.295231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.447305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.458227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.460292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.466633 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-607ab02d-f84f-4844-a583-a8fe4dc1dd81 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.207912 Oct 31 15:28:30.469251 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1309/2811] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:30 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:30.472923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:30.473684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:30.481103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.481620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.482056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.482760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.483276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.483854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.696653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:30.708208 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b0fd7db-bcb5-436c-98c1-92786bd08373 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1501 microversion: 2.1 time: 0.238704 Oct 31 15:28:30.709844 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1310/2812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:30 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:30.726540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:30.727875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:30.755023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.758809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.761460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:30.762599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:30.766542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:30.767618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.105042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:31.116578 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d7aadfa-218a-4fde-beff-08bf6d73d095 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.404804 Oct 31 15:28:31.117727 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1311/2813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:30 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:31.137960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.138851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:31.151574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.158630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.172935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.175268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.175777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.176226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.252937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:31.409103 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-610d6a72-e320-40e0-a32b-efc4351de463 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 204 len: 0 microversion: 2.1 time: 0.289319 Oct 31 15:28:31.415451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1312/2814] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:28:31 2022] DELETE /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:31.422823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.423904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: 0ace9f23-0d08-4d3b-8c64-dd82142559be] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:31.432228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.433013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.433695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.434932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.435552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.436163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.453654 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] HTTP exception thrown: Instance 0ace9f23-0d08-4d3b-8c64-dd82142559be could not be found. Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Request method failure captured: Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be HTTP/1.1 Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-e9WZODaL3jOVWR_h3Cy0MM-JCvy6_AvWP4aSqzmR9KdKXXyuWl6QaE6g3ZJ34LyIp1gDAMN6LJJP68ZYP2rzQAl7pU_GSuRo0y9Dbn2pKX8HER41z-xZ8Sy8aOIquBx2qLlwzPNdhCWdQqi9enR7YBjt_jhZUK5PXy4-YjS__nQ3k Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 320e16c5c6ba43569e325ed2d7967f6a Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e16c5c6ba43569e325ed2d7967f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_320e16c5c6ba43569e325ed2d7967f6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e16c5c6ba43569e325ed2d7967f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/320e16c5c6ba43569e325ed2d7967f6a"}]}] Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 320e16c5c6ba43569e325ed2d7967f6a Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-LiveAutoBlockMigrationV225Test-1174511701-project Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 676d4f2214e848c0aa654f0863b9f4a4 Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701-project Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 0ace9f23-0d08-4d3b-8c64-dd82142559be could not be found. Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '0ace9f23-0d08-4d3b-8c64-dd82142559be'} Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ace9f23-0d08-4d3b-8c64-dd82142559be could not be found. Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ace9f23-0d08-4d3b-8c64-dd82142559be could not be found. Oct 31 15:28:31.455606 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:31.461168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:31.461168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:31.461168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:31.461168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:31.461168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:31.461168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:31.461168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:31.461168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ace9f23-0d08-4d3b-8c64-dd82142559be could not be found. Oct 31 15:28:31.461168 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:31.463284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Returning 404 to user: Instance 0ace9f23-0d08-4d3b-8c64-dd82142559be could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:31.464385 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b0c23e90-f5e7-413d-9179-457f73f58168 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be" status: 404 len: 111 microversion: 2.25 time: 0.047016 Oct 31 15:28:31.465364 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1313/2815] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/servers/0ace9f23-0d08-4d3b-8c64-dd82142559be => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:28:31.474523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.475409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:31.482919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.483577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.484186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.485097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.485733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.486301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.763760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:31.775718 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70d7a6d0-dfad-4e45-b7d2-4e56822bf624 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1507 microversion: 2.1 time: 0.305504 Oct 31 15:28:31.778724 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1314/2816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:31.787452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdde390e-be94-4901-8bb8-cbce55525834 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '.version_select at 0x7f16e11845e0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.830251 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdde390e-be94-4901-8bb8-cbce55525834 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1056490735" status: 204 len: 0 microversion: 2.25 time: 0.050197 Oct 31 15:28:31.836126 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1315/2817] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:28:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1056490735 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:28:31.840976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:31.841611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:31.848329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.849485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.850103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:31.851048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:31.851513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:31.851953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:32.022289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:32.041306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:32.049878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:32.080615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:32.087594 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d23e965-1822-4f0b-ba06-eded1559e403 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1553 microversion: 2.91 time: 0.245739 Oct 31 15:28:32.087943 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1316/2818] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:31 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:32.144304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.147681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:32.168567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.169165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.169756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:32.171098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.171664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.172153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:32.373641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:32.384671 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c5691867-8a36-4de9-9648-f35b4749f1f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.248430 Oct 31 15:28:32.386063 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1317/2819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:32.417108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] validate_networks() for [('4d0fa26d-039a-40f3-a4e3-ccfe7dfd10a3', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:28:32.802208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:32.802869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:32.819086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.820587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.824717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:32.826931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:32.828779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:32.830130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.212907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.225171 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-84198448-99b3-4dbb-b9c9-9d3b602021b1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1507 microversion: 2.1 time: 0.428732 Oct 31 15:28:33.226269 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1318/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:32 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:33.232060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-779e12d6-f288-4464-a692-ebbd4bd3a43a req-e11599df-df23-4695-8af0-7f0b1bdffa19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30932182-ff62-4e04-a97c-d0c80577089f", "name": "network-vif-plugged", "status": "completed", "tag": "ef93582f-e5e2-493d-b6c4-4b6f4f126e30"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:33.242993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-779e12d6-f288-4464-a692-ebbd4bd3a43a req-e11599df-df23-4695-8af0-7f0b1bdffa19 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.243815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-779e12d6-f288-4464-a692-ebbd4bd3a43a req-e11599df-df23-4695-8af0-7f0b1bdffa19 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.244367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-779e12d6-f288-4464-a692-ebbd4bd3a43a req-e11599df-df23-4695-8af0-7f0b1bdffa19 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.258724 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-779e12d6-f288-4464-a692-ebbd4bd3a43a req-e11599df-df23-4695-8af0-7f0b1bdffa19 service nova] Creating event network-vif-plugged:ef93582f-e5e2-493d-b6c4-4b6f4f126e30 for instance 30932182-ff62-4e04-a97c-d0c80577089f on n-h2-858384-17 Oct 31 15:28:33.265506 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-779e12d6-f288-4464-a692-ebbd4bd3a43a req-e11599df-df23-4695-8af0-7f0b1bdffa19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037438 Oct 31 15:28:33.266484 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1319/2821] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:33.285738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.286854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:33.294799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.295311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.295733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.296438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.297715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.298147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.465597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.486876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.501068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:33.533540 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-151be451-579d-45f1-bf9d-aeecf3be397f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1535 microversion: 2.91 time: 0.265553 Oct 31 15:28:33.539385 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1320/2822] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1535 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:33.559427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.562354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:33.579194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.582084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.582532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.583865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.588978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.590496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.659409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:33.889460 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-920f7f2e-239e-4e00-b164-0c7bf56e0ef3 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 204 len: 0 microversion: 2.25 time: 0.341530 Oct 31 15:28:33.892813 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1321/2823] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:28:33 2022] DELETE /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:28:33.913256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:33.913450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:33.929573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.930081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.930552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:33.935491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:33.936720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:33.937190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.272366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:28:34.273058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:28:34.273789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:28:34.274361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:28:34.275038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:28:34.293996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.295004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.295901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.298928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.300547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.308786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:34.310003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.328864 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c2b90ed-2e97-43ff-be4f-a4b51efc5ddd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.426639 Oct 31 15:28:34.331259 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1322/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:33 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:34.346147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Getting quotas for project 9275c27ad1ac40568e4dbc778857d333. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:34.351447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.356068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:34.362180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Getting quotas for user b56e2ca778b04f7c9fc7590faacb4c1a and project 9275c27ad1ac40568e4dbc778857d333. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:34.377975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.377975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.378744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.379645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.380693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.385711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.399286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:28:34.413918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:28:34.541668 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eb9e92e5-d1ec-4e20-9f01-cb2258a66f6b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 17.994992 Oct 31 15:28:34.548374 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1503/2825] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:28:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 18002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:28:34.574209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.580057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:34.605290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.605795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.606234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.606955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:34.607409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:34.607832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:34.751737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:34.762499 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eae17edb-418b-4a5c-992d-1be7a6c93429 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1465 microversion: 2.1 time: 0.211508 Oct 31 15:28:34.776707 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1504/2826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1465 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:34.795948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a402797-28a8-43f4-b8e8-742b16a1f3ea tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:34.796500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a402797-28a8-43f4-b8e8-742b16a1f3ea tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:34.959547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a402797-28a8-43f4-b8e8-742b16a1f3ea tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:34.980987 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a402797-28a8-43f4-b8e8-742b16a1f3ea tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1221 microversion: 2.1 time: 0.197569 Oct 31 15:28:34.982086 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1505/2827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1221 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:34.999292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.000246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:35.021691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.022539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.023141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.024106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.024764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.025501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.076490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.108194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.112733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.113982 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98bf72c0-6d88-499d-9d37-2d4abd84266f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1550 microversion: 2.25 time: 0.781583 Oct 31 15:28:35.141170 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1323/2828] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1550 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:35.163634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-94135e3c-8f06-490c-adfe-bbdc0021d003 req-4cb375ae-1d49-45cb-95e6-ac9f002fd00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "575595cc-5dda-42f5-9b0e-9f9fe15606cd", "name": "network-vif-deleted", "tag": "d44f0e3a-5755-4aab-afaa-891874ed54af"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:35.217762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-94135e3c-8f06-490c-adfe-bbdc0021d003 req-4cb375ae-1d49-45cb-95e6-ac9f002fd00e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.218280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-94135e3c-8f06-490c-adfe-bbdc0021d003 req-4cb375ae-1d49-45cb-95e6-ac9f002fd00e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.218719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-94135e3c-8f06-490c-adfe-bbdc0021d003 req-4cb375ae-1d49-45cb-95e6-ac9f002fd00e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.240271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:35.245179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.258841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.260296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.276804 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c86315b7-b5c4-4377-8246-2d42f4b279b9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1535 microversion: 2.91 time: 0.293450 Oct 31 15:28:35.284558 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-94135e3c-8f06-490c-adfe-bbdc0021d003 req-4cb375ae-1d49-45cb-95e6-ac9f002fd00e service nova] Creating event network-vif-deleted:d44f0e3a-5755-4aab-afaa-891874ed54af for instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd on n-h1-858384-17 Oct 31 15:28:35.298281 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1506/2829] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:34 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1535 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:35.309187 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-94135e3c-8f06-490c-adfe-bbdc0021d003 req-4cb375ae-1d49-45cb-95e6-ac9f002fd00e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173938 Oct 31 15:28:35.311295 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1324/2830] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:35.321900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-277302435", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:35.358334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.359048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:35.385516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.388309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.390282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.391105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.396161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.396782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.863431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:35.898866 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40119b75-806c-4f36-9a35-c90cc74f06c2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.540673 Oct 31 15:28:35.904942 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1325/2831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:35 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:35.922141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:35.925396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:35.951374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.953940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.955620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:35.960482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:35.962480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:35.975438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.076230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.077195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.077195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.077632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lazy-loading 'fault' on Instance uuid 575595cc-5dda-42f5-9b0e-9f9fe15606cd {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:36.213595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.230664 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91f84d51-d990-4ca5-904b-33aa3432f02c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 200 len: 1311 microversion: 2.1 time: 0.323359 Oct 31 15:28:36.231286 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1326/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:35 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 1311 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:36.253422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5d091afb-3add-4130-82f5-e3e57bea7b66 req-d66584c2-dba0-4d74-8d86-63f054d7d80d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb133a9d-fd24-477f-bfd0-31c7e301802d", "name": "network-vif-deleted", "tag": "830ca30e-3090-4f40-8f89-0c31ab02a113"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:36.296837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5d091afb-3add-4130-82f5-e3e57bea7b66 req-d66584c2-dba0-4d74-8d86-63f054d7d80d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.298465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5d091afb-3add-4130-82f5-e3e57bea7b66 req-d66584c2-dba0-4d74-8d86-63f054d7d80d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.310781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5d091afb-3add-4130-82f5-e3e57bea7b66 req-d66584c2-dba0-4d74-8d86-63f054d7d80d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.347708 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5d091afb-3add-4130-82f5-e3e57bea7b66 req-d66584c2-dba0-4d74-8d86-63f054d7d80d service nova] Creating event network-vif-deleted:830ca30e-3090-4f40-8f89-0c31ab02a113 for instance cb133a9d-fd24-477f-bfd0-31c7e301802d on n-h2-858384-17 Oct 31 15:28:36.358532 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5d091afb-3add-4130-82f5-e3e57bea7b66 req-d66584c2-dba0-4d74-8d86-63f054d7d80d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108707 Oct 31 15:28:36.359259 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1327/2833] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:36.370931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:36.372493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:36.379942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.382031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.382729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.384356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.385085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.385881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.433180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.433943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.434594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.435052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lazy-loading 'fault' on Instance uuid cb133a9d-fd24-477f-bfd0-31c7e301802d {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:36.508018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.524660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.526540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.528267 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-95f3bda0-2b8c-4a5e-85e8-03d5a066c057 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 200 len: 1352 microversion: 2.25 time: 0.167682 Oct 31 15:28:36.529380 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1328/2834] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:36 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 1352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:36.535565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:36.537112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:36.551333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.552374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.553795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.554855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.555594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.566261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.704850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.717750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.719577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:36.727233 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eca6b75f-6395-4b42-a772-b29a091de1bb tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1478 microversion: 2.91 time: 0.196616 Oct 31 15:28:36.728109 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1329/2835] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:36 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1478 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:36.761508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:36.764729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:36.771888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.772671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.773552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.774429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.775054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.775674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.841276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-858384-17". {{(pid=120588) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:28:36.939508 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eaa23e34-8078-4019-9b10-29a394fa0c35 tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251/action" status: 202 len: 0 microversion: 2.91 time: 0.187760 Oct 31 15:28:36.940670 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1330/2836] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:28:36 2022] POST /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:28:36.951504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:36.952183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:36.961570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.962369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.963056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:36.963850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:36.964418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:36.964911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.372278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.380250 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8a26d58a-dc96-4c48-9a29-b7257022daf9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.437726 Oct 31 15:28:37.386906 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1331/2837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:36 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:37.430362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:37.431584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:37.446834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.450464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.450919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.456385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.457210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.457812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.513089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] validate_networks() for [('4d0fa26d-039a-40f3-a4e3-ccfe7dfd10a3', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:28:37.649668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.673634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.675427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:37.728905 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75c5a776-cf97-49c4-9264-c5c663819f38 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1486 microversion: 2.91 time: 0.329730 Oct 31 15:28:37.756783 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1332/2838] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:37 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1486 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:37.776361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:37.793907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:37.815747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.816976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.818737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.820072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:37.823714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:37.829310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:37.884784 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd HTTP/1.1 Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '575595cc-5dda-42f5-9b0e-9f9fe15606cd'} Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:37.910153 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:37.918105 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:37.918105 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:37.918105 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:37.918105 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:37.918105 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:37.918105 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:28:37.918105 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:37.920622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:37.923841 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-acf64586-c239-4303-bb9f-fbe006240e26 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 404 len: 111 microversion: 2.1 time: 0.163286 Oct 31 15:28:37.924444 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1333/2839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:37 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:28:37.966338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:37.967276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: cb133a9d-fd24-477f-bfd0-31c7e301802d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:38.006839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.008280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.015828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.032742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.034244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.035830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.094115 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] HTTP exception thrown: Instance cb133a9d-fd24-477f-bfd0-31c7e301802d could not be found. Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Request method failure captured: Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d HTTP/1.1 Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-e9WZODaL3jOVWR_h3Cy0MM-JCvy6_AvWP4aSqzmR9KdKXXyuWl6QaE6g3ZJ34LyIp1gDAMN6LJJP68ZYP2rzQAl7pU_GSuRo0y9Dbn2pKX8HER41z-xZ8Sy8aOIquBx2qLlwzPNdhCWdQqi9enR7YBjt_jhZUK5PXy4-YjS__nQ3k Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 320e16c5c6ba43569e325ed2d7967f6a Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e16c5c6ba43569e325ed2d7967f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_320e16c5c6ba43569e325ed2d7967f6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e16c5c6ba43569e325ed2d7967f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/320e16c5c6ba43569e325ed2d7967f6a"}]}] Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 320e16c5c6ba43569e325ed2d7967f6a Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-LiveAutoBlockMigrationV225Test-1174511701-project Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 676d4f2214e848c0aa654f0863b9f4a4 Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701-project Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance cb133a9d-fd24-477f-bfd0-31c7e301802d could not be found. Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'cb133a9d-fd24-477f-bfd0-31c7e301802d'} Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb133a9d-fd24-477f-bfd0-31c7e301802d could not be found. Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb133a9d-fd24-477f-bfd0-31c7e301802d could not be found. Oct 31 15:28:38.099678 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb133a9d-fd24-477f-bfd0-31c7e301802d could not be found. Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:28:38.103692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Returning 404 to user: Instance cb133a9d-fd24-477f-bfd0-31c7e301802d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:38.105004 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-701e7dde-7f84-4477-be4d-ce472f09e0c1 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d" status: 404 len: 111 microversion: 2.25 time: 0.165573 Oct 31 15:28:38.107649 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1334/2840] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:37 2022] GET /compute/v2.1/servers/cb133a9d-fd24-477f-bfd0-31c7e301802d => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:28:38.119606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4f905b4b-4573-498e-b32a-deb2ca04764f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'create', calling method: .version_select at 0x7f16e0f3a8b0>, body: {"keypair": {"name": "tempest-key-232044772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxoSro67QR4dKVlewpIrvDbbywSw/I6mUa7cq6vHzdUiRqHBx+3DJrxkNKxxdeFqOhweXzHHlfFNcE3BQnP9lceOdEn6suDhbFkwr4hKj18bBz21KQPmTUfG6hylk/5FQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:38.162483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-4f905b4b-4573-498e-b32a-deb2ca04764f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for project b62d7aa07ac6442d87c73de859d91c34. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:38.187455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-4f905b4b-4573-498e-b32a-deb2ca04764f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for user 31cd28d777ac40eda1a7abefb5a3256d and project b62d7aa07ac6442d87c73de859d91c34. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:38.289691 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4f905b4b-4573-498e-b32a-deb2ca04764f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.179637 Oct 31 15:28:38.290630 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1335/2841] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:28:38 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:38.300964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:38.302028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:38.310833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.312443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.313750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.315596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.316298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.317011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.394949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:28:38.606889 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-604e2cb3-06c5-4746-b195-33ca52f3fbf2 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 204 len: 0 microversion: 2.25 time: 0.314381 Oct 31 15:28:38.610874 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1336/2842] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:28:38 2022] DELETE /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:28:38.625108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96e2337e-517e-4eb4-97c6-2f272935dcb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '.version_select at 0x7f16e1676430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:38.631102 n-d-858384-17 devstack@n-api.service[120588]: WARNING oslo_db.sqlalchemy.utils [None req-96e2337e-517e-4eb4-97c6-2f272935dcb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 31 15:28:38.640551 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96e2337e-517e-4eb4-97c6-2f272935dcb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.030862 Oct 31 15:28:38.643277 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1337/2843] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:28:38 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:38.675505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:38.683609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:38.715130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.716625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.717090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.721013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.726042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.727870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.859784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:28:38.860597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:28:38.860722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:28:38.861362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:28:38.862195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:28:38.892804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.901730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.904651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.908734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:38.912232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:38.916669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:38.998657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Getting quotas for project 9275c27ad1ac40568e4dbc778857d333. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:39.029345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Getting quotas for user b56e2ca778b04f7c9fc7590faacb4c1a and project 9275c27ad1ac40568e4dbc778857d333. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:39.081422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:28:39.084785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:28:39.085895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.099585 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8eea12c2-c745-441d-882d-8cc9cae1b176 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.444599 Oct 31 15:28:39.121048 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1338/2844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:38 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:39.136409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:39.137087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:39.160586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.163929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.165598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.168181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.173121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.173631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.194399 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bcae596-0646-4dc7-8651-269dfee9e718 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.894135 Oct 31 15:28:39.195492 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1507/2845] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:28:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 3897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:28:39.206838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:39.210736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:39.225759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.227545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.230112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.231111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:39.231798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:39.232793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:39.412969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.435382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.436824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.476354 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-171030f3-1e82-4568-b2b4-d33b27d13612 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.271390 Oct 31 15:28:39.478211 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1508/2846] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:39 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:39.498834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-225784200", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "key_name": "tempest-key-232044772", "networks": [{"uuid": "2b5355db-9171-4de8-abb5-5f94412a242a"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:39.635813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] validate_networks() for [('2b5355db-9171-4de8-abb5-5f94412a242a', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:28:39.781265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.798578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.800052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.806239 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b270479f-b943-4ea5-a7b0-51dc6ee8421d tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1564 microversion: 2.25 time: 0.683707 Oct 31 15:28:39.807012 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1339/2847] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:39 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1564 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:39.825108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce6c06af-3a35-44d5-b1bd-5b6473562a2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:39.826256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce6c06af-3a35-44d5-b1bd-5b6473562a2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:39.932908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce6c06af-3a35-44d5-b1bd-5b6473562a2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:39.947595 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce6c06af-3a35-44d5-b1bd-5b6473562a2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1221 microversion: 2.1 time: 0.139238 Oct 31 15:28:39.955481 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1340/2848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:39 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:40.127838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:40.128452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:40.149673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.157628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.158134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:40.165390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:40.166035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:40.166599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.524693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:41.539773 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3fd0ea1-85d7-446a-bf58-8edb082eca84 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 1.415652 Oct 31 15:28:41.557172 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1341/2849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:40 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:41.557172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:41.557172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:41.574899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.575524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.576098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.576900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.577459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.577892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.627633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:28:41.628260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:28:41.628732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:28:41.629159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:28:41.629590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:28:41.676180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.679934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.680771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.682779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.684734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.686109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.750795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:28:41.774071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for user 31cd28d777ac40eda1a7abefb5a3256d and project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:28:41.814897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:28:41.819499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:28:41.827321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:41.837652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:41.849860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:41.851786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:41.869974 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-42262ab5-a38c-480e-b369-d3fc317345d5 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.320295 Oct 31 15:28:41.871129 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1342/2850] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:41 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:41.884441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:41.907324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:41.923443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.936516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.937034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.950471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:41.953970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:41.954538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:41.977712 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69e5a4f4-28d6-40fb-8bcd-851f88bb123e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.494204 Oct 31 15:28:41.980009 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1509/2851] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:28:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:28:42.011574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-22e38bb0-7b26-4962-be41-80ce6188fb40 req-0a5da551-f5e5-48b8-b14d-57318b4aefc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d93bc1-c14b-4889-975f-5e624ce57027", "name": "network-vif-deleted", "tag": "f27357e6-9586-4e9f-a712-a69e2f60a83d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:42.058396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22e38bb0-7b26-4962-be41-80ce6188fb40 req-0a5da551-f5e5-48b8-b14d-57318b4aefc9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.060470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22e38bb0-7b26-4962-be41-80ce6188fb40 req-0a5da551-f5e5-48b8-b14d-57318b4aefc9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.060592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22e38bb0-7b26-4962-be41-80ce6188fb40 req-0a5da551-f5e5-48b8-b14d-57318b4aefc9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.102878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.102878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.102878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.102878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lazy-loading 'fault' on Instance uuid e8d93bc1-c14b-4889-975f-5e624ce57027 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:28:42.184506 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-22e38bb0-7b26-4962-be41-80ce6188fb40 req-0a5da551-f5e5-48b8-b14d-57318b4aefc9 service nova] Creating event network-vif-deleted:f27357e6-9586-4e9f-a712-a69e2f60a83d for instance e8d93bc1-c14b-4889-975f-5e624ce57027 on n-h2-858384-17 Oct 31 15:28:42.202165 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-22e38bb0-7b26-4962-be41-80ce6188fb40 req-0a5da551-f5e5-48b8-b14d-57318b4aefc9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220409 Oct 31 15:28:42.220673 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1510/2852] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:42.242478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:42.246112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:42.275746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.276539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.280028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.281589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.283359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.285658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.537743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.553247 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c46d84a0-17cb-4774-90f2-5cc54b0c6f6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1279 microversion: 2.1 time: 0.329926 Oct 31 15:28:42.570437 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1511/2853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:42 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1279 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:42.570946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.595090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0d31080-95a3-4428-b9da-04e514b13742 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:42.605642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.605886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0d31080-95a3-4428-b9da-04e514b13742 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:42.615388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '676d4f2214e848c0aa654f0863b9f4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320e16c5c6ba43569e325ed2d7967f6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.632054 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7eff227a-23ce-4dd3-8118-a00833c2dd7f tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 200 len: 1351 microversion: 2.25 time: 0.752797 Oct 31 15:28:42.640221 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1343/2854] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:41 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 1351 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:42.656659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f03c592d-6f5b-4e38-95f3-1dbac75aa634 req-ecac9056-3143-4c58-a933-b0db57174a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38eb051-6410-4f8b-a4d6-19da70665a57", "tag": "9ecfc92a-e2cd-40fc-81ca-477cef1fa879"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:42.742985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f03c592d-6f5b-4e38-95f3-1dbac75aa634 req-ecac9056-3143-4c58-a933-b0db57174a77 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.743767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f03c592d-6f5b-4e38-95f3-1dbac75aa634 req-ecac9056-3143-4c58-a933-b0db57174a77 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.748040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f03c592d-6f5b-4e38-95f3-1dbac75aa634 req-ecac9056-3143-4c58-a933-b0db57174a77 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.833537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0d31080-95a3-4428-b9da-04e514b13742 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:42.838357 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f03c592d-6f5b-4e38-95f3-1dbac75aa634 req-ecac9056-3143-4c58-a933-b0db57174a77 service nova] Creating event network-changed:9ecfc92a-e2cd-40fc-81ca-477cef1fa879 for instance e38eb051-6410-4f8b-a4d6-19da70665a57 on n-h2-858384-17 Oct 31 15:28:42.847770 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0d31080-95a3-4428-b9da-04e514b13742 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1227 microversion: 2.1 time: 0.276038 Oct 31 15:28:42.856767 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1512/2855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:42 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1227 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:42.877526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:42.879633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:42.885815 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f03c592d-6f5b-4e38-95f3-1dbac75aa634 req-ecac9056-3143-4c58-a933-b0db57174a77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234923 Oct 31 15:28:42.886941 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1344/2856] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:42.908003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.908516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.908950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.910806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:42.912346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:42.914275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.921416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.922086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.925458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:42.933874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.935348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.940992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:42.945624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:42.946422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:42.947119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.280647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:43.301076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:43.304369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:43.313150 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16b1c22a-e351-4c2c-b601-4318d9559cc6 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.410404 Oct 31 15:28:43.314793 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1345/2857] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:42 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:43.533465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:43.545415 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a8124857-172b-4466-91c6-0998997f3dc7 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.687220 Oct 31 15:28:43.552478 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1513/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:42 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:43.584853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:43.586340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:43.602191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.603268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.604093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.605154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.606012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.606751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.670664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:43.671662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] [instance: e8d93bc1-c14b-4889-975f-5e624ce57027] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:43.684864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.690200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.691106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.692181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.693645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.694343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.746729 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] HTTP exception thrown: Instance e8d93bc1-c14b-4889-975f-5e624ce57027 could not be found. Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Request method failure captured: Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 HTTP/1.1 Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-e9WZODaL3jOVWR_h3Cy0MM-JCvy6_AvWP4aSqzmR9KdKXXyuWl6QaE6g3ZJ34LyIp1gDAMN6LJJP68ZYP2rzQAl7pU_GSuRo0y9Dbn2pKX8HER41z-xZ8Sy8aOIquBx2qLlwzPNdhCWdQqi9enR7YBjt_jhZUK5PXy4-YjS__nQ3k Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.25 Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 320e16c5c6ba43569e325ed2d7967f6a Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e16c5c6ba43569e325ed2d7967f6a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_320e16c5c6ba43569e325ed2d7967f6a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/320e16c5c6ba43569e325ed2d7967f6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/320e16c5c6ba43569e325ed2d7967f6a"}]}] Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 320e16c5c6ba43569e325ed2d7967f6a Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701 Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-LiveAutoBlockMigrationV225Test-1174511701-project Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 676d4f2214e848c0aa654f0863b9f4a4 Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1174511701-project Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance e8d93bc1-c14b-4889-975f-5e624ce57027 could not be found. Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'e8d93bc1-c14b-4889-975f-5e624ce57027'} Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8d93bc1-c14b-4889-975f-5e624ce57027 could not be found. Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8d93bc1-c14b-4889-975f-5e624ce57027 could not be found. Oct 31 15:28:43.750629 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.757630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:28:43.757630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.757630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:28:43.757630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:28:43.757630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:28:43.757630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:28:43.757630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:28:43.757630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8d93bc1-c14b-4889-975f-5e624ce57027 could not be found. Oct 31 15:28:43.757630 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:28:43.759948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] Returning 404 to user: Instance e8d93bc1-c14b-4889-975f-5e624ce57027 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:28:43.764592 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7916f0a7-8bf6-48d2-9a3a-0300d9568c39 tempest-LiveAutoBlockMigrationV225Test-1174511701 tempest-LiveAutoBlockMigrationV225Test-1174511701-project] 10.222.0.20 "GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027" status: 404 len: 111 microversion: 2.25 time: 0.098180 Oct 31 15:28:43.765634 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1514/2859] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:43 2022] GET /compute/v2.1/servers/e8d93bc1-c14b-4889-975f-5e624ce57027 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:28:43.863664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:43.884758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:43.887515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:43.890014 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83545756-1ede-4c63-834c-db0a62e0c699 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1279 microversion: 2.1 time: 0.309638 Oct 31 15:28:43.898100 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1346/2860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:43 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1279 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:43.914502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.915364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.916007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:43.916934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:43.917664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:43.918872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.110172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:44.119880 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f2e901ac-bd19-4048-8156-8f7724fd4b15 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1279 microversion: 2.1 time: 0.240542 Oct 31 15:28:44.126259 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1515/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:43 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1279 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:44.351193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:44.351812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:44.383600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.385232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.387714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.388629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.390179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.392385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.585658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:44.586283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:44.608454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.612717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.613412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.620328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.621087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.622827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.650094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:44.669084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:44.670599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:44.699277 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ead2f46f-7eaf-499c-947b-0b9a5a1641f1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.348845 Oct 31 15:28:44.702936 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1347/2862] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:44 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:44.921067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:44.921724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:44.936677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.937238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.943304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:44.948823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:44.949834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:44.950643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.390254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.409891 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d677b798-4bb0-49d5-9c61-6c61a6407742 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.829505 Oct 31 15:28:45.412878 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1516/2863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:44 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:45.428446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:45.442092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:45.464156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.466625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.467731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.472028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.474296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.477032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.712706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.725049 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b09fdb6b-9cad-4c79-9820-66c6ab6913f7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1285 microversion: 2.1 time: 0.308237 Oct 31 15:28:45.730341 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1517/2864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:45 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1285 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:45.747233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:45.748348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:45.777256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.778263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.778565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:45.779510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.780391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:45.781074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:45.781684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:45.797461 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-516a4e05-d263-4d43-92be-4b5142765350 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1321 microversion: 2.1 time: 0.880486 Oct 31 15:28:45.798232 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1348/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:44 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1321 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:46.069213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:46.094332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:46.099266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:46.131159 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f1d48cf7-d0e9-4da0-9821-fc4186cfe031 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.398770 Oct 31 15:28:46.173930 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1518/2866] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:45 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:46.436747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:46.437495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:46.465315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.465819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.466370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.467108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.467587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.468012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.762485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:46.763102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:46.793392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.793859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.794301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:46.795156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:46.795656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:46.796092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:47.083309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:47.111569 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f0c81e3-0955-49ee-baaa-5f06ec732776 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1285 microversion: 2.1 time: 0.352950 Oct 31 15:28:47.126801 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1519/2867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:46 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1285 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:47.158104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:47.167046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:47.179118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:47.191672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:47.195658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:47.196724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:47.197457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:47.198077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:47.535586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:47.547993 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed3e6d56-4fd7-487f-9de9-1d300b1eeb05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 1.116203 Oct 31 15:28:47.552849 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1349/2868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:46 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:47.566099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:47.566893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:47.589514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:47.591460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:47.592218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:47.595645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:47.596324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:47.598261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.486562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:48.502778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:48.521100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:48.528121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:48.546787 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9da76bd9-7c8c-4aa0-804d-d951f3425226 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.988162 Oct 31 15:28:48.548427 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1350/2869] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:47 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:48.552684 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-849a3c1f-cd26-4947-8378-ba511a93e9ca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1321 microversion: 2.1 time: 1.420053 Oct 31 15:28:48.558922 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1520/2870] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:47 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1321 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:48.587186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:48.589604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:48.592628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:48.593896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:48.608409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.612057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.616059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.616829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.617449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.617775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.634523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.634797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.635239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:48.635952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:48.638793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:48.639269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.308065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:49.322777 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4125d9e0-c5a1-4148-825d-5e02488966ee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1327 microversion: 2.1 time: 0.760088 Oct 31 15:28:49.334164 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1351/2871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:48 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1327 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:49.338578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3efc798f-b684-49a0-802c-c3a416b1803e req-c103911a-5eff-494d-8bbb-3a7f29310465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a4aa745-9180-42f8-9ccd-5c286351fd50", "tag": "64770c5f-870a-4838-9f15-799163477f87"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:49.366712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3efc798f-b684-49a0-802c-c3a416b1803e req-c103911a-5eff-494d-8bbb-3a7f29310465 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:49.367606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3efc798f-b684-49a0-802c-c3a416b1803e req-c103911a-5eff-494d-8bbb-3a7f29310465 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:49.369445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3efc798f-b684-49a0-802c-c3a416b1803e req-c103911a-5eff-494d-8bbb-3a7f29310465 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.419900 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3efc798f-b684-49a0-802c-c3a416b1803e req-c103911a-5eff-494d-8bbb-3a7f29310465 service nova] Creating event network-changed:64770c5f-870a-4838-9f15-799163477f87 for instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 on n-h1-858384-17 Oct 31 15:28:49.454334 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3efc798f-b684-49a0-802c-c3a416b1803e req-c103911a-5eff-494d-8bbb-3a7f29310465 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113999 Oct 31 15:28:49.458959 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1352/2872] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:49.587411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:49.588976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:49.611350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:49.621088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:49.621957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.643268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:49.645849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:49.650016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.739910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:49.749601 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b01c6ae6-bb85-4eb1-9525-97b4a9c2ace6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 1.177438 Oct 31 15:28:49.753321 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1521/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:48 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:49.775650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:49.778080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:49.796633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:49.797411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:49.798045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.799715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:49.809087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:49.811384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:49.947525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:50.320851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.336346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.363581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.378236 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52138f85-f1b4-4fc6-8e72-906ec273b32f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.799883 Oct 31 15:28:50.401859 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1353/2874] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:49 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:50.421796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5a8bfa38-4581-4b45-9acc-6b41bd8fc2db req-9094d881-d5f0-49b5-b805-9310d3cb6581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38eb051-6410-4f8b-a4d6-19da70665a57", "name": "network-vif-plugged", "status": "completed", "tag": "9ecfc92a-e2cd-40fc-81ca-477cef1fa879"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:50.445764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5a8bfa38-4581-4b45-9acc-6b41bd8fc2db req-9094d881-d5f0-49b5-b805-9310d3cb6581 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.447548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5a8bfa38-4581-4b45-9acc-6b41bd8fc2db req-9094d881-d5f0-49b5-b805-9310d3cb6581 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.448453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5a8bfa38-4581-4b45-9acc-6b41bd8fc2db req-9094d881-d5f0-49b5-b805-9310d3cb6581 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.499823 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5a8bfa38-4581-4b45-9acc-6b41bd8fc2db req-9094d881-d5f0-49b5-b805-9310d3cb6581 service nova] Creating event network-vif-plugged:9ecfc92a-e2cd-40fc-81ca-477cef1fa879 for instance e38eb051-6410-4f8b-a4d6-19da70665a57 on n-h2-858384-17 Oct 31 15:28:50.516681 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5a8bfa38-4581-4b45-9acc-6b41bd8fc2db req-9094d881-d5f0-49b5-b805-9310d3cb6581 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108240 Oct 31 15:28:50.518137 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1354/2875] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:50.547346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:50.549536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:50.580028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.582795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.584416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.587215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.587964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.592021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.725032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:50.740486 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-199ba4e2-56a4-4422-b9e2-aaa85064043a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1321 microversion: 2.1 time: 0.985089 Oct 31 15:28:50.773085 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1522/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:49 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1321 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:50.779137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:50.779995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:50.788320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.790420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.792111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:50.793528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:50.794222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:50.794885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:51.446186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.458700 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d5c9e0a-963b-4a15-a773-0a3911870a08 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1327 microversion: 2.1 time: 0.938215 Oct 31 15:28:51.460645 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1355/2877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:50 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1327 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:51.477967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:51.478747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:51.488671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:51.489639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:51.495191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:51.496211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:51.496842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:51.497623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:51.638175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.655480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.678289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.726633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:51.793213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-271ddde8-749a-40cc-b0d4-1151b57b1b3c tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.312207 Oct 31 15:28:51.833830 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1356/2878] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:51 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:51.852982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:51.872344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:51.900315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:51.900828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:51.901310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:51.902033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:51.902499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:51.902929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:51.940606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:51.951832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-06e5b194-1b86-4f83-ae56-f06c1d0ca9fa tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 1.176989 Oct 31 15:28:51.952456 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1523/2879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:50 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:51.978149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-bd4a3e36-f801-40c7-8be6-a2e55c78e989 req-23c8d4b1-d0ca-4d29-b231-14926532c4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31", "tag": "389b4a68-c090-4f88-9861-9c3a4c38b425"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:28:52.017948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bd4a3e36-f801-40c7-8be6-a2e55c78e989 req-23c8d4b1-d0ca-4d29-b231-14926532c4dd service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.021617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bd4a3e36-f801-40c7-8be6-a2e55c78e989 req-23c8d4b1-d0ca-4d29-b231-14926532c4dd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.022699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bd4a3e36-f801-40c7-8be6-a2e55c78e989 req-23c8d4b1-d0ca-4d29-b231-14926532c4dd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.085059 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-bd4a3e36-f801-40c7-8be6-a2e55c78e989 req-23c8d4b1-d0ca-4d29-b231-14926532c4dd service nova] Creating event network-changed:389b4a68-c090-4f88-9861-9c3a4c38b425 for instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 on n-h1-858384-17 Oct 31 15:28:52.108963 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-bd4a3e36-f801-40c7-8be6-a2e55c78e989 req-23c8d4b1-d0ca-4d29-b231-14926532c4dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129689 Oct 31 15:28:52.117601 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1524/2880] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:28:52.485454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:52.486221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:52.500789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:52.501549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.502356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.507458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.511422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.512379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.513045 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-74c109dc-2742-45fa-aec2-d2de9c22ac91 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1321 microversion: 2.1 time: 0.677598 Oct 31 15:28:52.513244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.534806 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1357/2881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:51 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1321 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:52.582951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:52.835722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:52.836471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:52.843399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=22 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:52.848244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.852264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.852823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:52.854962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:52.856177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:52.859657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.032141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:53.049202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:53.055749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:53.072578 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e2ffbbc-c7b7-472a-9cbb-ebdda37e3219 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.242066 Oct 31 15:28:53.075753 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1358/2882] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:52 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:53.090377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:53.091340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:53.127543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.130503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.131804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.132767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.133684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.134353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.659512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:53.674899 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f140cff-47a1-4e7a-801f-6f1ae4a9e6f5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1327 microversion: 2.1 time: 1.192304 Oct 31 15:28:53.678911 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1525/2883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:52 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1327 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:53.690850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:53.691854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:53.709585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:53.716624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.717628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.718397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.725622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:53.727003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:53.727887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:53.756243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:53.766983 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f108cc55-9054-4f26-b591-afeffa82892c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.686151 Oct 31 15:28:53.782134 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1359/2884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:53 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:54.110324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:54.111017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:54.140541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.141278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.144152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.148196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.149286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.153428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.420702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:54.437649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:54.441967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:54.454736 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-88f2fc4a-fcc3-4be3-b2fb-8083a3e8a9bc tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.352162 Oct 31 15:28:54.456005 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1360/2885] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:54 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:54.702497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:54.704255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:54.741019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.748467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.750654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.751626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:54.752646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:54.761913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:54.767291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:28:55.158830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:55.169837 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5383411-a6c0-4b5a-9456-e4c2dcacc93e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1327 microversion: 2.1 time: 0.471535 Oct 31 15:28:55.172552 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1361/2886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:54 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1327 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:55.183783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:55.185697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:55.200503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.201617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.202781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.203843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.205398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.206109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.280766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:55.292476 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b27b5e50-1e92-404b-b4b9-5f9e06a3451d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1321 microversion: 2.1 time: 1.610668 Oct 31 15:28:55.295563 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1526/2887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:53 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1321 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:55.492452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:55.493679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:55.507252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.508534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.509167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.510163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.510785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.511660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.759975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:55.772861 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-31cbf15b-d1c8-4166-b62e-69c4df96e077 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1523 microversion: 2.1 time: 0.598179 Oct 31 15:28:55.773596 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1362/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:55 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1523 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:55.793776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:55.794735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:55.804814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.807480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.808121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:55.809975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:55.812787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:55.814823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.171262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.184123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.185675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.187008 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5bbfeff4-0f5e-423e-9ac3-7fb442015bba tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2949 microversion: 2.42 time: 0.412120 Oct 31 15:28:56.225692 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1363/2889] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:55 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2949 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:56.230827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:56.231696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:56.248270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.248932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.250984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.253919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.254745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.257454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.375166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.415240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.427653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.451044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22689e8b-fd41-4a87-b832-abf2d86d054f tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.964853 Oct 31 15:28:56.459949 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1527/2890] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:55 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:28:56.481054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35b9746f-18c4-4878-98ba-7acb01e2f008 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:56.482283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35b9746f-18c4-4878-98ba-7acb01e2f008 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:56.517150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35b9746f-18c4-4878-98ba-7acb01e2f008 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.518374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35b9746f-18c4-4878-98ba-7acb01e2f008 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.521610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35b9746f-18c4-4878-98ba-7acb01e2f008 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.522905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35b9746f-18c4-4878-98ba-7acb01e2f008 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.526590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35b9746f-18c4-4878-98ba-7acb01e2f008 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.528143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35b9746f-18c4-4878-98ba-7acb01e2f008 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.797983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:56.809071 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98d805e4-4ba3-4217-90b2-ff0a9986c1b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1327 microversion: 2.1 time: 0.582170 Oct 31 15:28:56.810026 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1364/2891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:56 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1327 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:56.838308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:56.841832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:56.854758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.855659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.856291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.857316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:56.857930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:56.858504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:56.977864 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35b9746f-18c4-4878-98ba-7acb01e2f008 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.515395 Oct 31 15:28:56.978767 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1528/2892] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 31 15:28:56 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da/os-interface => generated 1831 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:56.985760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:56.988864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:57.001613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.002796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.003476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.005570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.006480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.007566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.397535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:57.411807 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b01a5d58-8c91-40c9-b819-c37c6e202411 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1321 microversion: 2.1 time: 0.582102 Oct 31 15:28:57.412837 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1365/2893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:56 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1321 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:57.502070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:57.502967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:57.524637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.525810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.527397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.529522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.531012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.532822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.708823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:57.742396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:57.744270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:57.781508 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc22cad4-bd2d-4edd-911c-48cc6088fb41 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.294466 Oct 31 15:28:57.798718 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1366/2894] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:57 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:57.839267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:57.839966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:57.871205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.871721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.872164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.872889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:57.873587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:57.873873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:57.996452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:58.061840 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b26b2715-3247-4c1f-9d88-923a6cdc36fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1505 microversion: 2.1 time: 1.079455 Oct 31 15:28:58.070914 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1529/2895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:56 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1505 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:58.440011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:58.441090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:58.459328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.465217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:58.476592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.485204 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c62e0c5e-4632-4a98-a8bc-8fba2c93b4d1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1327 microversion: 2.1 time: 0.651869 Oct 31 15:28:58.485693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.491885 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1367/2896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:57 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1327 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:58.497624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.507616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.515786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.816328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:58.817233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:58.838793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.844051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.845016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:58.845965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:58.848492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:58.854257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.117976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.141368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.142883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.171652 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-274934d9-bd23-4582-b252-3ad834f2c9ea tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.362018 Oct 31 15:28:59.198382 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1368/2897] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:28:58 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:28:59.211972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:59.216730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:59.230501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.232695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.233394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.234731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.237555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.239807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.399150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.425947 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8716a1d3-b6c5-48c1-aa46-c555fb200f38 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1321 microversion: 2.1 time: 0.990363 Oct 31 15:28:59.432937 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1530/2898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:58 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1321 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:28:59.513482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:28:59.514251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:28:59.537286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.538295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.540282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.542308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:28:59.545571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:28:59.546301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:28:59.623883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:28:59.633085 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dca890a-ecf5-45e2-9515-2925dfee8000 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1505 microversion: 2.1 time: 0.432638 Oct 31 15:28:59.633710 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1369/2899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:59 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:28:59.983962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-32134282-f6ed-46b6-af85-880ce96701db req-42846f92-f98b-4725-b06b-4d05a766a7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4aa745-9180-42f8-9ccd-5c286351fd50", "name": "network-vif-plugged", "status": "completed", "tag": "64770c5f-870a-4838-9f15-799163477f87"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:00.003017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-32134282-f6ed-46b6-af85-880ce96701db req-42846f92-f98b-4725-b06b-4d05a766a7ad service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.003837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-32134282-f6ed-46b6-af85-880ce96701db req-42846f92-f98b-4725-b06b-4d05a766a7ad service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.006264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-32134282-f6ed-46b6-af85-880ce96701db req-42846f92-f98b-4725-b06b-4d05a766a7ad service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.015235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:00.026819 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e717f55b-ca9d-46d7-aa02-c5ad836249ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1327 microversion: 2.1 time: 0.516839 Oct 31 15:29:00.041778 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1531/2900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:28:59 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1327 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:00.056062 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-32134282-f6ed-46b6-af85-880ce96701db req-42846f92-f98b-4725-b06b-4d05a766a7ad service nova] Creating event network-vif-plugged:64770c5f-870a-4838-9f15-799163477f87 for instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 on n-h1-858384-17 Oct 31 15:29:00.070386 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-32134282-f6ed-46b6-af85-880ce96701db req-42846f92-f98b-4725-b06b-4d05a766a7ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086202 Oct 31 15:29:00.073040 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1370/2901] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:29:00.217467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:00.222999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:00.237447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.237949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.238386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.239117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.239745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.245177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.407684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:00.447312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:00.451889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:00.476123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:00.477563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:00.484118 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4586f10d-74bb-4495-a83e-dd92326b3df1 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.272907 Oct 31 15:29:00.497250 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1532/2902] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:00 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:00.516339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.518500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.520445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.524563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.525431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.543383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.662619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:00.663418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:00.677865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.678838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.679608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:00.682591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:00.683326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:00.686164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:01.094514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.106394 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aebf9301-332c-4e3e-8b0f-1166844bfd05 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1505 microversion: 2.1 time: 0.449167 Oct 31 15:29:01.108805 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1533/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:00 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:01.139258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:01.147995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:01.168508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:01.171175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:01.171658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:01.178443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:01.179196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:01.179819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:01.648277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.663807 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00e0cff7-00cf-4c4e-8cba-be164920f826 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1321 microversion: 2.1 time: 1.212350 Oct 31 15:29:01.672469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.679760 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1371/2904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:00 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1321 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:01.687054 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f49402d9-7750-46fe-a718-698df875d5b4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1327 microversion: 2.1 time: 0.574299 Oct 31 15:29:01.702420 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1534/2905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:01 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1327 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:01.702797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:01.703514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:01.719023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:01.721765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:01.722427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:01.725003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:01.725684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:01.726280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:01.906784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.919732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.921845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:01.942692 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8de44c8e-47b9-4655-a0ce-3566a6963629 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.255000 Oct 31 15:29:01.944355 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1372/2906] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:01 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:02.133928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:02.134739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:02.148500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.149004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.162805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.163846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.178669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.179940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.331766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9f0b9223-4281-4631-862b-c3e1ebe601e3 req-59c615e5-9d74-4820-9435-0bb5ce30fc24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30932182-ff62-4e04-a97c-d0c80577089f", "name": "network-vif-unplugged", "status": "completed", "tag": "ef93582f-e5e2-493d-b6c4-4b6f4f126e30"}, {"server_uuid": "45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31", "name": "network-vif-plugged", "status": "completed", "tag": "389b4a68-c090-4f88-9861-9c3a4c38b425"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:02.395052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9f0b9223-4281-4631-862b-c3e1ebe601e3 req-59c615e5-9d74-4820-9435-0bb5ce30fc24 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.400825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9f0b9223-4281-4631-862b-c3e1ebe601e3 req-59c615e5-9d74-4820-9435-0bb5ce30fc24 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.402082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9f0b9223-4281-4631-862b-c3e1ebe601e3 req-59c615e5-9d74-4820-9435-0bb5ce30fc24 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.469357 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9f0b9223-4281-4631-862b-c3e1ebe601e3 req-59c615e5-9d74-4820-9435-0bb5ce30fc24 service nova] Creating event network-vif-unplugged:ef93582f-e5e2-493d-b6c4-4b6f4f126e30 for instance 30932182-ff62-4e04-a97c-d0c80577089f on n-h2-858384-17 Oct 31 15:29:02.481344 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9f0b9223-4281-4631-862b-c3e1ebe601e3 req-59c615e5-9d74-4820-9435-0bb5ce30fc24 service nova] Creating event network-vif-plugged:389b4a68-c090-4f88-9861-9c3a4c38b425 for instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 on n-h1-858384-17 Oct 31 15:29:02.518607 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9f0b9223-4281-4631-862b-c3e1ebe601e3 req-59c615e5-9d74-4820-9435-0bb5ce30fc24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.200342 Oct 31 15:29:02.533685 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1373/2907] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:29:02.570589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:02.581668 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c1b9284-b202-46c6-9edc-82cc890d6922 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 200 len: 1508 microversion: 2.1 time: 0.452874 Oct 31 15:29:02.582710 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1535/2908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:02 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:02.620958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:02.622565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:02.630713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.631377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.632006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.633003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.633723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.634438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.676360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:29:02.691911 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Working on deleting snapshot 3e7fef3f-9a5a-4dd3-8fff-8830603d48f2 from shelved instance... Oct 31 15:29:02.695555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:02.696366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:02.711958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.712513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.712952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:02.716547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:02.717032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:02.717494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.212184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:03.240787 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76f912c1-4471-46a7-a716-d1ee6ffa27e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1514 microversion: 2.1 time: 0.540395 Oct 31 15:29:03.244839 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1536/2909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:02 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1514 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:03.279417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:03.280814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:03.296244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.296755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.299463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.300686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.304401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.305352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.576936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:03.594419 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b2e2ffeb-26d3-4959-8aa6-d6d6becda1ed tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1327 microversion: 2.1 time: 0.333337 Oct 31 15:29:03.606173 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1537/2910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:03 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1327 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:03.606412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:03.607069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:03.629675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.632069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.632845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.635106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:03.639401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:03.640249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:03.900990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:03.921402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:03.926777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:03.944710 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f1f2cee0-78c8-4c6e-bb71-0138a2df1e23 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 0.346232 Oct 31 15:29:03.948942 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1538/2911] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:03 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:03.982290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:03.993875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:04.014804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.015454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.016046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:04.019561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.020074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.030796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:04.098039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lazy-loading 'flavor' on Instance uuid 6a4aa745-9180-42f8-9ccd-5c286351fd50 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:04.374861 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9cffef1a-d3d3-4e8c-b328-e536d7da217e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50/action" status: 200 len: 32 microversion: 2.1 time: 0.418082 Oct 31 15:29:04.375841 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1539/2912] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:03 2022] POST /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:04.388266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:04.389700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:04.405329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.418949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.419819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:04.420823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.423601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.428369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:04.439960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Doing local delete in cell 0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) {{(pid=120588) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 31 15:29:04.441398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.443050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.444793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:04.445530 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 31 15:29:04.451707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] deallocate_for_instance() {{(pid=120588) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 31 15:29:04.473286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:04.849929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:04.863992 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a8946d84-ddba-4131-bb98-01c95cb98c42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.479796 Oct 31 15:29:04.865325 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1540/2913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:04 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:04.897515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:04.901213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:04.923302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.924670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.925529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:04.926506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:04.927232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:04.928149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:05.476709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:05.492254 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc1b28ab-96b3-494b-b1bb-7adfc78f3dad tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1507 microversion: 2.1 time: 0.608036 Oct 31 15:29:05.492874 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1541/2914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:04 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1507 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:05.498189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:05.498802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:05.538099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:05.538742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:05.541221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:05.541840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:05.542317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:05.542764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.165057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Updating instance_info_cache with network_info: [] {{(pid=120588) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:29:06.525371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:06.539887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:06.545400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:06.558238 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6b4f0531-623c-4da1-8fc9-130f2c623ab9 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1544 microversion: 2.91 time: 1.063552 Oct 31 15:29:06.559916 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1542/2915] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:05 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1544 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:06.570448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:06.572557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:06.587456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:06.588214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:06.588865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.589831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:06.590871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:06.591518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.812746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:06.815572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:06.834313 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6efd309a-b7c1-42c8-b89b-a0441482763e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1507 microversion: 2.1 time: 0.271032 Oct 31 15:29:06.835170 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1543/2916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:06 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:06.850641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:06.857989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:06.865816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:06.866649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:06.867088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.867825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:06.868283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:06.868709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.889935 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ee57c7c0-7c42-4fe0-9473-96e92ade9e77 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 204 len: 0 microversion: 2.1 time: 4.273790 Oct 31 15:29:06.891013 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1374/2917] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:29:02 2022] DELETE /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 0 bytes in 4276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:29:06.900420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8feff444-22ad-42dc-8b10-0c1949070950 req-312bcaa5-4d90-4d60-9bec-f705b6e32d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30932182-ff62-4e04-a97c-d0c80577089f", "name": "network-vif-deleted", "tag": "ef93582f-e5e2-493d-b6c4-4b6f4f126e30"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:06.914672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8feff444-22ad-42dc-8b10-0c1949070950 req-312bcaa5-4d90-4d60-9bec-f705b6e32d9b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:06.915462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8feff444-22ad-42dc-8b10-0c1949070950 req-312bcaa5-4d90-4d60-9bec-f705b6e32d9b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:06.916075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8feff444-22ad-42dc-8b10-0c1949070950 req-312bcaa5-4d90-4d60-9bec-f705b6e32d9b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:06.934231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.server_external_events [req-8feff444-22ad-42dc-8b10-0c1949070950 req-312bcaa5-4d90-4d60-9bec-f705b6e32d9b service nova] Unable to find a host for instance 30932182-ff62-4e04-a97c-d0c80577089f. Dropping event network-vif-deleted {{(pid=120588) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 15:29:06.935392 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8feff444-22ad-42dc-8b10-0c1949070950 req-312bcaa5-4d90-4d60-9bec-f705b6e32d9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.041165 Oct 31 15:29:06.936168 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1375/2918] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 15:29:06.941888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1295121785", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f59d35fa-6b47-44b5-897e-f9d27d74a129"}], "security_groups": [{"name": "tempest-securitygroup--765321230"}], "key_name": "tempest-keypair-451473178", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5cd02114-3f22-44e7-8151-5b8509af1ae1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:07.046104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:07.055003 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f3e3ed4-072f-4175-aa99-16213703eacd tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.215566 Oct 31 15:29:07.055882 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1544/2919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:06 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:07.060633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:07.061447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:07.068389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.069569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.070271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.071185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.071891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.072550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.107505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:29:07.185010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] validate_networks() for [('f59d35fa-6b47-44b5-897e-f9d27d74a129', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:07.246825 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4254458a-aabc-41c8-acec-209cae31d9c4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 204 len: 0 microversion: 2.1 time: 0.189171 Oct 31 15:29:07.247882 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1545/2920] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:29:07 2022] DELETE /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:29:07.255588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:07.256305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:07.270325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.270554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.273687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.274762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.275391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.277678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.304257 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f HTTP/1.1 Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '30932182-ff62-4e04-a97c-d0c80577089f'} Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:07.306774 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-048d992e-afd7-4378-bf6c-f9837dfa01b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 404 len: 111 microversion: 2.1 time: 0.059763 Oct 31 15:29:07.313308 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1546/2921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:07 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:07.353513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:07.354158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:07.375302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.378099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.379221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.383910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.384762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.386542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.699734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:07.724896 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21aa7a73-8fd3-4c7c-8c2f-4449cde56a4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1513 microversion: 2.1 time: 0.409069 Oct 31 15:29:07.725824 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1547/2922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:07 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:07.737769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:07.738384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:07.777413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.782190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.789714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.790494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:07.790975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:07.791403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:07.934447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:07.951880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:07.954015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Getting quotas for project 64267a3a68804df186c862f2a2ab052e. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:07.955664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:07.970961 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a72eca5-a9f3-42a1-8460-8be590d581c8 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1531 microversion: 2.91 time: 0.244068 Oct 31 15:29:07.977216 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1548/2923] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:07 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1531 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:07.977851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Getting quotas for user 4e36ab46973945e98ebee270c794be87 and project 64267a3a68804df186c862f2a2ab052e. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:07.983807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-914436624", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "c356d61f-2e01-42fa-9c99-c94fb61838ec"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:08.001781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:08.004089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:08.005840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:08.006505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:08.007105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:08.007674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:08.029834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.031315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.031932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:08.033017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.033947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.034551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:08.099998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Getting quotas for project 64267a3a68804df186c862f2a2ab052e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:08.100438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] validate_networks() for [('c356d61f-2e01-42fa-9c99-c94fb61838ec', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:08.136638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Getting quotas for user 4e36ab46973945e98ebee270c794be87 and project 64267a3a68804df186c862f2a2ab052e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:08.243685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:08.246776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5cd02114-3f22-44e7-8151-5b8509af1ae1',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:08.499811 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb1871f4-0ce0-4c48-a1cc-d2a784fb92fc tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.562397 Oct 31 15:29:08.501009 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1376/2924] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:08.506234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:08.507038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:08.518999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.519836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.521296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:08.522640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.523122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.523671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:08.706450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] Lazy-loading 'services' on Instance uuid 7d83eacf-e291-41a0-9527-35e637519251 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:08.768692 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11f0da4f-9af4-4c98-8f2c-15667fdae68c tempest-UnshelveToHostMultiNodesTest-259917390 tempest-UnshelveToHostMultiNodesTest-259917390-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1938 microversion: 2.91 time: 0.262289 Oct 31 15:29:08.772907 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1377/2925] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:08 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1938 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:08.814275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:08.815725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:08.853605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.854327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.855578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:08.857060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:08.857568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:08.858003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.135902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.142514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:09.143500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:09.144168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:09.144737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:09.145340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:09.148213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5296bd41-44f3-45e4-92a4-8d0c51d94984 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.372806 Oct 31 15:29:09.162037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.163944 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1378/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:08 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:09.167023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.167715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.168515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.169036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.169714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.186055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ccf09c7a-188b-4791-8657-f87043e99021 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:09.188704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccf09c7a-188b-4791-8657-f87043e99021 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:09.190923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:09.197930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for user 93f77a1d41fd431d9da6587e0ca9cb1e and project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:09.214842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:09.218431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:09.293663 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b8fe05d-bbd9-440f-bc5a-df79506b0494 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314919 Oct 31 15:29:09.295091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1549/2927] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:09.301753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:09.303258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:09.311184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.312220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.312994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.313969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.314635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.315215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.334171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ccf09c7a-188b-4791-8657-f87043e99021 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.344093 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ccf09c7a-188b-4791-8657-f87043e99021 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1121 microversion: 2.1 time: 0.176521 Oct 31 15:29:09.347543 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1379/2928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:09 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1121 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:09.363538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:09.365465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:09.383118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.383614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.387483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.388427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.389055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.389659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.469603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:29:09.634160 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a617f4db-334c-4f41-978e-dc41f78515c0 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 204 len: 0 microversion: 2.91 time: 0.284790 Oct 31 15:29:09.635407 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1380/2929] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:29:09 2022] DELETE /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:29:09.652603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe0c648c-f60a-41e0-a716-247ef372dd94 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:09.654265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe0c648c-f60a-41e0-a716-247ef372dd94 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:09.695081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.710328 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-97197b14-79f2-4e0b-9f1d-2990e64ef1f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1513 microversion: 2.1 time: 0.412901 Oct 31 15:29:09.721186 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1550/2930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:09 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:09.721389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:09.722161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:09.731915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.733299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.733989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.735066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:09.735999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:09.737530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:09.831352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe0c648c-f60a-41e0-a716-247ef372dd94 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.840165 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe0c648c-f60a-41e0-a716-247ef372dd94 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1214 microversion: 2.1 time: 0.202528 Oct 31 15:29:09.842479 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1381/2931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:09 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:09.941226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.963114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.967664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:09.983941 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-91792384-86e4-491a-b7b6-b910c61c4a00 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.269492 Oct 31 15:29:09.986840 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1551/2932] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:09 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:10.173258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:10.174272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:10.204519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.206511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.208791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.210514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.212372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.212926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.254009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ca2e6161-11f0-412b-ad3c-9e577b8ec9c1 req-c77febf1-29f1-4b2a-b308-fc301a3d29ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31", "name": "network-vif-deleted", "tag": "389b4a68-c090-4f88-9861-9c3a4c38b425"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:10.277034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ca2e6161-11f0-412b-ad3c-9e577b8ec9c1 req-c77febf1-29f1-4b2a-b308-fc301a3d29ec service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.296465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ca2e6161-11f0-412b-ad3c-9e577b8ec9c1 req-c77febf1-29f1-4b2a-b308-fc301a3d29ec service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.297185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ca2e6161-11f0-412b-ad3c-9e577b8ec9c1 req-c77febf1-29f1-4b2a-b308-fc301a3d29ec service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.343430 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ca2e6161-11f0-412b-ad3c-9e577b8ec9c1 req-c77febf1-29f1-4b2a-b308-fc301a3d29ec service nova] Creating event network-vif-deleted:389b4a68-c090-4f88-9861-9c3a4c38b425 for instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 on n-h1-858384-17 Oct 31 15:29:10.382326 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ca2e6161-11f0-412b-ad3c-9e577b8ec9c1 req-c77febf1-29f1-4b2a-b308-fc301a3d29ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130418 Oct 31 15:29:10.387219 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1552/2933] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:29:10.402250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:10.406986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:10.417161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.418554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.419186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.422473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.423158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.424049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.508818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:10.519143 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a77df81f-547f-4b31-8e7d-636196d3e9cf tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1219 microversion: 2.1 time: 0.130381 Oct 31 15:29:10.521849 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1553/2934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:10 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:10.564397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:10.588439 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c56a562-bb93-4628-842b-5f8b9edde2d9 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.419432 Oct 31 15:29:10.589049 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1382/2935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:10 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:10.736080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:10.736770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:10.744960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.745712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.746332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.747238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.748001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.748597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.782210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.782698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.783128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.783568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lazy-loading 'fault' on Instance uuid 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:10.831513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:10.841165 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-58f1f31f-d792-4c00-9ccb-0c89755d5d00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 200 len: 1317 microversion: 2.1 time: 0.108943 Oct 31 15:29:10.842553 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1554/2936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:10 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 1317 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:10.869550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:10.870386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:10.879082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.880258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.881638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.883654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:10.883654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:10.884806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:10.960471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:10.970732 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb221536-007e-4ac7-a73b-9899c79b34ad tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1218 microversion: 2.1 time: 0.107579 Oct 31 15:29:10.971511 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1383/2937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:10 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:11.021510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:11.022137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:11.029300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.030192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.031859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:11.033061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.034165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.034998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:11.124675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:11.135467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:11.136822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:11.141978 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-611093ae-1717-4529-8dd8-38be88bb2d36 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1537 microversion: 2.91 time: 0.125253 Oct 31 15:29:11.149187 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1555/2938] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:11 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1537 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:11.549618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:11.550793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:11.582056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.582569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.583544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:11.584490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.584972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.585421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:11.613594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:11.614894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:11.627448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.628053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.628591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:11.629406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.630099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.630720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:11.694256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:11.704978 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77c8ca0f-1c3b-4623-8dd2-5b49dceaed77 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1219 microversion: 2.1 time: 0.160860 Oct 31 15:29:11.705816 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1384/2939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:11 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:11.830429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:11.839507 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d44b6b8b-0c7e-4e25-9c5b-2365c6ce445b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.229993 Oct 31 15:29:11.840265 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1556/2940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:11 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:11.868243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:11.868862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:11.874812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.875540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.875983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:11.876686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:11.877161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:11.877874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:11.893994 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 HTTP/1.1 Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31'} Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:11.896016 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:11.900509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:11.900509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:11.900509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:11.900509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:11.900509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:11.900509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:29:11.900509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:11.901727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:11.902966 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa755dc3-2dc2-49e1-ba62-a28413c88240 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 404 len: 111 microversion: 2.1 time: 0.039576 Oct 31 15:29:11.904027 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1385/2941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:11 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:11.913284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-800523cc-977a-4194-998e-ff119cc5851a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '.version_select at 0x7f16e553edc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:11.933271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:11.941865 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-800523cc-977a-4194-998e-ff119cc5851a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-232044772" status: 202 len: 0 microversion: 2.1 time: 0.032848 Oct 31 15:29:11.943439 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1557/2942] 10.222.0.20 () {58 vars in 1206 bytes} [Mon Oct 31 15:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-232044772 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:29:12.009744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:12.010453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:12.027301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:12.028336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:12.028933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:12.029935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:12.030791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:12.031460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:12.095160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1316828502", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "2b5355db-9171-4de8-abb5-5f94412a242a"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:12.167766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:12.181875 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d42b276-c016-4c39-b65e-c1c0e41d8114 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1210 microversion: 2.1 time: 0.190277 Oct 31 15:29:12.213415 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1386/2943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:11 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:12.220366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:12.230413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:12.231112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] validate_networks() for [('2b5355db-9171-4de8-abb5-5f94412a242a', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:12.252708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:12.253230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:12.253869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:12.255034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:12.255800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:12.256607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:12.327246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:12.331520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:12.333569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:12.334391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lazy-loading 'fault' on Instance uuid 7d83eacf-e291-41a0-9527-35e637519251 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:12.431828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:12.441384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:12.442874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31814b32da6a421f805503567a66d420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb752b227b2b4eb89fcbb70a6140df20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:12.457301 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e5dfec03-9bba-4544-adb5-e556a1e22f2a tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 200 len: 1542 microversion: 2.91 time: 0.242403 Oct 31 15:29:12.461897 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1387/2944] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:12 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 1542 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:29:12.729875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:12.730547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:12.744090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:12.745919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:12.747387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:12.748370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:12.751232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:12.752696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:12.957423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:12.967302 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a5dfcb4-6c69-4fce-9747-98dd7aa72095 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1237 microversion: 2.1 time: 0.241543 Oct 31 15:29:12.998395 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1388/2945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:12 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1237 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:13.003707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:13.005032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:13.030405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.032956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.035114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:13.037946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.039134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.039802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:13.040344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:13.040798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:13.041253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:13.041800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:13.042697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:13.059795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.061865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.068555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:13.069712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.070362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.071015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:13.093823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:13.117665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:13.135599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for user 31cd28d777ac40eda1a7abefb5a3256d and project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:13.165861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:13.172158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:13.306335 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d7d26da-687a-4e1c-b460-86864528e1d6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214350 Oct 31 15:29:13.307926 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1558/2946] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:29:13.336607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:13.340541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:13.353911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.354864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.355855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:13.356759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.357413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.358000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:13.445302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:13.452805 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c06a26b4-925f-4402-a235-116757b27f88 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1272 microversion: 2.1 time: 0.142017 Oct 31 15:29:13.453512 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1559/2947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:13 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:13.460319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-699b67a6-5ad1-47a2-8050-a68f668ee9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:13.460944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-699b67a6-5ad1-47a2-8050-a68f668ee9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:13.675925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-699b67a6-5ad1-47a2-8050-a68f668ee9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:13.689925 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-699b67a6-5ad1-47a2-8050-a68f668ee9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1209 microversion: 2.1 time: 0.234240 Oct 31 15:29:13.691740 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1560/2948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:13 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1209 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:13.866940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:13.877242 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70279f88-54b1-41d1-a484-98c18fdd2a1f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.877299 Oct 31 15:29:13.882793 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1389/2949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:12 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:13.895245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:13.897965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] [instance: 7d83eacf-e291-41a0-9527-35e637519251] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:13.915542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.916328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.917086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:13.918527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:13.919247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:13.919914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:13.938329 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] HTTP exception thrown: Instance 7d83eacf-e291-41a0-9527-35e637519251 could not be found. Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Request method failure captured: Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 HTTP/1.1 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-kKmO90c2hRnMWwjEVlRzjDpL8-mfk9sxQtaT0YWfIWQsK6wNw-BOe-Y-8NU43h-mACAG9H3V_nbJAhN_URILZiPfjobHMFM5qg3rdAaEeS9MOiFMF7T23yAOG2Y7DrcamyIbguttN20DdgrAyEQySvWBPIvCCOHTx3IV4iqQcyWTE Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.91 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: eb752b227b2b4eb89fcbb70a6140df20 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-549087393 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb752b227b2b4eb89fcbb70a6140df20"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_eb752b227b2b4eb89fcbb70a6140df20", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/eb752b227b2b4eb89fcbb70a6140df20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/eb752b227b2b4eb89fcbb70a6140df20"}]}] Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-549087393 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: eb752b227b2b4eb89fcbb70a6140df20 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-549087393 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-UnshelveToHostMultiNodesTest-549087393-project Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31814b32da6a421f805503567a66d420 Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-549087393-project Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 7d83eacf-e291-41a0-9527-35e637519251 could not be found. Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '7d83eacf-e291-41a0-9527-35e637519251'} Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d83eacf-e291-41a0-9527-35e637519251 could not be found. Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d83eacf-e291-41a0-9527-35e637519251 could not be found. Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:13.940257 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:13.944307 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:13.944307 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:13.944307 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:13.944307 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:13.944307 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:13.944307 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:13.944307 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d83eacf-e291-41a0-9527-35e637519251 could not be found. Oct 31 15:29:13.944307 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:13.947229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] Returning 404 to user: Instance 7d83eacf-e291-41a0-9527-35e637519251 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:13.948524 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7cdaead8-e574-45fd-a625-cc0deabcc904 tempest-UnshelveToHostMultiNodesTest-549087393 tempest-UnshelveToHostMultiNodesTest-549087393-project] 10.222.0.20 "GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251" status: 404 len: 111 microversion: 2.91 time: 0.063119 Oct 31 15:29:13.951247 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1390/2950] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:29:13 2022] GET /compute/v2.1/servers/7d83eacf-e291-41a0-9527-35e637519251 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:29:13.996354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:13.997412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:14.007142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:14.010062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:14.012718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:14.013903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:14.015621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:14.017980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:14.044102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-896195748", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:14.173481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:14.177934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:UPDATE=11,nova_cell1:DELETE=2,nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:14.194930 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ad48134-7f1a-499e-8679-866693d87c1a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1237 microversion: 2.1 time: 0.203729 Oct 31 15:29:14.195329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:14.199468 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1391/2951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:13 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1237 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:14.481261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:14.482117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:14.503801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:14.505243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:14.506034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:14.507180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:14.507861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:14.508502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:14.655648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:14.665407 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b21d08a-65e5-44ce-92e3-4c33e9534933 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1272 microversion: 2.1 time: 0.188601 Oct 31 15:29:14.689172 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1392/2952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:14 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:14.718439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:14.719280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:14.732642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:14.733505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:14.734289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:14.735299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:14.735941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:14.736551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:14.795598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:14.796284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:14.797307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:14.797916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:14.798662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:14.815099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:14.822930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:14.824651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:14.827752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:14.829008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:14.831640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:14.877986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Getting quotas for project d2ed234b3d934b4787f7a25c9b3253f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:14.888591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Getting quotas for user 8e44ce84068f48e19a71e92e53ded700 and project d2ed234b3d934b4787f7a25c9b3253f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:14.920743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:14.923649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:15.009698 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da3bf6ac-4dae-4a1e-87a3-9123b23d532a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314842 Oct 31 15:29:15.010808 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1561/2953] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:15.023182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:15.025565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:15.039235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.040077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.042393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:15.044272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.048105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.048834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:15.750835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:15.760173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:15.761988 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-59387340-5eb9-4e71-9317-5cc6e6952881 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.748665 Oct 31 15:29:15.773155 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1562/2954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:15 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:15.773485 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7aae715-a2c6-43e6-b3af-3ed8f0b2bdb0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1261 microversion: 2.1 time: 1.055524 Oct 31 15:29:15.775984 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1393/2955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:14 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1261 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:15.792476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:15.793890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd8c14d9-cbf3-4ffe-926d-a72c905487df tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:15.794510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd8c14d9-cbf3-4ffe-926d-a72c905487df tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:15.794964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:15.812860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.813541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.814207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:15.815163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.815839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.816540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:15.954135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd8c14d9-cbf3-4ffe-926d-a72c905487df tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:15.966922 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd8c14d9-cbf3-4ffe-926d-a72c905487df tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1218 microversion: 2.1 time: 0.202028 Oct 31 15:29:15.968331 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1563/2956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:15 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1218 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:15.980536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:15.981452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:15.996572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.997212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.997731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:15.998594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:15.999052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:15.999549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:16.342007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:16.367001 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75e5c237-6942-453e-a716-584dd2e338a6 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1304 microversion: 2.1 time: 0.588865 Oct 31 15:29:16.369421 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1394/2957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:15 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1304 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:16.789590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:16.790256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:16.799128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:16.799983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:16.800628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:16.801723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:16.802554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:16.803169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:17.294897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:17.312433 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a96814bf-8a9a-434e-92a8-a6c2b6ef5284 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 1.341547 Oct 31 15:29:17.328700 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1564/2958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:15 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:17.341768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:17.342685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:17.360927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:17.363220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:17.363845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:17.367373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:17.368967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:17.371180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:17.506583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:17.523331 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-885dd319-7d6c-4573-94ea-6749f946919f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.739386 Oct 31 15:29:17.524093 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1395/2959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:16 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:17.529584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:17.535142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:17.555879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:17.556512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:17.557597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:17.562102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:17.562860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:17.564003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:17.893570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:17.923983 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aee66b80-c635-44c2-a23b-843b3c874f17 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1276 microversion: 2.1 time: 0.398699 Oct 31 15:29:17.927996 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1396/2960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:17 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1276 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:17.934689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:17.935672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:17.963481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:17.964567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:17.965410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:17.966539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:17.967377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:17.968241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:18.073370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:18.243484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:18.260444 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b50f4212-935c-4d1e-8d15-bad16eb81d2d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1309 microversion: 2.1 time: 0.930339 Oct 31 15:29:18.261725 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1565/2961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:17 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1309 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:18.361283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:18.362868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:18.378764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:18.381498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:18.382391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:18.383951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:18.386110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:18.386835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:18.399333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:18.412875 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-560208b5-b9a6-4ba7-9bec-604bd31fcb83 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1304 microversion: 2.1 time: 0.483460 Oct 31 15:29:18.414491 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1397/2962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:17 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1304 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:18.555298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:18.556639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:18.601021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:18.602238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:18.616187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:18.618874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:18.619982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:18.620749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:18.763050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:18.782834 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34ab9a36-49f3-4b18-9f28-271b9ecf94c6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 0.426078 Oct 31 15:29:18.802341 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1566/2963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:18 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:18.949971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:18.950902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:18.980578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:18.981511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:18.982308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:18.983593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:18.984275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:18.985073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:18.991263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:19.003745 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92000d0b-5f67-4b42-bf64-422befa289bc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.457591 Oct 31 15:29:19.005526 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1398/2964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:18 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:19.141040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e4e88f56-65f1-4938-b2fa-4e002acfedd6 req-27ea925e-4b38-4637-8a46-f525b4556aed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb368d4-cee6-41ca-9cbe-1c86ad8b1011", "tag": "8fad434c-d880-48f1-8359-60a9b0ddb47d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:19.144912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:19.159291 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4215188-2c55-44c9-8f0f-758f721569e0 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1276 microversion: 2.1 time: 0.212973 Oct 31 15:29:19.162643 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1567/2965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:18 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:19.165038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e4e88f56-65f1-4938-b2fa-4e002acfedd6 req-27ea925e-4b38-4637-8a46-f525b4556aed service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.165567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e4e88f56-65f1-4938-b2fa-4e002acfedd6 req-27ea925e-4b38-4637-8a46-f525b4556aed service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.166186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e4e88f56-65f1-4938-b2fa-4e002acfedd6 req-27ea925e-4b38-4637-8a46-f525b4556aed service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.177080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e3fe13b7-af08-4d51-b384-b38016eefe54 req-d03bca45-45aa-4b5e-9d2e-6328f52df13e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f635e6d-663a-41b1-b002-5cd9d22c9e93", "tag": "eafc417a-a0f6-407b-9664-020730250cc2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:19.204211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e3fe13b7-af08-4d51-b384-b38016eefe54 req-d03bca45-45aa-4b5e-9d2e-6328f52df13e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.204700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e3fe13b7-af08-4d51-b384-b38016eefe54 req-d03bca45-45aa-4b5e-9d2e-6328f52df13e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.205219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e3fe13b7-af08-4d51-b384-b38016eefe54 req-d03bca45-45aa-4b5e-9d2e-6328f52df13e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.211565 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e4e88f56-65f1-4938-b2fa-4e002acfedd6 req-27ea925e-4b38-4637-8a46-f525b4556aed service nova] Creating event network-changed:8fad434c-d880-48f1-8359-60a9b0ddb47d for instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 on n-h2-858384-17 Oct 31 15:29:19.218725 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e4e88f56-65f1-4938-b2fa-4e002acfedd6 req-27ea925e-4b38-4637-8a46-f525b4556aed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081286 Oct 31 15:29:19.224103 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1399/2966] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:29:19.226356 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e3fe13b7-af08-4d51-b384-b38016eefe54 req-d03bca45-45aa-4b5e-9d2e-6328f52df13e service nova] Creating event network-changed:eafc417a-a0f6-407b-9664-020730250cc2 for instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 on n-h2-858384-17 Oct 31 15:29:19.231887 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e3fe13b7-af08-4d51-b384-b38016eefe54 req-d03bca45-45aa-4b5e-9d2e-6328f52df13e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068049 Oct 31 15:29:19.233068 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1568/2967] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:19.287213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:19.288705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:19.298042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.298798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.299851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.300901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.302256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.303103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.439783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:19.441407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:19.457365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.461231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.461946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.462927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.464506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.466463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.839777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:19.882529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:19.891399 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b84d0b0d-1304-46ea-b8fc-11107d270b30 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1309 microversion: 2.1 time: 0.610443 Oct 31 15:29:19.905153 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1400/2968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:19 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1309 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:19.905153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:19.905153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:19.910885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.911599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.912201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.912924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:19.920996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:19.921516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:19.940293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:19.955398 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c449a50f-c5ce-4b04-860d-90890950031e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1304 microversion: 2.1 time: 0.521756 Oct 31 15:29:19.972012 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1569/2969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:19 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1304 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:20.034900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:20.035528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:20.045804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:20.046420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:20.046746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:20.047478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:20.047945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:20.048379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:20.740073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:20.752407 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8a53a63-c666-4a3b-ad3a-d4b4bded56e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 0.855762 Oct 31 15:29:20.753330 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1401/2970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:19 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:20.759320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:20.760216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:20.768242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:20.769850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:20.770588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:20.777318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:20.778027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:20.778571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:20.881024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:20.889656 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f1738962-a8d9-40a4-b7cb-eab499a210b1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.859952 Oct 31 15:29:20.890435 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1570/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:20 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:20.960619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:20.972585 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2d8d4d1-7583-4418-aaab-9e73d49b0948 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1276 microversion: 2.1 time: 0.217960 Oct 31 15:29:20.988541 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1402/2972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:20 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1276 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:21.003983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:21.006252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:21.031367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.032682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.033431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.034679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.035410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.036126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.072174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16f8e225-1122-41b5-bf19-c0d5a99cc284 tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:21.077401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16f8e225-1122-41b5-bf19-c0d5a99cc284 tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.078082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16f8e225-1122-41b5-bf19-c0d5a99cc284 tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.078699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16f8e225-1122-41b5-bf19-c0d5a99cc284 tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.079590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16f8e225-1122-41b5-bf19-c0d5a99cc284 tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.080352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16f8e225-1122-41b5-bf19-c0d5a99cc284 tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.080930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16f8e225-1122-41b5-bf19-c0d5a99cc284 tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.128265 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16f8e225-1122-41b5-bf19-c0d5a99cc284 tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.232792 Oct 31 15:29:21.146217 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1571/2973] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:29:20 2022] GET /compute/v2.1/os-services => generated 949 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:21.154220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:21.154762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:21.163247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.163761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.164199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.164914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.165410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.166285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.401265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:21.411739 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b162eb9-6277-4356-ad5f-0a19d1d86a8b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.264230 Oct 31 15:29:21.413544 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1572/2974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:21 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:21.418797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a96b952-0012-486b-a5a8-280c3a64b8ef tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:21.423278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a96b952-0012-486b-a5a8-280c3a64b8ef tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.423985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a96b952-0012-486b-a5a8-280c3a64b8ef tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.424603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a96b952-0012-486b-a5a8-280c3a64b8ef tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.425679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a96b952-0012-486b-a5a8-280c3a64b8ef tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.426238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a96b952-0012-486b-a5a8-280c3a64b8ef tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.427348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a96b952-0012-486b-a5a8-280c3a64b8ef tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.454465 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a96b952-0012-486b-a5a8-280c3a64b8ef tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-858384-17" status: 200 len: 581 microversion: 2.1 time: 0.039598 Oct 31 15:29:21.455375 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1573/2975] 10.222.0.20 () {58 vars in 1174 bytes} [Mon Oct 31 15:29:21 2022] GET /compute/v2.1/os-services?host=n-d-858384-17 => generated 581 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:21.463035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-35b51094-2942-480b-af04-f5eb6e279601 req-3dd1248c-1ad0-489f-b433-89d7f7eff3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68000c37-bab1-490d-b199-cc5caed3783f", "tag": "08ac035f-6122-4952-ae6b-858760bdd7ff"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:21.474336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-35b51094-2942-480b-af04-f5eb6e279601 req-3dd1248c-1ad0-489f-b433-89d7f7eff3c4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.475166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-35b51094-2942-480b-af04-f5eb6e279601 req-3dd1248c-1ad0-489f-b433-89d7f7eff3c4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.475907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-35b51094-2942-480b-af04-f5eb6e279601 req-3dd1248c-1ad0-489f-b433-89d7f7eff3c4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.487499 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-35b51094-2942-480b-af04-f5eb6e279601 req-3dd1248c-1ad0-489f-b433-89d7f7eff3c4 service nova] Creating event network-changed:08ac035f-6122-4952-ae6b-858760bdd7ff for instance 68000c37-bab1-490d-b199-cc5caed3783f on n-h1-858384-17 Oct 31 15:29:21.492400 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-35b51094-2942-480b-af04-f5eb6e279601 req-3dd1248c-1ad0-489f-b433-89d7f7eff3c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035588 Oct 31 15:29:21.493364 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1574/2976] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:21.498347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfb61c83-b481-4d1b-847a-c7c1449da87b tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:21.502111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb61c83-b481-4d1b-847a-c7c1449da87b tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.502773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb61c83-b481-4d1b-847a-c7c1449da87b tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.503399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb61c83-b481-4d1b-847a-c7c1449da87b tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.504293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb61c83-b481-4d1b-847a-c7c1449da87b tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.504940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb61c83-b481-4d1b-847a-c7c1449da87b tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.505558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb61c83-b481-4d1b-847a-c7c1449da87b tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.535281 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfb61c83-b481-4d1b-847a-c7c1449da87b tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040723 Oct 31 15:29:21.536827 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1575/2977] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 31 15:29:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:21.549192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-657a2312-da2b-4fff-86bf-252e63801f6a tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:21.553888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-657a2312-da2b-4fff-86bf-252e63801f6a tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.554392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-657a2312-da2b-4fff-86bf-252e63801f6a tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.554830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-657a2312-da2b-4fff-86bf-252e63801f6a tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.555627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-657a2312-da2b-4fff-86bf-252e63801f6a tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.556079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-657a2312-da2b-4fff-86bf-252e63801f6a tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.556498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-657a2312-da2b-4fff-86bf-252e63801f6a tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.587404 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-657a2312-da2b-4fff-86bf-252e63801f6a tempest-ServicesAdminTestJSON-1299346502 tempest-ServicesAdminTestJSON-1299346502-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.042393 Oct 31 15:29:21.588066 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1576/2978] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:29:21 2022] GET /compute/v2.1/os-services => generated 949 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:29:21.609982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:21.620418 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9005d1ac-7fe2-4a67-bcb0-16d511dc3d80 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1309 microversion: 2.1 time: 0.629463 Oct 31 15:29:21.621001 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1403/2979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:20 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1309 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:21.779455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:21.780502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:21.789467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.790065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.790686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.791629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.792275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.792831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.913218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:21.914457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:21.921227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.922144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.922750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:21.923654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:21.924380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:21.924979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:22.042627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:22.051306 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60b3652e-ebd6-454d-9aed-6d0a93c0581a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 0.276772 Oct 31 15:29:22.052928 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1577/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:21 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:22.057401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:22.057990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:22.063985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:22.064850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:22.067898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:22.069042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:22.069868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:22.070457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:22.193484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:22.205509 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e397a4a5-5e5a-44ae-9686-646d3321dac8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.297514 Oct 31 15:29:22.206709 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1404/2981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:21 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:22.243180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:22.251248 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6db8d82b-2c51-4a97-9e12-2892a51860ab tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1318 microversion: 2.1 time: 0.197383 Oct 31 15:29:22.251838 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1578/2982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:22 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:22.440684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:22.441940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:22.449990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:22.450612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:22.451151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:22.451945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:22.452519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:22.453229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:22.650468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:22.652183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:22.663026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:22.663833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:22.664238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:22.665247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:22.665811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:22.666763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:22.901931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:22.909925 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c859615c-11e9-4096-bfef-8ec83605623a tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.475243 Oct 31 15:29:22.912054 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1405/2983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:22 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:23.064167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9136075c-d2b6-44ab-9d1d-d919ffa7e9f2 req-c5ad2d85-10ef-4208-b273-f3821af438dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06392995-13a7-46f2-acd2-8917f6f65bf5", "tag": "1a856416-ed7d-4e4c-8158-7928fe83eb83"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:23.086429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9136075c-d2b6-44ab-9d1d-d919ffa7e9f2 req-c5ad2d85-10ef-4208-b273-f3821af438dc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.086910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9136075c-d2b6-44ab-9d1d-d919ffa7e9f2 req-c5ad2d85-10ef-4208-b273-f3821af438dc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.087331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9136075c-d2b6-44ab-9d1d-d919ffa7e9f2 req-c5ad2d85-10ef-4208-b273-f3821af438dc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:23.112934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9136075c-d2b6-44ab-9d1d-d919ffa7e9f2 req-c5ad2d85-10ef-4208-b273-f3821af438dc service nova] Creating event network-changed:1a856416-ed7d-4e4c-8158-7928fe83eb83 for instance 06392995-13a7-46f2-acd2-8917f6f65bf5 on n-h1-858384-17 Oct 31 15:29:23.119257 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9136075c-d2b6-44ab-9d1d-d919ffa7e9f2 req-c5ad2d85-10ef-4208-b273-f3821af438dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058940 Oct 31 15:29:23.119537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:23.121008 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1406/2984] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:23.127153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:23.128036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:23.138607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.139279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.139861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:23.140784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.141427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.142075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:23.153290 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76f3b909-1eef-4306-986b-749cb961a9ef tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1309 microversion: 2.1 time: 0.511519 Oct 31 15:29:23.163862 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1579/2985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:22 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1309 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:23.229957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:23.230941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:23.239866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.240729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.241437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:23.242484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.243281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.244175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:23.507436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:23.549428 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c72ec62-ef79-461f-a0b8-c903fe8f249b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 0.426882 Oct 31 15:29:23.556209 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1407/2986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:23 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:23.556418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:23.571467 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a25815a5-961a-49a7-b926-236553a033d7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.345369 Oct 31 15:29:23.581070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:23.582188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:23.587712 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1580/2987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:23 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:23.589322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.589962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.590406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:23.591114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.591568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.591992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:23.844165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:23.854067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a23459c-4b95-475b-8557-cc01485f038b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1318 microversion: 2.1 time: 0.296271 Oct 31 15:29:23.854659 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1408/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:23 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:23.934188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:23.935004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:23.942247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.943087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.943532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:23.946966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:23.946966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:23.946966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:24.140933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:24.157984 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea9ec2ee-cc31-4d59-812f-8e6627a56d2d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.227819 Oct 31 15:29:24.168764 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1581/2989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:23 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:24.180573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:24.181211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:24.189222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:24.190073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:24.190512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:24.191567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:24.192773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:24.193715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:24.416716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:24.421869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:24.428673 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d1e058b-3a8c-4c8a-9c2e-44beae2d6ca4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1309 microversion: 2.1 time: 0.252563 Oct 31 15:29:24.430117 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1409/2990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:24 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1309 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:24.574076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:24.575191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:24.582416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:24.583567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:24.584177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:24.585116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:24.585596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:24.586074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:24.594195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:24.595033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:24.601228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:24.607308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:24.608660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:24.609101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:24.609908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:24.619231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:24.619675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:24.781597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:24.791259 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-63b7faac-e559-447d-b330-30dcddf86878 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 0.221068 Oct 31 15:29:24.792055 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1582/2991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:24 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:24.811980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:24.823839 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9d79899-0da0-4da6-8529-bec823776a02 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.233296 Oct 31 15:29:24.825173 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1410/2992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:24 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:24.884543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:24.886322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:24.894008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:24.895006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:24.896801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:24.906803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:24.907335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:24.908591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:25.095010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:25.105993 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e213f30-eb03-47f6-b234-594ca724c0cf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1318 microversion: 2.1 time: 0.227228 Oct 31 15:29:25.118444 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1583/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:24 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:25.182520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:25.183130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:25.186796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:25.198547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:25.199365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:25.199811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:25.200578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:25.205071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:25.206086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:25.454897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:25.456220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:25.464772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:25.465959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:25.466687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:25.467644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:25.468578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:25.469386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:25.479935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:25.490701 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f264619-2472-4304-b5ab-948336793cf9 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.311897 Oct 31 15:29:25.498596 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1411/2994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:25 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:25.709710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:25.720458 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bcb678e2-81a9-4444-94e4-e8f99920ba02 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1309 microversion: 2.1 time: 0.270393 Oct 31 15:29:25.736191 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1584/2995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:25 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:25.815125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:25.816190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:25.823496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:25.823985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:25.824434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:25.825115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:25.825766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:25.826350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:25.847811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:25.848946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:25.860222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:25.860948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:25.873894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:25.874904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:25.875711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:25.876294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:25.965907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=22 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:26.010420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:26.020940 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77c58901-fe3a-4095-9d5d-324ada5573a5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 0.210206 Oct 31 15:29:26.021959 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1412/2996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:25 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:26.068247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:26.076073 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21d5efbd-008a-470b-80ec-8fae833a9c98 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.232237 Oct 31 15:29:26.076657 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1585/2997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:25 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:26.132700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.133425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:26.140704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.141392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.141986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.142731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.143376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.143811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.291731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:26.300308 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b9f14662-d36c-4d37-abe9-c5b98677134a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1318 microversion: 2.1 time: 0.171994 Oct 31 15:29:26.305781 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1413/2998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:26.384886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ee09d31-d1ef-4afd-b3d9-b55231be98a5 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.388715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee09d31-d1ef-4afd-b3d9-b55231be98a5 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.389310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee09d31-d1ef-4afd-b3d9-b55231be98a5 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.389943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee09d31-d1ef-4afd-b3d9-b55231be98a5 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.390667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee09d31-d1ef-4afd-b3d9-b55231be98a5 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.391117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee09d31-d1ef-4afd-b3d9-b55231be98a5 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.391536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ee09d31-d1ef-4afd-b3d9-b55231be98a5 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.407831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:26.418294 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ee09d31-d1ef-4afd-b3d9-b55231be98a5 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.283504 Oct 31 15:29:26.418895 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1586/2999] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/os-services => generated 949 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:26.431587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e246d2d6-024d-4c3b-97a7-c4df94129f59 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.435280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e246d2d6-024d-4c3b-97a7-c4df94129f59 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.435760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e246d2d6-024d-4c3b-97a7-c4df94129f59 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.436194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e246d2d6-024d-4c3b-97a7-c4df94129f59 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.436914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e246d2d6-024d-4c3b-97a7-c4df94129f59 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.437437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e246d2d6-024d-4c3b-97a7-c4df94129f59 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.437863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e246d2d6-024d-4c3b-97a7-c4df94129f59 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.462296 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e246d2d6-024d-4c3b-97a7-c4df94129f59 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.034354 Oct 31 15:29:26.462895 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1414/3000] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:26.476679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e19a981f-ce46-4c05-9f61-4a597c19ef82 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.480468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19a981f-ce46-4c05-9f61-4a597c19ef82 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.480981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19a981f-ce46-4c05-9f61-4a597c19ef82 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.481439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19a981f-ce46-4c05-9f61-4a597c19ef82 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.482165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19a981f-ce46-4c05-9f61-4a597c19ef82 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.482616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19a981f-ce46-4c05-9f61-4a597c19ef82 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.483036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e19a981f-ce46-4c05-9f61-4a597c19ef82 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.508424 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e19a981f-ce46-4c05-9f61-4a597c19ef82 tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.036119 Oct 31 15:29:26.509232 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1587/3001] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/os-services => generated 949 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:26.523646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03674b76-33ba-4980-accf-9040a3f734ad tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.523851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.524304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:26.527559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03674b76-33ba-4980-accf-9040a3f734ad tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.528164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03674b76-33ba-4980-accf-9040a3f734ad tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.528702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03674b76-33ba-4980-accf-9040a3f734ad tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.529565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03674b76-33ba-4980-accf-9040a3f734ad tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.530148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03674b76-33ba-4980-accf-9040a3f734ad tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.530673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03674b76-33ba-4980-accf-9040a3f734ad tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.531671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.532161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.532786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.533519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.534080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.534525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.557270 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03674b76-33ba-4980-accf-9040a3f734ad tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-858384-17&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038480 Oct 31 15:29:26.564906 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1588/3002] 10.222.0.20 () {58 vars in 1196 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/os-services?host=n-d-858384-17&binary=xxx => generated 16 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:26.570365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b3537169-0c20-4624-8a96-5ef6df74205c tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.573839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3537169-0c20-4624-8a96-5ef6df74205c tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.574326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3537169-0c20-4624-8a96-5ef6df74205c tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.574762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3537169-0c20-4624-8a96-5ef6df74205c tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.575495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3537169-0c20-4624-8a96-5ef6df74205c tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.576016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3537169-0c20-4624-8a96-5ef6df74205c tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.576447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3537169-0c20-4624-8a96-5ef6df74205c tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.602506 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b3537169-0c20-4624-8a96-5ef6df74205c tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.036115 Oct 31 15:29:26.603061 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1589/3003] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/os-services => generated 949 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:26.616036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4792fb80-3b89-4315-8b7c-485b8bcb7f0a tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.619654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4792fb80-3b89-4315-8b7c-485b8bcb7f0a tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.620197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4792fb80-3b89-4315-8b7c-485b8bcb7f0a tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.620639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4792fb80-3b89-4315-8b7c-485b8bcb7f0a tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.621393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4792fb80-3b89-4315-8b7c-485b8bcb7f0a tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.621851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4792fb80-3b89-4315-8b7c-485b8bcb7f0a tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.622276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4792fb80-3b89-4315-8b7c-485b8bcb7f0a tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.646715 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4792fb80-3b89-4315-8b7c-485b8bcb7f0a tempest-ServicesAdminNegativeTestJSON-1177998649 tempest-ServicesAdminNegativeTestJSON-1177998649-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.034813 Oct 31 15:29:26.647480 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1590/3004] 10.222.0.20 () {58 vars in 1198 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:29:26.717047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:26.727091 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1bb606fc-161e-4e5b-83c3-dc693bf46cbb tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.208018 Oct 31 15:29:26.737524 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1415/3005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:26.748463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.749083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:26.755971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.756685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.757150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.757852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:26.758318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:26.758745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:26.839448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc32532e-f0e5-4916-bf3a-4a01ded7b22b tempest-ServicesAdminNegativeTestJSON-1862205132 tempest-ServicesAdminNegativeTestJSON-1862205132-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:26.843024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fc32532e-f0e5-4916-bf3a-4a01ded7b22b tempest-ServicesAdminNegativeTestJSON-1862205132 tempest-ServicesAdminNegativeTestJSON-1862205132-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '47dd835c5261467c9902d436480f4889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fce0e7c8e345c7ad508878caff7308', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc32532e-f0e5-4916-bf3a-4a01ded7b22b tempest-ServicesAdminNegativeTestJSON-1862205132 tempest-ServicesAdminNegativeTestJSON-1862205132-project] Request method failure captured: Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-nVoEEvPYtpY9hdVlJyDFFan4DRJ3_8WcfgeezqddLb0_ELUzzBFTkpjU5bVzWRvrGJVY8C94zbSu7rx1zVLEp9INrHra2sGE8ngWJEW4eZGgjiaJ55oWBKFwtWMlbiEkeI3wb-e8PunIOVYRlSEh4kdUaD7VMiVw_ChbYqxSg0wug Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 00fce0e7c8e345c7ad508878caff7308 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1862205132 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00fce0e7c8e345c7ad508878caff7308"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_00fce0e7c8e345c7ad508878caff7308", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/00fce0e7c8e345c7ad508878caff7308"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/00fce0e7c8e345c7ad508878caff7308"}]}] Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1862205132 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 00fce0e7c8e345c7ad508878caff7308 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1862205132 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServicesAdminNegativeTestJSON-1862205132-project Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 47dd835c5261467c9902d436480f4889 Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1862205132-project Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:29:26.849360 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:26.854000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:26.854000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:26.854000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:26.854000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:26.854000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:26.854000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:29:26.854000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:29:26.854000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:29:26.854000 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:26.856074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc32532e-f0e5-4916-bf3a-4a01ded7b22b tempest-ServicesAdminNegativeTestJSON-1862205132 tempest-ServicesAdminNegativeTestJSON-1862205132-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:26.857211 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc32532e-f0e5-4916-bf3a-4a01ded7b22b tempest-ServicesAdminNegativeTestJSON-1862205132 tempest-ServicesAdminNegativeTestJSON-1862205132-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.201714 Oct 31 15:29:26.858268 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1591/3006] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 203 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:29:27.049851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:27.053423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:27.065823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.072188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.073043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.074626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.076025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.076730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.081578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:27.090346 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-82ccc798-7159-4a27-b816-96e9e6d161fe tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1309 microversion: 2.1 time: 0.345652 Oct 31 15:29:27.105519 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1416/3007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:26 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1309 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:27.117549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:27.122873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:27.143031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.143529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.143965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.151333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.155187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.155712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.338563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:27.353054 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30185d72-dd6e-4f06-a0d6-59559ad0de5e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 0.311454 Oct 31 15:29:27.362240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1592/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:27 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:27.377356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:27.379182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:27.389592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.390537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.391656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.392841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.393587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.394488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.562919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:27.576880 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-424818fe-ab25-4b64-bea5-2f919e7cea37 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1318 microversion: 2.1 time: 0.208940 Oct 31 15:29:27.582218 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1593/3009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:27 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:27.592104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2325bcf1-9fe6-4f01-97ea-96c7d57c5c77 req-305465d6-9c6d-42c8-9ded-bd940aaceef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68000c37-bab1-490d-b199-cc5caed3783f", "name": "network-vif-plugged", "status": "completed", "tag": "08ac035f-6122-4952-ae6b-858760bdd7ff"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:27.604734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2325bcf1-9fe6-4f01-97ea-96c7d57c5c77 req-305465d6-9c6d-42c8-9ded-bd940aaceef2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.605277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2325bcf1-9fe6-4f01-97ea-96c7d57c5c77 req-305465d6-9c6d-42c8-9ded-bd940aaceef2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.605854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2325bcf1-9fe6-4f01-97ea-96c7d57c5c77 req-305465d6-9c6d-42c8-9ded-bd940aaceef2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.621333 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2325bcf1-9fe6-4f01-97ea-96c7d57c5c77 req-305465d6-9c6d-42c8-9ded-bd940aaceef2 service nova] Creating event network-vif-plugged:08ac035f-6122-4952-ae6b-858760bdd7ff for instance 68000c37-bab1-490d-b199-cc5caed3783f on n-h1-858384-17 Oct 31 15:29:27.628270 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2325bcf1-9fe6-4f01-97ea-96c7d57c5c77 req-305465d6-9c6d-42c8-9ded-bd940aaceef2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043820 Oct 31 15:29:27.631423 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1594/3010] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:27.752005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:27.752899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:27.759201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.759786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.760409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.761109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:27.761617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:27.762046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:27.908395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:27.918567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:27.923172 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b9bc8e29-4328-49e3-a7a2-038293b3c0e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.826847 Oct 31 15:29:27.925496 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1417/3011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:27 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:27.932208 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24eb8a48-5e5f-483b-95e1-524d2db618f8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.184437 Oct 31 15:29:27.934392 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1595/3012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:27 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:28.120958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:28.121611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:28.128180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:28.128754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:28.129407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:28.130618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:28.131107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:28.131564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:28.385543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:28.393389 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83fc48a6-f3fd-4482-91d3-bfc0d090affc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1309 microversion: 2.1 time: 0.279585 Oct 31 15:29:28.394718 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1418/3013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:28 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:28.603426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:28.604432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:28.616253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:28.616760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:28.617231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:28.617956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:28.618414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:28.621801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:28.709969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:28.710580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:28.717817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:28.718730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:28.719376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:28.720449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:28.721052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:28.721650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:28.869863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:28.886036 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f27994d-c154-49d6-9e28-71b67016bb4e tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1318 microversion: 2.1 time: 0.286474 Oct 31 15:29:28.888031 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1419/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:28 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:28.946639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:28.956368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:28.958656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:28.966149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:28.966919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:28.967830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:28.969298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:28.969428 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52fa68b7-6743-42a9-8753-50f18b0392d0 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 0.597125 Oct 31 15:29:28.970356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:28.971439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:28.972510 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1596/3015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:28 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:28.991041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:28.992165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:29.012227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.013244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.014617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:29.016871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.017578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.018734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:29.192076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:29.212781 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89ba56d9-42bf-4f96-b4fb-80ff1eea944b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.260785 Oct 31 15:29:29.221118 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1420/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:28 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:29.286805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:29.297513 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-724ca0fe-4ab0-4421-bba3-2da7d662f8b0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.323909 Oct 31 15:29:29.298439 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1597/3017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:28 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:29.417885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:29.418901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:29.425251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.425833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.426498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:29.427858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.428514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.429119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:29.585427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:29.594574 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a8af8a0c-31df-464e-8dcc-d672d465767c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1489 microversion: 2.1 time: 0.180856 Oct 31 15:29:29.595341 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1421/3018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:29 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1489 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:29.647519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c99c3a64-c871-4466-ac11-900bd5a2f534 req-cb2ec054-b8d0-4ced-9122-34a232e9e6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb368d4-cee6-41ca-9cbe-1c86ad8b1011", "name": "network-vif-plugged", "status": "completed", "tag": "8fad434c-d880-48f1-8359-60a9b0ddb47d"}, {"server_uuid": "06392995-13a7-46f2-acd2-8917f6f65bf5", "name": "network-vif-plugged", "status": "completed", "tag": "1a856416-ed7d-4e4c-8158-7928fe83eb83"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:29.664552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c99c3a64-c871-4466-ac11-900bd5a2f534 req-cb2ec054-b8d0-4ced-9122-34a232e9e6ef service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.665402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c99c3a64-c871-4466-ac11-900bd5a2f534 req-cb2ec054-b8d0-4ced-9122-34a232e9e6ef service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.666022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c99c3a64-c871-4466-ac11-900bd5a2f534 req-cb2ec054-b8d0-4ced-9122-34a232e9e6ef service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:29.680583 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c99c3a64-c871-4466-ac11-900bd5a2f534 req-cb2ec054-b8d0-4ced-9122-34a232e9e6ef service nova] Creating event network-vif-plugged:8fad434c-d880-48f1-8359-60a9b0ddb47d for instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 on n-h2-858384-17 Oct 31 15:29:29.681094 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c99c3a64-c871-4466-ac11-900bd5a2f534 req-cb2ec054-b8d0-4ced-9122-34a232e9e6ef service nova] Creating event network-vif-plugged:1a856416-ed7d-4e4c-8158-7928fe83eb83 for instance 06392995-13a7-46f2-acd2-8917f6f65bf5 on n-h1-858384-17 Oct 31 15:29:29.692529 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c99c3a64-c871-4466-ac11-900bd5a2f534 req-cb2ec054-b8d0-4ced-9122-34a232e9e6ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049073 Oct 31 15:29:29.695275 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1598/3019] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:29.748955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1316828502", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "2b5355db-9171-4de8-abb5-5f94412a242a"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:29.830420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] validate_networks() for [('2b5355db-9171-4de8-abb5-5f94412a242a', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:29.912333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:29.913352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:29.920743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.921356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.921854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:29.922772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:29.923303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:29.923807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.165510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:30.183898 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d542d978-5c5b-4c02-9c79-0cb627e5d968 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1318 microversion: 2.1 time: 0.275042 Oct 31 15:29:30.184949 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1599/3020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:29 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:30.190026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:30.190842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:30.197369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:30.198034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:30.198669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.199680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:30.200290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:30.200863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.365394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:30.376117 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe0bdc22-e1e2-42bb-8b91-08b4d56128b8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1314 microversion: 2.1 time: 0.189713 Oct 31 15:29:30.376911 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1600/3021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:30 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:30.382491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:30.383380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:30.389671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:30.390380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:30.390831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.391536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:30.391997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:30.392592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.542645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:30.550684 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd799084-55a6-4b3a-ae57-81d98b07a685 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.172474 Oct 31 15:29:30.551529 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1601/3022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:30 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:30.556307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:30.556916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:30.563350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:30.564193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:30.564855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.565984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:30.566746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:30.567470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.611204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:30.612167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:30.612825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:30.613557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:30.614243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:30.627268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:30.627934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:30.628668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.630050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:30.630795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:30.631388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:30.661776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:30.668213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for user 31cd28d777ac40eda1a7abefb5a3256d and project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:30.686373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:30.691235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:30.733206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:30.743478 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed7183bd-e780-4bbb-ace5-dae225df84d5 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.190761 Oct 31 15:29:30.744398 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1602/3023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:30 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:30.750762 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64d8f9f3-6049-4ecc-b4b9-7182f08920f2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.006542 Oct 31 15:29:30.751949 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1422/3024] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:30.770262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55aea750-fb2b-4517-bdee-59229b644b1e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:30.771701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-55aea750-fb2b-4517-bdee-59229b644b1e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:30.800951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15c93e3e-472e-4645-800e-0041a4684b6e tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Calling method '.version_select at 0x7f16e125a940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:30.858319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-55aea750-fb2b-4517-bdee-59229b644b1e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:30.859019 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-15c93e3e-472e-4645-800e-0041a4684b6e tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e" status: 200 len: 636 microversion: 2.1 time: 0.061866 Oct 31 15:29:30.860585 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1423/3025] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:29:30 2022] GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e => generated 636 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:29:30.869573 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55aea750-fb2b-4517-bdee-59229b644b1e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1209 microversion: 2.1 time: 0.106045 Oct 31 15:29:30.870783 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1603/3026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:30 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:30.875945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5ff0b2b8-9367-44de-8786-f39ff98f59ff tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Action: 'update_all', calling method: .version_select at 0x7f16e1012c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:30.933701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-5ff0b2b8-9367-44de-8786-f39ff98f59ff tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:30.939560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-5ff0b2b8-9367-44de-8786-f39ff98f59ff tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for user 66e04d9ff16e4b18aa7090ef5a8db935 and project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:31.207832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:31.209027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:31.233547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.234045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.238564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.245715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.246197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.246827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.334035 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5ff0b2b8-9367-44de-8786-f39ff98f59ff tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.461690 Oct 31 15:29:31.334696 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1424/3027] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:29:30 2022] PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 61 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:29:31.345835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87337805-e069-41ab-80be-b9549f9cac34 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Calling method '.version_select at 0x7f16e0ea4f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:31.494663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:31.505511 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4ada8fa3-8018-4bd7-abc5-293f7c40e3ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1318 microversion: 2.1 time: 0.300872 Oct 31 15:29:31.523219 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1604/3028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:31 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:31.527842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:31.529316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:31.539499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.540419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.541002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.541831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.552255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.553104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.594131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:31.774600 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87337805-e069-41ab-80be-b9549f9cac34 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "DELETE /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.433871 Oct 31 15:29:31.778348 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1425/3029] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Oct 31 15:29:31 2022] DELETE /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata/os_version => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:29:31.785581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:31.788014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:31.797666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.798351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.798953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.799955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.800914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.801049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.807712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:31.818379 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ffd4ce91-ea8a-40f7-989a-6302215c2690 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1501 microversion: 2.1 time: 0.310063 Oct 31 15:29:31.819307 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1605/3030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:31 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1501 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:31.824677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:31.825501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:31.834948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.835808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.836498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.837463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:31.838593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:31.839253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:31.996882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:32.006139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41ec173c-83d7-4916-a4bd-dd94e701f059 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.185440 Oct 31 15:29:32.006778 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1606/3031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:31 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:32.011593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02f0efe9-c6ac-4037-bd37-d5b4e925120f tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Calling method '.version_select at 0x7f16e55339d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:32.055812 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02f0efe9-c6ac-4037-bd37-d5b4e925120f tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 37 microversion: 2.1 time: 0.047939 Oct 31 15:29:32.056411 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1607/3032] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:29:32 2022] GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 37 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:32.061415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-729485bd-342e-40a7-abf5-dfe42b34c329 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:32.069394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-729485bd-342e-40a7-abf5-dfe42b34c329 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.070206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-729485bd-342e-40a7-abf5-dfe42b34c329 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.070648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-729485bd-342e-40a7-abf5-dfe42b34c329 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.095462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-729485bd-342e-40a7-abf5-dfe42b34c329 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:29:32.150336 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-729485bd-342e-40a7-abf5-dfe42b34c329 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011/action" status: 202 len: 0 microversion: 2.1 time: 0.092638 Oct 31 15:29:32.150923 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1608/3033] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:32 2022] POST /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:29:32.157876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:32.158585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:32.166217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.166710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.167151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.167862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.168415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.168745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.234190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:32.244279 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1539cf6b-92d7-4efe-9905-0e15967dd630 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1261 microversion: 2.1 time: 0.092128 Oct 31 15:29:32.244884 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1609/3034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:32 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:32.258155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cbe4f0f8-a323-407d-84fd-e4a6276572eb tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Action: 'update_all', calling method: .version_select at 0x7f16e5571040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:32.298497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:32.308047 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26293a61-dd19-4fd9-bd1c-b8f847c9c3df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.530294 Oct 31 15:29:32.308307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-cbe4f0f8-a323-407d-84fd-e4a6276572eb tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:32.309114 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1426/3035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:31 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:32.313991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-cbe4f0f8-a323-407d-84fd-e4a6276572eb tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for user 66e04d9ff16e4b18aa7090ef5a8db935 and project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:32.314520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:32.315379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:32.322805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.323296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.323737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.324436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.324926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.325379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.545196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:32.554073 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd52bd4b-fda4-449a-871c-faf94a3f8cee tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.243116 Oct 31 15:29:32.565627 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1427/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:32 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:32.578867 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cbe4f0f8-a323-407d-84fd-e4a6276572eb tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.328615 Oct 31 15:29:32.579709 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1610/3037] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:29:32 2022] PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 61 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:32.580525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:32.581249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:32.589079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.589816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.589936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-38090320-518c-4ec9-a701-389fbacf38dd tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Calling method '.version_select at 0x7f16e5571550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:32.590377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.591187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:32.591721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:32.592217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:32.633836 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-38090320-518c-4ec9-a701-389fbacf38dd tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.047565 Oct 31 15:29:32.634681 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1611/3038] 10.222.0.20 () {58 vars in 1290 bytes} [Mon Oct 31 15:29:32 2022] GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata/os_distro => generated 33 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:32.645957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-072db9d5-c245-475d-b90f-0536ecf33271 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Action: 'update_all', calling method: .version_select at 0x7f16e5591700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:32.696416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-072db9d5-c245-475d-b90f-0536ecf33271 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:32.702666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-072db9d5-c245-475d-b90f-0536ecf33271 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for user 66e04d9ff16e4b18aa7090ef5a8db935 and project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:32.795892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:32.805228 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c6ae8e9-65fe-4574-9f0c-ccdff2f55d8b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1467 microversion: 2.1 time: 0.238271 Oct 31 15:29:32.805807 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1428/3039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:32 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1467 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:32.870895 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-072db9d5-c245-475d-b90f-0536ecf33271 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.228182 Oct 31 15:29:32.870895 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1612/3040] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:29:32 2022] PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 61 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:29:32.881423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1d65ec30-1797-4634-b880-ea2a856c473f tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Calling method '.version_select at 0x7f16e5571310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:32.932403 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1d65ec30-1797-4634-b880-ea2a856c473f tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.055850 Oct 31 15:29:32.933346 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1613/3041] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:29:32 2022] GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 61 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:29:32.944433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bedc1402-7ecb-49f7-81b8-2e4bb5938d89 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Action: 'update_all', calling method: .version_select at 0x7f16e5556dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:32.999955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bedc1402-7ecb-49f7-81b8-2e4bb5938d89 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:33.015562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bedc1402-7ecb-49f7-81b8-2e4bb5938d89 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for user 66e04d9ff16e4b18aa7090ef5a8db935 and project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:33.091611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-28071938", "block_migration": true, "disk_over_commit": false}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:33.094588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:33.109778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.110516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.111151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.112041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.112651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.113423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.147028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lazy-loading 'flavor' on Instance uuid 06392995-13a7-46f2-acd2-8917f6f65bf5 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:33.169751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Going to try to live migrate instance to tempest-host-28071938 {{(pid=120588) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:29:33.179282 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] HTTP exception thrown: Compute host tempest-host-28071938 could not be found. Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Request method failure captured: Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5/action HTTP/1.1 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 105 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-nJPMxHI72KdwynSHrgiGobgHZ3GdXDq5TPKykCTOiQzwWhxbKEAkDRAFPhJJvF_VPQ1wAoE45xTItP1tSNkkzRU2ENNbzRK-AtzYQR0ByiXArUrJ8DKkekJBCOZMBx6rqvNl5iQphmX_NSvicQDcV-7W3F-FbKaOU5sc1-RgvjLS8 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: cf5bce196ddc4119bdc2f0b5253ead85 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-LiveMigrationNegativeTest-1160034860 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf5bce196ddc4119bdc2f0b5253ead85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf5bce196ddc4119bdc2f0b5253ead85", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf5bce196ddc4119bdc2f0b5253ead85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf5bce196ddc4119bdc2f0b5253ead85"}]}] Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-LiveMigrationNegativeTest-1160034860 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: cf5bce196ddc4119bdc2f0b5253ead85 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1160034860 Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-LiveMigrationNegativeTest-1160034860-project-admin Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ed5bab859ac749d4b179692e9658b1bf Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-LiveMigrationNegativeTest-1160034860-project-admin Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: {"os-migrateLive": {"host": "tempest-host-28071938", "block_migration": true, "disk_over_commit": false}} Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: exception: Compute host tempest-host-28071938 could not be found. Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '06392995-13a7-46f2-acd2-8917f6f65bf5', 'body': {'os-migrateLive': {'host': 'tempest-host-28071938', 'block_migration': True, 'disk_over_commit': False}}} Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5489, in live_migrate Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 31 15:29:33.211658 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-28071938 could not be found. Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-28071938 could not be found. Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-28071938 could not be found. Oct 31 15:29:33.215676 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:33.222372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Returning 400 to user: Compute host tempest-host-28071938 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:33.223549 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e249f9e-26c5-450d-82e7-5e59e74f5df1 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5/action" status: 400 len: 98 microversion: 2.1 time: 0.398633 Oct 31 15:29:33.224377 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1429/3042] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 31 15:29:32 2022] POST /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5/action => generated 98 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:29:33.226129 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bedc1402-7ecb-49f7-81b8-2e4bb5938d89 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.285990 Oct 31 15:29:33.226754 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1614/3043] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:29:32 2022] PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 61 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:33.237040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:33.238253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:33.239327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:33.239822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:33.246944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.247665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.248116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.248839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.249333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.249919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.262714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.264418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.265088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.266056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.266758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.267423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.309581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:33.526683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:33.538741 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc49067b-6f5d-4eba-a360-0a84fd25f379 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1467 microversion: 2.1 time: 0.305511 Oct 31 15:29:33.543749 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1615/3044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:33 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1467 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:33.554899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-707d9c3f-8978-4d78-9927-c7ef99b1700f tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Action: 'update_all', calling method: .version_select at 0x7f16e1d325e0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:33.630474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-707d9c3f-8978-4d78-9927-c7ef99b1700f tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:33.637406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-707d9c3f-8978-4d78-9927-c7ef99b1700f tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for user 66e04d9ff16e4b18aa7090ef5a8db935 and project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:33.691685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:33.704379 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b8419e50-a8ac-46a2-ba86-989b547616c0 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.478590 Oct 31 15:29:33.706222 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1430/3045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:33 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:33.713543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:33.722620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:33.739334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.740102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.740728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.741660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.742294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.742889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.843744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:33.854860 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-069e7ebf-5412-4ed1-89ff-36a3a73c5186 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1267 microversion: 2.1 time: 0.146102 Oct 31 15:29:33.879104 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1431/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:33 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:33.887985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:33.889155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:33.897378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.898100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.898921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:33.899840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:33.900632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:33.901315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:34.094477 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-707d9c3f-8978-4d78-9927-c7ef99b1700f tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.549537 Oct 31 15:29:34.099337 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1616/3047] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:29:33 2022] PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 64 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:34.104295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f70585e3-5774-453b-94a9-21b7cbd397af req-24a3ff0f-fa0d-4b7f-a91e-e623e95c8e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f635e6d-663a-41b1-b002-5cd9d22c9e93", "name": "network-vif-plugged", "status": "completed", "tag": "eafc417a-a0f6-407b-9664-020730250cc2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:34.114681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f70585e3-5774-453b-94a9-21b7cbd397af req-24a3ff0f-fa0d-4b7f-a91e-e623e95c8e2a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:34.115699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f70585e3-5774-453b-94a9-21b7cbd397af req-24a3ff0f-fa0d-4b7f-a91e-e623e95c8e2a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:34.116138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f70585e3-5774-453b-94a9-21b7cbd397af req-24a3ff0f-fa0d-4b7f-a91e-e623e95c8e2a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:34.128305 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f70585e3-5774-453b-94a9-21b7cbd397af req-24a3ff0f-fa0d-4b7f-a91e-e623e95c8e2a service nova] Creating event network-vif-plugged:eafc417a-a0f6-407b-9664-020730250cc2 for instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 on n-h2-858384-17 Oct 31 15:29:34.134337 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f70585e3-5774-453b-94a9-21b7cbd397af req-24a3ff0f-fa0d-4b7f-a91e-e623e95c8e2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037655 Oct 31 15:29:34.135036 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1617/3048] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:34.143219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:34.143964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:34.159760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:34.160367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:34.160920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:34.161723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:34.162299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:34.163531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:34.296020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:34.306661 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73f935f2-2692-4cf1-9dde-173eb10efbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1520 microversion: 2.1 time: 0.424006 Oct 31 15:29:34.307509 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1432/3049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:33 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:34.312520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-19449930", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:34.380929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:34.414571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:34.422390 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e5763bb-645e-4963-9000-4699990e7052 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.283332 Oct 31 15:29:34.433202 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1618/3050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:34 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:34.433202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10737ade-3b2b-403f-ac49-145eba8e206b tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Calling method '.version_select at 0x7f16e1528160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:34.479224 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10737ade-3b2b-403f-ac49-145eba8e206b tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 64 microversion: 2.1 time: 0.054464 Oct 31 15:29:34.484979 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1619/3051] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:29:34 2022] GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 64 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:34.492312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71a687f7-cb1b-4e0a-9d1a-0ee2f6f2977c tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Action: 'update_all', calling method: .version_select at 0x7f16e0b6b1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:34.575344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-71a687f7-cb1b-4e0a-9d1a-0ee2f6f2977c tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:34.585173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-71a687f7-cb1b-4e0a-9d1a-0ee2f6f2977c tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for user 66e04d9ff16e4b18aa7090ef5a8db935 and project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:35.044424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:35.045519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:35.046082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:35.046555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:35.047031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:35.065194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.065698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.066216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.071562 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71a687f7-cb1b-4e0a-9d1a-0ee2f6f2977c tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.585389 Oct 31 15:29:35.072427 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1620/3052] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:29:34 2022] PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 61 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:35.075206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.076041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.079112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.083815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:35.085308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:35.088344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:35.092160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.092871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.093405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.094423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.095089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.095725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.107211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Getting quotas for project d2ed234b3d934b4787f7a25c9b3253f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:35.112651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Getting quotas for user 8e44ce84068f48e19a71e92e53ded700 and project d2ed234b3d934b4787f7a25c9b3253f5. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:35.127421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:35.131015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:35.201445 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a965d7e5-dfc8-45e5-b588-56c2fc81abdf tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892524 Oct 31 15:29:35.203201 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1433/3053] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:35.208750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:35.209917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:35.219621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.220432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.221591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.223102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.224898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.225684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.355857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:35.366931 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ddffe26c-2f9c-4aaa-974b-f956cc89196c tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1292 microversion: 2.1 time: 0.288889 Oct 31 15:29:35.373175 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1621/3054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:35 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1292 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:35.381306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26bd5090-b0a3-43e1-8b38-86afa9fa885e tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Action: 'update', calling method: .version_select at 0x7f16e0b6bee0>, body: {"meta": {"os_version": "alt"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:35.446005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:35.456512 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-45c6c502-b844-49ee-8ecc-5ba8d56faed4 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1309 microversion: 2.1 time: 0.252071 Oct 31 15:29:35.466994 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1434/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:35 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:35.472323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb5b044e-d43a-4384-bc8f-d5601f208a4a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:35.474416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb5b044e-d43a-4384-bc8f-d5601f208a4a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:35.496501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-26bd5090-b0a3-43e1-8b38-86afa9fa885e tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:35.502826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-26bd5090-b0a3-43e1-8b38-86afa9fa885e tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for user 66e04d9ff16e4b18aa7090ef5a8db935 and project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:35.584588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb5b044e-d43a-4384-bc8f-d5601f208a4a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:35.596122 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb5b044e-d43a-4384-bc8f-d5601f208a4a tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1217 microversion: 2.1 time: 0.127813 Oct 31 15:29:35.603884 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1435/3056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:35 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:35.611569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:35.612514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:35.626021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.627552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.628692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.630675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:35.631218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:35.633605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:35.963772 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26bd5090-b0a3-43e1-8b38-86afa9fa885e tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.592429 Oct 31 15:29:35.965947 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1622/3057] 10.222.0.20 () {60 vars in 1313 bytes} [Mon Oct 31 15:29:35 2022] PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata/os_version => generated 31 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:35.976471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:35.980302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:36.000323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.001268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.002033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.003185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.003885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.005915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.194391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:36.206822 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d20d1403-d0f2-4018-a59d-d4bab35fb49b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1500 microversion: 2.1 time: 0.601479 Oct 31 15:29:36.208853 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1436/3058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:35 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1500 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:36.217662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-850a2b56-2eac-4b20-b5c7-c71aca759972 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Calling method '.version_select at 0x7f16e56d2b80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:36.272147 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-850a2b56-2eac-4b20-b5c7-c71aca759972 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 58 microversion: 2.1 time: 0.061637 Oct 31 15:29:36.272743 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1437/3059] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:29:36 2022] GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 58 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:36.277964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c3e342cc-207e-47bf-959c-4c01fce85cef req-79cd5454-12c4-4d43-aad3-de50168e7a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd", "tag": "e5852e9c-da30-4572-ad04-afd9aafe87eb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:36.288408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c3e342cc-207e-47bf-959c-4c01fce85cef req-79cd5454-12c4-4d43-aad3-de50168e7a57 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.289137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c3e342cc-207e-47bf-959c-4c01fce85cef req-79cd5454-12c4-4d43-aad3-de50168e7a57 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.289574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c3e342cc-207e-47bf-959c-4c01fce85cef req-79cd5454-12c4-4d43-aad3-de50168e7a57 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.311738 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c3e342cc-207e-47bf-959c-4c01fce85cef req-79cd5454-12c4-4d43-aad3-de50168e7a57 service nova] Creating event network-changed:e5852e9c-da30-4572-ad04-afd9aafe87eb for instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd on n-h1-858384-17 Oct 31 15:29:36.318179 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c3e342cc-207e-47bf-959c-4c01fce85cef req-79cd5454-12c4-4d43-aad3-de50168e7a57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043236 Oct 31 15:29:36.319095 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1438/3060] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:36.324159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:36.324870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:36.331254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.331770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.332218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.334037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.334712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.335165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.407270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:36.416821 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea4858d7-1b42-4407-b130-d5ef71a5c854 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.449670 Oct 31 15:29:36.417794 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1623/3061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:35 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:36.437689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-383211f1-b7d1-41de-807d-75bf04ff2e62 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Action: 'update_all', calling method: .version_select at 0x7f16e5756e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:36.503063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-383211f1-b7d1-41de-807d-75bf04ff2e62 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:36.509726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-383211f1-b7d1-41de-807d-75bf04ff2e62 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for user 66e04d9ff16e4b18aa7090ef5a8db935 and project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:36.634334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=24 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:36.702852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:36.714051 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-912f1d2e-3d17-4c5e-bddf-83f722be4082 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1515 microversion: 2.1 time: 0.393776 Oct 31 15:29:36.715474 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1439/3062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:36 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1515 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:36.720434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:36.721330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:36.728753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.729657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.741111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.743711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.745106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.745903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.832019 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-383211f1-b7d1-41de-807d-75bf04ff2e62 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 61 microversion: 2.1 time: 0.412850 Oct 31 15:29:36.838276 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1624/3063] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:29:36 2022] PUT /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 61 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:36.842850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:36.843468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:36.850727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.851213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.851717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.852515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.853145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.853785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.928305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:36.938370 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8d44fbe-b400-455c-bf67-ea9aea505fec tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1481 microversion: 2.1 time: 0.221470 Oct 31 15:29:36.939203 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1440/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:36 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1481 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:36.953239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:36.953239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:36.962103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.962589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.963025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:36.963728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:36.964412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:36.964757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.035316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:37.044597 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5508cb6-e7de-402c-9772-e762f49a0c16 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1309 microversion: 2.1 time: 0.205338 Oct 31 15:29:37.045207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1625/3065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:36 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1309 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:37.056789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19d3d938-9dba-48a3-993d-3e2bc99726fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:37.059879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19d3d938-9dba-48a3-993d-3e2bc99726fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: c7c5a0fa-77ac-4c53-b18b-807a67298932] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.068462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:37.077427 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-19d3d938-9dba-48a3-993d-3e2bc99726fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] HTTP exception thrown: Instance c7c5a0fa-77ac-4c53-b18b-807a67298932 could not be found. Oct 31 15:29:37.079585 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d8c002b-ebc3-4ab8-8c0c-a77fed143c95 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1269 microversion: 2.1 time: 0.134391 Oct 31 15:29:37.080439 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1441/3066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:36 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1269 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:37.086413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d361cf46-6d2a-4ad8-aaf4-bde722970ccd tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Action: 'create', calling method: .version_select at 0x7f16e1097e50>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19d3d938-9dba-48a3-993d-3e2bc99726fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Request method failure captured: Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/c7c5a0fa-77ac-4c53-b18b-807a67298932/action HTTP/1.1 Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 14 Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-mPAZq-02OTEsnv8GMkJRDJDL-rAJdgEJHn39ABJutgfh2_1AZN2oCBsrYt27l5tKBr9RG945Kyk--1kSEQ-akNiYprUFz_R7VxoVIJfbKRGxwgEKLAB8nUjvzWuTNL6KRyvhFuZKw3wxu_FY2qhzM7Zf-aduk3Wugzl7BHJI8VXXg Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9275c27ad1ac40568e4dbc778857d333", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9275c27ad1ac40568e4dbc778857d333"}]}] Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b56e2ca778b04f7c9fc7590faacb4c1a Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: {"rescue": {}} Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance c7c5a0fa-77ac-4c53-b18b-807a67298932 could not be found. Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'c7c5a0fa-77ac-4c53-b18b-807a67298932', 'body': {'rescue': {}}} Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7c5a0fa-77ac-4c53-b18b-807a67298932 could not be found. Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7c5a0fa-77ac-4c53-b18b-807a67298932 could not be found. Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:37.087190 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:37.099403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:37.099403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:37.099403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:37.099403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:37.099403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7c5a0fa-77ac-4c53-b18b-807a67298932 could not be found. Oct 31 15:29:37.099403 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:37.099403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19d3d938-9dba-48a3-993d-3e2bc99726fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Returning 404 to user: Instance c7c5a0fa-77ac-4c53-b18b-807a67298932 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:37.099403 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19d3d938-9dba-48a3-993d-3e2bc99726fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/c7c5a0fa-77ac-4c53-b18b-807a67298932/action" status: 404 len: 111 microversion: 2.1 time: 0.043620 Oct 31 15:29:37.099403 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1626/3067] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:37 2022] POST /compute/v2.1/servers/c7c5a0fa-77ac-4c53-b18b-807a67298932/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:37.105959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7ac1db1-cfee-4912-ab1b-804555fae033 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:37.106463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a7ac1db1-cfee-4912-ab1b-804555fae033 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.123491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7ac1db1-cfee-4912-ab1b-804555fae033 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.124033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7ac1db1-cfee-4912-ab1b-804555fae033 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.124474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7ac1db1-cfee-4912-ab1b-804555fae033 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.125266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7ac1db1-cfee-4912-ab1b-804555fae033 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.125996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7ac1db1-cfee-4912-ab1b-804555fae033 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.126643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7ac1db1-cfee-4912-ab1b-804555fae033 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.190119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-d361cf46-6d2a-4ad8-aaf4-bde722970ccd tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:37.197264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-d361cf46-6d2a-4ad8-aaf4-bde722970ccd tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Getting quotas for user 66e04d9ff16e4b18aa7090ef5a8db935 and project bd7b516b558d4b02a05d728b4bcd97e4. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:37.216298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:37.261187 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7ac1db1-cfee-4912-ab1b-804555fae033 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169083 Oct 31 15:29:37.262141 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1627/3068] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:29:37 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:37.266822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-37c8ff4d-8fa8-4573-a4e8-60e3c9140c69 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:37.267494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-37c8ff4d-8fa8-4573-a4e8-60e3c9140c69 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.278451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c8ff4d-8fa8-4573-a4e8-60e3c9140c69 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.279786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c8ff4d-8fa8-4573-a4e8-60e3c9140c69 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.280604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c8ff4d-8fa8-4573-a4e8-60e3c9140c69 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.281355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c8ff4d-8fa8-4573-a4e8-60e3c9140c69 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.281817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c8ff4d-8fa8-4573-a4e8-60e3c9140c69 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.282238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37c8ff4d-8fa8-4573-a4e8-60e3c9140c69 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.416772 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-37c8ff4d-8fa8-4573-a4e8-60e3c9140c69 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action" status: 202 len: 0 microversion: 2.1 time: 0.153112 Oct 31 15:29:37.418163 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1628/3069] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:37 2022] POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:29:37.431619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:37.432897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.441617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.443147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.444246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.445803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.447132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.448075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.608399 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d361cf46-6d2a-4ad8-aaf4-bde722970ccd tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "POST /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.526637 Oct 31 15:29:37.609226 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1442/3070] 10.222.0.20 () {60 vars in 1281 bytes} [Mon Oct 31 15:29:37 2022] POST /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 85 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:37.617943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:37.619994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:37.635903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.637548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.638594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.639535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:37.640578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:37.641238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:37.908570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:37.916825 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ab7bc604-494a-4694-a4ce-64f1ca5e9c5b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.305428 Oct 31 15:29:37.917180 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1443/3071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:37 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:37.922605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-970568cd-2a00-4bb1-bc44-71b15adbe994 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] Calling method '.version_select at 0x7f16e13f7f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:37.941883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:37.951242 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5526be5-386c-4adc-bf2a-a17424640c83 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1520 microversion: 2.1 time: 0.528489 Oct 31 15:29:37.952191 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1629/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:37 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1520 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:37.983455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-970568cd-2a00-4bb1-bc44-71b15adbe994 tempest-ImagesMetadataTestJSON-962698804 tempest-ImagesMetadataTestJSON-962698804-project] 10.222.0.20 "GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata" status: 200 len: 85 microversion: 2.1 time: 0.065195 Oct 31 15:29:37.984202 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1444/3073] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:29:37 2022] GET /compute/v2.1/images/95f58aa5-9f45-4df9-9026-869d458f056e/metadata => generated 85 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:29:38.089316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:38.091969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:38.100185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:38.102465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:38.103446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:38.104560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:38.105309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:38.105967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:38.106922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:38.107697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:38.122448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:38.123863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:38.124550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:38.126080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:38.127691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:38.132501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:38.454158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:38.467464 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ff5da2ff-5eef-4a24-a6c9-54180a47ade6 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1317 microversion: 2.1 time: 0.364408 Oct 31 15:29:38.468597 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1445/3074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:38 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:38.939949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:38.940574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:38.950189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:38.950694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:38.953881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:38.954696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:38.955126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:38.957375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.110916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:39.123031 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9772fd5-13df-40b2-880f-9487ece9667d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1309 microversion: 2.1 time: 1.057361 Oct 31 15:29:39.132967 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1630/3075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:38 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1309 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:39.140771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:39.142590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:39.150247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.151021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.152163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.153357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.154188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.154820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.390363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:39.398708 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e41d13c-c4c4-4f78-bbc4-4a1ef6cafef1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.462633 Oct 31 15:29:39.399482 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1446/3076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:38 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:39.404742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d451c48b-8fce-4397-828e-a69516536331 req-388667e5-5cb3-486e-871b-faac45b96bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72239fd2-0c1e-48de-abd2-39d9859bad05", "tag": "f649c48e-ea8b-4946-b8e0-7a76aaa49162"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:39.415574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d451c48b-8fce-4397-828e-a69516536331 req-388667e5-5cb3-486e-871b-faac45b96bf3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.416299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d451c48b-8fce-4397-828e-a69516536331 req-388667e5-5cb3-486e-871b-faac45b96bf3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.416868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d451c48b-8fce-4397-828e-a69516536331 req-388667e5-5cb3-486e-871b-faac45b96bf3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.429387 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d451c48b-8fce-4397-828e-a69516536331 req-388667e5-5cb3-486e-871b-faac45b96bf3 service nova] Creating event network-changed:f649c48e-ea8b-4946-b8e0-7a76aaa49162 for instance 72239fd2-0c1e-48de-abd2-39d9859bad05 on n-h2-858384-17 Oct 31 15:29:39.435534 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d451c48b-8fce-4397-828e-a69516536331 req-388667e5-5cb3-486e-871b-faac45b96bf3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033972 Oct 31 15:29:39.436300 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1447/3077] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:39.494712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:39.496366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:39.508900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.510364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.511233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.512327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.513561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.514474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.656792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:39.667511 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-895641d6-9017-4389-ae9f-c63d6c3bbf08 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1500 microversion: 2.1 time: 0.531069 Oct 31 15:29:39.669183 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1631/3078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:39 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1500 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:39.693624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:39.696950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:39.704275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.705230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.705617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.706877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.707184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.708002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.735098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lazy-loading 'flavor' on Instance uuid e38eb051-6410-4f8b-a4d6-19da70665a57 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:39.748805 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] HTTP exception thrown: Cannot 'rescue' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state paused Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Request method failure captured: Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action HTTP/1.1 Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 14 Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-mPAZq-02OTEsnv8GMkJRDJDL-rAJdgEJHn39ABJutgfh2_1AZN2oCBsrYt27l5tKBr9RG945Kyk--1kSEQ-akNiYprUFz_R7VxoVIJfbKRGxwgEKLAB8nUjvzWuTNL6KRyvhFuZKw3wxu_FY2qhzM7Zf-aduk3Wugzl7BHJI8VXXg Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9275c27ad1ac40568e4dbc778857d333", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9275c27ad1ac40568e4dbc778857d333"}]}] Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b56e2ca778b04f7c9fc7590faacb4c1a Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: {"rescue": {}} Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: exception: Cannot 'rescue' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state paused Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'e38eb051-6410-4f8b-a4d6-19da70665a57', 'body': {'rescue': {}}} Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e38eb051-6410-4f8b-a4d6-19da70665a57 in vm_state paused. Cannot rescue while the instance is in this state. Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state paused Oct 31 15:29:39.750699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state paused Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:39.756161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Returning 409 to user: Cannot 'rescue' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state paused {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:39.757546 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-91ee28f9-2d2c-4166-a8d8-1bacbc02cecf tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action" status: 409 len: 144 microversion: 2.1 time: 0.069604 Oct 31 15:29:39.758379 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1632/3079] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:39 2022] POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action => generated 144 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:29:39.766768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-917c767f-3fc7-4274-9ff7-aee7af43092f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:39.767434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-917c767f-3fc7-4274-9ff7-aee7af43092f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:39.774237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-917c767f-3fc7-4274-9ff7-aee7af43092f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.774868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-917c767f-3fc7-4274-9ff7-aee7af43092f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.775435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-917c767f-3fc7-4274-9ff7-aee7af43092f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.776247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-917c767f-3fc7-4274-9ff7-aee7af43092f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.776808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-917c767f-3fc7-4274-9ff7-aee7af43092f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.777384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-917c767f-3fc7-4274-9ff7-aee7af43092f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.784152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:39.865107 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-917c767f-3fc7-4274-9ff7-aee7af43092f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action" status: 202 len: 0 microversion: 2.1 time: 0.101094 Oct 31 15:29:39.876774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:39.880811 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1633/3080] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:39 2022] POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:29:39.887323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:39.887820 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b32988cd-5034-4eb6-a8fa-9d8ff185c45c tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1317 microversion: 2.1 time: 0.398964 Oct 31 15:29:39.888014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:39.888761 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1448/3081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:39 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:39.896215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.896707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.897166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:39.897901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:39.898353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:39.898776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.148054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:40.148797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:40.156084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.156728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.157299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.158110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.159414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.159960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.329089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:40.345037 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98a2a8ba-7bae-4e21-94ca-358d1ed8b4bf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1309 microversion: 2.1 time: 0.201331 Oct 31 15:29:40.345767 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1449/3082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:40 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1309 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:40.426212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:40.427742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:40.435054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.435702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.436323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.436995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.437693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.438218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.497010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:40.511777 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16c27739-6d08-46b8-b664-3be26c276284 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1507 microversion: 2.1 time: 0.626672 Oct 31 15:29:40.512837 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1634/3083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:39 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1507 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:40.600684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:40.608666 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e286f56-7724-427f-81c0-7c11c3ef9cf1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.186889 Oct 31 15:29:40.609546 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1450/3084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:40 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:40.829396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:40.830978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:40.845469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.846955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.847854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.850240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.850722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.851191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.869302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e64b086a-2d30-4f63-95f4-db571b92ccdc req-91b00e97-d0bb-41e2-8cf1-b176c233d126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f635e6d-663a-41b1-b002-5cd9d22c9e93", "tag": "eafc417a-a0f6-407b-9664-020730250cc2"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:40.883948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e64b086a-2d30-4f63-95f4-db571b92ccdc req-91b00e97-d0bb-41e2-8cf1-b176c233d126 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.884451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e64b086a-2d30-4f63-95f4-db571b92ccdc req-91b00e97-d0bb-41e2-8cf1-b176c233d126 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.884888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e64b086a-2d30-4f63-95f4-db571b92ccdc req-91b00e97-d0bb-41e2-8cf1-b176c233d126 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.915057 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e64b086a-2d30-4f63-95f4-db571b92ccdc req-91b00e97-d0bb-41e2-8cf1-b176c233d126 service nova] Creating event network-changed:eafc417a-a0f6-407b-9664-020730250cc2 for instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 on n-h2-858384-17 Oct 31 15:29:40.934774 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e64b086a-2d30-4f63-95f4-db571b92ccdc req-91b00e97-d0bb-41e2-8cf1-b176c233d126 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069173 Oct 31 15:29:40.936793 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1451/3085] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:29:40.943703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:40.944355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:40.951801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.952059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.952551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:40.953683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:40.954149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:40.954639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.218619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:41.235846 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc480ec3-2fc9-4ec3-94d2-0313ddd01382 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1481 microversion: 2.1 time: 0.412585 Oct 31 15:29:41.236826 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1635/3086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:40 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1481 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:41.244153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-04b9e95b-6e09-4ff3-a3ef-64374c0ba94e req-78bf584b-4afc-48b6-a371-526e2a444e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd", "name": "network-vif-plugged", "status": "completed", "tag": "e5852e9c-da30-4572-ad04-afd9aafe87eb"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:41.259941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04b9e95b-6e09-4ff3-a3ef-64374c0ba94e req-78bf584b-4afc-48b6-a371-526e2a444e87 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.260420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04b9e95b-6e09-4ff3-a3ef-64374c0ba94e req-78bf584b-4afc-48b6-a371-526e2a444e87 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.260847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04b9e95b-6e09-4ff3-a3ef-64374c0ba94e req-78bf584b-4afc-48b6-a371-526e2a444e87 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.281596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-04b9e95b-6e09-4ff3-a3ef-64374c0ba94e req-78bf584b-4afc-48b6-a371-526e2a444e87 service nova] Creating event network-vif-plugged:e5852e9c-da30-4572-ad04-afd9aafe87eb for instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd on n-h1-858384-17 Oct 31 15:29:41.290251 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-04b9e95b-6e09-4ff3-a3ef-64374c0ba94e req-78bf584b-4afc-48b6-a371-526e2a444e87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052136 Oct 31 15:29:41.296895 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1636/3087] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:41.370071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:41.371057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:41.378064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.378757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.379670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.380683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.381328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.381905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.434701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:41.446401 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d446e011-ffc2-42e9-abd4-1834617a80d2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1317 microversion: 2.1 time: 0.508282 Oct 31 15:29:41.450167 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1452/3088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:40 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:41.541016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:41.541704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:41.548809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.549357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.549820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.550545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.551050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.552076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.883599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:41.893261 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2eb6109-42aa-4e5e-b759-c9097bf814e1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1309 microversion: 2.1 time: 0.527972 Oct 31 15:29:41.893976 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1637/3089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:41 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:41.900452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:41.901414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:41.922245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.923625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.924169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:41.925274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:41.926074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:41.926643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.011233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.021039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:42.024081 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ad065e8d-c6d0-4947-adc0-27d3d0d7f413 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1515 microversion: 2.1 time: 0.487881 Oct 31 15:29:42.025246 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1453/3090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:41 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1515 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:42.415367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.424963 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-189248e8-755b-43d1-8d7b-8f4fb7493dd9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.528921 Oct 31 15:29:42.437859 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1638/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:41 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:42.477765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:42.478378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:42.486766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.487475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.487915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.488626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.489177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.489623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.654462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:42.664400 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dba5c78c-e3b7-45e8-83b0-304f8c3452ea tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1317 microversion: 2.1 time: 0.192023 Oct 31 15:29:42.665176 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1454/3092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:42 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:42.929952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:42.931855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:42.955739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.956637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.959278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:42.964242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:42.965938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:42.968235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:43.247767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:43.260428 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35c7b343-8ef1-4ff3-a693-59822d795604 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1309 microversion: 2.1 time: 0.343371 Oct 31 15:29:43.261779 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1639/3093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:42 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:43.451116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:43.451738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:43.470241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:43.474500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:43.475240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:43.476292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:43.476921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:43.477553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:43.687306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:43.688339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:43.697668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:43.698585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:43.699188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:43.700080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:43.700704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:43.701355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:43.972648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:43.984753 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de6736b6-5943-4d6d-9f0b-a17e95a9ca6b tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1317 microversion: 2.1 time: 0.301268 Oct 31 15:29:43.986272 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1640/3094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:43 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:44.001495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:44.010462 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f6975f85-b6ff-4393-b8fb-30338bdc967d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.564179 Oct 31 15:29:44.025567 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1455/3095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:43 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:44.287148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:44.287948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:44.296377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.298991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.304206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.305254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.306998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.307614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.598987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:44.608930 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9470db40-c7f0-4405-975e-3b3b4853bdda tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1490 microversion: 2.1 time: 0.325962 Oct 31 15:29:44.621068 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1641/3096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:44 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1490 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:44.638733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:44.639519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:44.672091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.674465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.675117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.675559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:44.681632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.683759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.684924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.685724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:44.693172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.694024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.694558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.695610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.696069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.696607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.737545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lazy-loading 'flavor' on Instance uuid e38eb051-6410-4f8b-a4d6-19da70665a57 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:44.846571 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-271eefc1-be33-4111-8264-320e428eea63 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action" status: 200 len: 32 microversion: 2.1 time: 0.194640 Oct 31 15:29:44.852901 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1642/3097] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:44 2022] POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:29:44.861428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:44.862856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:44.878346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.879107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.880407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:44.881462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:44.882088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:44.882669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.076719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:45.090532 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ace51c3-2312-448f-8b86-799c67423968 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1489 microversion: 2.1 time: 0.458509 Oct 31 15:29:45.095413 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1456/3098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:44 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1489 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:45.122392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:45.123395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:45.131085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:45.133777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.134661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.135256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.138376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.139068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.139695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.382441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:45.393515 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-448407ef-3483-4c78-b400-99e4b571d817 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.536177 Oct 31 15:29:45.394316 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1643/3099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:44 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:45.413674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:45.413674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:45.432500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.433161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.433682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.434557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.439193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.439794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.599922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:45.611373 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97894e69-5b18-4c5b-9818-3d308aa0790f tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1317 microversion: 2.1 time: 0.492844 Oct 31 15:29:45.615642 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1457/3100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:45 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:45.620760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:45.626508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:45.646460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.647029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.647413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.650213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.650909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.651527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.896980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:45.906538 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5ede52c4-3c47-4102-a8e1-52ec8b30b6e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.508880 Oct 31 15:29:45.907142 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1644/3101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:45 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:45.916675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-594c42b3-de47-467e-a4df-2aae2f6daca9 req-76307747-ab9a-441b-875e-549860ba4198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72239fd2-0c1e-48de-abd2-39d9859bad05", "name": "network-vif-plugged", "status": "completed", "tag": "f649c48e-ea8b-4946-b8e0-7a76aaa49162"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:45.942867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-594c42b3-de47-467e-a4df-2aae2f6daca9 req-76307747-ab9a-441b-875e-549860ba4198 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:45.944019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-594c42b3-de47-467e-a4df-2aae2f6daca9 req-76307747-ab9a-441b-875e-549860ba4198 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:45.944756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-594c42b3-de47-467e-a4df-2aae2f6daca9 req-76307747-ab9a-441b-875e-549860ba4198 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:45.956062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:45.966171 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7885edb2-cb1e-4422-8999-f6f94e5cbc51 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1490 microversion: 2.1 time: 0.349165 Oct 31 15:29:45.976249 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1458/3102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:45 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1490 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:45.980243 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-594c42b3-de47-467e-a4df-2aae2f6daca9 req-76307747-ab9a-441b-875e-549860ba4198 service nova] Creating event network-vif-plugged:f649c48e-ea8b-4946-b8e0-7a76aaa49162 for instance 72239fd2-0c1e-48de-abd2-39d9859bad05 on n-h2-858384-17 Oct 31 15:29:45.997930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:46.000359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:46.003078 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-594c42b3-de47-467e-a4df-2aae2f6daca9 req-76307747-ab9a-441b-875e-549860ba4198 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087120 Oct 31 15:29:46.006710 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1645/3103] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:46.027723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.028636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.029297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.030786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.034061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.034750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.115113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:29:46.316714 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-554321b0-2b78-4c6c-b8cd-24db92dbbeae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 204 len: 0 microversion: 2.1 time: 0.329153 Oct 31 15:29:46.322111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1459/3104] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:29:45 2022] DELETE /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:29:46.328418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:46.329375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:46.347676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.353011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.358246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.359913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.360654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.361378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.422484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:46.423190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:46.430507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.431001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.431452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.432153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.432627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.433064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.518542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=30 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:46.764112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:46.777498 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3237f33-4166-4058-8dcb-74a1312b6124 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.358862 Oct 31 15:29:46.782104 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1460/3105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:46 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:46.794298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:46.795337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:46.811630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.812565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.813206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:46.814210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:46.814885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:46.815620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:47.121633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:47.136267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:47.137174 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a9d1928-2194-4320-8e79-249504353c5e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1496 microversion: 2.1 time: 0.811677 Oct 31 15:29:47.139071 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1646/3106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:46 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1496 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:47.144397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:47.153318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:47.172132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:47.172682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:47.173089 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1545aa91-304a-4430-ba39-773c0436a9ec tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1317 microversion: 2.1 time: 0.389470 Oct 31 15:29:47.175270 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1461/3107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:46 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:47.185536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:47.186548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:47.195722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:47.196476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:47.473668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:47.487134 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6557554b-8a20-49a6-9fb5-af311441e859 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.345922 Oct 31 15:29:47.488408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1647/3108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:47 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:47.812344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:47.813071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:47.816604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=22 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:47.834781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:47.838602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:47.839211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:47.840520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:47.842787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:47.843343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.166919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:48.167584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:48.180615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.181072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.181536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.182357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.182816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.183240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.222231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:48.569794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:48.575711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:48.587369 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-435bf3c9-4d13-4c9b-9fcf-1b2cf75cd3e4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.779191 Oct 31 15:29:48.592594 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1462/3109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:47 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:48.605854 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e78b7aad-a8d8-4a32-87d7-94fa80502ba8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1496 microversion: 2.1 time: 0.444978 Oct 31 15:29:48.608627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:48.609284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:48.628722 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1648/3110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:48 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1496 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:48.638981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.639881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.640514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:48.640766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.641183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:48.645886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.647855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.648540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.665071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.666034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.666689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:48.668316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:48.672940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:48.676092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.076434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:49.090365 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1cda3937-10ad-4b7b-97f7-a458144db807 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.459300 Oct 31 15:29:49.091132 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1649/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:48 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:49.201556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:49.225923 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea1a9de2-a3b2-45d7-ba6f-651d0cb5fb68 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1467 microversion: 2.1 time: 0.631676 Oct 31 15:29:49.226688 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1463/3112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:48 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1467 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:49.251119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:49.252442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:49.269301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.270248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.271299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.272513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.273353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.274013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.360566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lazy-loading 'flavor' on Instance uuid 72239fd2-0c1e-48de-abd2-39d9859bad05 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:49.583140 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce4733fb-c474-4b42-8378-da22cd32ba96 tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05/action" status: 202 len: 0 microversion: 2.1 time: 0.335517 Oct 31 15:29:49.591045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-09b13519-d787-4af4-9047-d10e4232e50d req-e1a1d248-5497-4704-b497-fb71fbd43da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd", "name": "network-vif-deleted", "tag": "e5852e9c-da30-4572-ad04-afd9aafe87eb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:49.602171 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1650/3113] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:49 2022] POST /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:29:49.621016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:49.621781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:49.622417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-09b13519-d787-4af4-9047-d10e4232e50d req-e1a1d248-5497-4704-b497-fb71fbd43da5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.622936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-09b13519-d787-4af4-9047-d10e4232e50d req-e1a1d248-5497-4704-b497-fb71fbd43da5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.623386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-09b13519-d787-4af4-9047-d10e4232e50d req-e1a1d248-5497-4704-b497-fb71fbd43da5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.644130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.649007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.651546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.657313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.661379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.662179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.662357 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-09b13519-d787-4af4-9047-d10e4232e50d req-e1a1d248-5497-4704-b497-fb71fbd43da5 service nova] Creating event network-vif-deleted:e5852e9c-da30-4572-ad04-afd9aafe87eb for instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd on n-h1-858384-17 Oct 31 15:29:49.679387 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-09b13519-d787-4af4-9047-d10e4232e50d req-e1a1d248-5497-4704-b497-fb71fbd43da5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097951 Oct 31 15:29:49.682419 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1464/3114] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:49.694578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:49.698312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:49.727428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.728260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.728982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:49.730097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:49.732256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:49.734668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.115516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:50.138007 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45e12e22-032b-46a9-960e-c0ace41de9b3 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1475 microversion: 2.1 time: 0.533152 Oct 31 15:29:50.153854 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1651/3115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:49 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1475 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:50.159828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:50.160344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:50.167151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.167647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.168086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.168799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.169309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.169738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.276560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.277112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.277529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.277984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lazy-loading 'fault' on Instance uuid a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:50.359966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:50.387432 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-93f9bff9-2cd9-4644-9471-a7205b83ec09 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 200 len: 1299 microversion: 2.1 time: 0.232548 Oct 31 15:29:50.389529 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1652/3116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:50 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 1299 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:50.408359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:50.412704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:50.448977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.449882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.450521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.451666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:50.452390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:50.453049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:50.454258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:50.474924 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-90b8afc9-31d3-4012-8b83-98fa7a276140 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.790794 Oct 31 15:29:50.476758 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1465/3117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:49 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:50.756144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:50.769704 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de83d2cf-14a3-4e62-a149-b6a2ad1b791e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.372872 Oct 31 15:29:50.770824 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1653/3118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:50 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:51.163301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:51.163920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:51.179467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.179467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.179815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.180409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.180875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.181396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.204038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40f57c0c-ca15-40b7-af4b-9ee3cc1f96dd tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Action: 'create', calling method: .version_select at 0x7f16e125ae50>, body: {"keypair": {"name": "tempest-keypair-1061783245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA6eQCjqoJ1XYDqA8wNreYs6d+YajiVRGN7Ip/HK0/sEh1r/H8KHBaRbcvDYXMwO2gGRohDg5p2mI26gW9jMUA1sraUHjs0R9oeaYrp1Xt8B4Xuqfny+H8rn0Vq+kiNbw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:51.244825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-40f57c0c-ca15-40b7-af4b-9ee3cc1f96dd tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Getting quotas for project 4b80a5a22f05497590852beb8cd7de22. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:51.251256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-40f57c0c-ca15-40b7-af4b-9ee3cc1f96dd tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Getting quotas for user b8833cedeef14d3cb229231cff3a99d3 and project 4b80a5a22f05497590852beb8cd7de22. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:51.288883 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40f57c0c-ca15-40b7-af4b-9ee3cc1f96dd tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240437 Oct 31 15:29:51.292151 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1466/3119] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:29:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:51.380318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:51.390307 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5bd18dc8-dcd8-4fb2-b104-6ea59444ccf7 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1458 microversion: 2.1 time: 0.231781 Oct 31 15:29:51.391774 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1654/3120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:51 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1458 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:51.416101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:51.418019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:51.430941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.435595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0fe55a6-78cb-4883-be88-6ca1676d97ae tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:51.436462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.437073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.438052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0fe55a6-78cb-4883-be88-6ca1676d97ae tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:51.438264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.438883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.439469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.446741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0fe55a6-78cb-4883-be88-6ca1676d97ae tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.447328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0fe55a6-78cb-4883-be88-6ca1676d97ae tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.447854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0fe55a6-78cb-4883-be88-6ca1676d97ae tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.448628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0fe55a6-78cb-4883-be88-6ca1676d97ae tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.449163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0fe55a6-78cb-4883-be88-6ca1676d97ae tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.449646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0fe55a6-78cb-4883-be88-6ca1676d97ae tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.456886 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd HTTP/1.1 Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd'} Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:51.460696 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:51.465308 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:51.465308 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:51.465308 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:51.465308 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:51.465308 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:51.465308 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:29:51.465308 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:51.468738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:51.469956 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ceddf225-e1cf-49b1-87ef-c51904ac4620 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 404 len: 111 microversion: 2.1 time: 0.059770 Oct 31 15:29:51.471121 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1467/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:51 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:51.480703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:51.481547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:51.487944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.488813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.489619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.490573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.491231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.491890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.525672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:29:51.722319 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0751a5d1-61bd-4e25-9f5b-6dd00257f531 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 204 len: 0 microversion: 2.1 time: 0.245037 Oct 31 15:29:51.724231 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1468/3122] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:29:51 2022] DELETE /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:29:51.734952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:51.736049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:51.743898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.744448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.744923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.745814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:51.746333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:51.746918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:51.770514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:51.999979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:52.012493 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c13b3c8-af0d-446b-bf03-ef64b1964ffb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.285880 Oct 31 15:29:52.013992 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1469/3123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:51 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:52.031295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:52.032150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:52.049443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.051832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.052542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.055703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.057869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.058539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.368032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:52.385081 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7c75e0c-5e5e-4225-b394-04e5511d0f05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1495 microversion: 2.1 time: 0.364672 Oct 31 15:29:52.389740 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1470/3124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:52 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1495 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:52.402237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:52.405709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:52.423723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.424225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.424672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.425636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.426220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.426549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.536334 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0fe55a6-78cb-4883-be88-6ca1676d97ae tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1611 microversion: 2.1 time: 1.113201 Oct 31 15:29:52.537438 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1655/3125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:51 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1611 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:52.585662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab4dc5a2-d3b5-4519-a708-5dbd75145fef tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:52.592387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab4dc5a2-d3b5-4519-a708-5dbd75145fef tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.598994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab4dc5a2-d3b5-4519-a708-5dbd75145fef tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.599576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab4dc5a2-d3b5-4519-a708-5dbd75145fef tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.600496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab4dc5a2-d3b5-4519-a708-5dbd75145fef tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.601066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab4dc5a2-d3b5-4519-a708-5dbd75145fef tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.604795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab4dc5a2-d3b5-4519-a708-5dbd75145fef tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.668901 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab4dc5a2-d3b5-4519-a708-5dbd75145fef tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.104780 Oct 31 15:29:52.679115 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1656/3126] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 31 15:29:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:52.695424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-858384-17", "block_migration": true, "disk_over_commit": false}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:52.698469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:52.718466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.719659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.720323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.721873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.724837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.725590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.805769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Lazy-loading 'flavor' on Instance uuid 72239fd2-0c1e-48de-abd2-39d9859bad05 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:29:52.830462 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 72239fd2-0c1e-48de-abd2-39d9859bad05 while it is in vm_state suspended Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Request method failure captured: Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05/action HTTP/1.1 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 98 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-nJPMxHI72KdwynSHrgiGobgHZ3GdXDq5TPKykCTOiQzwWhxbKEAkDRAFPhJJvF_VPQ1wAoE45xTItP1tSNkkzRU2ENNbzRK-AtzYQR0ByiXArUrJ8DKkekJBCOZMBx6rqvNl5iQphmX_NSvicQDcV-7W3F-FbKaOU5sc1-RgvjLS8 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: cf5bce196ddc4119bdc2f0b5253ead85 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-LiveMigrationNegativeTest-1160034860 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf5bce196ddc4119bdc2f0b5253ead85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cf5bce196ddc4119bdc2f0b5253ead85", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cf5bce196ddc4119bdc2f0b5253ead85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cf5bce196ddc4119bdc2f0b5253ead85"}]}] Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-LiveMigrationNegativeTest-1160034860 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: cf5bce196ddc4119bdc2f0b5253ead85 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1160034860 Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-LiveMigrationNegativeTest-1160034860-project-admin Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ed5bab859ac749d4b179692e9658b1bf Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-LiveMigrationNegativeTest-1160034860-project-admin Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: {"os-migrateLive": {"host": "n-h1-858384-17", "block_migration": true, "disk_over_commit": false}} Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: exception: Cannot 'os-migrateLive' instance 72239fd2-0c1e-48de-abd2-39d9859bad05 while it is in vm_state suspended Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '72239fd2-0c1e-48de-abd2-39d9859bad05', 'body': {'os-migrateLive': {'host': 'n-h1-858384-17', 'block_migration': True, 'disk_over_commit': False}}} Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 72239fd2-0c1e-48de-abd2-39d9859bad05 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:52.834211 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 72239fd2-0c1e-48de-abd2-39d9859bad05 while it is in vm_state suspended Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 72239fd2-0c1e-48de-abd2-39d9859bad05 while it is in vm_state suspended Oct 31 15:29:52.838817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:52.842735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 72239fd2-0c1e-48de-abd2-39d9859bad05 while it is in vm_state suspended {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:52.845454 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2414d5d2-baf9-4a5c-9223-78f079be3c0a tempest-LiveMigrationNegativeTest-1160034860 tempest-LiveMigrationNegativeTest-1160034860-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05/action" status: 409 len: 155 microversion: 2.1 time: 0.159806 Oct 31 15:29:52.852626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1657/3127] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:29:52 2022] POST /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05/action => generated 155 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:29:52.858041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:52.858680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:52.869548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.870171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.870708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.871521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:52.872098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:52.872619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:52.897594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:52.914152 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9186cdf1-db76-47c7-a8df-eca838f1e88c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.518585 Oct 31 15:29:52.917436 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1471/3128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:52 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:52.948423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:29:53.046115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:53.051894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:53.068261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.069225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.069898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.071540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.077228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.077869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.177407 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-47aaa1b7-8fed-45df-961c-e9e7c46aa6e9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 204 len: 0 microversion: 2.1 time: 0.323046 Oct 31 15:29:53.183284 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1658/3129] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:29:52 2022] DELETE /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:29:53.198789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:53.199794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:53.216914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.222378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.223940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.225215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.225756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.226703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.415662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:53.426055 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-39dfa663-1258-4d3e-9e89-27deeb46a86a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.387352 Oct 31 15:29:53.427922 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1472/3130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:53 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:53.436697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:53.441347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:53.455288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.456764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.459626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.460554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.461048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.461522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.794615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:53.806334 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28561b41-0215-4f1a-8dab-e56785a3476c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1495 microversion: 2.1 time: 0.377002 Oct 31 15:29:53.809317 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1473/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:53 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1495 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:53.922330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:53.938411 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b954cca6-0936-48de-ab7c-455f85d683aa tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1464 microversion: 2.1 time: 0.753674 Oct 31 15:29:53.939012 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1659/3132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:53 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1464 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:53.956679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:53.956679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:53.976237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.977546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.978314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:53.979290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:53.979991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:53.981117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:54.211071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:54.223059 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8be05b35-5390-4f14-9a03-6aedec1c6c52 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.286833 Oct 31 15:29:54.236141 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1474/3133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:53 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:54.409949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1118553650", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "06e7639b-5f0f-44e8-bf26-2b96fed67e34"}], "security_groups": [{"name": "tempest-securitygroup--458148973"}], "key_name": "tempest-keypair-1061783245", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:54.441052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:54.455509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:54.456745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:54.466673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:54.467204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:54.468094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:54.470428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:54.471089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:54.471834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:54.614182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] validate_networks() for [('06e7639b-5f0f-44e8-bf26-2b96fed67e34', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:54.738475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:54.749504 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0260ba6b-d301-4d8c-8b05-17a5aa29d724 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.299102 Oct 31 15:29:54.750863 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1475/3134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:54 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:54.832323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:54.833353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:54.844488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:54.849674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:54.850935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:54.851718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:54.852180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:54.852610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:54.959462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:54.975465 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-02486b95-d71e-4628-8aa6-e573f2451664 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 200 len: 1453 microversion: 2.1 time: 0.146000 Oct 31 15:29:54.975695 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1476/3135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:54 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:54.982698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-041ff339-733b-47cb-be07-4aa2133569a8 req-062a5ccc-21ca-44d5-a5c1-2bed663e61d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68000c37-bab1-490d-b199-cc5caed3783f", "name": "network-vif-deleted", "tag": "08ac035f-6122-4952-ae6b-858760bdd7ff"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:54.994270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-041ff339-733b-47cb-be07-4aa2133569a8 req-062a5ccc-21ca-44d5-a5c1-2bed663e61d6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:54.994920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-041ff339-733b-47cb-be07-4aa2133569a8 req-062a5ccc-21ca-44d5-a5c1-2bed663e61d6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:54.995353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-041ff339-733b-47cb-be07-4aa2133569a8 req-062a5ccc-21ca-44d5-a5c1-2bed663e61d6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.012814 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-041ff339-733b-47cb-be07-4aa2133569a8 req-062a5ccc-21ca-44d5-a5c1-2bed663e61d6 service nova] Creating event network-vif-deleted:08ac035f-6122-4952-ae6b-858760bdd7ff for instance 68000c37-bab1-490d-b199-cc5caed3783f on n-h1-858384-17 Oct 31 15:29:55.020459 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-041ff339-733b-47cb-be07-4aa2133569a8 req-062a5ccc-21ca-44d5-a5c1-2bed663e61d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043177 Oct 31 15:29:55.021658 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1477/3136] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:55.027794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:55.028482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:55.042494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.042987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.043421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.044691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.045172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.045618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.231454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:55.250559 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2dc1dc71-abbe-460e-acbc-1d25519739f1 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1464 microversion: 2.1 time: 0.218047 Oct 31 15:29:55.252060 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1478/3137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:55 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1464 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:55.259725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:55.260639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:55.274065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.274570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.275010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.275726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.276183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.276786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.471792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:55.481173 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae8cf781-3c25-47a3-a57e-e38274b61948 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.227436 Oct 31 15:29:55.490280 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1479/3138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:55 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:55.775150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:55.776040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:55.787705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.788578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.788721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.789381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.791168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.791958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.862179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Getting quotas for project 4b80a5a22f05497590852beb8cd7de22. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:55.876029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Getting quotas for user b8833cedeef14d3cb229231cff3a99d3 and project 4b80a5a22f05497590852beb8cd7de22. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:55.892504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:55.893207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:55.893879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:55.894561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:55.895625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:55.912458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.912961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.913597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.914563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:55.915031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:55.915638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:55.938992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Getting quotas for project 4b80a5a22f05497590852beb8cd7de22. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:55.946088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Getting quotas for user b8833cedeef14d3cb229231cff3a99d3 and project 4b80a5a22f05497590852beb8cd7de22. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:55.990287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:55.993698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:56.003753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:56.030321 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0840cfeb-e7a3-43b6-9674-e38de107ed46 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.259333 Oct 31 15:29:56.030941 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1480/3139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:55 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:56.044305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:56.045256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:56.065087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:56.065899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:56.066580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:56.068656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:56.069829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:56.071287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:56.095541 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f HTTP/1.1 Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '68000c37-bab1-490d-b199-cc5caed3783f'} Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:56.097362 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:56.102974 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:56.102974 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:56.102974 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:56.102974 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:56.102974 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:56.102974 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:29:56.102974 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:29:56.104769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:56.105868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-386912d3-10cc-4430-9c14-5c61d5247e39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 404 len: 111 microversion: 2.1 time: 0.068134 Oct 31 15:29:56.107060 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1481/3140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:56 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:56.155620 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-79db6b96-c7ef-45a4-8385-164d320cdf29 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.755316 Oct 31 15:29:56.163603 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1660/3141] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 1765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:56.178313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8916e54c-2f39-4c56-b30c-5b53c08f2d7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:56.179275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8916e54c-2f39-4c56-b30c-5b53c08f2d7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:56.193757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:56.280033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:56.281024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:56.305556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:56.307681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:56.309402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:56.312815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:56.313827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:56.314506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:56.347358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8916e54c-2f39-4c56-b30c-5b53c08f2d7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:56.363218 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8916e54c-2f39-4c56-b30c-5b53c08f2d7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1278 microversion: 2.1 time: 0.192215 Oct 31 15:29:56.364554 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1482/3142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:56 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:56.384728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1572780065", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "2b5355db-9171-4de8-abb5-5f94412a242a"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:56.457529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:56.467763 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e6d0931-a0c7-4c0d-834c-f7f45440bbe2 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 200 len: 1293 microversion: 2.1 time: 0.194817 Oct 31 15:29:56.470308 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1661/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:56 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 1293 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:56.509479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:56.510225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:56.523753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:56.524267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:56.524712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:56.529948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:56.530466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:56.532691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:56.549933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] validate_networks() for [('2b5355db-9171-4de8-abb5-5f94412a242a', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:29:56.565976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:29:57.217906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:57.229285 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41a2aa42-672d-4194-96e3-8b3246d78e6c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.725278 Oct 31 15:29:57.230492 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1662/3144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:56 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:57.240348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:57.241865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:57.249777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.251323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.252113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.253310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.254012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.254767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.444451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:29:57.445913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:29:57.446731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:29:57.447379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:29:57.447985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:29:57.460528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.460980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.461459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.462302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.462776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.463411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.490670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:29:57.498393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for user 31cd28d777ac40eda1a7abefb5a3256d and project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:29:57.521680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:29:57.524626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:29:57.582085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:57.595276 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b11a809c-2835-470f-8082-e58cdc8f1a7e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.362379 Oct 31 15:29:57.595644 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00fafee8-f4c3-4744-a8e9-763213fb0323 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.227180 Oct 31 15:29:57.596067 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1663/3145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:57 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:57.597166 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1483/3146] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:29:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:29:57.603522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:57.604394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:57.611031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.613273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.614924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.616150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.616949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.617616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.628408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fce34ada-4878-44c6-b2d7-66bfc018acdf req-120b0952-ff92-483b-9c09-9851d67d4784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72239fd2-0c1e-48de-abd2-39d9859bad05", "name": "network-vif-deleted", "tag": "f649c48e-ea8b-4946-b8e0-7a76aaa49162"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:29:57.650920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fce34ada-4878-44c6-b2d7-66bfc018acdf req-120b0952-ff92-483b-9c09-9851d67d4784 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.654142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fce34ada-4878-44c6-b2d7-66bfc018acdf req-120b0952-ff92-483b-9c09-9851d67d4784 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.654720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fce34ada-4878-44c6-b2d7-66bfc018acdf req-120b0952-ff92-483b-9c09-9851d67d4784 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.674494 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fce34ada-4878-44c6-b2d7-66bfc018acdf req-120b0952-ff92-483b-9c09-9851d67d4784 service nova] Creating event network-vif-deleted:f649c48e-ea8b-4946-b8e0-7a76aaa49162 for instance 72239fd2-0c1e-48de-abd2-39d9859bad05 on n-h2-858384-17 Oct 31 15:29:57.689982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:57.693378 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fce34ada-4878-44c6-b2d7-66bfc018acdf req-120b0952-ff92-483b-9c09-9851d67d4784 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078146 Oct 31 15:29:57.695076 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1664/3147] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:29:57.699303 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a331d8de-19b9-413d-b3d8-6cbc46cd831a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1330 microversion: 2.1 time: 0.100674 Oct 31 15:29:57.712990 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1484/3148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:57 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:57.712990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47539eec-95f8-4629-8b46-20a99dbd58e0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:57.712990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47539eec-95f8-4629-8b46-20a99dbd58e0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:57.725461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:57.726453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 72239fd2-0c1e-48de-abd2-39d9859bad05] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:57.738020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.739332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.740071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.740907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.741466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.742001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.760769 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] HTTP exception thrown: Instance 72239fd2-0c1e-48de-abd2-39d9859bad05 could not be found. Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Request method failure captured: Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 HTTP/1.1 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-nHj6jj6qsp60wD9s3_oz8uSfDhAO6rHooPmDtIFqJSsNd3JKiqg9OPeSsp3JbRSPzTolXjycUsjkFMUZWM2PrmuMOyVrNwG1MMIxTffB1onupSHVYQMkhGSgaxKBw7GvVH57xKYgI9Xzlhqx-uaPRKOMDNTsBp_cgf0Fq1qlcSbwc Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d2ed234b3d934b4787f7a25c9b3253f5 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-LiveMigrationNegativeTest-689295755 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2ed234b3d934b4787f7a25c9b3253f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2ed234b3d934b4787f7a25c9b3253f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2ed234b3d934b4787f7a25c9b3253f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2ed234b3d934b4787f7a25c9b3253f5"}]}] Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-LiveMigrationNegativeTest-689295755 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d2ed234b3d934b4787f7a25c9b3253f5 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-689295755 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-LiveMigrationNegativeTest-689295755-project Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 8e44ce84068f48e19a71e92e53ded700 Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-LiveMigrationNegativeTest-689295755-project Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 72239fd2-0c1e-48de-abd2-39d9859bad05 could not be found. Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '72239fd2-0c1e-48de-abd2-39d9859bad05'} Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72239fd2-0c1e-48de-abd2-39d9859bad05 could not be found. Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72239fd2-0c1e-48de-abd2-39d9859bad05 could not be found. Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:29:57.764201 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:57.768908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:29:57.768908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:29:57.768908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:29:57.768908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:29:57.768908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:29:57.768908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72239fd2-0c1e-48de-abd2-39d9859bad05 could not be found. Oct 31 15:29:57.768908 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:29:57.770480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-47539eec-95f8-4629-8b46-20a99dbd58e0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:57.770684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Returning 404 to user: Instance 72239fd2-0c1e-48de-abd2-39d9859bad05 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:29:57.776607 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-860738bd-eae0-43df-b892-e30468d189d8 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05" status: 404 len: 111 microversion: 2.1 time: 0.075777 Oct 31 15:29:57.777574 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1665/3149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:57 2022] GET /compute/v2.1/servers/72239fd2-0c1e-48de-abd2-39d9859bad05 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:29:57.778600 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47539eec-95f8-4629-8b46-20a99dbd58e0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1209 microversion: 2.1 time: 0.076269 Oct 31 15:29:57.779267 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1485/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:57 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1209 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:57.785108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:57.785590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:57.796974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.796974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.796974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.796974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:57.796974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:57.796974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:57.856212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:29:58.010853 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d6df850e-a7a1-4b4e-8d56-a7fb8f568beb tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 204 len: 0 microversion: 2.1 time: 0.228576 Oct 31 15:29:58.012798 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1666/3151] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:29:57 2022] DELETE /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:29:58.021384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.022201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.034253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.036875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.037696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.038513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.039005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.042410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.234954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:58.243770 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-46d002bb-6884-472e-a2e9-d2e9aff830b9 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1473 microversion: 2.1 time: 0.226679 Oct 31 15:29:58.247637 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1486/3152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:58 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:58.262700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.263615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.270973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.271472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.271944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.272652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.273112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.273566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.503644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:58.512780 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a051f741-138c-4412-8bac-aab40a4556b9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.258621 Oct 31 15:29:58.513495 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1667/3153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:58 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:58.620542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.621197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.627679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.628171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.628675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.629796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.630256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.630677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.727284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.727897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.733814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.734982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.735462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.736380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.736849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.737637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.774538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:58.782575 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75cad877-06f8-4dac-aac9-5c36be392d8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.165936 Oct 31 15:29:58.783211 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1487/3154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:58 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:58.803915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:58.804610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:58.811063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.811448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:58.811612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.812264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.812982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:58.813518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:58.814124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:58.821178 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c931a7f-97f0-4016-b989-b7e366a1b932 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1348 microversion: 2.1 time: 0.098178 Oct 31 15:29:58.822741 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1668/3155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:58 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:58.883962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:58.893584 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e6cfdf6-aff7-4b5e-ba97-b986d2fbc59b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1213 microversion: 2.1 time: 0.093563 Oct 31 15:29:58.894190 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1488/3156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:58 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:29:59.270128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:59.272184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:59.278873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.279696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.280409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.281369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.282045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.282685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.540095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:59.541368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:59.550975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.552597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.553250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.554248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.555220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.555811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.571795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:59.581361 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-27fbbd13-f66b-4491-8448-69b6ce48ebe5 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1473 microversion: 2.1 time: 0.315062 Oct 31 15:29:59.606994 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1669/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:59 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1473 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:29:59.809935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:29:59.811689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:29:59.823686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.824702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.825442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.826492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:29:59.827278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:29:59.827849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:29:59.973706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:29:59.999931 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5205e5db-d36e-423d-972e-3a04e31a26f3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.465441 Oct 31 15:30:00.016457 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1489/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:59 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:00.030553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:00.032824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:00.044714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.045998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.046800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.047804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.049174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.050201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.065037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:00.077214 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a6451b1-59a4-46b1-82e4-aca573974bc7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.272765 Oct 31 15:30:00.079754 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1670/3159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:29:59 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:00.086970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:00.089706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:00.090351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:00.103171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.104694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.107474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.108425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.108905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.110902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.237186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:00.250158 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96865fea-b0b7-4c83-a463-9d5b0681d26b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1269 microversion: 2.1 time: 0.168776 Oct 31 15:30:00.265994 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1671/3160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:00 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1269 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:00.526292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:00.534686 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7730a718-f74d-4793-8523-570864b3671d tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1403 microversion: 2.1 time: 0.516137 Oct 31 15:30:00.535282 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1490/3161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:00 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1403 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:00.607344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:00.609668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:00.619116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.620969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.622216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.623143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.624458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.625339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.732321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e44ce84068f48e19a71e92e53ded700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed234b3d934b4787f7a25c9b3253f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:00.745580 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-acac9ce5-9a90-49e4-8563-ef8ed50cf78d tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 200 len: 1431 microversion: 2.1 time: 0.141619 Oct 31 15:30:00.757383 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1672/3162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:00 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 1431 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:00.852708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1334607a-498b-41a4-baf2-107d6e8f8559 req-72c115d6-a366-4d87-84c3-e72c34ae9988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06392995-13a7-46f2-acd2-8917f6f65bf5", "name": "network-vif-deleted", "tag": "1a856416-ed7d-4e4c-8158-7928fe83eb83"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:00.871622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1334607a-498b-41a4-baf2-107d6e8f8559 req-72c115d6-a366-4d87-84c3-e72c34ae9988 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:00.872089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1334607a-498b-41a4-baf2-107d6e8f8559 req-72c115d6-a366-4d87-84c3-e72c34ae9988 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:00.872527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1334607a-498b-41a4-baf2-107d6e8f8559 req-72c115d6-a366-4d87-84c3-e72c34ae9988 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:00.927369 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1334607a-498b-41a4-baf2-107d6e8f8559 req-72c115d6-a366-4d87-84c3-e72c34ae9988 service nova] Creating event network-vif-deleted:1a856416-ed7d-4e4c-8158-7928fe83eb83 for instance 06392995-13a7-46f2-acd2-8917f6f65bf5 on n-h1-858384-17 Oct 31 15:30:00.934297 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1334607a-498b-41a4-baf2-107d6e8f8559 req-72c115d6-a366-4d87-84c3-e72c34ae9988 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087448 Oct 31 15:30:00.935504 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1491/3163] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:01.027989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:01.028662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:01.045401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.046169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.046761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.047641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.048885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.050234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.103991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:01.105018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:01.127231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.131467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.134291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.136189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.136827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.137317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.382817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:01.392475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a8c465d9-fb8e-47db-9b35-5724513171b4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.369333 Oct 31 15:30:01.393829 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1673/3164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:01 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:01.400189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:01.400912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:01.416059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.417107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.418056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.419041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.420289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.420948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.521496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:01.535119 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0e44fe9e-e0d1-43d3-939d-2fc055fede1c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1267 microversion: 2.1 time: 0.140089 Oct 31 15:30:01.536651 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1674/3165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:01 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:01.542874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-eb1d7d08-74c0-4835-84f8-4b48591d85fa req-99da6465-f808-4b8d-b60f-47f1c2c71026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4cbe30-88fa-4f3d-b91d-95322b369e8b", "tag": "8321fc3b-db5c-4b70-b602-b9ca00054898"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:01.557053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-eb1d7d08-74c0-4835-84f8-4b48591d85fa req-99da6465-f808-4b8d-b60f-47f1c2c71026 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.557851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-eb1d7d08-74c0-4835-84f8-4b48591d85fa req-99da6465-f808-4b8d-b60f-47f1c2c71026 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.558586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-eb1d7d08-74c0-4835-84f8-4b48591d85fa req-99da6465-f808-4b8d-b60f-47f1c2c71026 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.573262 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-eb1d7d08-74c0-4835-84f8-4b48591d85fa req-99da6465-f808-4b8d-b60f-47f1c2c71026 service nova] Creating event network-changed:8321fc3b-db5c-4b70-b602-b9ca00054898 for instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b on n-h1-858384-17 Oct 31 15:30:01.579142 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-eb1d7d08-74c0-4835-84f8-4b48591d85fa req-99da6465-f808-4b8d-b60f-47f1c2c71026 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040687 Oct 31 15:30:01.580459 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1675/3166] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:01.588546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:01.589344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:01.597086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.598400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.599102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.600237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.600864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.601592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.631311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:01.650761 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a1a89d9e-5693-4fb4-886f-ed2eef6bbd8f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.551430 Oct 31 15:30:01.669631 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1492/3167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:01 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:01.772863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:01.774352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] [instance: 06392995-13a7-46f2-acd2-8917f6f65bf5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:01.781396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.782159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.782767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.783905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:01.786329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:01.787130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:01.812852 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] HTTP exception thrown: Instance 06392995-13a7-46f2-acd2-8917f6f65bf5 could not be found. Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Request method failure captured: Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 HTTP/1.1 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-nHj6jj6qsp60wD9s3_oz8uSfDhAO6rHooPmDtIFqJSsNd3JKiqg9OPeSsp3JbRSPzTolXjycUsjkFMUZWM2PrmuMOyVrNwG1MMIxTffB1onupSHVYQMkhGSgaxKBw7GvVH57xKYgI9Xzlhqx-uaPRKOMDNTsBp_cgf0Fq1qlcSbwc Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d2ed234b3d934b4787f7a25c9b3253f5 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-LiveMigrationNegativeTest-689295755 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2ed234b3d934b4787f7a25c9b3253f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d2ed234b3d934b4787f7a25c9b3253f5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d2ed234b3d934b4787f7a25c9b3253f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d2ed234b3d934b4787f7a25c9b3253f5"}]}] Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-LiveMigrationNegativeTest-689295755 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d2ed234b3d934b4787f7a25c9b3253f5 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-689295755 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-LiveMigrationNegativeTest-689295755-project Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 8e44ce84068f48e19a71e92e53ded700 Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-LiveMigrationNegativeTest-689295755-project Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 06392995-13a7-46f2-acd2-8917f6f65bf5 could not be found. Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '06392995-13a7-46f2-acd2-8917f6f65bf5'} Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06392995-13a7-46f2-acd2-8917f6f65bf5 could not be found. Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06392995-13a7-46f2-acd2-8917f6f65bf5 could not be found. Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:01.814741 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06392995-13a7-46f2-acd2-8917f6f65bf5 could not be found. Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] Returning 404 to user: Instance 06392995-13a7-46f2-acd2-8917f6f65bf5 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9aa4a125-37fb-42bc-ac90-0d9410d84f48 tempest-LiveMigrationNegativeTest-689295755 tempest-LiveMigrationNegativeTest-689295755-project] 10.222.0.20 "GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5" status: 404 len: 111 microversion: 2.1 time: 0.048331 Oct 31 15:30:01.820065 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1493/3168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:01 2022] GET /compute/v2.1/servers/06392995-13a7-46f2-acd2-8917f6f65bf5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:30:02.314781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:02.325531 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-264fc753-92e7-4fa3-9a43-bfea54a099ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1403 microversion: 2.1 time: 0.743615 Oct 31 15:30:02.343715 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1676/3169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:01 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1403 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:02.425222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:02.426321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:02.454795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.455473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.456029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.458471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.459431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.461641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.577983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:02.579054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:02.596732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.598031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.598660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.600032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.601553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.602338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.841558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:02.853236 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b70da34-dfdb-4284-bb5f-11136095ed1b tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1511 microversion: 2.1 time: 0.433690 Oct 31 15:30:02.871729 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1494/3170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:02 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:02.881999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:02.882662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:02.892926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.893863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.894900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.896204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:02.896904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:02.897691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:02.960591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:03.029013 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc0ef031-36c0-4232-beeb-1a05dbf843e7 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1309 microversion: 2.1 time: 0.462360 Oct 31 15:30:03.041390 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1677/3171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:02 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1309 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:03.198956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:03.212794 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d16fbfea-c446-44cb-a933-34a4897fc20a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.339373 Oct 31 15:30:03.213810 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1495/3172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:02 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:03.356589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:03.360126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:03.385416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:03.387266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:03.388535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:03.390913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:03.393279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:03.394249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:03.524737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7bafbec9-1723-4f75-a9bd-f0c623791732 req-8ac990f7-9231-4279-ac37-c8476bc1a11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b101cc-44dc-4159-8cf5-faffc8279d58", "tag": "b30d6fcd-12d0-4ce3-9081-e3d2cbec3540"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:03.556184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7bafbec9-1723-4f75-a9bd-f0c623791732 req-8ac990f7-9231-4279-ac37-c8476bc1a11e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:03.556767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7bafbec9-1723-4f75-a9bd-f0c623791732 req-8ac990f7-9231-4279-ac37-c8476bc1a11e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:03.557741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7bafbec9-1723-4f75-a9bd-f0c623791732 req-8ac990f7-9231-4279-ac37-c8476bc1a11e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:03.589875 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7bafbec9-1723-4f75-a9bd-f0c623791732 req-8ac990f7-9231-4279-ac37-c8476bc1a11e service nova] Creating event network-changed:b30d6fcd-12d0-4ce3-9081-e3d2cbec3540 for instance d2b101cc-44dc-4159-8cf5-faffc8279d58 on n-h1-858384-17 Oct 31 15:30:03.595737 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7bafbec9-1723-4f75-a9bd-f0c623791732 req-8ac990f7-9231-4279-ac37-c8476bc1a11e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076496 Oct 31 15:30:03.597105 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1496/3173] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:03.763226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:03.773274 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75c5f8ef-71e1-4769-a835-765a629a5358 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1403 microversion: 2.1 time: 0.425653 Oct 31 15:30:03.774345 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1678/3174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:03 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1403 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:03.889360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:03.890871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:03.901007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:03.901998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:03.902771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:03.904517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:03.905300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:03.906523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.057525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:04.058911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:04.066231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.067685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.068621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.069598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.070220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.070796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.094379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:04.105486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:04.120437 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7aa891d1-807d-4d35-9eb8-6d66de5a2e9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1488 microversion: 2.1 time: 0.237769 Oct 31 15:30:04.134749 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1497/3175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:03 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1488 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:04.151782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:04.152561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:04.164977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.165528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.166013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.167129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.168753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.169259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.211615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:04.278788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:04.288869 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-156ce817-ab37-4e29-869a-819c97b383c0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1309 microversion: 2.1 time: 0.235150 Oct 31 15:30:04.306020 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1679/3176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:04 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1309 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:04.311587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:04.312161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:04.320393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.320896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.321372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.322088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.322594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.323019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.341177 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-20ab867b-9c2e-408e-b871-338b74d2d164 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 204 len: 0 microversion: 2.1 time: 0.193184 Oct 31 15:30:04.342690 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1498/3177] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:04 2022] DELETE /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:30:04.368356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:04.369430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:04.383800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.384526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.385349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.386105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.386773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.387420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.515012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:04.538856 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76ab41ff-9957-412c-8550-655848dbbde0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.231246 Oct 31 15:30:04.539461 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1680/3178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:04 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:04.746665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:04.762099 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a18131cf-68ff-460f-aeb3-f36ea732bb15 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1494 microversion: 2.1 time: 0.403429 Oct 31 15:30:04.762664 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1499/3179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:04 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1494 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:04.798494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:04.799427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:04.808161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.809030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.809665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:04.810594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:04.811273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:04.811882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.102993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:05.117710 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46c54eec-4ad3-443d-b464-eb84410d084f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1403 microversion: 2.1 time: 0.322553 Oct 31 15:30:05.119795 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1681/3180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:04 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1403 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:05.322575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:05.323465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:05.336495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.338576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.339220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.340767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.343799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.344508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.572341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:05.579389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:05.585776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:05.593379 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f525385-16b1-4412-8967-0863f4c4b126 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1309 microversion: 2.1 time: 0.274738 Oct 31 15:30:05.594527 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1500/3181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:05 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1309 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:05.598293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.598959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.599405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.600145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.600610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.601037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.788944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:05.790228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:05.796527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.797038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.797492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.798189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:05.798657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:05.799327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:05.900729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:05.909929 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7718754-7e5e-42bd-99b8-70896392f3a6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.349377 Oct 31 15:30:05.911020 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1682/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:05 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:05.926981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:05.970228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:06.058366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-449667526", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:06.126543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:30:06.438446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:06.460669 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-484034d7-9c21-41c0-86a2-970a9de8e72e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1494 microversion: 2.1 time: 0.675857 Oct 31 15:30:06.473331 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1501/3183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:05 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1494 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:06.486023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:06.486993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:06.495685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.496477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.497169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.498131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.498855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.499568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.632830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:30:06.634488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:30:06.638194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:30:06.640819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:30:06.641399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:30:06.659567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.674693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.676670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.679418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.682115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.687562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.725550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:30:06.732710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for user 4df669ecccf24e8e9b41574f29ba157b and project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:30:06.757866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:30:06.762600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:30:06.839600 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fcf34153-b93f-4f14-9404-1c039f773d0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.926718 Oct 31 15:30:06.840863 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1683/3184] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:30:06.846106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a1347aab-45be-4c1a-8bd2-f1d2094ff428 req-7950adbb-ac4d-44f6-ac1f-2af0eca2d513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb368d4-cee6-41ca-9cbe-1c86ad8b1011", "name": "network-vif-deleted", "tag": "8fad434c-d880-48f1-8359-60a9b0ddb47d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:06.867933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a1347aab-45be-4c1a-8bd2-f1d2094ff428 req-7950adbb-ac4d-44f6-ac1f-2af0eca2d513 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.868903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a1347aab-45be-4c1a-8bd2-f1d2094ff428 req-7950adbb-ac4d-44f6-ac1f-2af0eca2d513 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.869936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a1347aab-45be-4c1a-8bd2-f1d2094ff428 req-7950adbb-ac4d-44f6-ac1f-2af0eca2d513 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.882519 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a1347aab-45be-4c1a-8bd2-f1d2094ff428 req-7950adbb-ac4d-44f6-ac1f-2af0eca2d513 service nova] Creating event network-vif-deleted:8fad434c-d880-48f1-8359-60a9b0ddb47d for instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 on n-h2-858384-17 Oct 31 15:30:06.887730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:06.888933 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a1347aab-45be-4c1a-8bd2-f1d2094ff428 req-7950adbb-ac4d-44f6-ac1f-2af0eca2d513 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046471 Oct 31 15:30:06.889897 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1684/3185] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:06.899338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:06.900541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:06.902205 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57d297bd-743c-4e89-a673-696e0dc03cc5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1403 microversion: 2.1 time: 0.427291 Oct 31 15:30:06.903109 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1502/3186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:06 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1403 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:06.917455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed117081-0f20-41fb-a83c-dfa0744009ba tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:06.918960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed117081-0f20-41fb-a83c-dfa0744009ba tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:06.925708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.927476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.928116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:06.929780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:06.930460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:06.931065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.231931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:07.256586 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22c3325e-caf8-4769-9008-e30b0d80a5ec tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1309 microversion: 2.1 time: 0.359802 Oct 31 15:30:07.257907 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1685/3187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:06 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:07.274600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:07.277305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:07.293486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.293993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.294436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.296614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.297091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.301863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed117081-0f20-41fb-a83c-dfa0744009ba tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:07.302068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.309894 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed117081-0f20-41fb-a83c-dfa0744009ba tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1212 microversion: 2.1 time: 0.405587 Oct 31 15:30:07.313995 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1503/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:06 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1212 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:07.377494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b16d0321-acd4-4ac6-99e0-78253f32767e req-ac15abc3-45b0-4a10-b760-6742c0914375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4cbe30-88fa-4f3d-b91d-95322b369e8b", "name": "network-vif-plugged", "status": "completed", "tag": "8321fc3b-db5c-4b70-b602-b9ca00054898"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:07.398737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b16d0321-acd4-4ac6-99e0-78253f32767e req-ac15abc3-45b0-4a10-b760-6742c0914375 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.400455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b16d0321-acd4-4ac6-99e0-78253f32767e req-ac15abc3-45b0-4a10-b760-6742c0914375 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.405566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b16d0321-acd4-4ac6-99e0-78253f32767e req-ac15abc3-45b0-4a10-b760-6742c0914375 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.425584 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b16d0321-acd4-4ac6-99e0-78253f32767e req-ac15abc3-45b0-4a10-b760-6742c0914375 service nova] Creating event network-vif-plugged:8321fc3b-db5c-4b70-b602-b9ca00054898 for instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b on n-h1-858384-17 Oct 31 15:30:07.438213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b16d0321-acd4-4ac6-99e0-78253f32767e req-ac15abc3-45b0-4a10-b760-6742c0914375 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064669 Oct 31 15:30:07.441660 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1504/3189] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:07.487784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:07.489243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:07.499463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:07.506420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.507137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.507823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.510255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.511325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.512421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.609491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.614740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.615156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.615692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lazy-loading 'fault' on Instance uuid 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:07.721512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:07.730595 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e8cf6a4-95d5-4f98-9b5f-cb2cf43bdef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.469278 Oct 31 15:30:07.734363 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1686/3190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:07 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:07.787678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:07.799374 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd0fb326-f779-4de4-b92c-e3e7f7c1dde5 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 200 len: 1304 microversion: 2.1 time: 0.315924 Oct 31 15:30:07.822857 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1505/3191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:07 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 1304 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:07.929935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:07.930551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:07.940013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.940797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.941498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:07.942972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:07.944772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:07.945508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.282331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:08.282946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:08.290286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.290777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.291210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.292198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.293351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.293351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.501894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:08.510992 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75e08901-f995-4ccb-8314-3fd80baf5eb3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1403 microversion: 2.1 time: 0.587000 Oct 31 15:30:08.521206 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1687/3192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:07 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1403 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:08.521206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:08.521206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:08.523882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:08.527260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.528191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.528935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.530243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.530997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.531445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.574981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:08.585844 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3bdd5d65-27b3-4353-be40-5f907c903550 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1309 microversion: 2.1 time: 0.307947 Oct 31 15:30:08.586690 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1506/3193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:08 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:08.610885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:08.619099 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-44f17c90-17dc-4108-a1ec-a16d78100baf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1264 microversion: 2.1 time: 0.105906 Oct 31 15:30:08.624802 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1688/3194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:08 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1264 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:08.763100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:08.765321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:08.771739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.772569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.773078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.774042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.774737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.775262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.835330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:08.836639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:08.849374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.850991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.852336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.854030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:08.855141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:08.855997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:08.884945 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 HTTP/1.1 Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '6fb368d4-cee6-41ca-9cbe-1c86ad8b1011'} Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:08.887431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73855659-df0b-4b52-b996-09545a51cb82 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 404 len: 111 microversion: 2.1 time: 0.062473 Oct 31 15:30:08.895685 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1689/3195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:08 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:09.018972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:09.022857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1247782595", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "c356d61f-2e01-42fa-9c99-c94fb61838ec"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:09.030484 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ead1b48-25bd-41e4-9f2d-36c702b37441 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.271137 Oct 31 15:30:09.031347 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1507/3196] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:08 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:09.111961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] validate_networks() for [('c356d61f-2e01-42fa-9c99-c94fb61838ec', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:30:09.464134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d20a6838-2eb3-46ff-b34b-d283615bd860 req-25774b58-0b2d-41b6-ba5d-838deee0d665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b101cc-44dc-4159-8cf5-faffc8279d58", "name": "network-vif-plugged", "status": "completed", "tag": "b30d6fcd-12d0-4ce3-9081-e3d2cbec3540"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:09.476002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d20a6838-2eb3-46ff-b34b-d283615bd860 req-25774b58-0b2d-41b6-ba5d-838deee0d665 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:09.476749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d20a6838-2eb3-46ff-b34b-d283615bd860 req-25774b58-0b2d-41b6-ba5d-838deee0d665 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:09.477403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d20a6838-2eb3-46ff-b34b-d283615bd860 req-25774b58-0b2d-41b6-ba5d-838deee0d665 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:09.491191 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d20a6838-2eb3-46ff-b34b-d283615bd860 req-25774b58-0b2d-41b6-ba5d-838deee0d665 service nova] Creating event network-vif-plugged:b30d6fcd-12d0-4ce3-9081-e3d2cbec3540 for instance d2b101cc-44dc-4159-8cf5-faffc8279d58 on n-h1-858384-17 Oct 31 15:30:09.497735 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d20a6838-2eb3-46ff-b34b-d283615bd860 req-25774b58-0b2d-41b6-ba5d-838deee0d665 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039749 Oct 31 15:30:09.501491 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1508/3197] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:09.544585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:09.545730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:09.602941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:09.607451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:09.609074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:09.614337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:09.615456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:09.617563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:09.631757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:09.979888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:09.990103 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8da67dfd-d2dd-4930-9521-abbbd33bba0f tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1590 microversion: 2.1 time: 0.456419 Oct 31 15:30:10.007796 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1509/3198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:09 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1590 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:10.013893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.014702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.022500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.023228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.023830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.024726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.025470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.026354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.180814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:30:10.181880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:30:10.182377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:30:10.182881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:30:10.183489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:30:10.194537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.195022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.195560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.196405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.196870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.197416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.219776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:30:10.227710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Getting quotas for user 93f77a1d41fd431d9da6587e0ca9cb1e and project 68e748d9ee1e464fa98c83c43dfbe12f. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:30:10.244660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:30:10.247432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:30:10.299014 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5817e6fc-9b4a-4b2c-9b0a-2ae46ae954c4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.284209 Oct 31 15:30:10.300260 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1690/3199] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:30:10.307474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.308343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.315279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.315972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.317282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.318337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.318952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.319520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.351303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:10.360883 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-460be97d-b445-461b-8857-9dfa7390ca57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1309 microversion: 2.1 time: 0.351509 Oct 31 15:30:10.378341 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1510/3200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1309 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:10.385938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b42acd4-216c-4372-93d2-42c571d2be87 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.385938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b42acd4-216c-4372-93d2-42c571d2be87 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.411280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b42acd4-216c-4372-93d2-42c571d2be87 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.412438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b42acd4-216c-4372-93d2-42c571d2be87 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.413199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b42acd4-216c-4372-93d2-42c571d2be87 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.414296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b42acd4-216c-4372-93d2-42c571d2be87 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.414772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b42acd4-216c-4372-93d2-42c571d2be87 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.415464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b42acd4-216c-4372-93d2-42c571d2be87 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.455295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:10.467150 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-94d2d21b-7b98-4d64-8e0f-75a8fd7dd64b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1270 microversion: 2.1 time: 0.163848 Oct 31 15:30:10.467669 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1691/3201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:10.493601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.494236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.514824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.515377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.516155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.516886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:10.517509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:10.518918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:10.547822 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b42acd4-216c-4372-93d2-42c571d2be87 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168286 Oct 31 15:30:10.549323 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1511/3202] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b/os-interface => generated 285 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:10.557240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15db7f1c-00ee-4b77-a5a1-45c8e0a7e5a1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:10.558256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-15db7f1c-00ee-4b77-a5a1-45c8e0a7e5a1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:10.666605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-15db7f1c-00ee-4b77-a5a1-45c8e0a7e5a1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:10.674528 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-15db7f1c-00ee-4b77-a5a1-45c8e0a7e5a1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1215 microversion: 2.1 time: 0.123211 Oct 31 15:30:10.676593 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1512/3203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:11.130331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:11.142625 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a2691fa-0d25-4c4d-808f-fb1075fe8eca tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1501 microversion: 2.1 time: 0.663566 Oct 31 15:30:11.143239 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1692/3204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:10 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1501 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:11.165787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d605869c-9330-47a0-ad89-a5c117b7ab1f"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:11.168302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:11.175468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.176761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.177579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.178516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.179213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.180480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.217442 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] HTTP exception thrown: Cannot 'attach_volume' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state rescued Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Request method failure captured: Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/os-volume_attachments HTTP/1.1 Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 74 Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-mPAZq-02OTEsnv8GMkJRDJDL-rAJdgEJHn39ABJutgfh2_1AZN2oCBsrYt27l5tKBr9RG945Kyk--1kSEQ-akNiYprUFz_R7VxoVIJfbKRGxwgEKLAB8nUjvzWuTNL6KRyvhFuZKw3wxu_FY2qhzM7Zf-aduk3Wugzl7BHJI8VXXg Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9275c27ad1ac40568e4dbc778857d333", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9275c27ad1ac40568e4dbc778857d333"}]}] Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b56e2ca778b04f7c9fc7590faacb4c1a Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: {"volumeAttachment": {"volumeId": "d605869c-9330-47a0-ad89-a5c117b7ab1f"}} Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: exception: Cannot 'attach_volume' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state rescued Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'server_id': 'e38eb051-6410-4f8b-a4d6-19da70665a57', 'body': {'volumeAttachment': {'volumeId': 'd605869c-9330-47a0-ad89-a5c117b7ab1f'}}} Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e38eb051-6410-4f8b-a4d6-19da70665a57 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 31 15:30:11.220077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state rescued Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state rescued Oct 31 15:30:11.225286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:11.228718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Returning 409 to user: Cannot 'attach_volume' instance e38eb051-6410-4f8b-a4d6-19da70665a57 while it is in vm_state rescued {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:11.232300 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-15a30c1a-39d9-472f-9894-a276d4dd9f42 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.070408 Oct 31 15:30:11.234301 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1513/3205] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:30:11 2022] POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:30:11.246376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7341c1af-456a-41e9-92ce-1dce88a2c56d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:11.247259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7341c1af-456a-41e9-92ce-1dce88a2c56d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:11.254196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7341c1af-456a-41e9-92ce-1dce88a2c56d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.255553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7341c1af-456a-41e9-92ce-1dce88a2c56d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.256186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7341c1af-456a-41e9-92ce-1dce88a2c56d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.257057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7341c1af-456a-41e9-92ce-1dce88a2c56d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.257644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7341c1af-456a-41e9-92ce-1dce88a2c56d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.258066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7341c1af-456a-41e9-92ce-1dce88a2c56d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.372295 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7341c1af-456a-41e9-92ce-1dce88a2c56d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action" status: 202 len: 0 microversion: 2.1 time: 0.132108 Oct 31 15:30:11.374859 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1693/3206] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:30:11 2022] POST /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:30:11.383875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:11.384489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:11.389738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:11.392811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:11.403334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.403547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.403948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.404670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.405152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.405452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.405585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.406493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.407112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.408639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.409579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.410478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.720327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:11.728942 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2384527d-2e65-408d-8d0b-7cf487d3217a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1509 microversion: 2.1 time: 0.349425 Oct 31 15:30:11.729817 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1514/3207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:11 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:11.748685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:11.749443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:11.758115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.758981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.759147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.759956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.760479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.760923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.859905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:11.877350 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71a111ac-83cd-4a40-bebd-ea50c6035aa4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1270 microversion: 2.1 time: 0.134337 Oct 31 15:30:11.893671 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1515/3208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:11 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:11.906932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:11.908700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:11.916908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.918451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.919238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:11.920212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:11.920892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:11.921570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.087529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:12.102934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ac02f0f5-4b5f-428f-be37-6877cc61199d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1267 microversion: 2.1 time: 0.206723 Oct 31 15:30:12.107441 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1516/3209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:11 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:12.171214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:12.186091 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61905f25-0412-4694-bb6c-584e856b6ac3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1489 microversion: 2.1 time: 0.801597 Oct 31 15:30:12.202168 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1694/3210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:11 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1489 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:12.213305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-076a1dbc-d38f-49a5-a18d-adb855f6129a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:12.216013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-076a1dbc-d38f-49a5-a18d-adb855f6129a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:12.219225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:12.223010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-076a1dbc-d38f-49a5-a18d-adb855f6129a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.223506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-076a1dbc-d38f-49a5-a18d-adb855f6129a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.223937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-076a1dbc-d38f-49a5-a18d-adb855f6129a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.224623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-076a1dbc-d38f-49a5-a18d-adb855f6129a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.225075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-076a1dbc-d38f-49a5-a18d-adb855f6129a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.225518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-076a1dbc-d38f-49a5-a18d-adb855f6129a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.300486 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-076a1dbc-d38f-49a5-a18d-adb855f6129a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "PUT /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1084 microversion: 2.1 time: 0.093294 Oct 31 15:30:12.302053 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1517/3211] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 15:30:12 2022] PUT /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1084 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:12.325253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:12.326098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:12.334583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.335426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.335939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.336751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.337494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.337990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.754105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:12.755952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:12.764035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.764615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.765285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.766163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.766466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.766896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.787267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:12.797658 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-115a15ff-92c9-4a52-b97a-f89a0e33cb95 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1510 microversion: 2.1 time: 0.479367 Oct 31 15:30:12.798260 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1695/3212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:12 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1510 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:12.821236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:12.821852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:12.828049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.828545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.828979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:12.829708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:12.830165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:12.830588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.171320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:13.184149 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-14832136-0eda-4636-86da-6c65233174ab tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1510 microversion: 2.1 time: 0.367424 Oct 31 15:30:13.185472 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1696/3213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:12 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:13.191610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:13.193422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:13.200090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.200752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.201665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.202820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.203493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.204330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.220256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:13.237842 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b33f6ec-7952-4663-b810-5fac29c94a4c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1509 microversion: 2.1 time: 0.487808 Oct 31 15:30:13.238519 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1518/3214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:12 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1509 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:13.252713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:13.253512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:13.259590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.260090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.260532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.261295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.270422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.271200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.367948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:13.380387 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e1dac3c-4e3c-4d58-8539-17bcf6315930 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1273 microversion: 2.1 time: 0.140592 Oct 31 15:30:13.381649 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1519/3215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:13 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:13.398425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:13.399296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:13.408260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.409021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.409634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.412043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.412944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.413512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.446468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:13.576260 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64588036-a1c8-4618-97c6-53ac63198a05 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 204 len: 0 microversion: 2.1 time: 0.192418 Oct 31 15:30:13.578032 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1520/3216] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:13 2022] DELETE /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:30:13.591153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:13.595434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:13.596011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:13.597188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:13.602821 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b014292-4541-45a4-8934-6926229a0895 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1312 microversion: 2.1 time: 0.415691 Oct 31 15:30:13.603853 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1697/3217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:13 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1312 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:13.609903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-727559fd-1dee-4693-a24b-8f369e36472b req-f65aa91e-7e66-4a3a-9857-b8896763fde5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d4cbe30-88fa-4f3d-b91d-95322b369e8b", "tag": "8321fc3b-db5c-4b70-b602-b9ca00054898"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:13.615114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.617149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.617654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.618391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.620992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-727559fd-1dee-4693-a24b-8f369e36472b req-f65aa91e-7e66-4a3a-9857-b8896763fde5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.621243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.621849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-727559fd-1dee-4693-a24b-8f369e36472b req-f65aa91e-7e66-4a3a-9857-b8896763fde5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.622451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-727559fd-1dee-4693-a24b-8f369e36472b req-f65aa91e-7e66-4a3a-9857-b8896763fde5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.622852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.637236 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-727559fd-1dee-4693-a24b-8f369e36472b req-f65aa91e-7e66-4a3a-9857-b8896763fde5 service nova] Creating event network-changed:8321fc3b-db5c-4b70-b602-b9ca00054898 for instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b on n-h1-858384-17 Oct 31 15:30:13.644827 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-727559fd-1dee-4693-a24b-8f369e36472b req-f65aa91e-7e66-4a3a-9857-b8896763fde5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039559 Oct 31 15:30:13.648132 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1698/3218] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:13.654663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:13.655649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:13.663359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.664502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.665533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.666404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:13.667013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:13.667586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:13.963650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:13.973216 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8ab75d5-af0f-4e61-a947-6610956a53f3 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1590 microversion: 2.1 time: 0.392684 Oct 31 15:30:13.983306 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1521/3219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:13 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1590 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:14.040068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:14.058897 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5705de8a-8a2c-4d66-8d8d-c6292650a5a2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1516 microversion: 2.1 time: 0.409345 Oct 31 15:30:14.059529 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1699/3220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:13 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1516 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:14.268156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:14.268964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:14.275805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.276718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.277391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:14.278291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.278752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.279338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:14.407061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:14.408587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:14.417631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.418268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.419001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:14.419835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.420540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.421063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:14.500732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:14.511962 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b91df7a-00a5-4d98-a3b8-b1e824270439 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1509 microversion: 2.1 time: 0.247894 Oct 31 15:30:14.513002 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1522/3221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:14 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:14.603574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:14.612141 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3ba5b04a-ca41-4f8a-bccd-1315f9f3aaa1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1315 microversion: 2.1 time: 0.209352 Oct 31 15:30:14.613999 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1700/3222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:14 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:14.632364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:14.633264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:14.640325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.640961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.642101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:14.642923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:14.643482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:14.644019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:14.981774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:15.000338 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52caab9c-abc1-4e38-af51-23781e85c577 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1312 microversion: 2.1 time: 0.366103 Oct 31 15:30:15.017392 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1523/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:14 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:15.089866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:15.090486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:15.112875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.114129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.114575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.115297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.115829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.116266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.483167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:15.504885 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e757520-0ad1-4763-8a27-f65259ec45ba tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1516 microversion: 2.1 time: 0.418812 Oct 31 15:30:15.518035 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1701/3224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:15 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1516 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:15.538150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:15.538777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:15.549050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.549833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.550656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.553007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.553709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.554315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.637377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:15.639716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:15.648593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.649088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.649726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.650849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.651608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.652203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.856370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:15.865096 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab04e78a-43ad-44e3-9494-0d8d4e0d18a3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1315 microversion: 2.1 time: 0.231562 Oct 31 15:30:15.865710 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1702/3225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:15 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:15.874212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-51cbc469-84c5-498a-8c4b-1f9ed4d20e1f req-d307a7fb-57f0-4426-8b0b-265254b8e837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2edf57d1-6672-4b8b-a2a8-c9732d43bd25", "tag": "4c8f254a-78b3-496f-8ba7-c0aa11279f47"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:15.885011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-51cbc469-84c5-498a-8c4b-1f9ed4d20e1f req-d307a7fb-57f0-4426-8b0b-265254b8e837 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:15.885562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-51cbc469-84c5-498a-8c4b-1f9ed4d20e1f req-d307a7fb-57f0-4426-8b0b-265254b8e837 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:15.886004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-51cbc469-84c5-498a-8c4b-1f9ed4d20e1f req-d307a7fb-57f0-4426-8b0b-265254b8e837 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:15.897252 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-51cbc469-84c5-498a-8c4b-1f9ed4d20e1f req-d307a7fb-57f0-4426-8b0b-265254b8e837 service nova] Creating event network-changed:4c8f254a-78b3-496f-8ba7-c0aa11279f47 for instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 on n-h2-858384-17 Oct 31 15:30:15.901988 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-51cbc469-84c5-498a-8c4b-1f9ed4d20e1f req-d307a7fb-57f0-4426-8b0b-265254b8e837 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031645 Oct 31 15:30:15.902606 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1703/3226] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:16.030259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:16.030900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:16.043804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:16.043804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:16.044309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:16.045311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:16.045780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:16.046212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:16.131488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:16.140021 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd74e97f-1c41-402b-b122-57f8d6125f07 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1515 microversion: 2.1 time: 0.607688 Oct 31 15:30:16.141048 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1524/3227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:15 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1515 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:16.256713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:16.265311 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bce85da8-0b60-4cad-ba4f-28a7f898dc9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1312 microversion: 2.1 time: 0.239414 Oct 31 15:30:16.265902 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1704/3228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:16 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:16.534225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:16.535096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:16.542789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:16.543288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:16.543736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:16.544440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:16.545303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:16.545889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:16.550712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:16.887856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:16.889062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:16.902223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:16.906973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:16.907632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:16.909106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:16.909796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:16.910441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:17.182732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:17.199356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:17.201801 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-800f0fdf-07fa-4163-8634-6a0086487776 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1315 microversion: 2.1 time: 0.317761 Oct 31 15:30:17.203090 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1705/3229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:16 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:17.215013 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a65f8501-524f-4dff-94f5-933220ea9f1f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 200 len: 1516 microversion: 2.1 time: 0.685479 Oct 31 15:30:17.215619 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1525/3230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:16 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 1516 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:17.217904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-db22dba5-e108-4c6c-82de-d0c74d965a8e req-837c6cbd-c4ae-4d50-88ae-2d35815cc245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277aecf2-e5a9-4b78-bd2f-7bb861501e39", "tag": "2e16cc15-efc4-47f4-ab8f-bf072459d904"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:17.249675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-db22dba5-e108-4c6c-82de-d0c74d965a8e req-837c6cbd-c4ae-4d50-88ae-2d35815cc245 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:17.250791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-db22dba5-e108-4c6c-82de-d0c74d965a8e req-837c6cbd-c4ae-4d50-88ae-2d35815cc245 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:17.252514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-db22dba5-e108-4c6c-82de-d0c74d965a8e req-837c6cbd-c4ae-4d50-88ae-2d35815cc245 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:17.287328 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-db22dba5-e108-4c6c-82de-d0c74d965a8e req-837c6cbd-c4ae-4d50-88ae-2d35815cc245 service nova] Creating event network-changed:2e16cc15-efc4-47f4-ab8f-bf072459d904 for instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 on n-h2-858384-17 Oct 31 15:30:17.290725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:17.291630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:17.303993 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-db22dba5-e108-4c6c-82de-d0c74d965a8e req-837c6cbd-c4ae-4d50-88ae-2d35815cc245 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098825 Oct 31 15:30:17.307161 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1706/3231] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:17.307825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:17.308332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:17.308776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:17.313612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:17.315668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:17.316354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:17.797275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:17.805292 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2675230d-dcdd-4cef-941f-f0bc3d88c3f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1312 microversion: 2.1 time: 0.520003 Oct 31 15:30:17.805998 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1526/3232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:17 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1312 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:18.227419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:18.228357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:18.236137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:18.236818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:18.237340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:18.238107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:18.238646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:18.239229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:18.244117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:18.244736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:18.251074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:18.251788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:18.252229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:18.252934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:18.253418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:18.253845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:18.271591 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 HTTP/1.1 Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'd2b101cc-44dc-4159-8cf5-faffc8279d58'} Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:18.273280 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:18.279571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:18.279571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:18.279571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:18.279571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:18.279571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:18.279571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:30:18.279571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:18.279571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:18.279571 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d43d18fd-5a4d-4ce6-807b-5a1e08760917 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 404 len: 111 microversion: 2.1 time: 0.034407 Oct 31 15:30:18.289506 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1527/3233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:18 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:30:18.394314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-818150221", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "2b5355db-9171-4de8-abb5-5f94412a242a"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:18.398739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:18.406907 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ccd8eb4-ddcb-4647-91a4-1e84e98e153c tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1315 microversion: 2.1 time: 0.184156 Oct 31 15:30:18.407689 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1707/3234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:18 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:18.452766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] validate_networks() for [('2b5355db-9171-4de8-abb5-5f94412a242a', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:30:18.625940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21e44336-de97-4390-85f0-f311467a5a99 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'create', calling method: .version_select at 0x7f16e0ba4040>, body: {"keypair": {"name": "tempest-keypair-1142448848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXgppTab6Kso5cOlkmkl7hZfmBOnp7YO0z82Ei+pVJnENeqJCdnB6gXHqX3IdD4VnOXzuQdTdD2Kk0WanlQbKe0z0+wdaW0Fg6qXTvNMOwm5mwwITTgkosfe5AM+h79dw=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:18.644469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-21e44336-de97-4390-85f0-f311467a5a99 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Getting quotas for project 9275c27ad1ac40568e4dbc778857d333. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:30:18.650763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-21e44336-de97-4390-85f0-f311467a5a99 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Getting quotas for user b56e2ca778b04f7c9fc7590faacb4c1a and project 9275c27ad1ac40568e4dbc778857d333. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:30:18.677970 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21e44336-de97-4390-85f0-f311467a5a99 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055983 Oct 31 15:30:18.678601 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1708/3235] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:30:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:18.782799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:18.788742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:18.789598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Searching by: {'deleted': False, 'project_id': '64267a3a68804df186c862f2a2ab052e'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:30:18.795599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:18.796173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:18.796719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:18.797864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:18.799510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:18.800171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:18.928206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:30:19.008811 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef71bf94-1aef-4ac9-9a32-64511a734d51 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.230932 Oct 31 15:30:19.017374 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1709/3236] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:30:18 2022] GET /compute/v2.1/servers => generated 344 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:19.017374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:19.017374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:19.023353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.024046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.024600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.025788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.026248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.027103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.529996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:19.552045 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac579ef9-420d-4654-b134-583b8b61fe52 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1312 microversion: 2.1 time: 0.538866 Oct 31 15:30:19.567388 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1710/3237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:19 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1312 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:19.574572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:19.588476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:19.590433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Searching by: {'deleted': False, 'project_id': '64267a3a68804df186c862f2a2ab052e'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:30:19.602189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.603290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.603832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.604815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.605405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.606325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.637172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:30:19.651475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:30:19.652060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:30:19.652897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:30:19.653619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:30:19.654478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:30:19.666814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=19 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:19.669363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.670244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.671204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.672276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.673075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.674179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.698691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:30:19.706751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Getting quotas for user 31cd28d777ac40eda1a7abefb5a3256d and project b62d7aa07ac6442d87c73de859d91c34. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:30:19.727547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:30:19.728779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:19.732569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:30:19.735934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.736424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.736860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.794112 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6fdd8935-a3c6-4d3f-904b-6055956ece49 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.403813 Oct 31 15:30:19.795432 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1528/3238] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:30:19.824554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-71f87d04-f3ca-42e0-ad4c-555a3853ba00 req-6143e906-1be0-4461-a3a7-d32b9a8eb8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b101cc-44dc-4159-8cf5-faffc8279d58", "name": "network-vif-deleted", "tag": "b30d6fcd-12d0-4ce3-9081-e3d2cbec3540"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:19.853801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-71f87d04-f3ca-42e0-ad4c-555a3853ba00 req-6143e906-1be0-4461-a3a7-d32b9a8eb8bf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.865154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-71f87d04-f3ca-42e0-ad4c-555a3853ba00 req-6143e906-1be0-4461-a3a7-d32b9a8eb8bf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.866798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-71f87d04-f3ca-42e0-ad4c-555a3853ba00 req-6143e906-1be0-4461-a3a7-d32b9a8eb8bf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.901862 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-71f87d04-f3ca-42e0-ad4c-555a3853ba00 req-6143e906-1be0-4461-a3a7-d32b9a8eb8bf service nova] Creating event network-vif-deleted:b30d6fcd-12d0-4ce3-9081-e3d2cbec3540 for instance d2b101cc-44dc-4159-8cf5-faffc8279d58 on n-h1-858384-17 Oct 31 15:30:19.914163 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-71f87d04-f3ca-42e0-ad4c-555a3853ba00 req-6143e906-1be0-4461-a3a7-d32b9a8eb8bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117113 Oct 31 15:30:19.917719 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1529/3239] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:19.931211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:19.933535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:19.955313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.955958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.957274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.957274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:19.957755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:19.958238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:19.959871 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e9c86731-732a-430b-8a18-5434e9366fe8 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1602 microversion: 2.1 time: 0.398745 Oct 31 15:30:19.960736 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1711/3240] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:30:19 2022] GET /compute/v2.1/servers/detail => generated 1602 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:19.965965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e42453d4-b4db-43da-a92a-7de245ebcaee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:19.967246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e42453d4-b4db-43da-a92a-7de245ebcaee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:20.119682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e42453d4-b4db-43da-a92a-7de245ebcaee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:20.132338 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e42453d4-b4db-43da-a92a-7de245ebcaee tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1208 microversion: 2.1 time: 0.166225 Oct 31 15:30:20.147104 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1712/3241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:19 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:20.155815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-435f25ce-65e0-4f1d-867e-ed93c496adf4 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:20.176378 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-435f25ce-65e0-4f1d-867e-ed93c496adf4 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027987 Oct 31 15:30:20.177339 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1713/3242] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:30:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:20.262609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:20.273089 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3943647-dfeb-44b4-9711-676c0d5a4541 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1315 microversion: 2.1 time: 0.354030 Oct 31 15:30:20.273728 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1530/3243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:19 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:20.566949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:20.567602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:20.577419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.578377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.579040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.580300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.581321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.581986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.588342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:20.588872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:20.598453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.599160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.599741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.600646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.601146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.601854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.615648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:20.744448 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-37858873-d492-42ec-a4c9-3fe9e610c83b tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 204 len: 0 microversion: 2.1 time: 0.181491 Oct 31 15:30:20.745723 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1714/3244] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:20 2022] DELETE /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:30:20.759523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:20.761297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:20.769381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.771113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.772129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.773064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:20.773773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:20.774391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:20.785239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:20.795193 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04a4f53a-0a89-40e1-8438-875cb30597f2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1312 microversion: 2.1 time: 0.212393 Oct 31 15:30:20.797827 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1531/3245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:20 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:21.162168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:21.165120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:21.166789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:21.182802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.184163 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b89a9190-b564-4977-9736-9ec8244bb9ef tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1605 microversion: 2.1 time: 0.432561 Oct 31 15:30:21.185543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.185968 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1715/3246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:20 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1605 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:21.187964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:21.188878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.189625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.190315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:21.201335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-125810966", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d0fa26d-039a-40f3-a4e3-ccfe7dfd10a3"}], "security_groups": [{"name": "tempest-securitygroup--198156950"}], "key_name": "tempest-keypair-1142448848", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:21.303679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:21.331017 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e546e0d-a207-48fa-bb19-6a14027fac00 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1260 microversion: 2.1 time: 0.174461 Oct 31 15:30:21.332978 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1532/3247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:21 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:21.340220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:21.341728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:21.351788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.352409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.353008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:21.354002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.354554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.356354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:21.420529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] validate_networks() for [('4d0fa26d-039a-40f3-a4e3-ccfe7dfd10a3', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:30:21.665802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:21.677809 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef2863c0-4070-4815-896b-e6b0557c07f6 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1315 microversion: 2.1 time: 0.341157 Oct 31 15:30:21.682350 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1533/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:21 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:21.825189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:21.826724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:21.839048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.839868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.841032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:21.844799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:21.846407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:21.847283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.141740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:22.151789 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed89e65e-b724-43d2-8796-4aebf8864d9b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1312 microversion: 2.1 time: 0.331839 Oct 31 15:30:22.152844 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1534/3249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:21 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1312 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:22.157788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3ae9df06-56f0-46de-b4df-a2705c28ee35 req-1508134b-5d6c-4341-8faf-e9f6ff9c37c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edf57d1-6672-4b8b-a2a8-c9732d43bd25", "name": "network-vif-plugged", "status": "completed", "tag": "4c8f254a-78b3-496f-8ba7-c0aa11279f47"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:22.169617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3ae9df06-56f0-46de-b4df-a2705c28ee35 req-1508134b-5d6c-4341-8faf-e9f6ff9c37c9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.170681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3ae9df06-56f0-46de-b4df-a2705c28ee35 req-1508134b-5d6c-4341-8faf-e9f6ff9c37c9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.171523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3ae9df06-56f0-46de-b4df-a2705c28ee35 req-1508134b-5d6c-4341-8faf-e9f6ff9c37c9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.186094 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3ae9df06-56f0-46de-b4df-a2705c28ee35 req-1508134b-5d6c-4341-8faf-e9f6ff9c37c9 service nova] Creating event network-vif-plugged:4c8f254a-78b3-496f-8ba7-c0aa11279f47 for instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 on n-h2-858384-17 Oct 31 15:30:22.192262 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3ae9df06-56f0-46de-b4df-a2705c28ee35 req-1508134b-5d6c-4341-8faf-e9f6ff9c37c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037110 Oct 31 15:30:22.197743 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1535/3250] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:22.210270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:22.210976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:22.218197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.218770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.219451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.220233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.220761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.221298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.275401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:30:22.283881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:30:22.284634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:30:22.285981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:30:22.286632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:30:22.300139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.302141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.302824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.303960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.304609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.305237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.342428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Getting quotas for project 9275c27ad1ac40568e4dbc778857d333. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:30:22.354423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Getting quotas for user b56e2ca778b04f7c9fc7590faacb4c1a and project 9275c27ad1ac40568e4dbc778857d333. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:30:22.365152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:22.393432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:30:22.404010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:30:22.479362 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1edfc0e-88c1-4b2d-95ad-69fad9f339f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.291977 Oct 31 15:30:22.480676 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1716/3251] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:30:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:30:22.485689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:22.487500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:22.496920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.497886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.498570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.499663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.500316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.500935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.526966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:22.544746 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-93393f26-b990-4050-bd92-af1b1611eb8e tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1605 microversion: 2.1 time: 0.339311 Oct 31 15:30:22.551868 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1536/3252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:22 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1605 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:22.562720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bbdce897-a93e-46b9-9c65-144a5b2ab98e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:22.564270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bbdce897-a93e-46b9-9c65-144a5b2ab98e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:22.572567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:22.704115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bbdce897-a93e-46b9-9c65-144a5b2ab98e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:22.715562 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bbdce897-a93e-46b9-9c65-144a5b2ab98e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1245 microversion: 2.1 time: 0.161437 Oct 31 15:30:22.716933 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1537/3253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:22 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1245 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:22.723714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:22.724558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:22.732882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.733741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.734485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:22.735636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:22.736253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:22.736777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.100827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:23.123333 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-871bf9a4-2917-48a6-9ed3-7b8a712c46d1 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1315 microversion: 2.1 time: 0.404854 Oct 31 15:30:23.126621 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1538/3254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:22 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:23.179724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:23.180738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:23.200779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.201559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.202146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.203042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.203660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.204232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.345833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:23.358470 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5cea6c4e-3fdf-4eff-a025-7313d7a67c84 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1308 microversion: 2.1 time: 0.876450 Oct 31 15:30:23.375632 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1717/3255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:22 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1308 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:23.581624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:23.582138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:23.598523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.599066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.599870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.600964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.601743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.602590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.868981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:23.877361 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa46a87c-972c-4c0f-a546-8ac6b9faf870 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1312 microversion: 2.1 time: 0.703894 Oct 31 15:30:23.881430 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1539/3256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:23 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1312 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:23.886545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:23.887238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:23.894269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.895118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.896195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:23.897310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:23.897775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:23.898202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.004636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:24.007273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:24.023213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-505fee6f-5440-4a7c-9a8d-112ff27d8e50 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1297 microversion: 2.1 time: 0.139180 Oct 31 15:30:24.025927 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01a664d9-cd42-43c9-976b-a949f4355f11 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1605 microversion: 2.1 time: 0.447576 Oct 31 15:30:24.033594 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1540/3257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:23 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1297 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:24.038617 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1718/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:23 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1605 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:24.153104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:24.154430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:24.164677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.165215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.165655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.166361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.175095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.176404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.215356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d8875802-c5a4-4844-979d-26ce12938071 req-bd04458b-c94a-4115-9401-98d59b4326b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277aecf2-e5a9-4b78-bd2f-7bb861501e39", "name": "network-vif-plugged", "status": "completed", "tag": "2e16cc15-efc4-47f4-ab8f-bf072459d904"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:24.226744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d8875802-c5a4-4844-979d-26ce12938071 req-bd04458b-c94a-4115-9401-98d59b4326b9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.227644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d8875802-c5a4-4844-979d-26ce12938071 req-bd04458b-c94a-4115-9401-98d59b4326b9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.228080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d8875802-c5a4-4844-979d-26ce12938071 req-bd04458b-c94a-4115-9401-98d59b4326b9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.251896 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d8875802-c5a4-4844-979d-26ce12938071 req-bd04458b-c94a-4115-9401-98d59b4326b9 service nova] Creating event network-vif-plugged:2e16cc15-efc4-47f4-ab8f-bf072459d904 for instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 on n-h2-858384-17 Oct 31 15:30:24.259177 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d8875802-c5a4-4844-979d-26ce12938071 req-bd04458b-c94a-4115-9401-98d59b4326b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047014 Oct 31 15:30:24.260613 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1719/3259] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:24.369857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c3837de7-88bf-4b70-8428-04bb7a09b53f req-f73143b4-5492-42e9-9e00-cf2502d23f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f518deb4-eed8-4866-a0d0-dc7a1383e70b", "tag": "28024182-5e5a-47f7-aebf-6885dd0fc328"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:24.387725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c3837de7-88bf-4b70-8428-04bb7a09b53f req-f73143b4-5492-42e9-9e00-cf2502d23f5b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.388460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c3837de7-88bf-4b70-8428-04bb7a09b53f req-f73143b4-5492-42e9-9e00-cf2502d23f5b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.389021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c3837de7-88bf-4b70-8428-04bb7a09b53f req-f73143b4-5492-42e9-9e00-cf2502d23f5b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.407790 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c3837de7-88bf-4b70-8428-04bb7a09b53f req-f73143b4-5492-42e9-9e00-cf2502d23f5b service nova] Creating event network-changed:28024182-5e5a-47f7-aebf-6885dd0fc328 for instance f518deb4-eed8-4866-a0d0-dc7a1383e70b on n-h1-858384-17 Oct 31 15:30:24.415106 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c3837de7-88bf-4b70-8428-04bb7a09b53f req-f73143b4-5492-42e9-9e00-cf2502d23f5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051710 Oct 31 15:30:24.417803 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1720/3260] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:24.425473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:24.427681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:24.435666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.436452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.437665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.439693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.440608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.441306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.575935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:24.589219 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1051ef30-de60-47d5-857a-570e142441a4 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1315 microversion: 2.1 time: 0.440476 Oct 31 15:30:24.590594 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1541/3261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:24 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:24.912629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:24.913515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:24.924278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.927214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.928042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.929266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:24.929755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:24.930600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:24.967685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:24.978124 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ec4a4ee-8daa-4eba-8e2f-86a145a4e2f3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1308 microversion: 2.1 time: 0.558800 Oct 31 15:30:24.979160 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1721/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:24 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:25.050153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:25.051619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:25.057769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.058470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.059078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.060030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.060652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.061269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.093841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.103545 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a5fff6a-924a-4b3a-aca6-b5f249a2fe02 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1462 microversion: 2.1 time: 0.197740 Oct 31 15:30:25.104130 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1542/3263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:24 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1462 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:25.108616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:25.109403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:25.126124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.126623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.127064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.127771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.128261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.128718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.193358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.201614 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2188fb18-29ea-474d-b5aa-5a34ae2ca56d tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1538 microversion: 2.1 time: 0.096389 Oct 31 15:30:25.202210 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1543/3264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:25 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1538 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:25.218758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.219505 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-79d8a471-3edf-42da-93ff-e40ee2821f05 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1303 microversion: 2.1 time: 0.172724 Oct 31 15:30:25.230594 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1722/3265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:25 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1303 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:25.278342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-737a3b21-0919-417c-b408-342e2d6f7e32 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:25.279082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-737a3b21-0919-417c-b408-342e2d6f7e32 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:25.286148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-737a3b21-0919-417c-b408-342e2d6f7e32 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.286743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-737a3b21-0919-417c-b408-342e2d6f7e32 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.287257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-737a3b21-0919-417c-b408-342e2d6f7e32 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.288028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-737a3b21-0919-417c-b408-342e2d6f7e32 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.288563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-737a3b21-0919-417c-b408-342e2d6f7e32 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.289084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-737a3b21-0919-417c-b408-342e2d6f7e32 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.584361 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-737a3b21-0919-417c-b408-342e2d6f7e32 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1615 microversion: 2.1 time: 0.378383 Oct 31 15:30:25.584973 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1544/3266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:25 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1615 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:25.608287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:25.609861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:25.612742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:25.613981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:25.623677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.624214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.624724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.626284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.626766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.627797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.635706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.637658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.638371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.639186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.639729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.640258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.662355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:25.747434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6e11767fcd8c4fb0b0076cf738c16823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab796477ef0c4239b1d64e1efd2dfbf5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.748626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] flavor_id is None. Assuming migration. {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 31 15:30:25.749078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:30:25.842842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:25.855247 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60e32351-47b5-46d5-93c5-dcb3a5cca928 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1315 microversion: 2.1 time: 0.247281 Oct 31 15:30:25.872156 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1545/3267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:25 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:25.877761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-52512589-888a-4d2f-9485-d6d6d6020cd3 req-a676acda-6f20-4475-a72b-68c1e3f4afea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f635e6d-663a-41b1-b002-5cd9d22c9e93", "name": "network-vif-deleted", "tag": "eafc417a-a0f6-407b-9664-020730250cc2"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:25.897413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-52512589-888a-4d2f-9485-d6d6d6020cd3 req-a676acda-6f20-4475-a72b-68c1e3f4afea service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:25.897931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-52512589-888a-4d2f-9485-d6d6d6020cd3 req-a676acda-6f20-4475-a72b-68c1e3f4afea service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:25.898501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-52512589-888a-4d2f-9485-d6d6d6020cd3 req-a676acda-6f20-4475-a72b-68c1e3f4afea service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:25.916950 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-52512589-888a-4d2f-9485-d6d6d6020cd3 req-a676acda-6f20-4475-a72b-68c1e3f4afea service nova] Creating event network-vif-deleted:eafc417a-a0f6-407b-9664-020730250cc2 for instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 on n-h2-858384-17 Oct 31 15:30:25.925183 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-52512589-888a-4d2f-9485-d6d6d6020cd3 req-a676acda-6f20-4475-a72b-68c1e3f4afea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050503 Oct 31 15:30:25.927123 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1546/3268] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:26.010911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:26.012156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:26.029082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.029619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.030068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.030794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.031257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.031687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.156376 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49f4ea68-afe7-4faf-9a8d-f092a0287cb8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25/action" status: 202 len: 0 microversion: 2.1 time: 0.552277 Oct 31 15:30:26.162929 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1723/3269] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:30:25 2022] POST /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:26.175067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:26.176644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:26.194554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.195340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.195947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.196854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.199446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.200054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.426565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:26.440595 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b8b4fd6-dcfd-42d1-adbb-6dbe28c39c2a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1308 microversion: 2.1 time: 0.438980 Oct 31 15:30:26.459168 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1547/3270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:25 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1308 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:26.479258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:26.481582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:26.507421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.509336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.512049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.514344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.515597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.516045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.676502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:26.690611 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-33dcc756-79dd-495d-8985-afba0d74efc5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1471 microversion: 2.1 time: 0.525158 Oct 31 15:30:26.691226 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1724/3271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:26 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1471 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:26.708462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:26.711905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:26.722279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:26.729498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.730244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.730868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.732166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.732789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.734339 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b709073b-c18f-4619-9159-f26826f97684 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1252 microversion: 2.1 time: 0.274748 Oct 31 15:30:26.734850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.734983 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1548/3272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:26 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1252 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:26.919020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:26.932205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:26.960943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.961700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.962136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:26.963687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:26.964812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:26.965431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.367523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:27.398121 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5396e487-1b54-4d1f-81ee-73db2e0de562 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1502 microversion: 2.1 time: 0.519160 Oct 31 15:30:27.403700 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1549/3273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:26 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1502 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:27.447230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:27.448808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:27.466720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.467669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.469478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.471094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.472425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.473751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.543167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lazy-loading 'flavor' on Instance uuid 277aecf2-e5a9-4b78-bd2f-7bb861501e39 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:27.867648 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1abcb89c-cfeb-4d1b-93e9-1c43cb5026dc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "POST /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39/action" status: 202 len: 0 microversion: 2.1 time: 0.437599 Oct 31 15:30:27.870684 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1550/3274] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:30:27 2022] POST /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:27.902196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:27.909092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:27.924069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.926568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.927237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:27.930298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:27.931619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:27.932207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.078055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.087616 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6dcc466b-7311-4739-8eff-c1358480ab4b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1370 microversion: 2.1 time: 1.394005 Oct 31 15:30:28.088460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1725/3275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:26 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1370 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:28.093754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:28.094750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:28.110238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.111256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.111847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.112721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.113809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.114627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.376160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.385957 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-98cba4c2-abfd-491b-9238-3a3fbc2a389e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1471 microversion: 2.1 time: 0.296308 Oct 31 15:30:28.386569 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1726/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:28 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1471 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:28.413290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:28.417964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:28.434676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.435440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.436047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.437819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.440426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.441042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.545761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.560693 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9662321c-3169-4bb8-afbb-46b1083ad78f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1308 microversion: 2.1 time: 0.683653 Oct 31 15:30:28.561903 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1551/3277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:27 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1308 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:28.576437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:28.577817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:28.594458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.597892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.599134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.600106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.601205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.601967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.603444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.614958 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d3a8a5f-4217-4c7f-9873-e7c3ba6b6c64 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1252 microversion: 2.1 time: 0.224594 Oct 31 15:30:28.615608 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1727/3278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:28 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1252 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:28.891881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:28.905951 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0572fee-6d2c-4b2a-8ce6-9c14ba7967e8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1493 microversion: 2.1 time: 0.338051 Oct 31 15:30:28.906970 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1552/3279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:28 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1493 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:28.930478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:28.931261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:28.940005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.940785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.942023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.943045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:28.943737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:28.944323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:28.979118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:29.085527 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51363e80-2f96-41eb-b674-515ec708258a tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 204 len: 0 microversion: 2.1 time: 0.159111 Oct 31 15:30:29.086772 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1728/3280] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:28 2022] DELETE /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:30:29.097727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.102114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.116691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.118712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.127483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.128297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.129582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.131454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.132275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.132932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.134080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.136052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.137259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.138026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.140542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.145704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.382402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:29.393324 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd32c8a1-6812-41b9-836f-29023f3d4e31 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1370 microversion: 2.1 time: 0.281820 Oct 31 15:30:29.398102 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1729/3281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:29.418443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.419060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.438625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.439240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.439704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.442831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.451606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:29.457388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.459979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.462504 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce4540c4-4184-4361-89f1-e49725eafbdc tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1499 microversion: 2.1 time: 0.371307 Oct 31 15:30:29.467115 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1553/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1499 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:29.493450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-193509d4-7717-477f-88ba-4cd8fa457b30 req-f0e001fc-3d56-49b2-b52b-da1f1ccfb844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f518deb4-eed8-4866-a0d0-dc7a1383e70b", "name": "network-vif-plugged", "status": "completed", "tag": "28024182-5e5a-47f7-aebf-6885dd0fc328"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:29.520929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-193509d4-7717-477f-88ba-4cd8fa457b30 req-f0e001fc-3d56-49b2-b52b-da1f1ccfb844 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.522099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-193509d4-7717-477f-88ba-4cd8fa457b30 req-f0e001fc-3d56-49b2-b52b-da1f1ccfb844 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.522811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-193509d4-7717-477f-88ba-4cd8fa457b30 req-f0e001fc-3d56-49b2-b52b-da1f1ccfb844 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.544872 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-193509d4-7717-477f-88ba-4cd8fa457b30 req-f0e001fc-3d56-49b2-b52b-da1f1ccfb844 service nova] Creating event network-vif-plugged:28024182-5e5a-47f7-aebf-6885dd0fc328 for instance f518deb4-eed8-4866-a0d0-dc7a1383e70b on n-h1-858384-17 Oct 31 15:30:29.553537 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-193509d4-7717-477f-88ba-4cd8fa457b30 req-f0e001fc-3d56-49b2-b52b-da1f1ccfb844 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084513 Oct 31 15:30:29.555127 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1554/3283] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:29.594513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.595642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.605392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.615264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.616078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.617800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.619286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.620392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.687724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:29.822286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:29.830439 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0822bca-6996-4f04-b567-415ed32c4de3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1471 microversion: 2.1 time: 0.416262 Oct 31 15:30:29.848253 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1730/3284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1471 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:29.853267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:29.856938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:29.865767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.866407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.868109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.869490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.870068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.871105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.945603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:29.953894 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-50f513a2-9287-432b-8548-087402767419 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1252 microversion: 2.1 time: 0.104329 Oct 31 15:30:29.954771 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1731/3285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1252 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:29.965110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-961b559c-a25c-4136-814b-198071fc4536 req-413a05cb-551b-4b6d-bf33-06c4200a3a71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70dad59f-00ca-480e-81e9-ca7bcdfcc633", "tag": "db98faa2-da61-4f08-8efd-816f4eae0468"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:29.977246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-961b559c-a25c-4136-814b-198071fc4536 req-413a05cb-551b-4b6d-bf33-06c4200a3a71 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:29.978036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-961b559c-a25c-4136-814b-198071fc4536 req-413a05cb-551b-4b6d-bf33-06c4200a3a71 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:29.978685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-961b559c-a25c-4136-814b-198071fc4536 req-413a05cb-551b-4b6d-bf33-06c4200a3a71 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:29.985381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:29.995694 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-961b559c-a25c-4136-814b-198071fc4536 req-413a05cb-551b-4b6d-bf33-06c4200a3a71 service nova] Creating event network-changed:db98faa2-da61-4f08-8efd-816f4eae0468 for instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 on n-h1-858384-17 Oct 31 15:30:29.997942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:30.005728 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-961b559c-a25c-4136-814b-198071fc4536 req-413a05cb-551b-4b6d-bf33-06c4200a3a71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040348 Oct 31 15:30:30.005728 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1732/3286] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:30.009029 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5135ad3b-446c-46ef-8ea7-0465d31fcae0 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1308 microversion: 2.1 time: 0.426497 Oct 31 15:30:30.010863 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1555/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:29 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:30.421175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:30.422553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:30.433638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.434583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.435589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.436353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.437098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.437627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.495313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:30.495313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:30.498968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:30.503465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.504832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.505376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.506088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.506542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.507191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.815492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:30.825602 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4fe8aeb9-cb1c-428f-95d3-99b0459f4a28 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1370 microversion: 2.1 time: 0.409207 Oct 31 15:30:30.826388 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1733/3288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:30 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1370 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:30.856014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:30.856698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:30.866246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.866699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.867147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.867879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.868410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.868842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.912560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:30.924338 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d33e91f-ca68-4b5a-80b2-5eecd44056e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1499 microversion: 2.1 time: 0.438276 Oct 31 15:30:30.928736 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1556/3289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:30 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1499 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:30.982512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:30.982729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:30.990565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.991066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.992519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:30.993386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:30.993848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:30.994286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.069274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:31.082573 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3691cda6-9c07-4b1a-ad11-575a110feee1 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1252 microversion: 2.1 time: 0.101018 Oct 31 15:30:31.083923 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1557/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:30 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1252 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:31.089592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:31.090205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:31.104058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.104621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.105068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.106596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.107095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.107528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.443042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:31.458207 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4cc5cfcc-1780-4f57-8e30-44316a3b6016 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1488 microversion: 2.1 time: 0.372930 Oct 31 15:30:31.469356 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1558/3291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:31 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1488 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:31.469740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:31.475083 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-126cefcf-3b72-4c7a-94fd-bf51f81f473a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1471 microversion: 2.1 time: 0.623786 Oct 31 15:30:31.477012 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1734/3292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:30 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1471 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:31.499201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63b955f1-01ee-4177-9f85-55397d0a56ae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1161031898"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:31.502368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63b955f1-01ee-4177-9f85-55397d0a56ae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:31.511456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b955f1-01ee-4177-9f85-55397d0a56ae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.511994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b955f1-01ee-4177-9f85-55397d0a56ae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.512447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b955f1-01ee-4177-9f85-55397d0a56ae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.513492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b955f1-01ee-4177-9f85-55397d0a56ae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.514223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b955f1-01ee-4177-9f85-55397d0a56ae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.514898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b955f1-01ee-4177-9f85-55397d0a56ae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.616277 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63b955f1-01ee-4177-9f85-55397d0a56ae tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "PUT /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1074 microversion: 2.1 time: 0.127845 Oct 31 15:30:31.617057 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1559/3293] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 15:30:31 2022] PUT /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1074 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:31.636750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:31.637466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:31.643813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.644745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.645382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.646287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.646962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.647556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.793935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-27492925-1f1c-4b0d-ab81-203ddd31fa76 req-c1c95b3a-94f9-48d7-a115-9e88af3c2284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277aecf2-e5a9-4b78-bd2f-7bb861501e39", "name": "network-vif-deleted", "tag": "2e16cc15-efc4-47f4-ab8f-bf072459d904"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:31.810107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-27492925-1f1c-4b0d-ab81-203ddd31fa76 req-c1c95b3a-94f9-48d7-a115-9e88af3c2284 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.810790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-27492925-1f1c-4b0d-ab81-203ddd31fa76 req-c1c95b3a-94f9-48d7-a115-9e88af3c2284 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.811645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-27492925-1f1c-4b0d-ab81-203ddd31fa76 req-c1c95b3a-94f9-48d7-a115-9e88af3c2284 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.848908 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-27492925-1f1c-4b0d-ab81-203ddd31fa76 req-c1c95b3a-94f9-48d7-a115-9e88af3c2284 service nova] Creating event network-vif-deleted:2e16cc15-efc4-47f4-ab8f-bf072459d904 for instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 on n-h2-858384-17 Oct 31 15:30:31.862164 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-27492925-1f1c-4b0d-ab81-203ddd31fa76 req-c1c95b3a-94f9-48d7-a115-9e88af3c2284 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076747 Oct 31 15:30:31.866920 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1560/3294] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:31.875393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:31.876369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:31.883711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.884214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.884707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:31.886348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:31.886348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:31.886747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.188140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.199924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:32.207519 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25ed2ad4-bbd0-471a-899b-8e06b295c6e3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1370 microversion: 2.1 time: 0.333226 Oct 31 15:30:32.211005 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1561/3295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:31 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1370 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:32.216421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:32.218356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:32.225836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.226692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.227373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.228317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.229023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.229698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.275498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.276145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.276852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.277583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lazy-loading 'fault' on Instance uuid 277aecf2-e5a9-4b78-bd2f-7bb861501e39 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:32.319338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:32.379473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=26 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:32.382551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f77a1d41fd431d9da6587e0ca9cb1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68e748d9ee1e464fa98c83c43dfbe12f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.391456 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-114dfdd7-06f2-4286-a387-b9efd1712707 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 200 len: 1305 microversion: 2.1 time: 0.179141 Oct 31 15:30:32.396020 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1562/3296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:32 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 1305 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:32.411580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:32.412230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:32.419225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.419781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.420751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.421592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.422003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.422428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.466413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.475546 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a468d03-9e59-41be-849f-1fe008803b86 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1500 microversion: 2.1 time: 0.842899 Oct 31 15:30:32.476615 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1735/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:31 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1500 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:32.499998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:32.500636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:32.514168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.514937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.515600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.517444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.518099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.518714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.603978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.620457 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c60db959-dd01-470b-8f01-9d2b967ee065 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1252 microversion: 2.1 time: 0.224551 Oct 31 15:30:32.621691 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1563/3298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:32 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1252 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:32.628684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:32.629623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:32.639090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.639965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.640609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.642004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.642819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.643533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.714295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:32.799800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.815202 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35ad2284-9f90-41fd-bc20-b94c2dff80bc tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1500 microversion: 2.1 time: 0.318955 Oct 31 15:30:32.822293 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1736/3299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:32 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1500 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:32.841504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df357ccd-b985-4cf3-a639-4acafd998e4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:32.850318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df357ccd-b985-4cf3-a639-4acafd998e4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.850962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df357ccd-b985-4cf3-a639-4acafd998e4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.851403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df357ccd-b985-4cf3-a639-4acafd998e4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.884061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df357ccd-b985-4cf3-a639-4acafd998e4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:30:32.952349 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df357ccd-b985-4cf3-a639-4acafd998e4b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "POST /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b/action" status: 202 len: 0 microversion: 2.1 time: 0.114907 Oct 31 15:30:32.956748 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1737/3300] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:30:32 2022] POST /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:32.970673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:32.974531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:32.975668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:32.986906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.987577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.989195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.990915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:32.991607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:32.992186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:32.998475 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8af22eed-3b55-4012-9419-e334eba4e1c0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1471 microversion: 2.1 time: 0.372228 Oct 31 15:30:32.999119 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1564/3301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:32 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1471 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:33.234209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.234209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.245797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.246309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.246840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.247499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.248326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:33.253921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.254455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.260342 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-98bd9692-a42b-4ca1-a1d1-326ce2565ea8 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.300670 Oct 31 15:30:33.265172 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1738/3302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:32 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:33.416641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.417683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.424361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.425035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.426820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.428027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.428650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.429259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.454951 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 HTTP/1.1 Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '277aecf2-e5a9-4b78-bd2f-7bb861501e39'} Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.457700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.462925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.462925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.462925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.462925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:33.462925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:33.462925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.462925 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.464869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:33.465989 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7aa6b8c-7f31-4964-bd3f-667a8980ace3 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 404 len: 111 microversion: 2.1 time: 0.053272 Oct 31 15:30:33.467107 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1739/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:33.481636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.482847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.490481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.491209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.492045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.492952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.493501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.493911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.511764 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 HTTP/1.1 Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '277aecf2-e5a9-4b78-bd2f-7bb861501e39'} Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:33.513512 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4cb5354c-e2c2-436f-937e-ffd4391a60ec tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 404 len: 111 microversion: 2.1 time: 0.037284 Oct 31 15:30:33.522701 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1740/3304] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:33 2022] DELETE /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:30:33.529609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:33.530386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.531006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 277aecf2-e5a9-4b78-bd2f-7bb861501e39] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.543449 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a684ad5-b474-4e85-8cd6-308231aba00b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1370 microversion: 2.1 time: 0.313827 Oct 31 15:30:33.546680 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1565/3305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1370 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:33.569438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.569939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.570376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.571080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.571870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.572437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.590034 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 HTTP/1.1 Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '277aecf2-e5a9-4b78-bd2f-7bb861501e39'} Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.591634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 277aecf2-e5a9-4b78-bd2f-7bb861501e39 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aea2cf8e-26a1-4db6-8b0a-42ad9676b6e2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39" status: 404 len: 111 microversion: 2.1 time: 0.072491 Oct 31 15:30:33.597118 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1741/3306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/277aecf2-e5a9-4b78-bd2f-7bb861501e39 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:30:33.604306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.614972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.635354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.635853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.637844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.638563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.639023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.642704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.647143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.647828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.655558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.656295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.656897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.657807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.658551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.659250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.703937 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 HTTP/1.1 Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '6fb368d4-cee6-41ca-9cbe-1c86ad8b1011'} Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:33.707380 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.712490 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.715358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.715928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.716205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:33.716597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.717148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lazy-loading 'fault' on Instance uuid 3f635e6d-663a-41b1-b002-5cd9d22c9e93 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:33.717588 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc01315a-1b92-4b30-a2f2-047282c3ec2d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 404 len: 111 microversion: 2.1 time: 0.118839 Oct 31 15:30:33.718641 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1566/3307] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:33 2022] DELETE /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:33.754965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.758285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.765827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e36ab46973945e98ebee270c794be87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64267a3a68804df186c862f2a2ab052e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:33.768481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.772552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.773235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.776186 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f863f73-6392-4c5c-818d-c0ff8138c063 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 200 len: 1257 microversion: 2.1 time: 0.133615 Oct 31 15:30:33.777454 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1742/3308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 1257 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:33.779752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.780285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.780726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.805816 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 HTTP/1.1 Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '6fb368d4-cee6-41ca-9cbe-1c86ad8b1011'} Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.807360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.812184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.812184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.812184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.812184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:33.812184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:33.812184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. Oct 31 15:30:33.812184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.812184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:33.812184 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dccb7c6f-6bd2-4694-81a0-0f4c2b7df8a2 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011" status: 404 len: 111 microversion: 2.1 time: 0.074308 Oct 31 15:30:33.812875 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1567/3309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/6fb368d4-cee6-41ca-9cbe-1c86ad8b1011 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:33.818791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.819491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.825893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.826712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.827405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.828291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.828919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.829574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.848588 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f HTTP/1.1 Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '30932182-ff62-4e04-a97c-d0c80577089f'} Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:33.850452 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.854707 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.856576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:33.857791 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db421496-93d7-4e29-a96c-2680a3e3a994 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 404 len: 111 microversion: 2.1 time: 0.043700 Oct 31 15:30:33.859072 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1743/3310] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:33 2022] DELETE /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:33.868824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.869818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 30932182-ff62-4e04-a97c-d0c80577089f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.876752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.877623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.878216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.879321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.879985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.880410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.916726 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f HTTP/1.1 Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '30932182-ff62-4e04-a97c-d0c80577089f'} Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.918660 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.923320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.923320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.923320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.923320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:33.923320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:33.923320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. Oct 31 15:30:33.923320 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.927204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 30932182-ff62-4e04-a97c-d0c80577089f could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:33.928371 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b8c707df-b1c8-417c-adc3-e743cf18ebb8 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f" status: 404 len: 111 microversion: 2.1 time: 0.064818 Oct 31 15:30:33.933078 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1568/3311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/30932182-ff62-4e04-a97c-d0c80577089f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:33.938301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.939218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.946064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.946676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.947153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.947854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.948492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.948806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.966108 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 HTTP/1.1 Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6'} Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:33.967717 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-883615e7-617c-4256-bb98-5ba4bf33e226 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 404 len: 111 microversion: 2.1 time: 0.035750 Oct 31 15:30:33.972297 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1744/3312] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:33 2022] DELETE /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:30:33.979005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:33.979812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:33.985904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.986668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.987258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:33.988729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:33.989507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:33.990087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.005622 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 HTTP/1.1 Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6'} Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:34.007509 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.012083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.012083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:34.012083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:34.012083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:34.012083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:34.012083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. Oct 31 15:30:34.012083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.012083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:34.013986 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7443a860-ae40-4a97-a0a4-2eb5f86aee8e tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6" status: 404 len: 111 microversion: 2.1 time: 0.038954 Oct 31 15:30:34.025654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.026610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.029740 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1569/3313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:33 2022] GET /compute/v2.1/servers/22fb234b-c308-4ce0-afb9-4bf2e2a0fbc6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:34.040057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.040581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.040984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.041519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.043725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.044494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.045078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.045543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.057218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.057218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.057218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.057218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.059498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.060347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.080590 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 HTTP/1.1 Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'b578558c-004b-4234-86f9-66dde88aace5'} Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:34.084189 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.089574 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.092529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:34.094196 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47e47f8f-10d9-425b-9f0d-e3bc6ad42300 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 404 len: 111 microversion: 2.1 time: 0.062689 Oct 31 15:30:34.099105 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1570/3314] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:34 2022] DELETE /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:34.106055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.107031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: b578558c-004b-4234-86f9-66dde88aace5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.114182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.114832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.115328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.116036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.116495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.116913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.134609 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 HTTP/1.1 Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'b578558c-004b-4234-86f9-66dde88aace5'} Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:34.136573 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.140927 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.140927 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:34.140927 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:34.140927 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:34.140927 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:34.140927 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. Oct 31 15:30:34.140927 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.142155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance b578558c-004b-4234-86f9-66dde88aace5 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:34.143873 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d17901b5-fe28-4346-98af-df363cc660e9 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5" status: 404 len: 111 microversion: 2.1 time: 0.043521 Oct 31 15:30:34.150609 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1571/3315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:34 2022] GET /compute/v2.1/servers/b578558c-004b-4234-86f9-66dde88aace5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:34.225438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:34.234117 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f8330ee-7409-4149-a666-b1e2c4bc1932 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.212503 Oct 31 15:30:34.241447 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1745/3316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:34 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:34.288269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.288994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.295508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.300354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.302883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.307894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.308714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.309404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.503512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:34.512949 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71b0e248-3fd3-48e3-933f-15bf72f9485b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.231814 Oct 31 15:30:34.525151 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1572/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:34 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:34.568551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.570217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.586373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.587056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.587686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.588574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.589255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.589692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.791120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:34.799992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.801036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] [instance: 3f635e6d-663a-41b1-b002-5cd9d22c9e93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:34.807709 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a95e6761-2bf4-4c68-998d-4ac2b04968b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1370 microversion: 2.1 time: 0.242759 Oct 31 15:30:34.809997 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1746/3318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:34 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:34.812715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.813573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.817599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.818726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:34.821287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:34.822012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:34.843327 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] HTTP exception thrown: Instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 could not be found. Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Request method failure captured: Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 HTTP/1.1 Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-mGmkQTG4FtQTtsk0PeiGFyBDEaZoANA1_ehoeUHeV-x1nagJTQQcWuqi1BhA83z7BShCVTQCC5xwW-HPUhWSbTYTonCYbmToCsjWllwV-jLP-kqVlWswror6spluVQzjE47RdnCbrCtw1Jy86WHEsss677A5lZMVHxtFBVnP83nRM Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 64267a3a68804df186c862f2a2ab052e Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestBootFromVolume-1517176240 Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64267a3a68804df186c862f2a2ab052e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_64267a3a68804df186c862f2a2ab052e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/64267a3a68804df186c862f2a2ab052e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/64267a3a68804df186c862f2a2ab052e"}]}] Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestBootFromVolume-1517176240 Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 64267a3a68804df186c862f2a2ab052e Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1517176240 Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestBootFromVolume-1517176240-project Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4e36ab46973945e98ebee270c794be87 Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestBootFromVolume-1517176240-project Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 could not be found. Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '3f635e6d-663a-41b1-b002-5cd9d22c9e93'} Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 could not be found. Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 could not be found. Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:34.846629 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.850699 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:34.850699 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:34.850699 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:34.850699 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:34.850699 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:34.850699 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 could not be found. Oct 31 15:30:34.850699 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:34.854923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Returning 404 to user: Instance 3f635e6d-663a-41b1-b002-5cd9d22c9e93 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:34.856214 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c8a0e12-d92e-4a4b-9e83-490cc945fe4f tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93" status: 404 len: 111 microversion: 2.1 time: 0.060217 Oct 31 15:30:34.857032 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1573/3319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:34 2022] GET /compute/v2.1/servers/3f635e6d-663a-41b1-b002-5cd9d22c9e93 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:34.873156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6528b158-a673-4d74-a0cc-515c72e7e1e3 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] Calling method '.version_select at 0x7f16e0b80b80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:34.894362 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6528b158-a673-4d74-a0cc-515c72e7e1e3 tempest-ServersTestBootFromVolume-1517176240 tempest-ServersTestBootFromVolume-1517176240-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451473178" status: 202 len: 0 microversion: 2.1 time: 0.031894 Oct 31 15:30:34.895458 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1747/3320] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:30:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451473178 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:35.258933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:35.259537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:35.271954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.276941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.277683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.278794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.279526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.280346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.540067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:35.540836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:35.560171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.564017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.564750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.568369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.570715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.571376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.649510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:35.659802 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1d58a7d8-4f61-4b26-9e5b-1fb04bb89b66 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.404612 Oct 31 15:30:35.661718 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1574/3321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:35 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:35.673800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a1311e45-0e58-45c5-9f31-403e744e26f1 req-80fb7b76-dcf1-4ff0-9729-40dbf8d24edd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dad59f-00ca-480e-81e9-ca7bcdfcc633", "name": "network-vif-plugged", "status": "completed", "tag": "db98faa2-da61-4f08-8efd-816f4eae0468"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:35.694590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a1311e45-0e58-45c5-9f31-403e744e26f1 req-80fb7b76-dcf1-4ff0-9729-40dbf8d24edd service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.695385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a1311e45-0e58-45c5-9f31-403e744e26f1 req-80fb7b76-dcf1-4ff0-9729-40dbf8d24edd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.695983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a1311e45-0e58-45c5-9f31-403e744e26f1 req-80fb7b76-dcf1-4ff0-9729-40dbf8d24edd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.733275 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a1311e45-0e58-45c5-9f31-403e744e26f1 req-80fb7b76-dcf1-4ff0-9729-40dbf8d24edd service nova] Creating event network-vif-plugged:db98faa2-da61-4f08-8efd-816f4eae0468 for instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 on n-h1-858384-17 Oct 31 15:30:35.739571 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a1311e45-0e58-45c5-9f31-403e744e26f1 req-80fb7b76-dcf1-4ff0-9729-40dbf8d24edd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073734 Oct 31 15:30:35.743665 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1575/3322] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:35.832866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:35.836463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:35.876681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.877212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.881588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.887291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:35.888624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:35.889939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:35.927967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:35.940282 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9ce3661b-87c6-47c9-a9da-697310374449 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.406188 Oct 31 15:30:35.944422 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1748/3323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:35 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:36.139855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.148662 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a8a03eed-36fa-4bff-8d6f-5822aaef138d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1370 microversion: 2.1 time: 0.320018 Oct 31 15:30:36.149287 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1576/3324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:35 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:36.688506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:36.689873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:36.697582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.698445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.701566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.706030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.707373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.708152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.955635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:36.973918 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-345c868f-ed76-4032-bb64-d6561dd5335a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.288545 Oct 31 15:30:36.974163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:36.975357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:36.975489 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1749/3325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:36 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:36.992756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.993284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.993979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:36.994899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:36.995534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:36.996132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.172883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:37.174238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:37.189483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.191656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.193705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.194976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:37.195755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:37.196414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:37.522174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:37.534046 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b8692967-1c49-44ea-aff8-18e39d88d533 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.564316 Oct 31 15:30:37.535528 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1577/3326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:36 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:37.540354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:37.554115 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67432fea-4bd1-40b6-bfea-721e72485a7a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1370 microversion: 2.1 time: 0.382524 Oct 31 15:30:37.570040 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1750/3327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:37 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1370 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:37.997457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:37.998068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:38.014906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.020110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.020891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.022018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.023479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.023911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.422212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:38.431908 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8b607d5-d1a4-426f-89bb-e04275bd78de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.438163 Oct 31 15:30:38.451971 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1578/3328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:37 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:38.559396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:38.560002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:38.574515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.575319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.584839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:38.585577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:38.589781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.592175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.594769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.595652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.598345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.599112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.605721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.606607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.607174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.607693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.837266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:38.849544 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26c4f1aa-5abe-4141-9d8f-411fefa22da5 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.293901 Oct 31 15:30:38.850653 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1751/3329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:38 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:38.861049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:38.862031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:38.882877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.883847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.884529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.885628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.886310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.886953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.908051 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d HTTP/1.1 Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '129edccf-8357-446b-9c1b-13c2fc7c5f0d'} Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:38.909851 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:38.913701 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f42d43a-1457-4e95-941e-31c1003012fd tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 404 len: 111 microversion: 2.1 time: 0.061277 Oct 31 15:30:38.916054 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1752/3330] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:38 2022] DELETE /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:38.924223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:38.924839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 129edccf-8357-446b-9c1b-13c2fc7c5f0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:38.935759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.936254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.936834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.938209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.940061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.940509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.962721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:38.964204 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d HTTP/1.1 Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '129edccf-8357-446b-9c1b-13c2fc7c5f0d'} Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:38.965792 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 129edccf-8357-446b-9c1b-13c2fc7c5f0d could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be8df780-59ae-4ed7-8ead-b974b5750892 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d" status: 404 len: 111 microversion: 2.1 time: 0.049308 Oct 31 15:30:38.971656 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1753/3331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:38 2022] GET /compute/v2.1/servers/129edccf-8357-446b-9c1b-13c2fc7c5f0d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:38.979731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:38.980686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:38.987571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.989332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.989974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:38.990779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:38.991260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:38.991691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.011615 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c HTTP/1.1 Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '2acca25b-b31f-4943-932e-062a314fca5c'} Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:39.014275 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-745e120f-8080-4bd2-9ee2-eff11beae493 tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 404 len: 111 microversion: 2.1 time: 0.042402 Oct 31 15:30:39.019474 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1754/3332] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:38 2022] DELETE /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:39.025619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:39.026243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] [instance: 2acca25b-b31f-4943-932e-062a314fca5c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:39.034019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.035113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.035849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.036719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.037769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.038225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.057600 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] HTTP exception thrown: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Request method failure captured: Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c HTTP/1.1 Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-irr63Eenpf7diTNTVJuWIFZbka0sR8i88Yqa2uIq4awngsiRE_BOkssOtB6xdT35eGUgcdBfxPDQwNQgbl-mQ0BPs-Q5kDjDED0d5ZIKilcBUSa5Yq5KfHfz8WH3Vu2N1k2WoNZ3Xadqg9mMvV6__uB47NlzVuZ6u7LUo0goumN7U Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_68e748d9ee1e464fa98c83c43dfbe12f", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/68e748d9ee1e464fa98c83c43dfbe12f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/68e748d9ee1e464fa98c83c43dfbe12f"}]}] Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 68e748d9ee1e464fa98c83c43dfbe12f Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-1419513423 Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 93f77a1d41fd431d9da6587e0ca9cb1e Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-1419513423-project Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '2acca25b-b31f-4943-932e-062a314fca5c'} Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:39.059175 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] Returning 404 to user: Instance 2acca25b-b31f-4943-932e-062a314fca5c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0bc46d64-78c5-4519-854f-d61bdf138b9d tempest-DeleteServersTestJSON-1419513423 tempest-DeleteServersTestJSON-1419513423-project] 10.222.0.20 "GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c" status: 404 len: 111 microversion: 2.1 time: 0.038871 Oct 31 15:30:39.063004 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1755/3333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:39 2022] GET /compute/v2.1/servers/2acca25b-b31f-4943-932e-062a314fca5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:39.305282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:39.315972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30280540-921c-49b7-b49e-d71f559e1b75 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1563 microversion: 2.1 time: 0.737448 Oct 31 15:30:39.338477 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1579/3334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:38 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1563 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:39.343638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e4aacb3-c385-41bd-921d-3032a8336039 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:39.344135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e4aacb3-c385-41bd-921d-3032a8336039 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:39.360890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e4aacb3-c385-41bd-921d-3032a8336039 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.361402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e4aacb3-c385-41bd-921d-3032a8336039 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.361842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e4aacb3-c385-41bd-921d-3032a8336039 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.362556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e4aacb3-c385-41bd-921d-3032a8336039 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.363673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e4aacb3-c385-41bd-921d-3032a8336039 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.364449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e4aacb3-c385-41bd-921d-3032a8336039 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.456282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:39.457506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:39.476289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.477260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.478505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.479828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.487395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.488365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.752239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e4aacb3-c385-41bd-921d-3032a8336039 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.412506 Oct 31 15:30:39.753223 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1756/3335] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:30:39 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-interface => generated 284 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:39.878331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:39.879000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:39.884175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:39.886926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.887604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.888296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:39.889178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:39.890756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:39.890756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:40.095278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:40.108335 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-884ddb4f-d52a-4319-8d3c-278c101faf1d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.655901 Oct 31 15:30:40.108936 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1580/3336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:39 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:40.220309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:40.229258 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e32ec99-50aa-4e14-8336-6c38334de6a1 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.354809 Oct 31 15:30:40.240056 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1757/3337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:39 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:30:41.135212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:41.136417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:41.150994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:41.151408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:41.151844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:41.152543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:41.153201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:41.153781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:41.254432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:41.255968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:41.263422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:41.264314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:41.264969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:41.265952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:41.266652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:41.267317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:41.579359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:41.590900 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2bc986e-cb5d-4e12-aff3-250249a19067 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.340312 Oct 31 15:30:41.592149 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1758/3338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:41 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:42.262707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:42.272234 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a5c6ec6-ffe6-4a86-b590-27d560e81307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 1.140820 Oct 31 15:30:42.280952 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1581/3339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:41 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:42.617857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:42.618480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:42.635066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.635823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.636411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.638575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.639996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.642259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.878553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-267a8705-b400-456b-a3fc-3e8512bfb03e req-aff118ed-1a78-4b07-8f24-d911bfdeec1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70dad59f-00ca-480e-81e9-ca7bcdfcc633", "tag": "db98faa2-da61-4f08-8efd-816f4eae0468"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:42.893098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-267a8705-b400-456b-a3fc-3e8512bfb03e req-aff118ed-1a78-4b07-8f24-d911bfdeec1e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:42.893878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-267a8705-b400-456b-a3fc-3e8512bfb03e req-aff118ed-1a78-4b07-8f24-d911bfdeec1e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:42.894719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-267a8705-b400-456b-a3fc-3e8512bfb03e req-aff118ed-1a78-4b07-8f24-d911bfdeec1e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:42.920914 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-267a8705-b400-456b-a3fc-3e8512bfb03e req-aff118ed-1a78-4b07-8f24-d911bfdeec1e service nova] Creating event network-changed:db98faa2-da61-4f08-8efd-816f4eae0468 for instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 on n-h1-858384-17 Oct 31 15:30:42.931973 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-267a8705-b400-456b-a3fc-3e8512bfb03e req-aff118ed-1a78-4b07-8f24-d911bfdeec1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058640 Oct 31 15:30:42.935623 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1582/3340] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:43.119555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:43.148055 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-28f46a3c-e8ee-43e2-bfb9-36d12cf2a13c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.535748 Oct 31 15:30:43.149435 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1759/3341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:42 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:43.327527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:43.329760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:43.356780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:43.357640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:43.358305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:43.359220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:43.359849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:43.360639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:43.893859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:43.910828 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-383cb28b-5543-477b-b5bd-a0ee7c424d9e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.603960 Oct 31 15:30:43.913044 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1583/3342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:43 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:44.173012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:44.175402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:44.190110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:44.192306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:44.193118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:44.196481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:44.197281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:44.199949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:44.726874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:44.743008 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfcdf901-f6d7-48a2-9234-a7b8ce5c91aa tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.574236 Oct 31 15:30:44.764065 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1760/3343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:44 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:44.940083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:44.942498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:44.959606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:44.960966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:44.962907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:44.964581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:44.966675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:44.968893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:44.975054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:45.454665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:45.469497 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40bb1832-e28a-43ec-bda7-e1467a6e89cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.532897 Oct 31 15:30:45.470702 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1584/3344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:44 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:45.768370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:45.769697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:45.780308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:45.780730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:45.781208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:45.781927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:45.782388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:45.782819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:46.086791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:46.096757 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89387025-37ca-475b-b0de-8a35fb8b6f8b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.332756 Oct 31 15:30:46.100079 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1761/3345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:45 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:46.498680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:46.499882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:46.507237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:46.508087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:46.508680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:46.509623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:46.510237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:46.510819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:46.688551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:46.698001 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6cb836c6-084b-477b-93c8-47c3d2819502 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.204420 Oct 31 15:30:46.700299 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1585/3346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:46 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:47.140660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:47.142056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:47.162714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.163237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.166539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.168513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.169014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.170569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.430417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:47.442635 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26c875e9-74dc-4b61-823d-0bf4fc14a11c tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.319880 Oct 31 15:30:47.447915 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1762/3347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:47 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:47.573838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:47.579027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:47.581926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Searching by: {'deleted': False, 'project_id': '4b80a5a22f05497590852beb8cd7de22'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:30:47.609207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.611034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.611667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.617718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.618961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.619844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.662863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:30:47.703265 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0fdf3a2e-3a87-4006-a9dc-ed0be480f86a tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.133491 Oct 31 15:30:47.705535 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1586/3348] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:30:47 2022] GET /compute/v2.1/servers => generated 340 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:47.718555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:47.726860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:47.727481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:47.734609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:47.741434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Searching by: {'deleted': False, 'project_id': '4b80a5a22f05497590852beb8cd7de22'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:30:47.744615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.745122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.747891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.753321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.753321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.753321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.763428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.763873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.765724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.776057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.776057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.781925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:47.836275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:30:47.908797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:47.917805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:47.918467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:47.919071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:48.128696 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f0c6bc0-9e22-480e-8451-620d16292a7e tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.414784 Oct 31 15:30:48.129497 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1763/3349] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:30:47 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:48.147769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:48.158108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51f1479d-f83d-4f10-a104-7302777edb66 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:48.159621 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-10586ac0-3f0e-463a-b8f0-a3d7cf1afb58 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.435738 Oct 31 15:30:48.167823 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51f1479d-f83d-4f10-a104-7302777edb66 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014541 Oct 31 15:30:48.176513 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1764/3351] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:30:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:48.176688 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1587/3351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:47 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:48.477836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:48.478459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:48.501745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:48.502323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:48.502919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:48.503707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:48.504216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:48.505027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:48.517358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:48.518271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:48.530938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:48.532300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:48.533026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:48.536246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:48.537687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:48.538393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:48.576669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:30:48.730222 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5f9f0354-ca34-43d9-be65-94a88aa1cc11 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 204 len: 0 microversion: 2.1 time: 0.218609 Oct 31 15:30:48.731583 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1588/3352] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:30:48 2022] DELETE /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:30:48.758560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:48.762153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:48.772861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:48.774029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:48.774784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:48.776043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:48.777213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:48.778107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:48.943167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:48.958107 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f0a166a-7d60-4ae9-8c07-d9726e7b4d1b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.489281 Oct 31 15:30:48.960637 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1765/3353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:48 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:49.196066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:49.198483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:49.210251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.211521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.212246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.213374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:49.214234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:49.214895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:49.473015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:49.491910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfa3a3ad-9d03-44e3-85b7-e41e64200755 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.303037 Oct 31 15:30:49.492715 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1766/3354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:49 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:49.610250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:49.624254 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14b86536-a2c2-4f05-9b35-93df8b295609 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1715 microversion: 2.1 time: 0.885981 Oct 31 15:30:49.625872 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1589/3355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:48 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1715 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:49.989493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:49.991309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:50.008268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:50.017913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:50.018720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:50.020195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:50.020962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:50.025696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:50.516279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:50.516913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:50.529747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:50.530518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:50.531198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:50.534096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:50.534923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:50.536454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:51.021808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:51.040122 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-697e1af6-2d0c-41b3-9eec-1db93236f03e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 1.053682 Oct 31 15:30:51.041217 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1767/3356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:49 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:51.056479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:51.057112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:51.064311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:51.064786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:51.065455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:51.067332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:51.068040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:51.068635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:51.092538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:51.115005 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-720a22b2-395f-4a62-a51b-8d8f057ebcb3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.602959 Oct 31 15:30:51.132058 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1590/3357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:50 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:51.519514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:51.539314 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0dff294-4c72-41a0-8e60-339195e0a8c5 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1715 microversion: 2.1 time: 0.495839 Oct 31 15:30:51.542961 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1768/3358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:51 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1715 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:52.070715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:52.072326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:52.091034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.091755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.094306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.096007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.096644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.106402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.165529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:52.166144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:52.177878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.178379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.178813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.179528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.179980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.180401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.940030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:52.954354 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c6aae7d-bc06-45e7-806a-7a4a15612a6f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.799136 Oct 31 15:30:52.955739 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1769/3359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:52 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:52.965225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:52.966055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:52.979929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.980647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.982748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:52.984102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:52.984876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:52.992921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:53.041459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:53.049902 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ebb767c7-c617-4a0d-9862-452e3ed096bb tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.986313 Oct 31 15:30:53.056000 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1591/3360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:52 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:53.113297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:53.124722 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-075698ec-c9bc-445a-88bf-197bd01ed8c6 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1648 microversion: 2.1 time: 0.166888 Oct 31 15:30:53.125990 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1770/3361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:52 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1648 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:53.962559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4b962439-4248-4699-9bd7-4609dd9170ba req-e9c4f890-bd43-4052-af3d-10b8997810fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d4cbe30-88fa-4f3d-b91d-95322b369e8b", "name": "network-vif-deleted", "tag": "8321fc3b-db5c-4b70-b602-b9ca00054898"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:53.986611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:53.991479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:53.999796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4b962439-4248-4699-9bd7-4609dd9170ba req-e9c4f890-bd43-4052-af3d-10b8997810fa service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.001457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4b962439-4248-4699-9bd7-4609dd9170ba req-e9c4f890-bd43-4052-af3d-10b8997810fa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.001457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4b962439-4248-4699-9bd7-4609dd9170ba req-e9c4f890-bd43-4052-af3d-10b8997810fa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.006870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.014941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.016787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.019597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.022661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.023368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.075235 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4b962439-4248-4699-9bd7-4609dd9170ba req-e9c4f890-bd43-4052-af3d-10b8997810fa service nova] Creating event network-vif-deleted:8321fc3b-db5c-4b70-b602-b9ca00054898 for instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b on n-h1-858384-17 Oct 31 15:30:54.112021 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4b962439-4248-4699-9bd7-4609dd9170ba req-e9c4f890-bd43-4052-af3d-10b8997810fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151108 Oct 31 15:30:54.116200 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1592/3362] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:54.139138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:54.142345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:54.165116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.168319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.170418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.174096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.177083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.179226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.760581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:54.772313 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-334f8f9f-0894-424d-91ed-dcfa4530d782 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1476 microversion: 2.1 time: 0.789819 Oct 31 15:30:54.773425 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1771/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:53 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1476 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:54.780306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:54.790714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:54.822017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.823121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.826029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.828708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.829809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.833232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.928598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:54.973173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:54.986972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:54.989274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:54.993154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:54.998280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lazy-loading 'fault' on Instance uuid 0d4cbe30-88fa-4f3d-b91d-95322b369e8b {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:30:55.008517 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c9bb1eb-c626-4b13-a690-da805f1fe5a6 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.887983 Oct 31 15:30:55.021682 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1593/3364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:54 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:55.202431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8833cedeef14d3cb229231cff3a99d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b80a5a22f05497590852beb8cd7de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:55.230973 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df500cb8-5c2d-4e74-a3cf-e5773b546a54 tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 200 len: 1368 microversion: 2.1 time: 0.453898 Oct 31 15:30:55.245566 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1772/3365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:54 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 1368 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:55.815165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:55.816895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:55.829347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:55.832825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:55.833785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:55.834922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:55.836472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:55.838382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.049702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:56.050495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:56.063921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.065748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.069638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.070632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.071289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.071898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.619028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:56.632201 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61ee6c8e-2fd4-48ba-a617-5f293aaa387a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1475 microversion: 2.1 time: 0.817338 Oct 31 15:30:56.633512 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1594/3366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:55 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1475 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:56.644056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:56.646690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] [instance: 0d4cbe30-88fa-4f3d-b91d-95322b369e8b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:56.657918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.661454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.662170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.663656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.665608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.667385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.708450 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] HTTP exception thrown: Instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b could not be found. Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Request method failure captured: Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b HTTP/1.1 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-nucOgIkpok-CvFGDz7n2OyYijjD87YM9u0JpWU9-V518Xf99rP3mUk4kFn_sPUiY9qmyNj2PHEP_zF5mHNkcG8CTJTJ0MqIWUZFOmSqwKRC-MP1aaHnWSHY9x6pkqdTI-QboA4X2fxynBEc2U7MFoRDiieJwfHByGu2yQgfvfqzMg Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 4b80a5a22f05497590852beb8cd7de22 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestManualDisk-53440099 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b80a5a22f05497590852beb8cd7de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4b80a5a22f05497590852beb8cd7de22", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4b80a5a22f05497590852beb8cd7de22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4b80a5a22f05497590852beb8cd7de22"}]}] Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestManualDisk-53440099 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 4b80a5a22f05497590852beb8cd7de22 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestManualDisk-53440099 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestManualDisk-53440099-project Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b8833cedeef14d3cb229231cff3a99d3 Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestManualDisk-53440099-project Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b could not be found. Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '0d4cbe30-88fa-4f3d-b91d-95322b369e8b'} Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b could not be found. Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b could not be found. Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:30:56.712576 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b could not be found. Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Returning 404 to user: Instance 0d4cbe30-88fa-4f3d-b91d-95322b369e8b could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5bda3c7-7a40-4ed6-b1a8-9cc0d80f7e5c tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b" status: 404 len: 111 microversion: 2.1 time: 0.081177 Oct 31 15:30:56.720052 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1595/3367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:56 2022] GET /compute/v2.1/servers/0d4cbe30-88fa-4f3d-b91d-95322b369e8b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:30:56.731680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46936f1f-ffad-4201-8c0d-eb62da6140ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] Calling method '.version_select at 0x7f16e5598790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:56.777861 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-46936f1f-ffad-4201-8c0d-eb62da6140ff tempest-ServersTestManualDisk-53440099 tempest-ServersTestManualDisk-53440099-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061783245" status: 202 len: 0 microversion: 2.1 time: 0.053810 Oct 31 15:30:56.779456 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1596/3368] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 15:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061783245 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:30:56.876703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9d3dea3b-cc21-49fd-a31b-d51015fa5399 req-0c14f9ca-76b5-436f-906b-33d93bb3ee46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edf57d1-6672-4b8b-a2a8-c9732d43bd25", "name": "network-vif-unplugged", "status": "completed", "tag": "4c8f254a-78b3-496f-8ba7-c0aa11279f47"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:56.894625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:56.904533 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fdc252be-c586-4c00-8efa-a711ac87d69f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.860909 Oct 31 15:30:56.914692 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1773/3369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:56 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:56.917007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9d3dea3b-cc21-49fd-a31b-d51015fa5399 req-0c14f9ca-76b5-436f-906b-33d93bb3ee46 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:56.917556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9d3dea3b-cc21-49fd-a31b-d51015fa5399 req-0c14f9ca-76b5-436f-906b-33d93bb3ee46 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:56.920381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9d3dea3b-cc21-49fd-a31b-d51015fa5399 req-0c14f9ca-76b5-436f-906b-33d93bb3ee46 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:56.959350 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9d3dea3b-cc21-49fd-a31b-d51015fa5399 req-0c14f9ca-76b5-436f-906b-33d93bb3ee46 service nova] Creating event network-vif-unplugged:4c8f254a-78b3-496f-8ba7-c0aa11279f47 for instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 on n-h1-858384-17 Oct 31 15:30:56.992034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-9d3dea3b-cc21-49fd-a31b-d51015fa5399 req-0c14f9ca-76b5-436f-906b-33d93bb3ee46 service nova] Instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:30:57.020874 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9d3dea3b-cc21-49fd-a31b-d51015fa5399 req-0c14f9ca-76b5-436f-906b-33d93bb3ee46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150142 Oct 31 15:30:57.026420 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1597/3370] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:30:57.666239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:57.666852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:57.682691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.685641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.694115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.695422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.696103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.696780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.808273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:57.909106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:57.937677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:57.938394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:57.948278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:30:57.954848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.958290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.959986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:57.961822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:57.963563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:57.965400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:58.442269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:58.468030 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53c8014b-c389-4444-96b7-f54c662195d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1475 microversion: 2.1 time: 0.807041 Oct 31 15:30:58.480880 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1774/3371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:57 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1475 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:58.570923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:30:58.589275 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b366dc7-a823-4923-9194-725c57251e5f tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.656992 Oct 31 15:30:58.590231 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1598/3372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:57 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:30:59.079581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-45b7f5c9-b581-41ca-afb0-54ad4c56c6b2 req-1ae75645-301b-464f-8f9a-d03ba7eb4b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2edf57d1-6672-4b8b-a2a8-c9732d43bd25", "tag": "4c8f254a-78b3-496f-8ba7-c0aa11279f47"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:30:59.098628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-45b7f5c9-b581-41ca-afb0-54ad4c56c6b2 req-1ae75645-301b-464f-8f9a-d03ba7eb4b9a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:59.105677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-45b7f5c9-b581-41ca-afb0-54ad4c56c6b2 req-1ae75645-301b-464f-8f9a-d03ba7eb4b9a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:59.106407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-45b7f5c9-b581-41ca-afb0-54ad4c56c6b2 req-1ae75645-301b-464f-8f9a-d03ba7eb4b9a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:59.145721 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-45b7f5c9-b581-41ca-afb0-54ad4c56c6b2 req-1ae75645-301b-464f-8f9a-d03ba7eb4b9a service nova] Creating event network-changed:4c8f254a-78b3-496f-8ba7-c0aa11279f47 for instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 on n-h1-858384-17 Oct 31 15:30:59.162650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-45b7f5c9-b581-41ca-afb0-54ad4c56c6b2 req-1ae75645-301b-464f-8f9a-d03ba7eb4b9a service nova] Instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:30:59.182823 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-45b7f5c9-b581-41ca-afb0-54ad4c56c6b2 req-1ae75645-301b-464f-8f9a-d03ba7eb4b9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105988 Oct 31 15:30:59.184265 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1775/3373] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:30:59.496916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:59.498193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:59.514902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:59.515692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:59.522909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:59.524063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:59.524954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:59.531502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:59.621213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:30:59.621985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:30:59.640462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:59.641245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:59.641699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:30:59.642454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:30:59.642916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:30:59.643349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:00.097397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:00.110675 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e05ef231-ae9f-42ff-b145-4301748267be tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1475 microversion: 2.1 time: 0.619056 Oct 31 15:31:00.111879 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1599/3374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:59 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1475 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:00.217410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:00.230867 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa880bb2-9b16-4a7c-a421-e8964c7a3517 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.620646 Oct 31 15:31:00.232610 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1776/3375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:30:59 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:01.053072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1868481710", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "7ad0db6c-d4b5-4da0-bd5f-b8e8cfeb8f95"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:01.098388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:01.148591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:01.149998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:01.156594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] validate_networks() for [('7ad0db6c-d4b5-4da0-bd5f-b8e8cfeb8f95', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:31:01.174360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:01.174874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:01.181874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:01.182759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:01.189956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:01.190717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:02.348837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:02.361398 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0963b435-3561-4bc7-9a03-75377dec11d4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1473 microversion: 2.1 time: 1.228558 Oct 31 15:31:02.362570 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1777/3376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:01 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1473 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:02.375152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:02.375986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:02.387212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:02.387939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:02.388809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:02.389874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:02.390650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:02.391288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:02.554756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:31:02.556270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:31:02.556996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:31:02.557598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:31:02.558180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:31:02.577691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:02.585313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:02.586814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:02.590117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:02.591554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:02.592166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:02.646920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Getting quotas for project 4e0a498b89194390873540a519a26789. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:02.656230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Getting quotas for user 44c393a20165446faa2654a7e80e3585 and project 4e0a498b89194390873540a519a26789. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:02.697813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:31:02.700630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:31:02.783638 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-858d5759-0f48-4f79-b239-dd1c4bd140b1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.959856 Oct 31 15:31:02.792295 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1600/3377] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:31:02.804101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a9608f98-7792-4302-be8e-ebca8fee58d2 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:02.809920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a9608f98-7792-4302-be8e-ebca8fee58d2 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:02.918097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9608f98-7792-4302-be8e-ebca8fee58d2 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:02.926720 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a9608f98-7792-4302-be8e-ebca8fee58d2 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1217 microversion: 2.1 time: 0.127352 Oct 31 15:31:02.937223 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1601/3378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:02 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:02.972749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:02.986355 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4cec588a-82e2-4f4f-883c-40fd07c79bac tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1510 microversion: 2.1 time: 0.621153 Oct 31 15:31:03.004671 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1778/3379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:02 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1510 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:03.389116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:03.389674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:03.415407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.416523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.421096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.426688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.428545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.429732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.491981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:03.492728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:03.512172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.513311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.514869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.516052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.520174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.521780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.592560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:31:03.622840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:03.835797 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0aec1d8e-b5dd-4f59-916b-481fa87323d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 204 len: 0 microversion: 2.42 time: 0.708941 Oct 31 15:31:03.837712 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1602/3380] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:31:03 2022] DELETE /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 0 bytes in 712 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:31:03.856119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:03.856945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:03.888893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.896417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.897547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:03.900162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:03.900863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:03.902086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.010737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:04.025416 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f7e0a03-3b7c-4837-8bdf-33f1881b7162 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1470 microversion: 2.1 time: 0.641077 Oct 31 15:31:04.040876 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1779/3381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:03 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1470 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:04.053762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:04.054828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:04.073206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.076636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.078264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.079469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.079942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.082794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.393420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:04.409483 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca18a47e-dfea-46b4-b59a-391327db55cf tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1221 microversion: 2.1 time: 0.376730 Oct 31 15:31:04.427516 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1780/3382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:04 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1221 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:04.434619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:04.437707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:04.445254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:04.449398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.450012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.450458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.464734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.465272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.469631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.471551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:04.478439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:04.486280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-009cf59c-8c6b-435c-abd2-0f817500d917 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2955 microversion: 2.42 time: 0.642590 Oct 31 15:31:04.491313 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1603/3383] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:03 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2955 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:04.504941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5f0331e3-c284-4f3f-9196-3e310867a9cb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:04.506668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5f0331e3-c284-4f3f-9196-3e310867a9cb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:04.528998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f0331e3-c284-4f3f-9196-3e310867a9cb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.531762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f0331e3-c284-4f3f-9196-3e310867a9cb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.535451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f0331e3-c284-4f3f-9196-3e310867a9cb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.537270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f0331e3-c284-4f3f-9196-3e310867a9cb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.540843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f0331e3-c284-4f3f-9196-3e310867a9cb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.541392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f0331e3-c284-4f3f-9196-3e310867a9cb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.718457 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5f0331e3-c284-4f3f-9196-3e310867a9cb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25/action" status: 204 len: 0 microversion: 2.1 time: 0.225797 Oct 31 15:31:04.719806 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1604/3384] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:04 2022] POST /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25/action => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:04.736241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:04.740215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:04.756669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.757598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.758217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:04.759113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:04.759873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:04.765544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.113881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:05.124785 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a9006fa1-79da-4d27-b372-55771b7d8263 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1487 microversion: 2.1 time: 0.695741 Oct 31 15:31:05.125879 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1781/3385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:04 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1487 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:05.155738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4d158e6-4dd4-44b1-ab2d-f3abfd570940 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-396042245"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:05.163334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4d158e6-4dd4-44b1-ab2d-f3abfd570940 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:05.189041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4d158e6-4dd4-44b1-ab2d-f3abfd570940 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.189688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4d158e6-4dd4-44b1-ab2d-f3abfd570940 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.190186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4d158e6-4dd4-44b1-ab2d-f3abfd570940 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.208756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4d158e6-4dd4-44b1-ab2d-f3abfd570940 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.210346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4d158e6-4dd4-44b1-ab2d-f3abfd570940 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.211132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4d158e6-4dd4-44b1-ab2d-f3abfd570940 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.301991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:05.314973 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-154d4a43-60b1-4d76-a2cf-460fb9d501a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1470 microversion: 2.1 time: 0.590001 Oct 31 15:31:05.324346 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1605/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:04 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1470 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:05.406923 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4d158e6-4dd4-44b1-ab2d-f3abfd570940 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "PUT /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1059 microversion: 2.1 time: 0.260133 Oct 31 15:31:05.412885 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1782/3387] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 15:31:05 2022] PUT /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1059 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:05.434627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:05.435249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:05.443809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:05.444341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:05.455519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.456021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.456592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.458163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.458972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.459417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.460136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.462483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.462948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.463629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.464266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.466401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.685712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:05.695369 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86e7716d-fe23-4b94-9f7e-13577c774868 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1287 microversion: 2.1 time: 0.266275 Oct 31 15:31:05.698477 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1606/3388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:05 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1287 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:05.704646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:05.721709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:05.758232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.758729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.759168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:05.763523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:05.764007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:05.764445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:06.517795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.559058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.569883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.572165 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4f91e07b-c7ab-43d7-8521-1fcd1d1a04eb tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2955 microversion: 2.42 time: 0.872006 Oct 31 15:31:06.603308 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1607/3389] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:05 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2955 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:06.616833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:06.617745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:06.624228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:06.625002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:06.626239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:06.627270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:06.627947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:06.628872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:06.725697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:06.750093 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b8b9ac0f-ec3d-401f-ad2d-e925efb771b3 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1486 microversion: 2.1 time: 1.311500 Oct 31 15:31:06.750706 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1783/3390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:05 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1486 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:06.767134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:06.768135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:06.780279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:06.783331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:06.785484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:06.786523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:06.788548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:06.791189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.390071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:07.403042 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-90da8ac1-0448-4d57-9fdd-a3dc30d75c20 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1275 microversion: 2.1 time: 0.650943 Oct 31 15:31:07.416307 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1784/3391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:06 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1275 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:07.425010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:07.437620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:07.460278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.462324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.469591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.477590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.478361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.478923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.557473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:07.612037 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c652aa2-52e8-4f7f-a820-bf593345e4c9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1470 microversion: 2.1 time: 1.006607 Oct 31 15:31:07.613377 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1608/3392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:06 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1470 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:07.629677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2c3339bd-ec83-443a-9bcb-e28c60c52ced req-cf124525-aed9-4309-aa22-918076d38dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edf57d1-6672-4b8b-a2a8-c9732d43bd25", "name": "network-vif-plugged", "status": "completed", "tag": "4c8f254a-78b3-496f-8ba7-c0aa11279f47"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:07.663951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2c3339bd-ec83-443a-9bcb-e28c60c52ced req-cf124525-aed9-4309-aa22-918076d38dc4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.665895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2c3339bd-ec83-443a-9bcb-e28c60c52ced req-cf124525-aed9-4309-aa22-918076d38dc4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.669446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2c3339bd-ec83-443a-9bcb-e28c60c52ced req-cf124525-aed9-4309-aa22-918076d38dc4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.692967 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2c3339bd-ec83-443a-9bcb-e28c60c52ced req-cf124525-aed9-4309-aa22-918076d38dc4 service nova] Creating event network-vif-plugged:4c8f254a-78b3-496f-8ba7-c0aa11279f47 for instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 on n-h1-858384-17 Oct 31 15:31:07.700357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-2c3339bd-ec83-443a-9bcb-e28c60c52ced req-cf124525-aed9-4309-aa22-918076d38dc4 service nova] Instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:31:07.728430 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2c3339bd-ec83-443a-9bcb-e28c60c52ced req-cf124525-aed9-4309-aa22-918076d38dc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112204 Oct 31 15:31:07.730159 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1609/3393] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:07.742260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:07.742851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:07.760286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.760785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.761283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:07.761989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:07.762447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:07.762868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.244520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.255822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.257772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.259313 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1b0ba86c-53a4-4e0d-a654-56aba7a63fee tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2955 microversion: 2.42 time: 0.527889 Oct 31 15:31:08.273603 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1610/3394] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:07 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2955 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:08.438141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:08.439973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:08.446784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.447277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.447714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.459134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.461289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.461854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.652822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.662517 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60ec2887-d1fa-4019-9011-d3923347750e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1486 microversion: 2.1 time: 1.244628 Oct 31 15:31:08.663119 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1785/3395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:07 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1486 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:08.678080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:08.679011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:08.688538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.689037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.689498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.693262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.695347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.695903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.897966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:08.915373 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-174b0460-6df6-413f-a2df-ce165992e50d tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1317 microversion: 2.1 time: 0.481231 Oct 31 15:31:08.920111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1611/3396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:08 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:08.925925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:08.932479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:08.947101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.947757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.950959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:08.951980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:08.952710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:08.953458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.020993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:31:09.184208 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fdf7b1f6-0ab6-4997-9d86-d535667f212b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 204 len: 0 microversion: 2.1 time: 0.259488 Oct 31 15:31:09.184890 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1612/3397] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:08 2022] DELETE /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:09.196089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:09.201028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:09.213954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.214765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.215473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.216434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.217253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.217873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.297688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:09.312934 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66a9d71c-0074-4da7-b7b2-14c796c9a802 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1470 microversion: 2.1 time: 0.645635 Oct 31 15:31:09.313918 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1786/3398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:08 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1470 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:09.339769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:09.343054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:09.352166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.353029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.353986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.355015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.355720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.356721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.644441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:09.662058 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14666efd-92e5-40c7-af5e-aad4aee50760 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1492 microversion: 2.1 time: 0.472370 Oct 31 15:31:09.663298 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1613/3399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:09 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1492 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:09.773410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-af65bff8-80a1-41b7-8976-9b1cd5480267 req-1faca61c-47ba-43d6-819b-d3dba545a08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-unplugged", "status": "completed", "tag": "1e16090b-0a3b-4c92-81fa-daf4885f848e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:09.796903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-af65bff8-80a1-41b7-8976-9b1cd5480267 req-1faca61c-47ba-43d6-819b-d3dba545a08b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.800405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-af65bff8-80a1-41b7-8976-9b1cd5480267 req-1faca61c-47ba-43d6-819b-d3dba545a08b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.801404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-af65bff8-80a1-41b7-8976-9b1cd5480267 req-1faca61c-47ba-43d6-819b-d3dba545a08b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.817226 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-af65bff8-80a1-41b7-8976-9b1cd5480267 req-1faca61c-47ba-43d6-819b-d3dba545a08b service nova] Creating event network-vif-unplugged:1e16090b-0a3b-4c92-81fa-daf4885f848e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:09.824463 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-af65bff8-80a1-41b7-8976-9b1cd5480267 req-1faca61c-47ba-43d6-819b-d3dba545a08b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054815 Oct 31 15:31:09.825810 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1614/3400] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:31:09.944415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:09.945834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:09.963684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.964153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.966790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:09.968876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:09.969564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:09.970825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:10.432219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:10.442454 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2e4c0d1-fb93-4825-9d4f-f4229f6cd0a7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1317 microversion: 2.1 time: 0.502705 Oct 31 15:31:10.445963 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1615/3401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:09 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:10.458931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:10.463436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:10.477625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:10.478317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:10.483844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:10.484865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:10.485537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:10.486279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:10.522851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:10.614513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:10.648195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:10.662857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:10.664606 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-93bec6e3-0aa8-4bdd-a7e6-5ae5df9a5c0f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2955 microversion: 2.42 time: 1.346635 Oct 31 15:31:10.693841 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1787/3402] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:09 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2955 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:10.718797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d2034d4e-79ce-4ec0-81a9-194d40c8603f req-13a61dee-2e3e-49cb-9c79-14a6ab87c55e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27368d6e-e7ae-4172-891c-cfc8a7eba5ef", "tag": "2eda2ae3-b3bc-4a9d-839c-478fee3e1ce0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:10.732470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=65 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:10.734815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2034d4e-79ce-4ec0-81a9-194d40c8603f req-13a61dee-2e3e-49cb-9c79-14a6ab87c55e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:10.735524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2034d4e-79ce-4ec0-81a9-194d40c8603f req-13a61dee-2e3e-49cb-9c79-14a6ab87c55e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:10.736239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2034d4e-79ce-4ec0-81a9-194d40c8603f req-13a61dee-2e3e-49cb-9c79-14a6ab87c55e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:10.767997 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d2034d4e-79ce-4ec0-81a9-194d40c8603f req-13a61dee-2e3e-49cb-9c79-14a6ab87c55e service nova] Creating event network-changed:2eda2ae3-b3bc-4a9d-839c-478fee3e1ce0 for instance 27368d6e-e7ae-4172-891c-cfc8a7eba5ef on n-h2-858384-17 Oct 31 15:31:10.776016 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d2034d4e-79ce-4ec0-81a9-194d40c8603f req-13a61dee-2e3e-49cb-9c79-14a6ab87c55e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069741 Oct 31 15:31:10.777863 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1788/3403] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:10.798208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:10.799514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:10.819018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:10.820586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:10.821329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:10.822306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:10.823004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:10.823751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:10.839292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:11.090937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:11.101484 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1579be82-ec7c-4c7d-bca0-6c118b20e97e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1462 microversion: 2.1 time: 0.652973 Oct 31 15:31:11.107593 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1616/3404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:10 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1462 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:11.133847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67a4a250-4cde-42b2-8192-0dfe77184398 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:11.134820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-67a4a250-4cde-42b2-8192-0dfe77184398 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:11.149084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67a4a250-4cde-42b2-8192-0dfe77184398 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.149704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67a4a250-4cde-42b2-8192-0dfe77184398 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.150473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67a4a250-4cde-42b2-8192-0dfe77184398 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.151277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67a4a250-4cde-42b2-8192-0dfe77184398 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.153214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67a4a250-4cde-42b2-8192-0dfe77184398 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.153751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-67a4a250-4cde-42b2-8192-0dfe77184398 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.778437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:11.792685 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05ecda72-c2d8-4cc1-9faf-ebf64da3b652 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1492 microversion: 2.1 time: 1.012599 Oct 31 15:31:11.795678 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1789/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:10 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1492 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:11.807367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:11.810783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:11.822741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.824627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.825313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.826278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.827316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.828098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.929409 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67a4a250-4cde-42b2-8192-0dfe77184398 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1615 microversion: 2.1 time: 0.800003 Oct 31 15:31:11.930240 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1617/3406] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:11 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1615 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:11.935764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:11.936563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:11.964093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.965325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.965876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:11.966860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:11.967599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:11.968162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.316415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:12.336318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:12.340308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:12.357218 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f817b857-5fe6-465d-bd17-910ec39496d2 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2934 microversion: 2.42 time: 0.425373 Oct 31 15:31:12.359560 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1618/3407] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:11 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2934 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:12.390508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e8ecc15-71a3-4db4-98b9-6d80ca98386b tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '.version_select at 0x7f16e5606e50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.395276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8ecc15-71a3-4db4-98b9-6d80ca98386b tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.396409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8ecc15-71a3-4db4-98b9-6d80ca98386b tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.397407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e8ecc15-71a3-4db4-98b9-6d80ca98386b tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.410938 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e8ecc15-71a3-4db4-98b9-6d80ca98386b tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.031216 Oct 31 15:31:12.413224 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1619/3408] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:31:12 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:12.423677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e89c62e7-65fd-4bfd-abea-5889804ecee0 req-ae59eaae-1cb3-4773-8adf-9982e00f00ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-unplugged", "status": "completed", "tag": "e99aa557-85c0-4573-88a4-2fe810a71e21"}, {"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-unplugged", "status": "completed", "tag": "c2a80bb3-9c3f-48a0-9d1e-6beeb88fd04e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:12.438784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e89c62e7-65fd-4bfd-abea-5889804ecee0 req-ae59eaae-1cb3-4773-8adf-9982e00f00ca service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.439717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e89c62e7-65fd-4bfd-abea-5889804ecee0 req-ae59eaae-1cb3-4773-8adf-9982e00f00ca service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.440825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e89c62e7-65fd-4bfd-abea-5889804ecee0 req-ae59eaae-1cb3-4773-8adf-9982e00f00ca service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.465098 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e89c62e7-65fd-4bfd-abea-5889804ecee0 req-ae59eaae-1cb3-4773-8adf-9982e00f00ca service nova] Creating event network-vif-unplugged:e99aa557-85c0-4573-88a4-2fe810a71e21 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:12.466058 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e89c62e7-65fd-4bfd-abea-5889804ecee0 req-ae59eaae-1cb3-4773-8adf-9982e00f00ca service nova] Creating event network-vif-unplugged:c2a80bb3-9c3f-48a0-9d1e-6beeb88fd04e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:12.481820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:12.505728 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e89c62e7-65fd-4bfd-abea-5889804ecee0 req-ae59eaae-1cb3-4773-8adf-9982e00f00ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.090252 Oct 31 15:31:12.510201 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1620/3409] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:12.510963 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f06d046e-0d34-4421-bd45-d8c752a20ddd tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1317 microversion: 2.1 time: 0.710625 Oct 31 15:31:12.515150 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1790/3410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:11 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:12.677702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:12.682866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1220085263", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:12.820530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:12.821791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:12.832785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.834996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.836149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.838680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.839329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.840285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.905082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:12.909072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:12.911443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:12.912902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lazy-loading 'fault' on Instance uuid f518deb4-eed8-4866-a0d0-dc7a1383e70b {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:31:12.926004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:13.053431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:13.068367 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c34ec54-0db3-4d86-9344-c02b3eb8f3c2 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 200 len: 1309 microversion: 2.1 time: 0.253284 Oct 31 15:31:13.083123 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1791/3411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:12 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 1309 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:13.099355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-871d4b1c-b995-41ed-b408-e0323b8b5352 req-afdef4c8-f624-408c-9d56-181c0e3a6ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f518deb4-eed8-4866-a0d0-dc7a1383e70b", "name": "network-vif-deleted", "tag": "28024182-5e5a-47f7-aebf-6885dd0fc328"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:13.120119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-871d4b1c-b995-41ed-b408-e0323b8b5352 req-afdef4c8-f624-408c-9d56-181c0e3a6ff5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:13.125815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-871d4b1c-b995-41ed-b408-e0323b8b5352 req-afdef4c8-f624-408c-9d56-181c0e3a6ff5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:13.126569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-871d4b1c-b995-41ed-b408-e0323b8b5352 req-afdef4c8-f624-408c-9d56-181c0e3a6ff5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:13.132786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:31:13.140265 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-871d4b1c-b995-41ed-b408-e0323b8b5352 req-afdef4c8-f624-408c-9d56-181c0e3a6ff5 service nova] Creating event network-vif-deleted:28024182-5e5a-47f7-aebf-6885dd0fc328 for instance f518deb4-eed8-4866-a0d0-dc7a1383e70b on n-h1-858384-17 Oct 31 15:31:13.148404 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-871d4b1c-b995-41ed-b408-e0323b8b5352 req-afdef4c8-f624-408c-9d56-181c0e3a6ff5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058244 Oct 31 15:31:13.149901 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1792/3412] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:13.391353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:13.392308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:13.412433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:13.414448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:13.415050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:13.417634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:13.418908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:13.419825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.363954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:31:14.364498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:31:14.364961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:31:14.365470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:31:14.365961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:31:14.380304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.381754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.382399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.383359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.384113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.384775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.410671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:14.420891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for user 4df669ecccf24e8e9b41574f29ba157b and project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:14.452873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:31:14.456176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:31:14.527179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:14.540362 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-af94fd0e-b62d-4ccb-8f7e-22e16deaa2d3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.863792 Oct 31 15:31:14.541022 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1621/3413] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:31:14.560686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:14.567106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:14.570446 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-50e55cd5-3a36-4b7a-99fc-11cb72301f07 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2913 microversion: 2.42 time: 1.185408 Oct 31 15:31:14.585367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:14.587124 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1793/3414] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:13 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2913 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:14.591183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:14.599681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:14.604339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:14.610337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.610832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.612592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.613327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.613908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.615027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.615670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.616327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.617464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.618213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:14.618856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:14.619493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:14.633946 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b HTTP/1.1 Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f518deb4-eed8-4866-a0d0-dc7a1383e70b'} Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:14.637884 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:14.642634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:14.642634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:14.642634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:14.642634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:14.642634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:14.642634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:14.642634 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:14.644638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:14.648702 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c3f942a-a98f-459a-a0b9-279e439d8d01 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 404 len: 111 microversion: 2.1 time: 0.058522 Oct 31 15:31:14.654924 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1794/3415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:14 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:14.662012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6437cf34-7fb9-46d0-8af4-a9579aea0e36 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:14.662837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6437cf34-7fb9-46d0-8af4-a9579aea0e36 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:14.961363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6437cf34-7fb9-46d0-8af4-a9579aea0e36 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:14.971215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6437cf34-7fb9-46d0-8af4-a9579aea0e36 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1213 microversion: 2.1 time: 0.314535 Oct 31 15:31:14.974448 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1795/3416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:14 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1213 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:14.981361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-307861bd-b674-4554-b886-7c5966beaa48 req-8dc396ba-b628-4fcb-b467-904162008438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-unplugged", "status": "completed", "tag": "09848140-2371-4ed5-87cf-2d323d065746"}, {"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-unplugged", "status": "completed", "tag": "2a4a9196-b5c2-4e85-9d1b-ff3182ce40bd"}, {"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-unplugged", "status": "completed", "tag": "f7b1863f-6b3c-4899-8a17-846c72b01a0e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:15.014917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-307861bd-b674-4554-b886-7c5966beaa48 req-8dc396ba-b628-4fcb-b467-904162008438 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.015936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-307861bd-b674-4554-b886-7c5966beaa48 req-8dc396ba-b628-4fcb-b467-904162008438 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.016582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-307861bd-b674-4554-b886-7c5966beaa48 req-8dc396ba-b628-4fcb-b467-904162008438 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.053669 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-307861bd-b674-4554-b886-7c5966beaa48 req-8dc396ba-b628-4fcb-b467-904162008438 service nova] Creating event network-vif-unplugged:09848140-2371-4ed5-87cf-2d323d065746 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:15.054625 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-307861bd-b674-4554-b886-7c5966beaa48 req-8dc396ba-b628-4fcb-b467-904162008438 service nova] Creating event network-vif-unplugged:2a4a9196-b5c2-4e85-9d1b-ff3182ce40bd for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:15.055200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:15.055967 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-307861bd-b674-4554-b886-7c5966beaa48 req-8dc396ba-b628-4fcb-b467-904162008438 service nova] Creating event network-vif-unplugged:f7b1863f-6b3c-4899-8a17-846c72b01a0e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:15.063775 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21c2af8e-b299-4f4e-8fa9-cdb347c09922 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1317 microversion: 2.1 time: 0.506188 Oct 31 15:31:15.069400 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1622/3417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:14 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:15.081005 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-307861bd-b674-4554-b886-7c5966beaa48 req-8dc396ba-b628-4fcb-b467-904162008438 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.102070 Oct 31 15:31:15.082218 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1796/3418] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:15.087395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.088321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.136960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.137711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.139321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.143164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.144084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.146520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.198242 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b HTTP/1.1 Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f518deb4-eed8-4866-a0d0-dc7a1383e70b'} Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:15.201007 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:15.205032 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7a12768-4d4a-49f5-91d9-b257087ac632 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 404 len: 111 microversion: 2.1 time: 0.131327 Oct 31 15:31:15.210960 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1623/3419] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:15 2022] DELETE /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:15.216442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.217478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f518deb4-eed8-4866-a0d0-dc7a1383e70b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.228656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.238044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.238949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.244506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.245972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.246431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.293938 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b HTTP/1.1 Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f518deb4-eed8-4866-a0d0-dc7a1383e70b'} Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.300580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.305755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.305755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.305755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.305755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:15.305755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:15.305755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. Oct 31 15:31:15.305755 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.305755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance f518deb4-eed8-4866-a0d0-dc7a1383e70b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:15.309819 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67624509-cd87-4a57-9339-fe996e4ed173 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b" status: 404 len: 111 microversion: 2.1 time: 0.092209 Oct 31 15:31:15.310815 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1797/3420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:15 2022] GET /compute/v2.1/servers/f518deb4-eed8-4866-a0d0-dc7a1383e70b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:31:15.322175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.322175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.346036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.351267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.351747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.354939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.355795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.356422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.406294 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 HTTP/1.1 Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'd2b101cc-44dc-4159-8cf5-faffc8279d58'} Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:15.407923 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52d4548b-d61e-4732-bf06-fc1cfdc47a3a tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 404 len: 111 microversion: 2.1 time: 0.094635 Oct 31 15:31:15.412965 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1624/3421] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:15 2022] DELETE /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:15.420533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.421235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: d2b101cc-44dc-4159-8cf5-faffc8279d58] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.437505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.441994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.442375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.443219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.444153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.445864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.495658 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 HTTP/1.1 Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'd2b101cc-44dc-4159-8cf5-faffc8279d58'} Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.501992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.506763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.506763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.506763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.506763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:15.506763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:15.506763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. Oct 31 15:31:15.506763 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.509594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance d2b101cc-44dc-4159-8cf5-faffc8279d58 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:15.510808 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8cc637fb-b309-4fa1-be0a-872e3f216455 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58" status: 404 len: 111 microversion: 2.1 time: 0.094428 Oct 31 15:31:15.516691 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1798/3422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:15 2022] GET /compute/v2.1/servers/d2b101cc-44dc-4159-8cf5-faffc8279d58 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:15.525758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.526327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.548417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.554001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.554457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.555234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.555702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.556146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.613514 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd HTTP/1.1 Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd'} Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:15.615152 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b4abfd13-566d-4298-ba9f-050efa60ed39 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 404 len: 111 microversion: 2.1 time: 0.098836 Oct 31 15:31:15.619128 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1625/3423] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:15 2022] DELETE /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:31:15.624220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.626666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.634626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.635657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.636326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.637183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.637812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.638238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.641432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.642629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.668143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.668143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.668586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.669338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.680222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.680686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.703117 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd HTTP/1.1 Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd'} Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.727040 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.732005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.732005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.732005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.732005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:15.732005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:15.732005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. Oct 31 15:31:15.732005 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.735966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:15.737941 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0539e4a9-13be-4508-bd71-ee77ab4ec768 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd" status: 404 len: 111 microversion: 2.1 time: 0.104098 Oct 31 15:31:15.739093 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1626/3424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:15 2022] GET /compute/v2.1/servers/a14d9dc5-3f39-4565-b7a1-c8a27c0ec3cd => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:15.759273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.759822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.767470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.768014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.768452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.770629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.771107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.771530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.807153 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f HTTP/1.1 Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '68000c37-bab1-490d-b199-cc5caed3783f'} Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:15.809064 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:15.814184 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47eee55e-3988-4820-9449-e2045b0456b9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 404 len: 111 microversion: 2.1 time: 0.068380 Oct 31 15:31:15.818371 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1627/3425] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:15 2022] DELETE /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:31:15.828742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.831194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 68000c37-bab1-490d-b199-cc5caed3783f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.843920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.844474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.845000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.845876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.846421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.848323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.870186 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f HTTP/1.1 Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '68000c37-bab1-490d-b199-cc5caed3783f'} Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.873158 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.877306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.877306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.877306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.877306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:15.877306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:15.877306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. Oct 31 15:31:15.877306 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.880072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance 68000c37-bab1-490d-b199-cc5caed3783f could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:15.881065 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aba2335a-33de-416b-88a0-c9aedaed7685 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f" status: 404 len: 111 microversion: 2.1 time: 0.061594 Oct 31 15:31:15.885069 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1628/3426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:15 2022] GET /compute/v2.1/servers/68000c37-bab1-490d-b199-cc5caed3783f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:15.891910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.892410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.900997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.901531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.902155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.902874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.903330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.903749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.938930 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 HTTP/1.1 Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31'} Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:15.942247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:15.946755 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-568b2be3-57d2-44ba-9ba0-73570cc4032b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 404 len: 111 microversion: 2.1 time: 0.057304 Oct 31 15:31:15.948222 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1629/3427] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:15 2022] DELETE /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:15.954718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:15.955570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:15.963587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:15.966762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.967312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.967761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:15.968564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:15.969397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:15.970025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.022979 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 HTTP/1.1 Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31'} Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.035709 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.040328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.040328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.040328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.040328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:16.040328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:16.040328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. Oct 31 15:31:16.040328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.040328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance 45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:16.040328 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-749831ab-3d83-4535-b416-3d1c5c40989e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31" status: 404 len: 111 microversion: 2.1 time: 0.090317 Oct 31 15:31:16.045055 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1630/3428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:15 2022] GET /compute/v2.1/servers/45d814b9-6f7a-4cc2-b4ea-ba4c3b4b0a31 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:16.063951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.064593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.072811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.073776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.074389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.075102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.075564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.075991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.210294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.222470 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe83ff17-6d96-4eb1-a472-66556f9e57fb tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1265 microversion: 2.1 time: 0.170679 Oct 31 15:31:16.241765 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1631/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:16 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:16.247760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.248488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.277581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.278422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.279043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.279925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.280712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.281555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.301912 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd HTTP/1.1 Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '575595cc-5dda-42f5-9b0e-9f9fe15606cd'} Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:16.304077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.308624 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.312474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:16.313728 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ee9a92b-0d36-4951-8f21-e90162107d3e tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 404 len: 111 microversion: 2.1 time: 0.070930 Oct 31 15:31:16.323559 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1632/3430] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:16 2022] DELETE /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:16.339093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.340247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.354099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.354916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.355622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.356507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.357295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.358739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.482414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.506768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.508992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.510886 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-599f1ce8-7a1f-4d98-b4f1-bd9f0c997492 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2913 microversion: 2.42 time: 0.897679 Oct 31 15:31:16.525348 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1799/3431] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:15 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2913 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:16.538879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.541464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: 575595cc-5dda-42f5-9b0e-9f9fe15606cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.569883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.573856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.574785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.577912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.578639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.579090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.624964 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.626568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd HTTP/1.1 Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '575595cc-5dda-42f5-9b0e-9f9fe15606cd'} Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.630215 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.635126 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.635126 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.635126 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.635126 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:16.635126 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:16.635126 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. Oct 31 15:31:16.635126 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.638745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance 575595cc-5dda-42f5-9b0e-9f9fe15606cd could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:16.638942 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-69cc4ce7-5aec-4797-a01e-bbc6668dd7f3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1317 microversion: 2.1 time: 0.311912 Oct 31 15:31:16.639389 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1633/3432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:16 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:16.663715 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e5db887-10f2-49da-ac39-46cad89dcda9 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd" status: 404 len: 111 microversion: 2.1 time: 0.136443 Oct 31 15:31:16.665779 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1800/3433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:16 2022] GET /compute/v2.1/servers/575595cc-5dda-42f5-9b0e-9f9fe15606cd => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:16.674469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13ab2f40-0bda-40b7-aaee-43fbf11c53cf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.675947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13ab2f40-0bda-40b7-aaee-43fbf11c53cf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: fffda748-45ff-484d-953f-29c26869d8ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.706218 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-13ab2f40-0bda-40b7-aaee-43fbf11c53cf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13ab2f40-0bda-40b7-aaee-43fbf11c53cf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff HTTP/1.1 Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'fffda748-45ff-484d-953f-29c26869d8ff'} Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.714754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.719915 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.719915 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.719915 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.719915 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:16.719915 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:16.719915 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.719915 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.724546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13ab2f40-0bda-40b7-aaee-43fbf11c53cf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:16.730936 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13ab2f40-0bda-40b7-aaee-43fbf11c53cf tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff" status: 404 len: 111 microversion: 2.1 time: 0.057234 Oct 31 15:31:16.732826 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1634/3434] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:16 2022] DELETE /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:16.741962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-120e3de1-e838-44b2-8be7-8a7393001530 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.742500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-120e3de1-e838-44b2-8be7-8a7393001530 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: fffda748-45ff-484d-953f-29c26869d8ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.754931 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-120e3de1-e838-44b2-8be7-8a7393001530 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-120e3de1-e838-44b2-8be7-8a7393001530 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff HTTP/1.1 Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'fffda748-45ff-484d-953f-29c26869d8ff'} Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:16.756684 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:16.762038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:16.762038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:16.762038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:16.762038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. Oct 31 15:31:16.762038 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:16.762038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-120e3de1-e838-44b2-8be7-8a7393001530 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance fffda748-45ff-484d-953f-29c26869d8ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:16.762038 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-120e3de1-e838-44b2-8be7-8a7393001530 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff" status: 404 len: 111 microversion: 2.1 time: 0.024034 Oct 31 15:31:16.762038 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1801/3435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:16 2022] GET /compute/v2.1/servers/fffda748-45ff-484d-953f-29c26869d8ff => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:16.771234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:16.772022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.785489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.789182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.789878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.790825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.794655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.795729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.859498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:31:16.918347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8d728483-632f-47cb-8cde-464e12d9d1e8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc866329-5958-455d-ae24-a890033c24ab"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:16.920795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8d728483-632f-47cb-8cde-464e12d9d1e8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:16.945748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d728483-632f-47cb-8cde-464e12d9d1e8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.953713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d728483-632f-47cb-8cde-464e12d9d1e8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.954356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d728483-632f-47cb-8cde-464e12d9d1e8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:16.959144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d728483-632f-47cb-8cde-464e12d9d1e8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:16.959594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d728483-632f-47cb-8cde-464e12d9d1e8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:16.960042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d728483-632f-47cb-8cde-464e12d9d1e8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.109877 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c868be34-c1bc-421f-ae29-05e8af2e6c5b tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 204 len: 0 microversion: 2.1 time: 0.343194 Oct 31 15:31:17.111161 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1635/3436] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:16 2022] DELETE /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:17.121338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:17.122285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:17.138254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.142120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.142803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.145286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.145935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.146528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.568057 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8d728483-632f-47cb-8cde-464e12d9d1e8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.656543 Oct 31 15:31:17.585503 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1802/3437] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:31:16 2022] POST /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:17.592007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:17.608906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:17.641846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.643083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.652980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:17.654245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.655897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.661773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.662741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.668451 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f32d7ced-814f-46f0-bf4e-d6244924fb53 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1479 microversion: 2.1 time: 0.552515 Oct 31 15:31:17.681248 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1636/3438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:17 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1479 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:17.941040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d56b6f22-c40c-4d0c-8f9e-3415b9f6fbe5 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-579576349", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:17.946121 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d56b6f22-c40c-4d0c-8f9e-3415b9f6fbe5 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] HTTP exception thrown: min_count must be <= max_count Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d56b6f22-c40c-4d0c-8f9e-3415b9f6fbe5 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Request method failure captured: Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 183 Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-pFxaMYnUZ-e8KYxAxFztKildHCE3Kl4YPLDmhHcHP36RDd6-DB6u8s3qkeiFbIdsIdwZ1vzQBaqAtD2yiON7t0TPJlrCrqisRkT74qLH5SXE5am4vdwAZHUzFm06aS2H-AUzme8E5v-l3fBgVURedRwrYCJ9GnGA782pJmXt78jpk Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_17f4649e0a6c4e219f0562ba23cc322c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/17f4649e0a6c4e219f0562ba23cc322c"}]}] Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 2079c9542bb34179a19e9ed653d3d8ba Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-579576349", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: exception: min_count must be <= max_count Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-579576349', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 31 15:31:17.948872 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:17.954049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d56b6f22-c40c-4d0c-8f9e-3415b9f6fbe5 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Returning 400 to user: min_count must be <= max_count {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:17.954049 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d56b6f22-c40c-4d0c-8f9e-3415b9f6fbe5 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.273835 Oct 31 15:31:17.957550 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1637/3439] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:17 2022] POST /compute/v2.1/servers => generated 74 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 31 15:31:17.966444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:17.967640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:17.982316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.983070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.984341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:17.986464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:17.987211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:17.988658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.016050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:18.033028 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-70b69a69-9e78-4104-b1a6-543e7e25d077 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1271 microversion: 2.1 time: 0.439268 Oct 31 15:31:18.034624 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1803/3440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:17 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1271 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:18.053253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:18.053887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:18.082892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.083942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.087921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.088902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.089566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.092632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.889796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:18.899857 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17000729-7cf2-41eb-9c0b-7c60c0569340 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1317 microversion: 2.1 time: 0.863930 Oct 31 15:31:18.906667 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1804/3441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:18 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:18.912784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b8011d9d-321a-46d6-8263-dfaa2d271791 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1859219899", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "max_count": 0}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b8011d9d-321a-46d6-8263-dfaa2d271791 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Request method failure captured: Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 168 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-pFxaMYnUZ-e8KYxAxFztKildHCE3Kl4YPLDmhHcHP36RDd6-DB6u8s3qkeiFbIdsIdwZ1vzQBaqAtD2yiON7t0TPJlrCrqisRkT74qLH5SXE5am4vdwAZHUzFm06aS2H-AUzme8E5v-l3fBgVURedRwrYCJ9GnGA782pJmXt78jpk Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_17f4649e0a6c4e219f0562ba23cc322c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/17f4649e0a6c4e219f0562ba23cc322c"}]}] Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 2079c9542bb34179a19e9ed653d3d8ba Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1859219899", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "max_count": 0}} Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1859219899', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'max_count': 0}}} Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 0 Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:31:18.917970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:31:18.922927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:18.925855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b8011d9d-321a-46d6-8263-dfaa2d271791 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:18.926890 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b8011d9d-321a-46d6-8263-dfaa2d271791 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018950 Oct 31 15:31:18.937970 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1805/3442] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:18 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:31:18.944760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d7fcc336-9069-437a-b3fc-943c1f54322a req-c1a02d9b-055c-4020-8829-737ed7e33cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-deleted", "tag": "f7b1863f-6b3c-4899-8a17-846c72b01a0e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:18.959391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d7fcc336-9069-437a-b3fc-943c1f54322a req-c1a02d9b-055c-4020-8829-737ed7e33cc5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:18.960244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d7fcc336-9069-437a-b3fc-943c1f54322a req-c1a02d9b-055c-4020-8829-737ed7e33cc5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:18.960867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d7fcc336-9069-437a-b3fc-943c1f54322a req-c1a02d9b-055c-4020-8829-737ed7e33cc5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:18.989360 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d7fcc336-9069-437a-b3fc-943c1f54322a req-c1a02d9b-055c-4020-8829-737ed7e33cc5 service nova] Creating event network-vif-deleted:f7b1863f-6b3c-4899-8a17-846c72b01a0e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:18.999630 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d7fcc336-9069-437a-b3fc-943c1f54322a req-c1a02d9b-055c-4020-8829-737ed7e33cc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060211 Oct 31 15:31:19.001074 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1806/3443] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:19.013700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:19.014685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:19.049090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:19.049805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:19.056118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:19.057158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:19.057697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:19.058368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:19.548673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:19.567995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:19.578288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:19.586410 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ba5d343-5dcf-42c1-a0b1-43a467bf80c3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2867 microversion: 2.42 time: 1.625299 Oct 31 15:31:19.588695 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1638/3444] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:17 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2867 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:19.606816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-31257d7b-7aa0-45a1-956a-02469f292fe4 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-443752280", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "max_count": 2.5}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-31257d7b-7aa0-45a1-956a-02469f292fe4 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Request method failure captured: Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 169 Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-pFxaMYnUZ-e8KYxAxFztKildHCE3Kl4YPLDmhHcHP36RDd6-DB6u8s3qkeiFbIdsIdwZ1vzQBaqAtD2yiON7t0TPJlrCrqisRkT74qLH5SXE5am4vdwAZHUzFm06aS2H-AUzme8E5v-l3fBgVURedRwrYCJ9GnGA782pJmXt78jpk Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_17f4649e0a6c4e219f0562ba23cc322c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/17f4649e0a6c4e219f0562ba23cc322c"}]}] Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 2079c9542bb34179a19e9ed653d3d8ba Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-443752280", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "max_count": 2.5}} Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-443752280', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'max_count': 2.5}}} Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 2.5 Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:31:19.611328 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:31:19.616627 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:19.618968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-31257d7b-7aa0-45a1-956a-02469f292fe4 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:19.621274 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-31257d7b-7aa0-45a1-956a-02469f292fe4 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030975 Oct 31 15:31:19.622025 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1639/3445] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:19 2022] POST /compute/v2.1/servers => generated 139 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:31:19.633691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:19.636132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:20.058366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.059124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.059768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.060645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.061291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.061876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.276221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cd28d777ac40eda1a7abefb5a3256d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b62d7aa07ac6442d87c73de859d91c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:20.287124 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0f6bf95e-5acb-4055-8f35-4dcb3eeeae57 tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 200 len: 1479 microversion: 2.1 time: 1.284571 Oct 31 15:31:20.289195 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1807/3446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:19 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 1479 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:20.305540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-246f686b-e7f3-4164-899d-7b2886252934 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1232903146", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 0}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-246f686b-e7f3-4164-899d-7b2886252934 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Request method failure captured: Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 168 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-pFxaMYnUZ-e8KYxAxFztKildHCE3Kl4YPLDmhHcHP36RDd6-DB6u8s3qkeiFbIdsIdwZ1vzQBaqAtD2yiON7t0TPJlrCrqisRkT74qLH5SXE5am4vdwAZHUzFm06aS2H-AUzme8E5v-l3fBgVURedRwrYCJ9GnGA782pJmXt78jpk Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_17f4649e0a6c4e219f0562ba23cc322c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/17f4649e0a6c4e219f0562ba23cc322c"}]}] Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 2079c9542bb34179a19e9ed653d3d8ba Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1232903146", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 0}} Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1232903146', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'min_count': 0}}} Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 0 Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:31:20.311021 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 31 15:31:20.316373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.318372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-246f686b-e7f3-4164-899d-7b2886252934 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:20.319401 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-246f686b-e7f3-4164-899d-7b2886252934 tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028188 Oct 31 15:31:20.320513 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1808/3447] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:20 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:31:20.325407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c7eb0df2-81b0-40ee-8bf3-90cb195fea3f req-1c8c8b1b-a971-408e-9b54-b0fa3553cfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f854e7e8-6a2c-4fe0-9317-f17fa81d3243", "name": "network-vif-deleted", "tag": "8e7814a5-2149-4218-a84c-b967864f8da7"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:20.337907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c7eb0df2-81b0-40ee-8bf3-90cb195fea3f req-1c8c8b1b-a971-408e-9b54-b0fa3553cfba service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.338760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c7eb0df2-81b0-40ee-8bf3-90cb195fea3f req-1c8c8b1b-a971-408e-9b54-b0fa3553cfba service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.339347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c7eb0df2-81b0-40ee-8bf3-90cb195fea3f req-1c8c8b1b-a971-408e-9b54-b0fa3553cfba service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.354505 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c7eb0df2-81b0-40ee-8bf3-90cb195fea3f req-1c8c8b1b-a971-408e-9b54-b0fa3553cfba service nova] Creating event network-vif-deleted:8e7814a5-2149-4218-a84c-b967864f8da7 for instance f854e7e8-6a2c-4fe0-9317-f17fa81d3243 on n-h2-858384-17 Oct 31 15:31:20.362338 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c7eb0df2-81b0-40ee-8bf3-90cb195fea3f req-1c8c8b1b-a971-408e-9b54-b0fa3553cfba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039507 Oct 31 15:31:20.363720 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1809/3448] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:20.372682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:20.373591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:20.382600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.383266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.383859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.385007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.385656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.386261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.888377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:20.898420 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-844d1b00-df7b-44bd-8f37-d68943190a25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1313 microversion: 2.1 time: 1.274508 Oct 31 15:31:20.899012 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1640/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:19 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1313 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:20.929220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-449c4843-bbfa-43eb-a9aa-db7beed05c2f tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1937799641", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 2.5}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-449c4843-bbfa-43eb-a9aa-db7beed05c2f tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Request method failure captured: Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 170 Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-pFxaMYnUZ-e8KYxAxFztKildHCE3Kl4YPLDmhHcHP36RDd6-DB6u8s3qkeiFbIdsIdwZ1vzQBaqAtD2yiON7t0TPJlrCrqisRkT74qLH5SXE5am4vdwAZHUzFm06aS2H-AUzme8E5v-l3fBgVURedRwrYCJ9GnGA782pJmXt78jpk Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_17f4649e0a6c4e219f0562ba23cc322c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/17f4649e0a6c4e219f0562ba23cc322c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/17f4649e0a6c4e219f0562ba23cc322c"}]}] Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 17f4649e0a6c4e219f0562ba23cc322c Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1652066948 Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 2079c9542bb34179a19e9ed653d3d8ba Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1652066948-project Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1937799641", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 2.5}} Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1937799641', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'min_count': 2.5}}} Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 2.5 Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:31:20.933681 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 31 15:31:20.937828 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:31:20.942913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-449c4843-bbfa-43eb-a9aa-db7beed05c2f tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:20.944053 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-449c4843-bbfa-43eb-a9aa-db7beed05c2f tempest-MultipleCreateNegativeTestJSON-1652066948 tempest-MultipleCreateNegativeTestJSON-1652066948-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028053 Oct 31 15:31:20.946732 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1641/3450] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:31:20.964801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:20.965689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:20.984802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.985703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.986349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:20.987302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:20.990839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:20.991573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.016946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:21.031984 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d06d0c6-797b-46f0-bd84-2019bf573a88 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1317 microversion: 2.1 time: 0.664376 Oct 31 15:31:21.032849 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1810/3451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:20 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:21.049811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-08f243da-7a95-4d53-91ae-7147f17b9ecb req-e713a386-b1ff-4f1a-ae80-261209f2ed42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-deleted", "tag": "2a4a9196-b5c2-4e85-9d1b-ff3182ce40bd"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:21.067835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-08f243da-7a95-4d53-91ae-7147f17b9ecb req-e713a386-b1ff-4f1a-ae80-261209f2ed42 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.068676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-08f243da-7a95-4d53-91ae-7147f17b9ecb req-e713a386-b1ff-4f1a-ae80-261209f2ed42 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.069344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-08f243da-7a95-4d53-91ae-7147f17b9ecb req-e713a386-b1ff-4f1a-ae80-261209f2ed42 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.114803 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-08f243da-7a95-4d53-91ae-7147f17b9ecb req-e713a386-b1ff-4f1a-ae80-261209f2ed42 service nova] Creating event network-vif-deleted:2a4a9196-b5c2-4e85-9d1b-ff3182ce40bd for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:21.124897 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-08f243da-7a95-4d53-91ae-7147f17b9ecb req-e713a386-b1ff-4f1a-ae80-261209f2ed42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078808 Oct 31 15:31:21.126204 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1811/3452] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:31:21.316982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:21.320061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] [instance: f854e7e8-6a2c-4fe0-9317-f17fa81d3243] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:21.337597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.338506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.339391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.340320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.341940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.343354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.380550 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] HTTP exception thrown: Instance f854e7e8-6a2c-4fe0-9317-f17fa81d3243 could not be found. Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Request method failure captured: Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 HTTP/1.1 Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-lpDCRGkeH51Chb4d1gbe6SzHqaeaU2NCtDC6H2ndbrZ9clOIS_ilc9e_qdDU9nk0MtnjM_ZGTkiyTQlM8fKVmnlhaH-bEQ5BUmXHC--mKrag52dddYGzJ2eQyu1r0PEJ3mViJjthgjFJHdGZS7mJbj4d4oHvMSYk8aIlc8EraGV_c Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b62d7aa07ac6442d87c73de859d91c34", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b62d7aa07ac6442d87c73de859d91c34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b62d7aa07ac6442d87c73de859d91c34"}]}] Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersTestJSON-1466901692 Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: b62d7aa07ac6442d87c73de859d91c34 Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersTestJSON-1466901692 Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 31cd28d777ac40eda1a7abefb5a3256d Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersTestJSON-1466901692-project Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f854e7e8-6a2c-4fe0-9317-f17fa81d3243 could not be found. Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f854e7e8-6a2c-4fe0-9317-f17fa81d3243'} Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f854e7e8-6a2c-4fe0-9317-f17fa81d3243 could not be found. Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f854e7e8-6a2c-4fe0-9317-f17fa81d3243 could not be found. Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:21.385109 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:21.389103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:21.389103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:21.389103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:21.389103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:21.389103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:21.389103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f854e7e8-6a2c-4fe0-9317-f17fa81d3243 could not be found. Oct 31 15:31:21.389103 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:21.399150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] Returning 404 to user: Instance f854e7e8-6a2c-4fe0-9317-f17fa81d3243 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:21.400651 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-00f1b75b-c90e-4c27-9cf0-c77c20a0cc7d tempest-ServersTestJSON-1466901692 tempest-ServersTestJSON-1466901692-project] 10.222.0.20 "GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243" status: 404 len: 111 microversion: 2.1 time: 0.089857 Oct 31 15:31:21.401515 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1812/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:21 2022] GET /compute/v2.1/servers/f854e7e8-6a2c-4fe0-9317-f17fa81d3243 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:31:21.924753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:21.926826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:21.938029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.942152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.943706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:21.948871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:21.949718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:21.950429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.238639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:22.294367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:22.298183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:22.313574 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-368e5758-8353-4ebd-8fbd-1781af9782a3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2708 microversion: 2.42 time: 1.357161 Oct 31 15:31:22.317285 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1642/3454] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:20 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2708 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:22.351626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:22.357795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:22.379461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:22.379956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:22.380392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.387545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:22.389022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:22.390672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.399605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:22.420136 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2e82fce-ddf0-418d-a624-678ac6a127a9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1313 microversion: 2.1 time: 0.499388 Oct 31 15:31:22.421219 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1813/3455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:21 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:22.462171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:22.836269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:22.855731 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-560650a3-3d7a-4722-b6fc-9cb8561e39b7 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1317 microversion: 2.1 time: 0.530250 Oct 31 15:31:22.858505 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1643/3456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:22 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:22.875379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4361dcb5-acfe-492e-81c2-1c0dd39423dd req-b3aa6872-e452-4e37-a803-65d356e739d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e4c90d-51a5-43da-bd79-bb99662db232", "tag": "2e5a8b47-d95d-4dbf-852e-51ad01cbe282"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:22.895945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4361dcb5-acfe-492e-81c2-1c0dd39423dd req-b3aa6872-e452-4e37-a803-65d356e739d6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:22.896591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4361dcb5-acfe-492e-81c2-1c0dd39423dd req-b3aa6872-e452-4e37-a803-65d356e739d6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:22.900719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4361dcb5-acfe-492e-81c2-1c0dd39423dd req-b3aa6872-e452-4e37-a803-65d356e739d6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:22.921840 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4361dcb5-acfe-492e-81c2-1c0dd39423dd req-b3aa6872-e452-4e37-a803-65d356e739d6 service nova] Creating event network-changed:2e5a8b47-d95d-4dbf-852e-51ad01cbe282 for instance 17e4c90d-51a5-43da-bd79-bb99662db232 on n-h1-858384-17 Oct 31 15:31:22.946198 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4361dcb5-acfe-492e-81c2-1c0dd39423dd req-b3aa6872-e452-4e37-a803-65d356e739d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074414 Oct 31 15:31:22.947000 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1814/3457] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:23.186121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6fa692b4-c199-4457-9c7d-d837893b3ba8 req-c37956af-6412-4ac0-8cdc-647b8abf8102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-deleted", "tag": "09848140-2371-4ed5-87cf-2d323d065746"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:23.211411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6fa692b4-c199-4457-9c7d-d837893b3ba8 req-c37956af-6412-4ac0-8cdc-647b8abf8102 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.212738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6fa692b4-c199-4457-9c7d-d837893b3ba8 req-c37956af-6412-4ac0-8cdc-647b8abf8102 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.214377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6fa692b4-c199-4457-9c7d-d837893b3ba8 req-c37956af-6412-4ac0-8cdc-647b8abf8102 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.247573 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6fa692b4-c199-4457-9c7d-d837893b3ba8 req-c37956af-6412-4ac0-8cdc-647b8abf8102 service nova] Creating event network-vif-deleted:09848140-2371-4ed5-87cf-2d323d065746 for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:23.268022 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6fa692b4-c199-4457-9c7d-d837893b3ba8 req-c37956af-6412-4ac0-8cdc-647b8abf8102 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085138 Oct 31 15:31:23.269812 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1644/3458] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:23.306895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-07f0b89f-f613-44ab-b111-a860e452cedb req-7d679044-8352-4093-9ad3-cd1e37d3ef56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27368d6e-e7ae-4172-891c-cfc8a7eba5ef", "name": "network-vif-plugged", "status": "completed", "tag": "2eda2ae3-b3bc-4a9d-839c-478fee3e1ce0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:23.331906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-07f0b89f-f613-44ab-b111-a860e452cedb req-7d679044-8352-4093-9ad3-cd1e37d3ef56 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.332562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-07f0b89f-f613-44ab-b111-a860e452cedb req-7d679044-8352-4093-9ad3-cd1e37d3ef56 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.333117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-07f0b89f-f613-44ab-b111-a860e452cedb req-7d679044-8352-4093-9ad3-cd1e37d3ef56 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.352775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:23.353606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:23.372537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.376065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.376686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.380090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.381192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.383212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.406062 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-07f0b89f-f613-44ab-b111-a860e452cedb req-7d679044-8352-4093-9ad3-cd1e37d3ef56 service nova] Creating event network-vif-plugged:2eda2ae3-b3bc-4a9d-839c-478fee3e1ce0 for instance 27368d6e-e7ae-4172-891c-cfc8a7eba5ef on n-h2-858384-17 Oct 31 15:31:23.427275 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-07f0b89f-f613-44ab-b111-a860e452cedb req-7d679044-8352-4093-9ad3-cd1e37d3ef56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124855 Oct 31 15:31:23.428413 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1815/3459] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:31:23.447547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:23.448428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:23.463240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.464036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.464725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.465721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:23.466410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:23.467061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:23.558966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:23.964006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:23.982134 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c924109c-bdfe-4734-b9d1-1537975e83d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1313 microversion: 2.1 time: 0.538702 Oct 31 15:31:23.990496 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1816/3460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:23 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:24.020546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:24.021954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:24.035548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.038851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.039631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.041740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:24.042323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:24.043518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:24.350907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:24.365499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:24.376745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:24.399921 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df01d404-4dae-4107-a6a2-96618cbe3e52 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2212 microversion: 2.42 time: 1.052872 Oct 31 15:31:24.407451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1645/3461] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:23 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2212 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:24.970891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:25.015752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:25.016711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:25.019201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:25.020444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:25.035738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.040323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.043429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.044339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.045341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.045902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.768642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:25.778326 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac98d8d2-7225-4340-89fb-10276e5a2bb3 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1317 microversion: 2.1 time: 1.786562 Oct 31 15:31:25.782065 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1817/3462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:23 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1317 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:25.793182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:25.800320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:25.809510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.810280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.810900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:25.811802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:25.812432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:25.813326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.020055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:26.044378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:26.052716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:26.058974 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19e9ad73-3b13-4698-97f2-1985df52a31c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 2145 microversion: 2.42 time: 0.270065 Oct 31 15:31:26.062011 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1818/3463] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:25 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 2145 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:26.073435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8061b428-c83c-4d96-a0be-ed6162263a7d req-5fc315b3-6f36-4575-a76a-f6dcf2fc91b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-deleted", "tag": "c2a80bb3-9c3f-48a0-9d1e-6beeb88fd04e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:26.096283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8061b428-c83c-4d96-a0be-ed6162263a7d req-5fc315b3-6f36-4575-a76a-f6dcf2fc91b2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.105874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8061b428-c83c-4d96-a0be-ed6162263a7d req-5fc315b3-6f36-4575-a76a-f6dcf2fc91b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.106434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8061b428-c83c-4d96-a0be-ed6162263a7d req-5fc315b3-6f36-4575-a76a-f6dcf2fc91b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.112013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:26.133319 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8061b428-c83c-4d96-a0be-ed6162263a7d req-5fc315b3-6f36-4575-a76a-f6dcf2fc91b2 service nova] Creating event network-vif-deleted:c2a80bb3-9c3f-48a0-9d1e-6beeb88fd04e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:26.138068 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26ad9af8-011e-4241-bc14-ebc4be0b8854 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1313 microversion: 2.1 time: 1.127449 Oct 31 15:31:26.139125 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1646/3464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:25 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1313 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:26.173552 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8061b428-c83c-4d96-a0be-ed6162263a7d req-5fc315b3-6f36-4575-a76a-f6dcf2fc91b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098735 Oct 31 15:31:26.175615 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1819/3465] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:26.809978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:26.810597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:26.819423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.819924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.820362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:26.821071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:26.822763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:26.823200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.098235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:27.098933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:27.111491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:27.111996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:27.112990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.113748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:27.114211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:27.114642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.248081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:27.265359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:27.270871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:27.272151 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae8ada48-d874-4ff0-8c74-265de26452e1 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.180419 Oct 31 15:31:27.276088 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1820/3466] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:27 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:27.291683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:27.296827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:27.311159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:27.311656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:27.312091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.312810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:27.313793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:27.313793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:27.704287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:27.715112 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9caba2d-711a-4142-bfc9-a1b685d0995c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1313 microversion: 2.1 time: 0.437555 Oct 31 15:31:27.718833 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1821/3467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:27 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:28.078674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.093674 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e1d2a0e-5e28-4113-be09-bfe159e042c0 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1506 microversion: 2.1 time: 1.287635 Oct 31 15:31:28.099299 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1647/3468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:26 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1506 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:28.126300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:28.126979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:28.140953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.141948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.142628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.151498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.152370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.153043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.224226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.228499 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2ab3f94-c5da-42f3-8b72-b81428249d64 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef/os-instance-actions/req-858d5759-0f48-4f79-b239-dd1c4bd140b1" status: 200 len: 313 microversion: 2.1 time: 0.106530 Oct 31 15:31:28.232493 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1822/3469] 10.222.0.20 () {58 vars in 1419 bytes} [Mon Oct 31 15:31:28 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef/os-instance-actions/req-858d5759-0f48-4f79-b239-dd1c4bd140b1 => generated 313 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:28.256689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-49ca4bc6-f082-4c37-98d0-66630b826374 req-bd44bf80-fd72-49fc-9b2e-8d1e59347de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f46659e6-fbb0-4b25-9b6b-5648ebeb16da", "name": "network-vif-deleted", "tag": "1e16090b-0a3b-4c92-81fa-daf4885f848e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:28.258065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-412bd0fb-6aa1-42d8-b49b-39e5741bda91 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:28.263910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-412bd0fb-6aa1-42d8-b49b-39e5741bda91 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:28.284369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-412bd0fb-6aa1-42d8-b49b-39e5741bda91 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.287371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-49ca4bc6-f082-4c37-98d0-66630b826374 req-bd44bf80-fd72-49fc-9b2e-8d1e59347de4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.288372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-412bd0fb-6aa1-42d8-b49b-39e5741bda91 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.291317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-412bd0fb-6aa1-42d8-b49b-39e5741bda91 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.292338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-412bd0fb-6aa1-42d8-b49b-39e5741bda91 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.293315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-49ca4bc6-f082-4c37-98d0-66630b826374 req-bd44bf80-fd72-49fc-9b2e-8d1e59347de4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.294004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-49ca4bc6-f082-4c37-98d0-66630b826374 req-bd44bf80-fd72-49fc-9b2e-8d1e59347de4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.294874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-412bd0fb-6aa1-42d8-b49b-39e5741bda91 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.298557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-412bd0fb-6aa1-42d8-b49b-39e5741bda91 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.330524 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-49ca4bc6-f082-4c37-98d0-66630b826374 req-bd44bf80-fd72-49fc-9b2e-8d1e59347de4 service nova] Creating event network-vif-deleted:1e16090b-0a3b-4c92-81fa-daf4885f848e for instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da on n-h1-858384-17 Oct 31 15:31:28.340096 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-49ca4bc6-f082-4c37-98d0-66630b826374 req-bd44bf80-fd72-49fc-9b2e-8d1e59347de4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094911 Oct 31 15:31:28.341087 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1823/3470] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:28.346585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:28.360075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:28.367445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.368241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.369748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.370727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.374247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.374977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.470794 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-412bd0fb-6aa1-42d8-b49b-39e5741bda91 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "POST /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef/action" status: 202 len: 0 microversion: 2.1 time: 0.224172 Oct 31 15:31:28.472828 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1648/3471] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:28 2022] POST /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:31:28.485203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:28.486694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:28.502248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.504628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.505388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.507623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.508523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.512618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.824936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.860003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.868774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:28.871791 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-325f6a73-e4a7-404a-af46-b414f0281d8a tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.527753 Oct 31 15:31:28.872617 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1824/3472] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:28 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:28.908274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:28.911821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:28.928991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.934521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.936773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:28.939733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:28.942987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:28.944182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:29.436665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:29.453474 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-973cd772-1004-4ed7-83d3-b31ac7369e4c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1313 microversion: 2.1 time: 0.562500 Oct 31 15:31:29.454021 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1825/3473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:28 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:29.821221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:29.832030 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9e11936d-a99b-4267-9a08-2fff9200ac85 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1508 microversion: 2.1 time: 1.353848 Oct 31 15:31:29.834482 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1649/3474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:28 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1508 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:29.903360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:29.903903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:29.918686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:29.918880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:29.919503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:29.920406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:29.921034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:29.921645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:30.207798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:30.224688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:30.227533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:30.229178 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-163225a8-0659-4ede-acb0-7c3bb1d6d2af tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.330961 Oct 31 15:31:30.230498 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1826/3475] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:29 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:30.481122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:30.482761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:30.495765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:30.499210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:30.500447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:30.504334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:30.505193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:30.506196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:30.858557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:30.859153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:30.872010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:30.872510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:30.872946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:30.873693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:30.885156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:30.885745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.362686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:31.371387 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0ffb294-1a74-43e4-bab3-cf91de723ff7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1313 microversion: 2.1 time: 0.896373 Oct 31 15:31:31.381930 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1650/3476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:30 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1313 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:31.397596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:31.401933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:31.429434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.429434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.429434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.429434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:31.429434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:31.429899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:31.888082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:31.917094 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7869a6e9-e522-484a-929b-d03f2fe3b22e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1508 microversion: 2.1 time: 1.059769 Oct 31 15:31:31.919739 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1827/3477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:30 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1508 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:32.302059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-cb5e3af5-c27c-499e-8ca1-290ae4122f7d req-b5399a30-6e50-4c9c-89ea-f1b3f7d046df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e4c90d-51a5-43da-bd79-bb99662db232", "name": "network-vif-plugged", "status": "completed", "tag": "2e5a8b47-d95d-4dbf-852e-51ad01cbe282"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:32.335064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cb5e3af5-c27c-499e-8ca1-290ae4122f7d req-b5399a30-6e50-4c9c-89ea-f1b3f7d046df service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.339682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cb5e3af5-c27c-499e-8ca1-290ae4122f7d req-b5399a30-6e50-4c9c-89ea-f1b3f7d046df service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.340384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cb5e3af5-c27c-499e-8ca1-290ae4122f7d req-b5399a30-6e50-4c9c-89ea-f1b3f7d046df service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.366858 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cb5e3af5-c27c-499e-8ca1-290ae4122f7d req-b5399a30-6e50-4c9c-89ea-f1b3f7d046df service nova] Creating event network-vif-plugged:2e5a8b47-d95d-4dbf-852e-51ad01cbe282 for instance 17e4c90d-51a5-43da-bd79-bb99662db232 on n-h1-858384-17 Oct 31 15:31:32.382520 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-cb5e3af5-c27c-499e-8ca1-290ae4122f7d req-b5399a30-6e50-4c9c-89ea-f1b3f7d046df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087384 Oct 31 15:31:32.385519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1828/3478] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:31:32.406657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:32.408006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:32.422646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.426828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.427602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.430699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.433589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.436359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.684529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:32.711738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:32.713568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:32.714993 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-65d1612a-223e-48b1-87d4-48f4e3f82fbd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 1.331655 Oct 31 15:31:32.715559 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1651/3479] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:31 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:32.948170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:32.948961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:32.961829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.968398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.973747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:32.974775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:32.978966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:32.981598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:33.268846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:33.293324 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a7f7324-b605-4c08-9858-40259e54439d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1313 microversion: 2.1 time: 0.891271 Oct 31 15:31:33.298168 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1829/3480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:32 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1313 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:33.754186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:33.754796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:33.771976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.772474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.772909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:33.773638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.776119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.781795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:33.847192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:33.860758 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c3f945f-e94b-46d5-8fad-c45f34c4ad93 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1506 microversion: 2.1 time: 0.917627 Oct 31 15:31:33.861390 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1652/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:32 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1506 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:33.876766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:33.897603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:33.920709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.921440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.922134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:33.933563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:33.935047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:33.935517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.008107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lazy-loading 'flavor' on Instance uuid 70dad59f-00ca-480e-81e9-ca7bcdfcc633 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:31:34.200200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:34.229412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:34.231688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:34.249357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0e58786-dbbf-4cd9-8ec9-735de2f1fbde tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.499567 Oct 31 15:31:34.257173 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1830/3482] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:33 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:34.286897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aea9f809-0ce7-4e0a-95d2-e5e62979c94c tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '.version_select at 0x7f16e16548b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:34.292182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aea9f809-0ce7-4e0a-95d2-e5e62979c94c tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:34.310071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea9f809-0ce7-4e0a-95d2-e5e62979c94c tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.318178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea9f809-0ce7-4e0a-95d2-e5e62979c94c tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.318610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea9f809-0ce7-4e0a-95d2-e5e62979c94c tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.324040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea9f809-0ce7-4e0a-95d2-e5e62979c94c tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.326671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea9f809-0ce7-4e0a-95d2-e5e62979c94c tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.327272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aea9f809-0ce7-4e0a-95d2-e5e62979c94c tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.415479 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32595384-f452-41e3-bbf1-2f6a604fc719 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/action" status: 200 len: 32 microversion: 2.1 time: 0.539656 Oct 31 15:31:34.418758 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aea9f809-0ce7-4e0a-95d2-e5e62979c94c tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.147213 Oct 31 15:31:34.419087 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1653/3483] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:33 2022] POST /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/action => generated 32 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:31:34.419569 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1831/3484] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Oct 31 15:31:34 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef/os-instance-actions => generated 611 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:34.439247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:34.439873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:34.454688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:34.457500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:34.464748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.465294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.465742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.466468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.466933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.467362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.481878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.484196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.485685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:34.486856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:34.489060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:34.491133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.055142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.064325 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e53cbaa-b442-4066-8f28-b4d435e143f7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.630022 Oct 31 15:31:35.093312 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1832/3485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:34 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:35.103213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:35.104056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:35.116830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.117961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.119692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.120761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.121698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.122393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.191288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:31:35.308218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:35.460262 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d911ec1-da03-4003-af42-d8838401c611 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "DELETE /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 204 len: 0 microversion: 2.1 time: 0.365443 Oct 31 15:31:35.464277 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1833/3486] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:31:35 2022] DELETE /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:31:35.475718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:35.476440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:35.500917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.501459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.504375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.506952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.507525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.507983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.603922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.619284 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ae92f29-5ec0-4b37-8b68-be7571da0d8f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1313 microversion: 2.1 time: 1.195492 Oct 31 15:31:35.633250 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1654/3487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:34 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1313 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:35.633250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:35.637249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:35.650348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.654365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.655392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.657009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:35.658567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:35.661380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:35.788676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.806681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.808697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:35.810190 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32462e77-f751-456f-bace-8a352da14ca4 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.347163 Oct 31 15:31:35.829563 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1834/3488] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:35 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:36.102339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:36.102952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:36.104958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:36.121293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.121800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.122246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.122965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.123431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.123863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.539059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:36.583967 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-431a4c5e-42b6-4d4e-82da-5df9a6c3620f tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1512 microversion: 2.1 time: 0.958650 Oct 31 15:31:36.584816 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1655/3489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:35 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1512 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:36.647528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:36.648887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:36.669449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.670214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.672986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:36.677438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:36.679379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:36.680279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.182042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.192498 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b7c8e4cb-2d32-45be-baa5-a9892ac951cc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1463 microversion: 2.1 time: 0.549314 Oct 31 15:31:37.220570 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1656/3490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:36 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1463 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:37.227209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:37.234572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:37.248799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.254607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.255255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.256181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.256711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.257231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.257354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.271716 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4aceedc9-f40e-417e-948a-0818faf67dfb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 1.173195 Oct 31 15:31:37.273521 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1835/3491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:36 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:37.280046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:37.283390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:37.302722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.304472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.306093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.309261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.310034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.312026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.453065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.455411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:37.468303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.469806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.475450 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c9572558-ed19-43eb-a126-ad24c4f102d9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.253552 Oct 31 15:31:37.476696 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1657/3492] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:37 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:37.560511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:37.568373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Old instance type m1.heat2, new instance type m1.heat {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:31:37.585168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:31:37.585168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:31:37.585576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:31:37.585984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:31:37.586392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:31:37.611444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:37.612794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:37.620401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.624037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.626204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.630721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.631434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.632041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.890586 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-04b74897-430f-4298-a366-17a6b9878443 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232/action" status: 202 len: 0 microversion: 2.1 time: 0.612900 Oct 31 15:31:37.895995 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1836/3493] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:31:37 2022] POST /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:31:37.907769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:37.908438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:37.926234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.926733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.927167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:37.927876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:37.928358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:37.928735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.671852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:38.688141 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-20b34dd0-1aba-470a-aec8-315092c5f1f1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1512 microversion: 2.1 time: 1.077863 Oct 31 15:31:38.710451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1658/3494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:37 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1512 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:38.715793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:38.739521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:38.747518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.758770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.759514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.762335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.765850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.767856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.855061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:38.883485 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3287c76c-0636-4440-be03-7ff37d6f262d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1472 microversion: 2.1 time: 0.986155 Oct 31 15:31:38.886108 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1837/3495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:37 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1472 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:38.893268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:38.894752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:38.901785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.903451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.904738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:38.908252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:38.909558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:38.910872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.064905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.101604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.109644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.116420 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fbe8f7f6-e971-4248-a4e7-a4e9cdbd3df3 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.226333 Oct 31 15:31:39.138181 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1838/3496] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:38 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:39.739415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:39.756973 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d145c9f5-5d8f-418c-8e65-461e54561bf0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 1.045135 Oct 31 15:31:39.764607 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1659/3497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:38 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:39.775459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:39.776341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:39.800215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.802276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.802892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.807196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.808081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.808866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.921554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.922290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.925498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.927244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lazy-loading 'fault' on Instance uuid 27368d6e-e7ae-4172-891c-cfc8a7eba5ef {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:31:39.947552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-daa58b23-f380-446b-a48c-3c0476ce4c23 req-2e95e573-5f9c-4507-b6d7-a6bcba4fc240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27368d6e-e7ae-4172-891c-cfc8a7eba5ef", "name": "network-vif-deleted", "tag": "2eda2ae3-b3bc-4a9d-839c-478fee3e1ce0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:39.964631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-daa58b23-f380-446b-a48c-3c0476ce4c23 req-2e95e573-5f9c-4507-b6d7-a6bcba4fc240 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:39.965365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-daa58b23-f380-446b-a48c-3c0476ce4c23 req-2e95e573-5f9c-4507-b6d7-a6bcba4fc240 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:39.965959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-daa58b23-f380-446b-a48c-3c0476ce4c23 req-2e95e573-5f9c-4507-b6d7-a6bcba4fc240 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:39.991148 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-daa58b23-f380-446b-a48c-3c0476ce4c23 req-2e95e573-5f9c-4507-b6d7-a6bcba4fc240 service nova] Creating event network-vif-deleted:2eda2ae3-b3bc-4a9d-839c-478fee3e1ce0 for instance 27368d6e-e7ae-4172-891c-cfc8a7eba5ef on n-h2-858384-17 Oct 31 15:31:39.996692 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-daa58b23-f380-446b-a48c-3c0476ce4c23 req-2e95e573-5f9c-4507-b6d7-a6bcba4fc240 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.509764 Oct 31 15:31:39.999019 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1839/3498] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:31:40.006504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:40.007391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:40.015833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.017091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.017743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.019556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.020218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.020950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.363198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:40.375172 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd823238-03c3-497c-8f79-8f4f83734243 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1472 microversion: 2.1 time: 0.374704 Oct 31 15:31:40.382123 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1840/3499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:39 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1472 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:40.395890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:40.396823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:40.415173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.418462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.420332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.422640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.426704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.428060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.615607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:40.639877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:40.656971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:40.661284 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c466d88-6984-49b2-8145-145de247d049 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.276136 Oct 31 15:31:40.681977 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1841/3500] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:40 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:40.801421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:40.804424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:40.848128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.853964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.855592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.859728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:40.862627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:40.863303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:40.992005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c393a20165446faa2654a7e80e3585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0a498b89194390873540a519a26789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.001122 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d7b18c91-dd68-4d1c-97e4-11f333181c3e tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 200 len: 1307 microversion: 2.1 time: 1.229700 Oct 31 15:31:41.019220 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1660/3501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:39 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 1307 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:41.387426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.408527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:41.410108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:41.423567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:41.423801 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-641eb946-f58f-4186-b57a-a7dc3247e28e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.634583 Oct 31 15:31:41.427113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:41.427765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:41.428164 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1842/3502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:40 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:41.436022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:41.440692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:41.441482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:41.704878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:41.706195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:41.720145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:41.720811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:41.724314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:41.725392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:41.730126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:41.731175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:41.940881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.951904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.954093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:41.960748 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-242dcd82-2bbe-4148-a10f-aa402dbdd0fd tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.262537 Oct 31 15:31:41.962153 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1843/3503] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:41 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:42.034973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:42.036032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] [instance: 27368d6e-e7ae-4172-891c-cfc8a7eba5ef] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:42.053848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.054890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.055359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.057976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.060005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.060478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.138005 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] HTTP exception thrown: Instance 27368d6e-e7ae-4172-891c-cfc8a7eba5ef could not be found. Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Request method failure captured: Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef HTTP/1.1 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-o0EooHGiosMbmoh-joEXivxBiSfBzsLjkH0g60402XDI2WGwb8YPnopp17O5qOQSG_snebVJsabO42Ms0IN1_6dEndyp81RoiwWvOTtFqVeXkTxzLb4yRHyVOJ9aGhSVGyYWplaFiKpUSRJkSvWzDENOdcmRhwp9DvITkDThR38Hc Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 4e0a498b89194390873540a519a26789 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-InstanceActionsTestJSON-1254949359 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a498b89194390873540a519a26789"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4e0a498b89194390873540a519a26789", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4e0a498b89194390873540a519a26789"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4e0a498b89194390873540a519a26789"}]}] Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-InstanceActionsTestJSON-1254949359 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 4e0a498b89194390873540a519a26789 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1254949359 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-InstanceActionsTestJSON-1254949359-project Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 44c393a20165446faa2654a7e80e3585 Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-InstanceActionsTestJSON-1254949359-project Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 27368d6e-e7ae-4172-891c-cfc8a7eba5ef could not be found. Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '27368d6e-e7ae-4172-891c-cfc8a7eba5ef'} Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27368d6e-e7ae-4172-891c-cfc8a7eba5ef could not be found. Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27368d6e-e7ae-4172-891c-cfc8a7eba5ef could not be found. Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:31:42.145976 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:42.153209 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:31:42.153209 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:31:42.153209 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:31:42.153209 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:31:42.153209 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:31:42.153209 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27368d6e-e7ae-4172-891c-cfc8a7eba5ef could not be found. Oct 31 15:31:42.153209 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:31:42.165197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] Returning 404 to user: Instance 27368d6e-e7ae-4172-891c-cfc8a7eba5ef could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:31:42.168049 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8121fd3-bc9a-4db9-8c13-15a55921f3e1 tempest-InstanceActionsTestJSON-1254949359 tempest-InstanceActionsTestJSON-1254949359-project] 10.222.0.20 "GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef" status: 404 len: 111 microversion: 2.1 time: 0.140847 Oct 31 15:31:42.176300 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1844/3504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:42 2022] GET /compute/v2.1/servers/27368d6e-e7ae-4172-891c-cfc8a7eba5ef => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:31:42.443899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:42.458189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:42.459711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:42.484431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.491045 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a9a32ba-db14-40a1-b214-03fe8f145c35 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1472 microversion: 2.1 time: 1.081819 Oct 31 15:31:42.491757 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1661/3505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:41 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1472 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:42.492377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.493720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:42.496689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:42.498480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:42.498959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.001893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:43.004401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:43.020214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.021307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.021964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.038469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.039406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.042205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.193843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:43.213184 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a93ea178-c835-4943-a077-c6f3ebf3c579 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.751201 Oct 31 15:31:43.213706 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1845/3506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:42 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:43.485463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:43.501515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:43.506593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:43.511057 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-edc013c1-54e2-4b93-97e8-54e98dd60e78 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.523894 Oct 31 15:31:43.519480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:43.520906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:43.529475 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1662/3507] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:42 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:43.531534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.540802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.543099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:43.544028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:43.546203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:43.546833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.243113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:44.243771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:44.258325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.258842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.259297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.260028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.265353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.265922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.862557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:44.874977 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b936069-ee67-488c-ae12-94cf147d56c7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.636010 Oct 31 15:31:44.879110 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1663/3508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:44 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:44.889824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:44.890467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:44.903593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.906234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.910919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:44.916549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:44.917005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:44.917671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:45.174354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:45.208002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:45.212142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:45.213807 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e2ca1c3e-7b96-4436-a36f-a2ae7b301e43 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.333680 Oct 31 15:31:45.215323 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1664/3509] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:44 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:45.826669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:45.858169 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ddee340d-84df-49e7-afec-43589fd3b4ec tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1472 microversion: 2.1 time: 2.340373 Oct 31 15:31:45.862896 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1846/3510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:43 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1472 bytes in 2347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:45.900664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:45.901471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:45.912978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:45.915963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:45.916565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:45.919817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:45.920464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:45.921014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.244932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:46.246104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:46.271486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.271486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.271486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.271486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.271486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.271486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.445501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:46.460455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c574ae05-c629-4fb2-be0d-ecceaa4b70e1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.563625 Oct 31 15:31:46.461095 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1665/3511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:45 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:46.571214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:46.606753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:46.613928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:46.625100 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c083299a-ffe9-477c-b44b-af279fed937e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.383869 Oct 31 15:31:46.626151 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1847/3512] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:46 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:31:46.714663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7dfb70f1-0f83-4924-9192-e6108f4f4a26 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'create', calling method: .version_select at 0x7f16e0ea4790>, body: {"keypair": {"name": "tempest-keypair-372721830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDf5xeXSbCNL/bz5mQ9wG6Ocp1ix5ZFSN/xVeLGNyi9wubbSKwishvFOkznMYKVLJmHlfVqCI4CnlihM5NWwqzM0qCNqN6SHrhqjJxYFGtVvRUdENPjFkmkWCcTUpWbl9A=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:46.721710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:46.780482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-7dfb70f1-0f83-4924-9192-e6108f4f4a26 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:46.798611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-7dfb70f1-0f83-4924-9192-e6108f4f4a26 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for user 33e8230d70464e5da2cced0060bb1a31 and project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:46.863588 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7dfb70f1-0f83-4924-9192-e6108f4f4a26 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.269411 Oct 31 15:31:46.879785 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1666/3513] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:31:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:31:46.884677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:46.885465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:46.902876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.904565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.910117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:46.913186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:46.915548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:46.918052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:47.486004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:47.488134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:47.515685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:47.517275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:47.518617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:47.519854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:47.525054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:47.526204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:48.023915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:48.024431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:48.039472 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6458e9a6-13b2-494a-9b79-a92c0f936d4d tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.557870 Oct 31 15:31:48.040161 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b7bfeb8-ba4c-4546-8a2f-0aaa42100958 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 1.159808 Oct 31 15:31:48.060389 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1667/3514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:47 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:48.065745 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1848/3515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:46 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:48.078199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:48.080496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:48.098738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:48.101334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:48.102626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:48.106954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:48.107706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:48.110869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:48.416044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:48.445844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:48.459538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:48.461114 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56f7a1e7-6541-4de7-8504-11ad9d6b6610 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.399360 Oct 31 15:31:48.467352 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1668/3516] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:48 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:49.072002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:49.072649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:49.073025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:49.073160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:49.094210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:49.095678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:49.099856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:49.100461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:49.101231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:49.101583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:49.102239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:49.102892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:49.104970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:49.106564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:49.107098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:49.109741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:49.630726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:49.634632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:49.640369 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-77cb7b6a-68a7-446d-9740-6d85e2d3193a tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.577525 Oct 31 15:31:49.647068 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1849/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:49 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:49.657888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:49.659208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:49.694360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:49.694867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:49.703351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:49.704239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:49.709691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:49.710142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:50.403081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:50.417571 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-35a673fd-98e6-430f-8144-cd2a6716becc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 1.349746 Oct 31 15:31:50.425034 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1669/3518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:49 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:50.561196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:50.582766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:50.588693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:50.590316 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-40f9c383-136a-4945-9aab-1df8f6c7de92 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.942012 Oct 31 15:31:50.593742 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1850/3519] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:49 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:50.678550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:50.679219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:50.692592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.693120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.693620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:50.694376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:50.694846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:50.695287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.448002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:51.448707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:51.469440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.469946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.470385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.471155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.471620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.472139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.473681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:51.488737 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1cfddbf0-4cd3-4f3c-9ff4-da43c81d0ef6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.817240 Oct 31 15:31:51.489897 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1670/3520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:50 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:51.625801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:51.627011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:51.641747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.644114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.647645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.651246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:51.655025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:51.659440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:51.914139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:51.930957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:51.936666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:51.939708 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-352b4b54-b632-4196-87a3-f1fc62be638e tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.316680 Oct 31 15:31:51.942414 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1671/3521] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:51 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:52.391594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1912685961", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa1888d6-b08a-4260-8505-69a899fd42e4"}], "security_groups": [{"name": "tempest-securitygroup--1519016272"}], "key_name": "tempest-keypair-372721830", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:31:52.484806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:52.515649 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c09d53a-312c-4929-ba9e-ee49119a5b93 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 1.071441 Oct 31 15:31:52.538543 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1851/3522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:51 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:52.555619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:52.556263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:52.595714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.596246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.596776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:52.607172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:52.607693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:52.608143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:52.789247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] validate_networks() for [('fa1888d6-b08a-4260-8505-69a899fd42e4', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:31:53.643549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:53.653485 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d6309c2-dfcb-412e-94c5-51553b1afeff tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 1.113714 Oct 31 15:31:53.665498 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1852/3523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:52 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:53.684865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:53.685711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:53.698503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:53.699430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:53.700761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:53.702014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:53.702730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:53.708997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.232725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:54.256321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:54.266033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:54.275417 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76dac50e-282d-4a56-b078-4603bb50236c tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.602212 Oct 31 15:31:54.281695 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1853/3524] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:53 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:54.296556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:54.307131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:54.342849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.345910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.347118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.353387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.354691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.355859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.833797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:31:54.834976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:31:54.835585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:31:54.836019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:31:54.836594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:31:54.854351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.856633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.857788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.858647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:54.862290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:54.862792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:54.926027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:31:54.939013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for user 33e8230d70464e5da2cced0060bb1a31 and project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:31:54.979726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:31:54.982710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:31:55.113773 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-efbb79f8-f1f0-46e1-9e92-4941d8b2cd14 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.728108 Oct 31 15:31:55.131584 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1672/3525] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:31:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:31:55.141531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:55.142680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:55.194171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:55.195501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:55.199715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:55.222621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:55.224304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:55.242903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:55.582621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:55.593562 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a618b2bb-215b-4536-be29-d154c0b1519a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 1.310448 Oct 31 15:31:55.601985 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1854/3526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:54 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:55.616695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6afcee0c-c983-4072-acbb-c8aa7424fc0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:55.621982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6afcee0c-c983-4072-acbb-c8aa7424fc0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:56.008395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:56.022440 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-45fe6d6e-55e1-4f93-b4f6-764bfa276798 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.889565 Oct 31 15:31:56.024557 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1673/3527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:55 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:56.038879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:56.039499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:56.058978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.063221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.065368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.073206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.075765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.076866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.078751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6afcee0c-c983-4072-acbb-c8aa7424fc0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:56.088116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6afcee0c-c983-4072-acbb-c8aa7424fc0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1238 microversion: 2.1 time: 0.484618 Oct 31 15:31:56.096019 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1855/3528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:55 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1238 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:56.542336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:56.607659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:56.615406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:56.619942 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-afbe3081-a2e9-4c75-8ecc-9745e5e9892d tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.593132 Oct 31 15:31:56.623509 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1674/3529] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:56 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:56.623849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:56.624455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:56.640430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.641034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.641499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.642288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:56.642775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:56.643209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:56.931447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:56.944207 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5072cbec-e689-4d07-b67f-544fe4bbe1ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 0.324167 Oct 31 15:31:56.945786 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1856/3530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:56 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:57.051048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:57.051575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:57.066437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.085873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.086445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.088130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.092770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.098219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.112647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:57.115930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:57.132233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.132726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.133393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.141963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.144904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.145602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.378516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:57.397783 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1290 microversion: 2.1 time: 0.284904 Oct 31 15:31:57.429430 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1857/3531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:57 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1290 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:57.442156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:57.459249 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0fa31d3d-d6bf-4b48-b8e3-b3f0f633b5bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.014916 Oct 31 15:31:57.460305 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1858/3532] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 31 15:31:57 2022] GET /compute/ => generated 377 bytes in 22 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 15:31:57.653813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:57.654549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:57.674306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.679195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.682431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.684697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.684697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.684697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.882442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:57.906016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:57.909792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:57.925930 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a78badb-b1b5-4662-8a35-be6fbb755d08 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.274699 Oct 31 15:31:57.929160 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1859/3533] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:57 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:57.970192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:57.971301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:57.983242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.983774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.986012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:57.991076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:57.993762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:57.994226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:58.788831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:58.791350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:31:58.803361 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c17cc0b-6102-4d30-b59b-3edcee7adbc3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 1.758919 Oct 31 15:31:58.809696 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1675/3534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:57 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:58.816089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:58.834217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:58.859367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:58.859799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:58.861967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:58.863788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:58.864373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:58.865972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:58.980268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:58.993883 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8cfff95-bbe5-45d7-b87a-f86887651816 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 1.029072 Oct 31 15:31:58.995104 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1860/3535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:57 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:31:59.005439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:59.007533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:59.037513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.041778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.042405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.043313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.043992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.044734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.158239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:59.179927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:59.207136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:59.211153 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6daf1889-4fcd-4681-830c-33e078d424c7 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1605 microversion: 2.42 time: 0.214854 Oct 31 15:31:59.232576 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1861/3536] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:31:58 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:31:59.331831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:31:59.359904 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47e0775c-ffc9-4668-92a6-ead64ce70e67 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1296 microversion: 2.1 time: 0.548690 Oct 31 15:31:59.360686 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1676/3537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:58 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1296 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:31:59.831663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:31:59.832621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:31:59.853574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.854579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.858693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:31:59.859453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:31:59.859925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:31:59.860354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.022728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:00.023336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:00.030727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:00.041165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:00.042840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.045047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:00.052547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:00.053348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.193295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:00.210695 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34e9e858-f99e-4329-ac19-802708a068df tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.383436 Oct 31 15:32:00.211312 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1862/3538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:31:59 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:00.250868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:00.252796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:00.263973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:00.275695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:00.278372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.279153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:00.279857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:00.280046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.386957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:00.391358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:00.391983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.392657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lazy-loading 'fault' on Instance uuid f46659e6-fbb0-4b25-9b6b-5648ebeb16da {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:32:00.540849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:00.552803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:00.561782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '030780ff23d84175a364754b045c8083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ff0d809d824516a08568744e0ca176', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:00.563322 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e60fca4c-e54e-4029-8c53-d6b81b166cce tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 200 len: 1372 microversion: 2.42 time: 0.317069 Oct 31 15:32:00.565729 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1863/3539] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:00 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 1372 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:32:00.572413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:00.574320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:00.582584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:00.583876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:00.584543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.585662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:00.586348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:00.587201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:00.673448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:00.694178 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-94501aa8-1014-4399-bff6-ffe24fde41de tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 0.675337 Oct 31 15:32:00.706047 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1677/3540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:00 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:00.755006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:00.767565 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-acc4b4bd-e592-4fd1-b8ef-09f31823ab03 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1296 microversion: 2.1 time: 0.196159 Oct 31 15:32:00.768567 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1864/3541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:00 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1296 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:01.238334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:01.239056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:01.257250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.257803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.261442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.262697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.263197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.263638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.596623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:01.599381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:01.610959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.612290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.613331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.614519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.615149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.615726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.666125 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] HTTP exception thrown: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Request method failure captured: Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da HTTP/1.1 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-i7HVGNG-efrJg7uYw0xgkVtRxO5UmVBfN3kAPmMh1BZsaL0pKvGP2MMHhCMd__06SEiOsSv_OClnanOEAXzLL4ovHcB8e24oZeMNz_H4fJ0QZZMS6XMXWSUSdnWkEeJsHNQwe_K2NDXg1JwSnsUCuSqqEusVHGlRwOUj4Eebi0z_0 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.42 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 18ff0d809d824516a08568744e0ca176 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-212338419 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ff0d809d824516a08568744e0ca176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18ff0d809d824516a08568744e0ca176", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ff0d809d824516a08568744e0ca176"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18ff0d809d824516a08568744e0ca176"}]}] Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TaggedBootDevicesTest_v242-212338419 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 18ff0d809d824516a08568744e0ca176 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-212338419 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TaggedBootDevicesTest_v242-212338419-project Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 030780ff23d84175a364754b045c8083 Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TaggedBootDevicesTest_v242-212338419-project Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f46659e6-fbb0-4b25-9b6b-5648ebeb16da'} Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:01.695035 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Returning 404 to user: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:01.702808 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a39ab317-279d-404f-93c3-31a9c3eeb66f tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 404 len: 111 microversion: 2.42 time: 0.110058 Oct 31 15:32:01.711162 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1865/3542] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:01 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:32:01.719087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5179858-cde2-4aaa-b3a3-8109c26e26cf tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '.version_select at 0x7f16e14cbd30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:01.771718 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5179858-cde2-4aaa-b3a3-8109c26e26cf tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023206213" status: 204 len: 0 microversion: 2.42 time: 0.059211 Oct 31 15:32:01.775975 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1866/3543] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:32:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023206213 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:32:01.782214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:01.786206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:01.798266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.800037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.802730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.810033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:01.811699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:01.819786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:01.990484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:02.000497 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4dce0a45-3d25-4e80-99d5-ef5fcc95ec1c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.767244 Oct 31 15:32:02.012236 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1678/3544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:01 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:02.018738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:02.019694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:02.034895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:02.043885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:02.044817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:02.045625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:02.046102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:02.046532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:02.231887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:02.260165 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f487d92d-2682-41a9-8c9c-c559000b93a2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1296 microversion: 2.1 time: 0.246019 Oct 31 15:32:02.260868 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1679/3545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:02 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1296 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:02.288719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:02.303636 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc1d3c85-b7a2-4993-b743-f12a0df381fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 0.526004 Oct 31 15:32:02.310194 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1867/3546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:01 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:03.042799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:03.044798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:03.056750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.058856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.059816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.060998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.062597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.066035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.286142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:03.286754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:03.303980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.304475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.305099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.306020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.306638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.307221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.593337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:03.604472 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-29fd2523-b614-4e72-8cdb-54426eac43c5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.571967 Oct 31 15:32:03.605780 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1680/3547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:03 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:03.610791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:03.611816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:03.618817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.619812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.620487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.621573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:03.622260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:03.623183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:03.802678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:03.828336 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-872fe0b2-5916-47b9-be61-17bf0439d9cd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1364 microversion: 2.1 time: 0.546426 Oct 31 15:32:03.832324 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1868/3548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:03 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1364 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:04.632732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:04.635760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:04.648888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.649680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.652439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:04.656523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.657495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.659010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:04.704139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:04.714423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9ff4af98-0c12-46bc-9f0d-547dacda3f75 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 1.107374 Oct 31 15:32:04.715376 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1681/3549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:03 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:04.856352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:04.857783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:04.868692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.869561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.870296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:04.872130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:04.872890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:04.873601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:04.898455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:04.962971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:05.144998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:05.162111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:05.170403 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a061da50-87cd-4fb3-928c-173e8c1bd119 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1734 microversion: 2.1 time: 0.541810 Oct 31 15:32:05.172806 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1869/3550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:04 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1734 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:05.462770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:05.471513 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d979c0b9-f253-4569-b4a8-38e03eeac377 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1364 microversion: 2.1 time: 0.620446 Oct 31 15:32:05.480886 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1682/3551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:04 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1364 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:05.745823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:05.747098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:05.777014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:05.777801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:05.778851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:05.782881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:05.785678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:05.788080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:06.087700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:06.202034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:06.202656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:06.219693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:06.220396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:06.221544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:06.222339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:06.222802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:06.223231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:06.349118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:06.366795 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69d100f1-968c-4a99-a66e-acab2e70936b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 0.627871 Oct 31 15:32:06.368293 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1870/3552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:05 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:06.513910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:06.514823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:06.524332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:06.528450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:06.534755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:06.535458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:06.536393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:06.537035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:06.538274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.680436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:07.690171 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-261b4297-2102-44a4-baa5-b3cefb1299fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1714 microversion: 2.1 time: 1.496768 Oct 31 15:32:07.691924 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1683/3553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:06 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1714 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:07.698104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-720ea974-c65d-4302-a830-f8c622aa3cdb req-f2a3ce5a-ec46-48bf-9215-15c61cb3ab1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:07.709923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-720ea974-c65d-4302-a830-f8c622aa3cdb req-f2a3ce5a-ec46-48bf-9215-15c61cb3ab1d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.710881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-720ea974-c65d-4302-a830-f8c622aa3cdb req-f2a3ce5a-ec46-48bf-9215-15c61cb3ab1d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.711560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-720ea974-c65d-4302-a830-f8c622aa3cdb req-f2a3ce5a-ec46-48bf-9215-15c61cb3ab1d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.738135 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-720ea974-c65d-4302-a830-f8c622aa3cdb req-f2a3ce5a-ec46-48bf-9215-15c61cb3ab1d service nova] Creating event network-changed:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:32:07.754858 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-720ea974-c65d-4302-a830-f8c622aa3cdb req-f2a3ce5a-ec46-48bf-9215-15c61cb3ab1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061462 Oct 31 15:32:07.755485 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1684/3554] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:07.765171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:07.769087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:07.784369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.789010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.789904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.791246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.791943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.792602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.882014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:07.897618 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd0b30eb-c0d6-4f0c-90c3-f0509343d6e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1364 microversion: 2.1 time: 1.393504 Oct 31 15:32:07.898710 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1871/3555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:06 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1364 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:07.914051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:07.914443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:07.933255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.934047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.934911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:07.936662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:07.938243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:07.938964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:08.090038 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] HTTP exception thrown: Cannot 'detach_volume' instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 while it is in vm_state rescued Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Request method failure captured: Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments/cc866329-5958-455d-ae24-a890033c24ab HTTP/1.1 Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-mPAZq-02OTEsnv8GMkJRDJDL-rAJdgEJHn39ABJutgfh2_1AZN2oCBsrYt27l5tKBr9RG945Kyk--1kSEQ-akNiYprUFz_R7VxoVIJfbKRGxwgEKLAB8nUjvzWuTNL6KRyvhFuZKw3wxu_FY2qhzM7Zf-aduk3Wugzl7BHJI8VXXg Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9275c27ad1ac40568e4dbc778857d333", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9275c27ad1ac40568e4dbc778857d333"}]}] Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b56e2ca778b04f7c9fc7590faacb4c1a Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: exception: Cannot 'detach_volume' instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 while it is in vm_state rescued Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': '70dad59f-00ca-480e-81e9-ca7bcdfcc633', 'id': 'cc866329-5958-455d-ae24-a890033c24ab'} Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 while it is in vm_state rescued Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:08.092486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:08.098949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:08.098949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:08.098949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:08.098949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:08.098949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 while it is in vm_state rescued Oct 31 15:32:08.098949 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:32:08.102195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Returning 409 to user: Cannot 'detach_volume' instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 while it is in vm_state rescued {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:08.103554 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bbfeae22-3f5c-4e33-98d4-ec993772b4c1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments/cc866329-5958-455d-ae24-a890033c24ab" status: 409 len: 152 microversion: 2.1 time: 0.198460 Oct 31 15:32:08.105328 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1872/3556] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:32:07 2022] DELETE /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments/cc866329-5958-455d-ae24-a890033c24ab => generated 152 bytes in 206 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:32:08.117010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83f83c00-8878-40df-b855-dd0cac8964ae tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:08.118305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-83f83c00-8878-40df-b855-dd0cac8964ae tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:08.131650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83f83c00-8878-40df-b855-dd0cac8964ae tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.135823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83f83c00-8878-40df-b855-dd0cac8964ae tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.137807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83f83c00-8878-40df-b855-dd0cac8964ae tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:08.140899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83f83c00-8878-40df-b855-dd0cac8964ae tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.145868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83f83c00-8878-40df-b855-dd0cac8964ae tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.147807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83f83c00-8878-40df-b855-dd0cac8964ae tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:08.383661 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-83f83c00-8878-40df-b855-dd0cac8964ae tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/action" status: 202 len: 0 microversion: 2.1 time: 0.272457 Oct 31 15:32:08.384937 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1873/3557] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:08 2022] POST /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:32:08.414924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:08.416692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:08.441401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.445650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.448199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:08.450762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.453117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.455628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:08.650221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:08.666978 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d462d42f-9b5a-44b0-bd4c-069150f24051 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1477 microversion: 2.1 time: 0.910257 Oct 31 15:32:08.667582 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1685/3558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:07 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1477 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:08.927451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:08.928837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:08.953336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.954004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.954467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:08.955283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:08.955814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:08.956183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:09.101697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:09.110037 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-62ea5cc2-13ba-44d6-995d-1dfaf87921f6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1722 microversion: 2.1 time: 0.720839 Oct 31 15:32:09.120565 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1874/3559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:08 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1722 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:09.694360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:09.694976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:09.704092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:09.705949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:09.709694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:09.710694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:09.711386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:09.712002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:09.781577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:09.793167 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f7aed26-3307-4ff3-a993-72d375d78283 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1364 microversion: 2.1 time: 0.867685 Oct 31 15:32:09.805422 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1686/3560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:08 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1364 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:10.136716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:10.138352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:10.168724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.168724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.168724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.168724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.168724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.168724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.589348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:10.606603 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8e6e8df-c5ef-4d4c-a2e4-97c265305f6b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1476 microversion: 2.1 time: 0.915218 Oct 31 15:32:10.608636 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1875/3561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:09 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1476 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:10.819773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:10.829493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:10.843587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.844086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.844530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:10.847503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:10.847991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:10.854120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:11.081243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:11.096782 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1dd460ac-b825-41ef-9057-92cb953fedf5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1722 microversion: 2.1 time: 0.962226 Oct 31 15:32:11.101938 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1687/3562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:10 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1722 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:11.619543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:11.629084 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a161f94-a98a-4d0a-8200-539cc2bb5e92 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1364 microversion: 2.1 time: 0.814078 Oct 31 15:32:11.636440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:11.637991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:11.645192 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1876/3563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:10 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1364 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:11.652068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:11.652773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:11.653429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:11.655294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:11.662370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:11.662830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.123830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:12.124528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:12.136170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.138293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.138988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.166936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.219937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.075s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.220413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.644885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:12.653643 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63e2a7e9-bfbb-4dea-a765-69874ca4f86c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1476 microversion: 2.1 time: 1.021315 Oct 31 15:32:12.665657 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1688/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:11 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1476 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:12.675439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-42de8339-19bb-4433-bc27-0abdaf462093 req-e974c395-7e08-468a-81f0-9bb07f9544e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e4c90d-51a5-43da-bd79-bb99662db232", "name": "network-vif-unplugged", "status": "completed", "tag": "2e5a8b47-d95d-4dbf-852e-51ad01cbe282"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:12.701158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-42de8339-19bb-4433-bc27-0abdaf462093 req-e974c395-7e08-468a-81f0-9bb07f9544e3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.701823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-42de8339-19bb-4433-bc27-0abdaf462093 req-e974c395-7e08-468a-81f0-9bb07f9544e3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.702272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-42de8339-19bb-4433-bc27-0abdaf462093 req-e974c395-7e08-468a-81f0-9bb07f9544e3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.732069 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-42de8339-19bb-4433-bc27-0abdaf462093 req-e974c395-7e08-468a-81f0-9bb07f9544e3 service nova] Creating event network-vif-unplugged:2e5a8b47-d95d-4dbf-852e-51ad01cbe282 for instance 17e4c90d-51a5-43da-bd79-bb99662db232 on n-h2-858384-17 Oct 31 15:32:12.744737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-42de8339-19bb-4433-bc27-0abdaf462093 req-e974c395-7e08-468a-81f0-9bb07f9544e3 service nova] Instance 17e4c90d-51a5-43da-bd79-bb99662db232 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:32:12.768923 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-42de8339-19bb-4433-bc27-0abdaf462093 req-e974c395-7e08-468a-81f0-9bb07f9544e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105331 Oct 31 15:32:12.769597 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1689/3565] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:12.782695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:12.783641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:12.798543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.799197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.799574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.800729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:12.802029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:12.802622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:12.938449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:12.955554 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61bbac62-2b6e-4714-82c5-8177882218aa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1722 microversion: 2.1 time: 0.835363 Oct 31 15:32:12.972774 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1877/3566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:12 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1722 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:13.405413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:13.427171 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-368cf470-2e04-4579-9ed5-34081d65ae84 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1364 microversion: 2.1 time: 0.649026 Oct 31 15:32:13.428267 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1690/3567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:12 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1364 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:13.681055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:13.681708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:13.693807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.694761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.695217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.695969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:13.696435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:13.696866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:13.985650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:13.988905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:14.012310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.017768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.018671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.020443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.021497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.022134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.388915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:14.412569 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b68add94-a871-47fe-a6a3-25749e116af8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1476 microversion: 2.1 time: 0.735336 Oct 31 15:32:14.419436 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1878/3568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:13 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1476 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:14.451627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:14.452250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:14.463587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.464316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.464973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.465878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:14.466639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:14.468199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:14.843473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:14.854108 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0aea40f8-1a9c-4fd6-a172-8adb78ee6eaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1722 microversion: 2.1 time: 0.874046 Oct 31 15:32:14.870994 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1691/3569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:13 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1722 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:15.159870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-33c3f206-96c7-4b25-ad74-747030e72fa2 req-c54ce64a-7b5f-454b-bb71-b40736e37404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "name": "network-vif-plugged", "status": "completed", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:15.180660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-33c3f206-96c7-4b25-ad74-747030e72fa2 req-c54ce64a-7b5f-454b-bb71-b40736e37404 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.181612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-33c3f206-96c7-4b25-ad74-747030e72fa2 req-c54ce64a-7b5f-454b-bb71-b40736e37404 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.184015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-33c3f206-96c7-4b25-ad74-747030e72fa2 req-c54ce64a-7b5f-454b-bb71-b40736e37404 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.204573 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-33c3f206-96c7-4b25-ad74-747030e72fa2 req-c54ce64a-7b5f-454b-bb71-b40736e37404 service nova] Creating event network-vif-plugged:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:32:15.224424 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-33c3f206-96c7-4b25-ad74-747030e72fa2 req-c54ce64a-7b5f-454b-bb71-b40736e37404 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351620 Oct 31 15:32:15.227084 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1692/3570] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:15.241763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f1ef0d9f-6d2b-44e9-850b-32d77a52a542 req-3a1454d6-206f-49db-9e2c-aa7e237c5d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e4c90d-51a5-43da-bd79-bb99662db232", "tag": "2e5a8b47-d95d-4dbf-852e-51ad01cbe282"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:15.272726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f1ef0d9f-6d2b-44e9-850b-32d77a52a542 req-3a1454d6-206f-49db-9e2c-aa7e237c5d34 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.273328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f1ef0d9f-6d2b-44e9-850b-32d77a52a542 req-3a1454d6-206f-49db-9e2c-aa7e237c5d34 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.273730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f1ef0d9f-6d2b-44e9-850b-32d77a52a542 req-3a1454d6-206f-49db-9e2c-aa7e237c5d34 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.321777 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f1ef0d9f-6d2b-44e9-850b-32d77a52a542 req-3a1454d6-206f-49db-9e2c-aa7e237c5d34 service nova] Creating event network-changed:2e5a8b47-d95d-4dbf-852e-51ad01cbe282 for instance 17e4c90d-51a5-43da-bd79-bb99662db232 on n-h2-858384-17 Oct 31 15:32:15.344095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-f1ef0d9f-6d2b-44e9-850b-32d77a52a542 req-3a1454d6-206f-49db-9e2c-aa7e237c5d34 service nova] Instance 17e4c90d-51a5-43da-bd79-bb99662db232 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:32:15.374565 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f1ef0d9f-6d2b-44e9-850b-32d77a52a542 req-3a1454d6-206f-49db-9e2c-aa7e237c5d34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144419 Oct 31 15:32:15.377642 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1693/3571] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:15.442516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:15.443480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:15.457849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.458710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.459151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.459862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.460597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.461206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.493144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:15.669037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:15.681077 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a947460-0861-4160-a2b2-aa4d997c5428 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1364 microversion: 2.1 time: 1.234390 Oct 31 15:32:15.695855 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1879/3572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:14 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1364 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:15.758361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:15.781420 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92d09266-7861-4cbc-9f0a-3aadbdc39510 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1476 microversion: 2.1 time: 0.343394 Oct 31 15:32:15.787591 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1694/3573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:15 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:15.879327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:15.879931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:15.893041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.894199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.897953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:15.901713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:15.907664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:15.908441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.454620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:16.469089 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5646c0cc-d4ba-4256-a655-f6fbf8285b80 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1728 microversion: 2.1 time: 0.594984 Oct 31 15:32:16.469851 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1880/3574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:15 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1728 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:16.496853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40586f7c-523f-4898-bbe1-56de47678eb2 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:16.498109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40586f7c-523f-4898-bbe1-56de47678eb2 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:16.505381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40586f7c-523f-4898-bbe1-56de47678eb2 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.506257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40586f7c-523f-4898-bbe1-56de47678eb2 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.506964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40586f7c-523f-4898-bbe1-56de47678eb2 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.507789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40586f7c-523f-4898-bbe1-56de47678eb2 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.508353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40586f7c-523f-4898-bbe1-56de47678eb2 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.508890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40586f7c-523f-4898-bbe1-56de47678eb2 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.707382 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40586f7c-523f-4898-bbe1-56de47678eb2 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.214511 Oct 31 15:32:16.708982 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1695/3575] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:32:16 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-interface => generated 284 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:16.710263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:16.710998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:16.724129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.728258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.728838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.729881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.730586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.732236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.812213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:16.813376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:16.815756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:16.828770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.829583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.832111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:16.834203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:16.848775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:16.850910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:17.590608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:17.602635 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f09fe7ec-d3a4-4acf-91fc-0aa53c30aebb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1364 microversion: 2.1 time: 0.898434 Oct 31 15:32:17.604882 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1881/3576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:16 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1364 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:18.335399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:18.346087 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25433720-dbcd-4e7f-a55d-42b14cac0e79 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1476 microversion: 2.1 time: 1.538123 Oct 31 15:32:18.346692 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1696/3577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:16 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1476 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:18.632967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:18.633921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:18.644646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:18.648335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:18.648783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:18.652289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:18.652774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:18.653236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:18.797104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-996a09d7-7c28-464b-b1dd-4be09a6632cc tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] Calling method '.version_select at 0x7f16e199c1f0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:18.891987 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-996a09d7-7c28-464b-b1dd-4be09a6632cc tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51/defaults" status: 200 len: 371 microversion: 2.1 time: 0.355539 Oct 31 15:32:18.893437 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1882/3578] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:32:18 2022] GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51/defaults => generated 371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:18.914128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-592643e2-540c-4279-81ae-38509fcc1194 tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] Calling method '.version_select at 0x7f16e55d3dc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:19.079124 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-592643e2-540c-4279-81ae-38509fcc1194 tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51" status: 200 len: 371 microversion: 2.1 time: 0.174592 Oct 31 15:32:19.082691 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1883/3579] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:32:18 2022] GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51 => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:19.099954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f0a00be-ca2a-440e-be69-fbc996f35264 tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] Calling method '.version_select at 0x7f16e575d280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:19.257279 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f0a00be-ca2a-440e-be69-fbc996f35264 tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51/defaults" status: 200 len: 371 microversion: 2.1 time: 0.165818 Oct 31 15:32:19.258549 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1884/3580] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:32:19 2022] GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51/defaults => generated 371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:32:19.280130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2d94f62-2a98-4e67-bf97-264adc0b9458 tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] Calling method '.version_select at 0x7f16e17cdc10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:19.434579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:19.445760 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34207b64-7ebc-4c5c-8cbd-8ffcc3106b5b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1551 microversion: 2.1 time: 0.817859 Oct 31 15:32:19.450574 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1697/3581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:18 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1551 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:19.452514 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2d94f62-2a98-4e67-bf97-264adc0b9458 tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51" status: 200 len: 371 microversion: 2.1 time: 0.176404 Oct 31 15:32:19.457264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:19.466591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:19.466747 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1885/3582] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:32:19 2022] GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51 => generated 371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:19.477996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-691c1cec-f819-4dcb-835f-4bcadc84ddd3 tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] Calling method '.version_select at 0x7f16e0e80550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:19.487257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.497471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.498054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.498807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.499293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.499729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.662663 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-691c1cec-f819-4dcb-835f-4bcadc84ddd3 tempest-QuotasTestJSON-1376852425 tempest-QuotasTestJSON-1376852425-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51?user_id=e02fa7e3b69f469bbd25088b9333e5a5" status: 200 len: 371 microversion: 2.1 time: 0.193650 Oct 31 15:32:19.671847 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1886/3583] 10.222.0.20 () {58 vars in 1323 bytes} [Mon Oct 31 15:32:19 2022] GET /compute/v2.1/os-quota-sets/79e86753c58849c59a395130a9658d51?user_id=e02fa7e3b69f469bbd25088b9333e5a5 => generated 371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:19.697645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26a7648c-4ef6-4140-ad16-f7024eb442e0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:19.698204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26a7648c-4ef6-4140-ad16-f7024eb442e0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:19.713966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26a7648c-4ef6-4140-ad16-f7024eb442e0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.714772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26a7648c-4ef6-4140-ad16-f7024eb442e0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.715764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26a7648c-4ef6-4140-ad16-f7024eb442e0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.717690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26a7648c-4ef6-4140-ad16-f7024eb442e0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:19.718563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26a7648c-4ef6-4140-ad16-f7024eb442e0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:19.720943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26a7648c-4ef6-4140-ad16-f7024eb442e0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:19.829983 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26a7648c-4ef6-4140-ad16-f7024eb442e0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156581 Oct 31 15:32:19.831756 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1887/3584] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:32:19 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:19.918641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-695994347", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "b45be808-ce65-4f73-9e2c-b307b378bee3"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:20.006757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] validate_networks() for [('b45be808-ce65-4f73-9e2c-b307b378bee3', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:32:20.239310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:20.250691 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5da39c61-bdf1-4d13-82ff-424919dbaff3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1474 microversion: 2.1 time: 0.798543 Oct 31 15:32:20.257355 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1698/3585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:19 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1474 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:20.299223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:20.300306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:20.323605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.328446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.333950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.337192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.338094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.340627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.415416 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] HTTP exception thrown: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Request method failure captured: Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da HTTP/1.1 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-i7HVGNG-efrJg7uYw0xgkVtRxO5UmVBfN3kAPmMh1BZsaL0pKvGP2MMHhCMd__06SEiOsSv_OClnanOEAXzLL4ovHcB8e24oZeMNz_H4fJ0QZZMS6XMXWSUSdnWkEeJsHNQwe_K2NDXg1JwSnsUCuSqqEusVHGlRwOUj4Eebi0z_0 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.42 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 18ff0d809d824516a08568744e0ca176 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-212338419 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ff0d809d824516a08568744e0ca176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18ff0d809d824516a08568744e0ca176", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ff0d809d824516a08568744e0ca176"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18ff0d809d824516a08568744e0ca176"}]}] Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TaggedBootDevicesTest_v242-212338419 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 18ff0d809d824516a08568744e0ca176 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-212338419 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TaggedBootDevicesTest_v242-212338419-project Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 030780ff23d84175a364754b045c8083 Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TaggedBootDevicesTest_v242-212338419-project Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f46659e6-fbb0-4b25-9b6b-5648ebeb16da'} Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:20.422015 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.433443 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.439406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Returning 404 to user: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:20.441945 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-46330a7c-7390-45d2-bb35-025c3b67a6c6 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 404 len: 111 microversion: 2.42 time: 0.148085 Oct 31 15:32:20.448657 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1699/3586] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:32:20 2022] DELETE /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:32:20.471570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:20.472568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] [instance: f46659e6-fbb0-4b25-9b6b-5648ebeb16da] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:20.482354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.483217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.483935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.485025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:20.489705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:20.490462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:20.521667 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] HTTP exception thrown: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Request method failure captured: Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da HTTP/1.1 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-i7HVGNG-efrJg7uYw0xgkVtRxO5UmVBfN3kAPmMh1BZsaL0pKvGP2MMHhCMd__06SEiOsSv_OClnanOEAXzLL4ovHcB8e24oZeMNz_H4fJ0QZZMS6XMXWSUSdnWkEeJsHNQwe_K2NDXg1JwSnsUCuSqqEusVHGlRwOUj4Eebi0z_0 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.42 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 18ff0d809d824516a08568744e0ca176 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-212338419 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ff0d809d824516a08568744e0ca176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_18ff0d809d824516a08568744e0ca176", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/18ff0d809d824516a08568744e0ca176"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/18ff0d809d824516a08568744e0ca176"}]}] Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TaggedBootDevicesTest_v242-212338419 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 18ff0d809d824516a08568744e0ca176 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-212338419 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TaggedBootDevicesTest_v242-212338419-project Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 030780ff23d84175a364754b045c8083 Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TaggedBootDevicesTest_v242-212338419-project Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f46659e6-fbb0-4b25-9b6b-5648ebeb16da'} Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.524761 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:20.536840 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.536840 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:20.536840 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:20.536840 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:20.536840 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:20.536840 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:20.536840 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. Oct 31 15:32:20.536840 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:20.542070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] Returning 404 to user: Instance f46659e6-fbb0-4b25-9b6b-5648ebeb16da could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:20.543927 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ee37f3cd-a3d9-46ef-a8e4-fef0ce1cbda9 tempest-TaggedBootDevicesTest_v242-212338419 tempest-TaggedBootDevicesTest_v242-212338419-project] 10.222.0.20 "GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da" status: 404 len: 111 microversion: 2.42 time: 0.091558 Oct 31 15:32:20.563419 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1700/3587] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:20 2022] GET /compute/v2.1/servers/f46659e6-fbb0-4b25-9b6b-5648ebeb16da => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:32:21.290808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:21.291884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:21.313952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.327793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.328259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.329024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:21.329527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:21.330011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:21.988702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:21.999472 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5819fa59-de36-496a-959c-6a1cd2f89225 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1471 microversion: 2.1 time: 0.716385 Oct 31 15:32:22.000082 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1701/3588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:21 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1471 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:22.034137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c16da825-55ad-4965-92b5-72074c86b459 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:22.034692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c16da825-55ad-4965-92b5-72074c86b459 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:22.051710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c16da825-55ad-4965-92b5-72074c86b459 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.052138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c16da825-55ad-4965-92b5-72074c86b459 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.052584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c16da825-55ad-4965-92b5-72074c86b459 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.053327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c16da825-55ad-4965-92b5-72074c86b459 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.054186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c16da825-55ad-4965-92b5-72074c86b459 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.054186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c16da825-55ad-4965-92b5-72074c86b459 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.217017 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c16da825-55ad-4965-92b5-72074c86b459 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232/action" status: 204 len: 0 microversion: 2.1 time: 0.193906 Oct 31 15:32:22.218581 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1702/3589] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:22 2022] POST /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232/action => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:32:22.239555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:22.242100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:22.264518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.268210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.269655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.270805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:22.275358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:22.276185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:22.959642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:22.974428 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2d74c6a2-2529-4cc1-872a-4703a29d252e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1471 microversion: 2.1 time: 0.741833 Oct 31 15:32:22.982023 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1703/3590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:22 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1471 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:22.990009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70dad59f-00ca-480e-81e9-ca7bcdfcc633", "tag": "db98faa2-da61-4f08-8efd-816f4eae0468"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:23.013844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:23.014413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:23.015762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:23.063535 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] Creating event network-changed:db98faa2-da61-4f08-8efd-816f4eae0468 for instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 on n-h1-858384-17 Oct 31 15:32:23.072644 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088566 Oct 31 15:32:23.075572 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1704/3591] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:23.498597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:23.500077 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002714 Oct 31 15:32:23.502335 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1705/3592] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 31 15:32:23 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 31 15:32:23.509995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:23.511321 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001860 Oct 31 15:32:23.511915 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1706/3593] 10.222.0.20 () {54 vars in 1035 bytes} [Mon Oct 31 15:32:23 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Oct 31 15:32:23.522542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:23.524375 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002284 Oct 31 15:32:23.524787 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1707/3594] 10.222.0.20 () {54 vars in 1041 bytes} [Mon Oct 31 15:32:23 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:32:23.535382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:23.536339 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c952ea13-72a5-41fc-bb10-a919b7e4e57e req-49a21e40-f566-4b7c-a8f5-4050b88a5749 service nova] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001298 Oct 31 15:32:23.536684 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1708/3595] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 31 15:32:23 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 15:32:24.006238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:24.006947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:24.034604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.035213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.038777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.039548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.047549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.048018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.239269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:32:24.240552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:32:24.241553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:32:24.242160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:32:24.242773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:32:24.263721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.264379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.265045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.268476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:24.271720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:24.273050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:24.301632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Getting quotas for project 874639724dda4528b1945ca5e4466428. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:24.308684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Getting quotas for user d25b7c18a0914c9b88afbbde3c96c35e and project 874639724dda4528b1945ca5e4466428. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:24.334877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:32:24.338699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:32:24.491505 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8e4c02f-cc7d-4670-9206-1dde6a96bbb1 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.658071 Oct 31 15:32:24.501108 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1888/3596] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:32:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 4669 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:32:24.506535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66ab680b-0266-4806-b89e-3fea4d49f570 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:24.522057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-66ab680b-0266-4806-b89e-3fea4d49f570 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:24.763386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:24.777557 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96638608-0642-4cbc-aac7-c32b8f242a2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1471 microversion: 2.1 time: 0.777512 Oct 31 15:32:24.779944 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1709/3597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:23 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1471 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:24.867906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-66ab680b-0266-4806-b89e-3fea4d49f570 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:24.880951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-66ab680b-0266-4806-b89e-3fea4d49f570 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:24.884278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-66ab680b-0266-4806-b89e-3fea4d49f570 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:24.887608 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66ab680b-0266-4806-b89e-3fea4d49f570 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1258 microversion: 2.21 time: 0.384950 Oct 31 15:32:24.889632 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1889/3598] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:24 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1258 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:25.109179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d283c785-f38d-4543-839f-f918ac2fcbe2 req-caeda07c-1049-41e6-ae3b-a1ebfecae6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70dad59f-00ca-480e-81e9-ca7bcdfcc633", "tag": "db98faa2-da61-4f08-8efd-816f4eae0468"}, {"name": "network-changed", "server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:25.137829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d283c785-f38d-4543-839f-f918ac2fcbe2 req-caeda07c-1049-41e6-ae3b-a1ebfecae6ef service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.142625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d283c785-f38d-4543-839f-f918ac2fcbe2 req-caeda07c-1049-41e6-ae3b-a1ebfecae6ef service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.142625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d283c785-f38d-4543-839f-f918ac2fcbe2 req-caeda07c-1049-41e6-ae3b-a1ebfecae6ef service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.203875 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d283c785-f38d-4543-839f-f918ac2fcbe2 req-caeda07c-1049-41e6-ae3b-a1ebfecae6ef service nova] Creating event network-changed:db98faa2-da61-4f08-8efd-816f4eae0468 for instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 on n-h1-858384-17 Oct 31 15:32:25.204325 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d283c785-f38d-4543-839f-f918ac2fcbe2 req-caeda07c-1049-41e6-ae3b-a1ebfecae6ef service nova] Creating event network-changed:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:32:25.224009 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d283c785-f38d-4543-839f-f918ac2fcbe2 req-caeda07c-1049-41e6-ae3b-a1ebfecae6ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118295 Oct 31 15:32:25.224710 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1710/3599] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:25.805002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:25.805549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:25.816777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.817294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.817742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.827158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.827697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.828155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.920465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:25.921224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:25.935620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.936134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.936663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:25.937325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:25.937785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:25.938721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:26.139484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:26.151070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:26.155321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:26.157946 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1437718d-f95c-4b15-b918-0fd1baa04bd7 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1254 microversion: 2.21 time: 0.240406 Oct 31 15:32:26.182248 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1711/3600] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:25 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1254 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:32:26.794917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:26.807393 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c058c17-d906-4fdb-baea-31b2843eecd5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1471 microversion: 2.1 time: 1.006647 Oct 31 15:32:26.809091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1890/3601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:25 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1471 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:27.193253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:27.202967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:27.218360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:27.227567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:27.228643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:27.234087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:27.234956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:27.235651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:27.412011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:27.421835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:27.423214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:27.425465 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-12824a76-f75d-4591-8791-ed02f116ae2c tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1328 microversion: 2.21 time: 0.240137 Oct 31 15:32:27.457157 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1712/3602] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:27 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1328 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:27.835732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:27.836709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:27.853778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:27.855633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:27.856346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:27.857505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:27.858144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:27.858738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.480216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:28.480847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:28.499139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.500883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.504011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.506528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.508116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.509953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.559793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:28.603380 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1089ad44-035b-4d5c-ac06-62e69257eab6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1463 microversion: 2.1 time: 0.772697 Oct 31 15:32:28.609598 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1891/3603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:27 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1463 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:28.635854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-26174d56-f7f4-44bf-8c12-2236dad9964a req-31db5179-909d-4e64-8304-3d92d2107bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e4c90d-51a5-43da-bd79-bb99662db232", "name": "network-vif-plugged", "status": "completed", "tag": "2e5a8b47-d95d-4dbf-852e-51ad01cbe282"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:28.659248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-26174d56-f7f4-44bf-8c12-2236dad9964a req-31db5179-909d-4e64-8304-3d92d2107bd4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.659836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-26174d56-f7f4-44bf-8c12-2236dad9964a req-31db5179-909d-4e64-8304-3d92d2107bd4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.660278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-26174d56-f7f4-44bf-8c12-2236dad9964a req-31db5179-909d-4e64-8304-3d92d2107bd4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.687012 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-26174d56-f7f4-44bf-8c12-2236dad9964a req-31db5179-909d-4e64-8304-3d92d2107bd4 service nova] Creating event network-vif-plugged:2e5a8b47-d95d-4dbf-852e-51ad01cbe282 for instance 17e4c90d-51a5-43da-bd79-bb99662db232 on n-h2-858384-17 Oct 31 15:32:28.693122 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-26174d56-f7f4-44bf-8c12-2236dad9964a req-31db5179-909d-4e64-8304-3d92d2107bd4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082247 Oct 31 15:32:28.694480 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1892/3604] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:28.700988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:28.701949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:28.709305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.709816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.710227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.710940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:28.711397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:28.711825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:28.716587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:28.827149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:28.854591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:28.859388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:28.865532 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6adc1e12-cf14-43ef-81a8-048affd8790e tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1316 microversion: 2.21 time: 0.387801 Oct 31 15:32:28.867382 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1713/3605] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:28 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1316 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:29.408885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:29.420145 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-63f7b5a0-25a2-44a3-b947-d46aa4fd7704 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1463 microversion: 2.1 time: 0.723799 Oct 31 15:32:29.433509 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1893/3606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:28 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1463 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:29.453800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aae70da5-4691-4f6c-bc0f-f2aa17be9d63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'create', calling method: .version_select at 0x7f16e56d2dc0>, body: {"keypair": {"name": "tempest-keypair-1194593652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKh1r68acvj+HDRHsuYi1lpVfjWn98fjFfjJp/qS0kJbpH7YlqLPdovbqKS9JVSaEpBrY16ofK/1pAWOrkPoDe2D8mSQbGOW8GN2h82aOuwvJlmhN9tOCl6G1ALH3MKsA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:29.509808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-aae70da5-4691-4f6c-bc0f-f2aa17be9d63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:29.531940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-aae70da5-4691-4f6c-bc0f-f2aa17be9d63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for user 4df669ecccf24e8e9b41574f29ba157b and project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:29.602922 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aae70da5-4691-4f6c-bc0f-f2aa17be9d63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156129 Oct 31 15:32:29.610539 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1714/3607] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:32:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:29.688228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bca52811-62df-497a-8727-2efef9de7073 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Action: 'create', calling method: .version_select at 0x7f16e1748160>, body: {"keypair": {"name": "tempest-keypair-806860877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQlRadD/VpPLLGcmGjpcYF2KNkqcDoGjT3/hgWoX1eEY+hlsfXNtlIpMnNs6N7CAejqi7+1znErdhCM+kfPOE1pfPzsj/le4BZo2efLBPTUigd92LbutwHuAcmMHygLxw=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:29.767925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bca52811-62df-497a-8727-2efef9de7073 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Getting quotas for project 4f25561007bb4e22921c780c727fd86c. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:29.793234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bca52811-62df-497a-8727-2efef9de7073 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Getting quotas for user bee445dd89f544f8b866432dcc0f1ec1 and project 4f25561007bb4e22921c780c727fd86c. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:29.863191 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bca52811-62df-497a-8727-2efef9de7073 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.180634 Oct 31 15:32:29.864996 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1894/3608] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 31 15:32:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 183 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:32:29.893202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:29.894086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:29.903086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:29.909745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:29.911086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:29.919813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:29.934327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:29.934982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:30.156286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:30.168931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:30.174339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:30.178837 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e888eb61-5f09-4636-97e1-16b2bff22296 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1316 microversion: 2.21 time: 0.289591 Oct 31 15:32:30.184894 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1715/3609] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:29 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:31.214651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:31.215358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:31.241507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.242027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.245096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:31.255377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:31.258306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:31.259151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:31.765338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:31.782278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:31.793048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:31.794267 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-83d44a77-9e4e-4d34-bdba-f8d3fadb2bb6 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1358 microversion: 2.21 time: 0.586808 Oct 31 15:32:31.801109 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1895/3610] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:31 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1358 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:32.722449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-490267db-7062-44f0-a343-461b8644e4bf tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '.version_select at 0x7f16e125a160>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:32.727696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490267db-7062-44f0-a343-461b8644e4bf tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:32.730578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490267db-7062-44f0-a343-461b8644e4bf tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:32.731743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-490267db-7062-44f0-a343-461b8644e4bf tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:32.752542 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-490267db-7062-44f0-a343-461b8644e4bf tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.035705 Oct 31 15:32:32.757364 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1716/3611] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:32:32 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:32.781091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad3f7bc8-62d0-4ebe-aecd-4eb9496df798 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:32.789169 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad3f7bc8-62d0-4ebe-aecd-4eb9496df798 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012737 Oct 31 15:32:32.790719 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1896/3612] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:32:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:32.804826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8756580-9c09-4993-a3e9-37daa3e96700 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-291125160", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:32.833820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:32.835475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:32.854553 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8756580-9c09-4993-a3e9-37daa3e96700 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.052765 Oct 31 15:32:32.863575 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1717/3613] 10.222.0.20 () {60 vars in 1146 bytes} [Mon Oct 31 15:32:32 2022] POST /compute/v2.1/flavors => generated 498 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:32.863788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:32.863788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:32.863788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:32.863788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:32.863788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:32.865459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:32.875931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f71373bd-c983-49db-b92f-89da84608e44 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:32.894623 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f71373bd-c983-49db-b92f-89da84608e44 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022645 Oct 31 15:32:32.901821 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1718/3614] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Oct 31 15:32:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:32:32.946073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5812fc4f-69dd-487c-9a1e-71707eea74d2 req-888af735-646f-4110-a69f-6a136a967237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5ef5cd-a222-4cd2-a18c-a345a62f40e1", "tag": "373e2c25-5600-46b5-a2f9-a4924dbf323d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:32.958602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5812fc4f-69dd-487c-9a1e-71707eea74d2 req-888af735-646f-4110-a69f-6a136a967237 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:32.959421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5812fc4f-69dd-487c-9a1e-71707eea74d2 req-888af735-646f-4110-a69f-6a136a967237 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:32.960113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5812fc4f-69dd-487c-9a1e-71707eea74d2 req-888af735-646f-4110-a69f-6a136a967237 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:32.988890 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5812fc4f-69dd-487c-9a1e-71707eea74d2 req-888af735-646f-4110-a69f-6a136a967237 service nova] Creating event network-changed:373e2c25-5600-46b5-a2f9-a4924dbf323d for instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 on n-h1-858384-17 Oct 31 15:32:33.000735 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5812fc4f-69dd-487c-9a1e-71707eea74d2 req-888af735-646f-4110-a69f-6a136a967237 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058216 Oct 31 15:32:33.001882 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1719/3615] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:32:33.077796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-250514757", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "3efc2580-9540-4dec-95e5-3c22e44af6d3"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:33.161571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:32:33.312222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:33.322081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:33.332581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:33.334433 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2eaf2653-061e-4179-b7b9-bbf134f82871 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1358 microversion: 2.21 time: 0.507836 Oct 31 15:32:33.335179 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1897/3616] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:32 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1358 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:32:33.769742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:32:33.770863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:32:33.771664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:32:33.772305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:32:33.772947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:32:33.797788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:33.802171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:33.802892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:33.803839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:33.804345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:33.804755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:33.891741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:33.913614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for user 4df669ecccf24e8e9b41574f29ba157b and project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:33.974175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:32:33.993975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:32:34.076426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-798696991", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "68f19d16-8c5a-48de-96b1-1741e998a2a7"}, {"port": "843a9ed1-8632-4e46-98bb-0693efe5aa5b", "tag": "port-1"}, {"port": "b00466ed-bfa7-4acf-8cbf-347445a38720", "tag": "port-2"}, {"uuid": "046ca1ea-984b-4125-98ac-f52e5413a566", "tag": "net-1"}, {"uuid": "046ca1ea-984b-4125-98ac-f52e5413a566"}, {"uuid": "5fa7c24b-59af-489c-9202-bfa7648ff56c", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5fa7c24b-59af-489c-9202-bfa7648ff56c", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c69a62aa-8071-4e83-9cd0-00c5f36d1c6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fab89fd1-8a07-449b-b6c6-f22806ebb88a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fcf34e4f-2f87-43d3-a9ec-dd79c9e570f8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1085698257"}], "key_name": "tempest-keypair-806860877", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:34.095371 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6bf233c1-28f5-485a-a54d-f0ea86fa2431 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023675 Oct 31 15:32:34.105284 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1720/3617] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:32:34.145657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e1e2bb0-72a0-4ca9-a8bc-dd79bb10fc9c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:34.149392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e1e2bb0-72a0-4ca9-a8bc-dd79bb10fc9c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:34.290515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] validate_networks() for [('68f19d16-8c5a-48de-96b1-1741e998a2a7', None, None, None, None, None), (None, None, '843a9ed1-8632-4e46-98bb-0693efe5aa5b', None, None, None), (None, None, 'b00466ed-bfa7-4acf-8cbf-347445a38720', None, None, None), ('046ca1ea-984b-4125-98ac-f52e5413a566', None, None, None, None, None), ('046ca1ea-984b-4125-98ac-f52e5413a566', None, None, None, None, None), ('5fa7c24b-59af-489c-9202-bfa7648ff56c', '10.2.2.100', None, None, None, None), ('5fa7c24b-59af-489c-9202-bfa7648ff56c', '10.2.2.200', None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:32:34.295454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:34.340956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e1e2bb0-72a0-4ca9-a8bc-dd79bb10fc9c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:34.357552 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e1e2bb0-72a0-4ca9-a8bc-dd79bb10fc9c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1278 microversion: 2.1 time: 0.248666 Oct 31 15:32:34.357552 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1721/3618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:34 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:34.379549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:34.380460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:34.388231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.388968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.390258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.391220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:34.391940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:34.393058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:34.665677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:34.671315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:34.677893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:34.679329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:34.680462 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ba57127-62e4-49f1-8b81-0fc75897d0c2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1358 microversion: 2.21 time: 0.307063 Oct 31 15:32:34.700216 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1722/3619] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:34 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1358 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:35.381845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:35.389917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:35.417910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.421037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.421702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.423802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.429096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.429808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.585086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:35.593541 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e6c2693a-92f0-4690-83df-73c84e3238b5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1330 microversion: 2.1 time: 0.218668 Oct 31 15:32:35.597840 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1723/3620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:35 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1330 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:35.711920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:35.713969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:35.734275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.739479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.741475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.742497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:35.744364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:35.745026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:35.997983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:36.013813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:36.018859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:36.025275 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a777018-ece5-470f-adb2-7be6d4a01b4a tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1358 microversion: 2.21 time: 0.318065 Oct 31 15:32:36.026116 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1724/3621] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:35 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:36.622253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:36.626215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:36.653247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:36.653815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:36.655487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:36.658674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:36.660355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:36.662652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:36.937728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:36.955118 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9cd63dd-dd30-4273-ba7a-d90ac4ad485d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1336 microversion: 2.1 time: 0.337935 Oct 31 15:32:36.974542 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1725/3622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:36 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1336 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:37.053951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:37.054636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:37.065218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:37.065761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:37.066208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:37.066994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:37.067500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:37.067884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:37.341012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:37.355267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:37.356733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:37.357903 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ecd7a1e7-4c19-42f1-8208-d14839e3f307 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1358 microversion: 2.21 time: 0.310719 Oct 31 15:32:37.374214 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1726/3623] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:37 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:32:37.982764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:37.983482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:38.009190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:38.009733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:38.012998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:38.013864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:38.016117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:38.016575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:38.166406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.183274 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ac643e35-0760-463b-bc7d-245a640b6533 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1336 microversion: 2.1 time: 0.205862 Oct 31 15:32:38.184639 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1727/3624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:37 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1336 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:38.389274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:38.390021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:38.399465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:38.400966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:38.402311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:38.404225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:38.404952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:38.405631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:38.768954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.798613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.800838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:38.802493 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6abf74de-d0e8-474e-a791-799f46e375fb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1358 microversion: 2.21 time: 0.420173 Oct 31 15:32:38.803706 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1728/3625] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:38 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1358 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:39.213906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:39.214937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:39.234749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:39.234749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:39.234749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:39.238311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:39.239142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:39.240395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:39.774742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:39.795039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd0a5d75-c3b0-48fa-97db-685ae9e9775f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1378 microversion: 2.1 time: 0.585263 Oct 31 15:32:39.796877 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1729/3626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:39 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1378 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:39.812218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=20 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:39.842967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:39.844364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:39.861943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:39.867661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:39.869806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:39.872442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:39.873074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:39.877317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:40.500247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:40.515577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:40.517345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:40.519025 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a06e4254-99b1-49f4-9341-d82bd783d3bb tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1358 microversion: 2.21 time: 0.688658 Oct 31 15:32:40.522681 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1730/3627] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:39 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1358 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:32:40.819763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:40.820470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:40.832828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:40.833722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:40.834239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:40.835119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:40.835821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:40.836464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.206007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:32:41.209306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:32:41.216299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:32:41.218856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:32:41.219470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:32:41.223827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:41.232910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.233443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.234172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.235081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.236805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.237539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.283204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Getting quotas for project 4f25561007bb4e22921c780c727fd86c. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:32:41.296858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Getting quotas for user bee445dd89f544f8b866432dcc0f1ec1 and project 4f25561007bb4e22921c780c727fd86c. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:32:41.623604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:32:41.627131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c69a62aa-8071-4e83-9cd0-00c5f36d1c6f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fab89fd1-8a07-449b-b6c6-f22806ebb88a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcf34e4f-2f87-43d3-a9ec-dd79c9e570f8',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:32:41.728038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:41.744595 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13b027da-84ea-43de-bbe8-d4340b06c916 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1378 microversion: 2.1 time: 0.928549 Oct 31 15:32:41.761435 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1731/3628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:40 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1378 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:41.766386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f164e636-f2cd-4805-90ef-4d479354a628 req-4a3a6182-ac64-430b-b6db-da1a7fce7bde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1d5920-53d9-4a92-a425-fa5b05188607", "tag": "0f659744-e2ea-4c48-aa1a-d1a62adc94e0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:41.791531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f164e636-f2cd-4805-90ef-4d479354a628 req-4a3a6182-ac64-430b-b6db-da1a7fce7bde service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.791972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f164e636-f2cd-4805-90ef-4d479354a628 req-4a3a6182-ac64-430b-b6db-da1a7fce7bde service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.792414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f164e636-f2cd-4805-90ef-4d479354a628 req-4a3a6182-ac64-430b-b6db-da1a7fce7bde service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.826055 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f164e636-f2cd-4805-90ef-4d479354a628 req-4a3a6182-ac64-430b-b6db-da1a7fce7bde service nova] Creating event network-changed:0f659744-e2ea-4c48-aa1a-d1a62adc94e0 for instance 1a1d5920-53d9-4a92-a425-fa5b05188607 on n-h2-858384-17 Oct 31 15:32:41.839026 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f164e636-f2cd-4805-90ef-4d479354a628 req-4a3a6182-ac64-430b-b6db-da1a7fce7bde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076185 Oct 31 15:32:41.840004 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1732/3629] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:41.845332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:41.846100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:41.853741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.854446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.855037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:41.855930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:41.856575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:41.857050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:42.241283 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32e17ced-67ce-45dc-aefa-ca01af818d3c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 8.168815 Oct 31 15:32:42.246612 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1898/3630] 10.222.0.20 () {62 vars in 1189 bytes} [Mon Oct 31 15:32:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 8174 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 31 15:32:42.248136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.258440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.259929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.261102 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1d89251a-9b0f-4230-819a-046076b4f865 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1358 microversion: 2.21 time: 0.419917 Oct 31 15:32:42.265001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d2a96587-5adb-4d3f-9426-6b65095a4659 req-1bf608f6-5fe7-451a-ba23-65c5aa2bab94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5ef5cd-a222-4cd2-a18c-a345a62f40e1", "name": "network-vif-plugged", "status": "completed", "tag": "373e2c25-5600-46b5-a2f9-a4924dbf323d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:42.291357 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1733/3631] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:41 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1358 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:42.291357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c1a8f66-38fc-48ab-98d2-2f8057859434 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:42.291357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7c1a8f66-38fc-48ab-98d2-2f8057859434 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:42.292582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2a96587-5adb-4d3f-9426-6b65095a4659 req-1bf608f6-5fe7-451a-ba23-65c5aa2bab94 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:42.293076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2a96587-5adb-4d3f-9426-6b65095a4659 req-1bf608f6-5fe7-451a-ba23-65c5aa2bab94 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:42.293534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2a96587-5adb-4d3f-9426-6b65095a4659 req-1bf608f6-5fe7-451a-ba23-65c5aa2bab94 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:42.309183 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d2a96587-5adb-4d3f-9426-6b65095a4659 req-1bf608f6-5fe7-451a-ba23-65c5aa2bab94 service nova] Creating event network-vif-plugged:373e2c25-5600-46b5-a2f9-a4924dbf323d for instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 on n-h1-858384-17 Oct 31 15:32:42.319128 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d2a96587-5adb-4d3f-9426-6b65095a4659 req-1bf608f6-5fe7-451a-ba23-65c5aa2bab94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069967 Oct 31 15:32:42.322027 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1899/3632] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:42.431750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7c1a8f66-38fc-48ab-98d2-2f8057859434 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.440881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7c1a8f66-38fc-48ab-98d2-2f8057859434 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.442844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7c1a8f66-38fc-48ab-98d2-2f8057859434 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:42.444291 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c1a8f66-38fc-48ab-98d2-2f8057859434 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1284 microversion: 2.32 time: 0.165562 Oct 31 15:32:42.445103 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1734/3633] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:42 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:42.769736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:42.771350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:42.784366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:42.793867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:42.794523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:42.795434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:42.796059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:42.796677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:43.295278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.307526 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b43a74ea-31c2-44ca-8656-07ecb1ccd2e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1378 microversion: 2.1 time: 0.543130 Oct 31 15:32:43.308454 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1900/3634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:42 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1378 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:43.309543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:43.310724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:43.330605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:43.331278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:43.331724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:43.332442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:43.341017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:43.341771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:43.472755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c1107a6-ad6c-47a1-a9b2-aa22e6d33bea tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:43.473237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c1107a6-ad6c-47a1-a9b2-aa22e6d33bea tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:43.615492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c1107a6-ad6c-47a1-a9b2-aa22e6d33bea tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.635683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c1107a6-ad6c-47a1-a9b2-aa22e6d33bea tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.642682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c1107a6-ad6c-47a1-a9b2-aa22e6d33bea tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.647777 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c1107a6-ad6c-47a1-a9b2-aa22e6d33bea tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1284 microversion: 2.32 time: 0.180277 Oct 31 15:32:43.649232 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1901/3635] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:43 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:43.680602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.692946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.696046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:43.698305 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-90cd3d43-19be-4197-a836-b21aab4dac0f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1358 microversion: 2.21 time: 0.394161 Oct 31 15:32:43.715963 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1735/3636] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:43 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1358 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:44.333795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:44.334411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:44.358338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:44.358935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:44.359385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:44.360117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:44.368768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:44.371716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:44.691120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:44.692566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:44.699376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:44.705413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:44.728072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:44.730860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:44.731473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:44.733330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:44.736794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:44.738237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:45.030544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:45.058817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:45.063070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:45.067880 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7916c7d4-89be-4ad7-bbe3-5f47c951a7cc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1518 microversion: 2.32 time: 0.397133 Oct 31 15:32:45.068993 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1736/3637] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:44 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1518 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:45.085335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:45.086273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:45.100598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:45.100938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:45.102503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:45.104439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:45.106079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:45.106545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:45.340089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:45.349092 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85f7d3b4-29d3-4891-aa6e-a8747aff4444 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1378 microversion: 2.1 time: 1.019676 Oct 31 15:32:45.356593 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1902/3638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:44 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1378 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:45.441580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:45.455027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:45.458936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:45.462419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a1e6307-f26d-4870-8652-a58301782655 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1551 microversion: 2.21 time: 0.389826 Oct 31 15:32:45.465772 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1737/3639] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:45 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1551 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:45.499190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:45.502703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:45.521339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:45.538241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:45.540219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:45.545600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:45.547568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:45.550994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:45.644201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:32:45.921510 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a3e024f-b827-4edf-b00e-963d5098828d tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 204 len: 0 microversion: 2.21 time: 0.433025 Oct 31 15:32:45.924394 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1903/3640] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:32:45 2022] DELETE /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:32:45.933379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:45.934001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:45.943256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:45.943755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:45.944703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:45.944900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:45.947564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:45.948278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.106613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:46.107324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:46.130895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.134724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.135206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.140726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.141310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.145896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.319814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:46.337874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:46.340808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:46.343748 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8327d5af-62f5-4cce-8641-54e0cfc130b2 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1557 microversion: 2.21 time: 0.414988 Oct 31 15:32:46.345977 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1738/3641] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:45 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1557 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:46.383323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:46.384539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:46.402352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.403178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.405999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.407098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:46.409244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:46.409974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:46.490912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:46.501793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:46.509900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:46.514780 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a6f27fb4-1e54-4f2d-8367-be6bb5ac86c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1592 microversion: 2.32 time: 0.420634 Oct 31 15:32:46.517214 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1904/3642] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:46 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1592 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:46.807847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:46.818253 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b45476d5-6d96-4aea-95c1-3060f96aa843 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1378 microversion: 2.1 time: 0.440041 Oct 31 15:32:46.833810 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1739/3643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:46 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1378 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:47.370361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:47.370975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:47.380270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.380774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.381250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.381965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.382427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.382856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.545951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:47.545951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:47.559598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.560416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.561046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.561984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.562619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.563211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.759089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.780258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.782060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:47.783679 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-654b2ff4-f21c-4507-b98c-bb431338670f tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1557 microversion: 2.21 time: 0.417190 Oct 31 15:32:47.784446 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1905/3644] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:47 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1557 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:47.843230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:47.844111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:47.851862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.852354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.857269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:47.859489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:47.862356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:47.863149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:48.350918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:48.371012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:48.376606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:48.379137 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c62e4f8-68fe-4c51-a0e0-1b74312017c8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1592 microversion: 2.32 time: 0.839737 Oct 31 15:32:48.383074 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1740/3645] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:47 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1592 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:48.815674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:48.816995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:48.817149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:48.830853 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8d39ed1-7184-47a5-8891-6248f6fb628d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1378 microversion: 2.1 time: 0.991093 Oct 31 15:32:48.834523 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1906/3646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:47 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1378 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:48.838989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:48.839734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:48.841405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:48.845548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:48.846505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:48.849446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:48.857749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:48.904074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f3887e49-8b43-4a9b-b4cc-f36160adc40a req-ca465471-f4aa-486f-acdf-9f6df765a5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d5920-53d9-4a92-a425-fa5b05188607", "name": "network-vif-plugged", "status": "completed", "tag": "0f659744-e2ea-4c48-aa1a-d1a62adc94e0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:48.926256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f3887e49-8b43-4a9b-b4cc-f36160adc40a req-ca465471-f4aa-486f-acdf-9f6df765a5f6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:48.927061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f3887e49-8b43-4a9b-b4cc-f36160adc40a req-ca465471-f4aa-486f-acdf-9f6df765a5f6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:48.927743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f3887e49-8b43-4a9b-b4cc-f36160adc40a req-ca465471-f4aa-486f-acdf-9f6df765a5f6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:48.943998 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f3887e49-8b43-4a9b-b4cc-f36160adc40a req-ca465471-f4aa-486f-acdf-9f6df765a5f6 service nova] Creating event network-vif-plugged:0f659744-e2ea-4c48-aa1a-d1a62adc94e0 for instance 1a1d5920-53d9-4a92-a425-fa5b05188607 on n-h2-858384-17 Oct 31 15:32:48.958528 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f3887e49-8b43-4a9b-b4cc-f36160adc40a req-ca465471-f4aa-486f-acdf-9f6df765a5f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056837 Oct 31 15:32:48.960372 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1907/3647] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:32:49.288351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:49.314701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:49.316948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:49.319448 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5f85103e-73dd-4a12-92cd-6e3c284716cc tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1557 microversion: 2.21 time: 0.507520 Oct 31 15:32:49.320853 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1741/3648] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:48 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1557 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:49.414631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-380edf77-4af6-4947-909e-885434c32b5c req-a3500e1e-a36d-4b43-989f-bb81512ce522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5ef5cd-a222-4cd2-a18c-a345a62f40e1", "name": "network-vif-deleted", "tag": "373e2c25-5600-46b5-a2f9-a4924dbf323d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:49.417905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:49.419345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:49.441821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:49.442641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:49.443256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:49.444289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:49.444915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:49.445582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:49.446694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-380edf77-4af6-4947-909e-885434c32b5c req-a3500e1e-a36d-4b43-989f-bb81512ce522 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:49.450767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-380edf77-4af6-4947-909e-885434c32b5c req-a3500e1e-a36d-4b43-989f-bb81512ce522 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:49.455436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-380edf77-4af6-4947-909e-885434c32b5c req-a3500e1e-a36d-4b43-989f-bb81512ce522 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:49.508099 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-380edf77-4af6-4947-909e-885434c32b5c req-a3500e1e-a36d-4b43-989f-bb81512ce522 service nova] Creating event network-vif-deleted:373e2c25-5600-46b5-a2f9-a4924dbf323d for instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 on n-h1-858384-17 Oct 31 15:32:49.541114 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-380edf77-4af6-4947-909e-885434c32b5c req-a3500e1e-a36d-4b43-989f-bb81512ce522 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129848 Oct 31 15:32:49.542272 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1742/3649] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:49.757543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:49.771589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:49.779818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:49.781231 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8dc6d131-c10b-41b5-ae11-d5f7ffaa41b6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1592 microversion: 2.32 time: 0.374469 Oct 31 15:32:49.794545 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1908/3650] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:49 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1592 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:49.862052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:49.863581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:49.880431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:49.880943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:49.881427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:49.884234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:49.884751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:49.889813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.349268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:50.350652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:50.362619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.367750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.368755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.369774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.370459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.371082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.490470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.490966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.491400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.491856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lazy-loading 'fault' on Instance uuid 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:32:50.666471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.672579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.675759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.685205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd25b7c18a0914c9b88afbbde3c96c35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874639724dda4528b1945ca5e4466428', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:50.686628 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ff77ca4-dcb1-481d-9d80-432fb378bdab tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 200 len: 1348 microversion: 2.21 time: 0.342409 Oct 31 15:32:50.687693 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1909/3651] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:50 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 1348 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:50.688811 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e3e310c8-c9d7-4fb7-b099-92519fa98ae9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1378 microversion: 2.1 time: 0.834407 Oct 31 15:32:50.701297 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1743/3652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:49 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1378 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:50.807240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:50.807861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:50.822081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.822584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.823026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:50.823736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:50.824390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:50.824838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.254638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:51.395527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:51.411383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:51.415993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:51.417517 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-316fd2fe-eec2-48a0-bbb0-4987a2b4e0d7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1660 microversion: 2.32 time: 0.614173 Oct 31 15:32:51.438515 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1910/3653] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:50 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1660 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:51.716070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:51.720884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:51.722132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:51.726662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:51.737603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.738101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.738533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.748133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.748640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.749083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.749829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.750285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.750710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.760498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.761495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.761966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.807972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] HTTP exception thrown: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Request method failure captured: Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 HTTP/1.1 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-qDI9g_MfmCAS8gmAyGg2EwmK7BtYs28d6EVYKgmdIFOJW37UEYfsquY5IGUO6VG2xdV238UOgN9FJgJBV5criokNRG7rijI8X28iKGFSwilqPl8EaKUdnfk7dlitzD_D0Tph2xwZsCW_w9wW_uGpl-H3L7XKrMl2HrPDJEoXSYEW0 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.21 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 874639724dda4528b1945ca5e4466428 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-InstanceActionsV221TestJSON-15774054 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/874639724dda4528b1945ca5e4466428"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_874639724dda4528b1945ca5e4466428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/874639724dda4528b1945ca5e4466428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/874639724dda4528b1945ca5e4466428"}]}] Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-InstanceActionsV221TestJSON-15774054 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 874639724dda4528b1945ca5e4466428 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-15774054 Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-InstanceActionsV221TestJSON-15774054-project Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d25b7c18a0914c9b88afbbde3c96c35e Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-InstanceActionsV221TestJSON-15774054-project Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9c5ef5cd-a222-4cd2-a18c-a345a62f40e1'} Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:51.809716 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Returning 404 to user: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:51.818023 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3eaf945-18be-4e43-b613-13545a3f8804 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 404 len: 111 microversion: 2.21 time: 0.100373 Oct 31 15:32:51.832573 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1744/3654] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:51 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:32:51.839873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58734037-196e-44ca-aec9-47cf7559d371 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '.version_select at 0x7f16e11e7790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:51.840455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58734037-196e-44ca-aec9-47cf7559d371 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:51.855165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58734037-196e-44ca-aec9-47cf7559d371 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.857231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58734037-196e-44ca-aec9-47cf7559d371 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.857884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58734037-196e-44ca-aec9-47cf7559d371 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.863329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58734037-196e-44ca-aec9-47cf7559d371 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.865392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58734037-196e-44ca-aec9-47cf7559d371 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.867834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58734037-196e-44ca-aec9-47cf7559d371 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.949869 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58734037-196e-44ca-aec9-47cf7559d371 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.116578 Oct 31 15:32:51.951037 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1745/3655] 10.222.0.20 () {60 vars in 1337 bytes} [Mon Oct 31 15:32:51 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1/os-instance-actions => generated 611 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:32:51.971479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:51.972499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:51.979640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.980030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.980473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.981192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:51.981829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:51.982419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:51.998936 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] HTTP exception thrown: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Request method failure captured: Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 HTTP/1.1 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-qDI9g_MfmCAS8gmAyGg2EwmK7BtYs28d6EVYKgmdIFOJW37UEYfsquY5IGUO6VG2xdV238UOgN9FJgJBV5criokNRG7rijI8X28iKGFSwilqPl8EaKUdnfk7dlitzD_D0Tph2xwZsCW_w9wW_uGpl-H3L7XKrMl2HrPDJEoXSYEW0 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.21 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 874639724dda4528b1945ca5e4466428 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-InstanceActionsV221TestJSON-15774054 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/874639724dda4528b1945ca5e4466428"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_874639724dda4528b1945ca5e4466428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/874639724dda4528b1945ca5e4466428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/874639724dda4528b1945ca5e4466428"}]}] Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-InstanceActionsV221TestJSON-15774054 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 874639724dda4528b1945ca5e4466428 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-15774054 Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-InstanceActionsV221TestJSON-15774054-project Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d25b7c18a0914c9b88afbbde3c96c35e Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-InstanceActionsV221TestJSON-15774054-project Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9c5ef5cd-a222-4cd2-a18c-a345a62f40e1'} Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:52.001209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.006557 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.008975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Returning 404 to user: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:52.010030 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf135cf5-a2d9-4141-8709-6e424dfc78a4 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 404 len: 111 microversion: 2.21 time: 0.043798 Oct 31 15:32:52.014138 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1746/3656] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:32:51 2022] DELETE /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:32:52.022987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:52.023921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] [instance: 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:52.031169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.032844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.034057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.035654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.036344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.037083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.053676 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] HTTP exception thrown: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Request method failure captured: Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 HTTP/1.1 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-qDI9g_MfmCAS8gmAyGg2EwmK7BtYs28d6EVYKgmdIFOJW37UEYfsquY5IGUO6VG2xdV238UOgN9FJgJBV5criokNRG7rijI8X28iKGFSwilqPl8EaKUdnfk7dlitzD_D0Tph2xwZsCW_w9wW_uGpl-H3L7XKrMl2HrPDJEoXSYEW0 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.21 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 874639724dda4528b1945ca5e4466428 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-InstanceActionsV221TestJSON-15774054 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/874639724dda4528b1945ca5e4466428"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_874639724dda4528b1945ca5e4466428", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/874639724dda4528b1945ca5e4466428"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/874639724dda4528b1945ca5e4466428"}]}] Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-InstanceActionsV221TestJSON-15774054 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 874639724dda4528b1945ca5e4466428 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-15774054 Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-InstanceActionsV221TestJSON-15774054-project Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: d25b7c18a0914c9b88afbbde3c96c35e Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-InstanceActionsV221TestJSON-15774054-project Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9c5ef5cd-a222-4cd2-a18c-a345a62f40e1'} Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.055364 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:32:52.060784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.060784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:32:52.060784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:32:52.060784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:32:52.060784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:32:52.060784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:32:52.060784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. Oct 31 15:32:52.060784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:32:52.060784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] Returning 404 to user: Instance 9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:32:52.061909 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a1d75f2-f187-4526-b1cb-248fcc68e363 tempest-InstanceActionsV221TestJSON-15774054 tempest-InstanceActionsV221TestJSON-15774054-project] 10.222.0.20 "GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1" status: 404 len: 111 microversion: 2.21 time: 0.044556 Oct 31 15:32:52.062731 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1747/3657] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:52 2022] GET /compute/v2.1/servers/9c5ef5cd-a222-4cd2-a18c-a345a62f40e1 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:32:52.457545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:52.459145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:52.471015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:52.477437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.478342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.479010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.479999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.482929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.483607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.622650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:52.638046 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a413e62-4625-48dc-b7f9-679b66fdf653 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1528 microversion: 2.1 time: 0.922866 Oct 31 15:32:52.650627 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1911/3658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:51 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1528 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:52.675375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:52.676157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:52.688220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.689854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.690577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:52.691392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:52.691948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:52.692468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.159078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:53.163115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:53.173073 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8424b3fd-936e-46a5-bffb-fc0457234030 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1528 microversion: 2.1 time: 0.502155 Oct 31 15:32:53.190741 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1912/3659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:52 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1528 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:53.205026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ede5aefc-ef65-4df9-8f66-07c0003456ce tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:53.262011 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ede5aefc-ef65-4df9-8f66-07c0003456ce tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/3efc2580-9540-4dec-95e5-3c22e44af6d3" status: 202 len: 0 microversion: 2.1 time: 0.062611 Oct 31 15:32:53.262635 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1913/3660] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:32:53 2022] DELETE /compute/v2.1/flavors/3efc2580-9540-4dec-95e5-3c22e44af6d3 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:32:53.276623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-caa88950-eb75-4a33-af64-4a79f11d3412 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:53.339759 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-caa88950-eb75-4a33-af64-4a79f11d3412 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071435 Oct 31 15:32:53.344359 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1914/3661] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:32:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:53.373354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:53.380250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:53.399175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.399780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.405413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.406653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.407897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.408643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.477100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:53.481655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:53.499711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:53.524901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:53.527559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Old instance type tempest-test_resize_flavor_-291125160, new instance type m1.heat {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:32:53.537241 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aef8850d-1651-4058-8e57-ecf88fa1d92e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1707 microversion: 2.32 time: 1.087643 Oct 31 15:32:53.546337 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1748/3662] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:52 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1707 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:53.568085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:32:53.568606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:32:53.576265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:32:53.576744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:32:53.577229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:32:53.623243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:32:53.736146 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-38930c2a-f410-43f3-82cb-7952a35ea94d tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607/action" status: 202 len: 0 microversion: 2.1 time: 0.373588 Oct 31 15:32:53.737467 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1915/3663] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:53 2022] POST /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:32:53.746554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:53.747650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:53.757711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.758819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.759457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:53.760597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:53.761849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:53.762490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:54.323626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:54.339715 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f183ff2b-cf49-4957-a9a9-2df1638ac8d1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1537 microversion: 2.1 time: 0.595809 Oct 31 15:32:54.341051 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1749/3664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:53 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1537 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:54.572671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:54.573428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:54.586389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:54.587375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:54.589432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:54.590415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:54.593785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:54.594695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:54.730545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:54.731691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:54.741308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:54.743122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:54.743782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:54.744735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:54.745465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:54.746135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:54.990500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lazy-loading 'services' on Instance uuid 70dad59f-00ca-480e-81e9-ca7bcdfcc633 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:32:55.152155 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0bfd8ed5-7535-4de4-b76a-4a2c39eab654 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments/cc866329-5958-455d-ae24-a890033c24ab" status: 202 len: 0 microversion: 2.1 time: 0.426579 Oct 31 15:32:55.155398 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1750/3665] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:32:54 2022] DELETE /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments/cc866329-5958-455d-ae24-a890033c24ab => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:32:55.171650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a126f5e6-f6d5-4f22-aceb-0e792205f76e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:55.181566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a126f5e6-f6d5-4f22-aceb-0e792205f76e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:55.201111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a126f5e6-f6d5-4f22-aceb-0e792205f76e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.201854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a126f5e6-f6d5-4f22-aceb-0e792205f76e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.203325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a126f5e6-f6d5-4f22-aceb-0e792205f76e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.217855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a126f5e6-f6d5-4f22-aceb-0e792205f76e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.222144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a126f5e6-f6d5-4f22-aceb-0e792205f76e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.223353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a126f5e6-f6d5-4f22-aceb-0e792205f76e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.267465 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a126f5e6-f6d5-4f22-aceb-0e792205f76e tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107913 Oct 31 15:32:55.268936 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1751/3666] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:32:55 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:55.369770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:55.371917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:55.380783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.383492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.384200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.385473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.386157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.387382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.707623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:55.731640 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f2daf24-72c2-4f7e-bbe4-a86fdd4be821 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1537 microversion: 2.1 time: 0.367243 Oct 31 15:32:55.735771 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1752/3667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:55 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1537 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:55.763496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:55.764231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:55.777028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.781817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.783103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:55.784660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:55.785666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:55.786342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.632045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:56.691573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:56.693601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:56.702716 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-510fb147-62e3-4e07-be2a-90ca0ae78fbf tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.944163 Oct 31 15:32:56.715742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:56.723508 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1df1cf73-4fa1-4b1a-a6aa-40be6a743afa tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1754 microversion: 2.32 time: 2.154500 Oct 31 15:32:56.725967 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1753/3668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:55 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:56.732074 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1916/3669] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:54 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1754 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:56.749001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-037ad6ca-740a-463c-9d72-40cbb537e3ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:56.761739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-037ad6ca-740a-463c-9d72-40cbb537e3ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:56.772009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:56.772903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:56.787565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037ad6ca-740a-463c-9d72-40cbb537e3ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.793084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.793640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.796091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.798793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.800776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.801469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.803900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037ad6ca-740a-463c-9d72-40cbb537e3ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.804895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037ad6ca-740a-463c-9d72-40cbb537e3ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.806190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037ad6ca-740a-463c-9d72-40cbb537e3ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.807024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037ad6ca-740a-463c-9d72-40cbb537e3ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.818497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-037ad6ca-740a-463c-9d72-40cbb537e3ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.911289 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-037ad6ca-740a-463c-9d72-40cbb537e3ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184115 Oct 31 15:32:56.917524 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1754/3670] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:32:56 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:56.923856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:56.924813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:56.933238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.935362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.936102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:56.937114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:56.937790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:56.938426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:57.596631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:57.638587 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c29f5de-8cd4-478f-86ee-1e858cc762af tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1537 microversion: 2.1 time: 0.718500 Oct 31 15:32:57.643913 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1755/3671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:56 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1537 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:57.764057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:57.767417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:57.799339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:57.799939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:57.800408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:57.801184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:57.801731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:57.802191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.070820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:58.080501 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce1d8651-8b4d-474d-a7bb-6b4114391f63 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 1.328238 Oct 31 15:32:58.085953 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1917/3672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:56 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:32:58.109441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3db86f2a-8733-4afb-912a-a1cd77dfab0c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:58.120728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3db86f2a-8733-4afb-912a-a1cd77dfab0c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:58.139640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3db86f2a-8733-4afb-912a-a1cd77dfab0c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.141555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3db86f2a-8733-4afb-912a-a1cd77dfab0c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.146311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3db86f2a-8733-4afb-912a-a1cd77dfab0c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.148376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3db86f2a-8733-4afb-912a-a1cd77dfab0c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.151977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3db86f2a-8733-4afb-912a-a1cd77dfab0c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.153210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3db86f2a-8733-4afb-912a-a1cd77dfab0c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.293416 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3db86f2a-8733-4afb-912a-a1cd77dfab0c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202077 Oct 31 15:32:58.296764 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1918/3673] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:32:58 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:58.307879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:58.308799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:58.322129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.325003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.325657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:58.334036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:58.334702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:58.335318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.335049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:59.350780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:59.356551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:59.358077 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2c3a257-211d-4aba-a2e5-bd332332e5dc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1754 microversion: 2.32 time: 1.601956 Oct 31 15:32:59.365084 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1756/3674] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:32:57 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1754 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:32:59.370144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:59.373912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:59.392267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.396039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.396623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.397631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.400794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.401452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.426432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:59.449918 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-27e574bd-b25e-4ab1-850a-82920acaeb50 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 1.150534 Oct 31 15:32:59.450530 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1919/3675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:58 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:32:59.464490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7b36bc5-071f-46db-9ece-c339960500a7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:32:59.472699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e7b36bc5-071f-46db-9ece-c339960500a7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:59.487857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b36bc5-071f-46db-9ece-c339960500a7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.489250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b36bc5-071f-46db-9ece-c339960500a7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.489719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b36bc5-071f-46db-9ece-c339960500a7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.490447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b36bc5-071f-46db-9ece-c339960500a7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.490907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b36bc5-071f-46db-9ece-c339960500a7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.491330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b36bc5-071f-46db-9ece-c339960500a7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.595150 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7b36bc5-071f-46db-9ece-c339960500a7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141122 Oct 31 15:32:59.598766 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1920/3676] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:32:59 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:32:59.611632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9caf5671-08bc-453d-85fc-4e185477f96d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1596254588"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:32:59.617763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9caf5671-08bc-453d-85fc-4e185477f96d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:32:59.635382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9caf5671-08bc-453d-85fc-4e185477f96d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.635778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9caf5671-08bc-453d-85fc-4e185477f96d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.636216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9caf5671-08bc-453d-85fc-4e185477f96d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.636936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9caf5671-08bc-453d-85fc-4e185477f96d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:32:59.639122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9caf5671-08bc-453d-85fc-4e185477f96d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:32:59.639587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9caf5671-08bc-453d-85fc-4e185477f96d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:32:59.914293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:32:59.923938 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13989fc3-4871-40b8-9146-e1ee0c5e119e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1537 microversion: 2.1 time: 0.557352 Oct 31 15:32:59.924458 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1757/3677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:32:59 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1537 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:00.071098 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9caf5671-08bc-453d-85fc-4e185477f96d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.470295 Oct 31 15:33:00.072112 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1921/3678] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:32:59 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 31 15:33:00.396544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:00.397197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:00.413529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.414035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.414478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.415195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.415653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.416080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.609013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46c133dc-3e18-4bd8-bb23-05c6c55158f0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:00.614072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46c133dc-3e18-4bd8-bb23-05c6c55158f0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:00.636705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c133dc-3e18-4bd8-bb23-05c6c55158f0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.637592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c133dc-3e18-4bd8-bb23-05c6c55158f0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.638254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c133dc-3e18-4bd8-bb23-05c6c55158f0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.639178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c133dc-3e18-4bd8-bb23-05c6c55158f0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.639799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c133dc-3e18-4bd8-bb23-05c6c55158f0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.640390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46c133dc-3e18-4bd8-bb23-05c6c55158f0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.711195 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46c133dc-3e18-4bd8-bb23-05c6c55158f0 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107144 Oct 31 15:33:00.712130 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1922/3679] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:33:00 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:33:00.956907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:00.958144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:00.971599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.977930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.978633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:00.979551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:00.983366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:00.983983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:01.154372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:01.187441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:01.189701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:01.191037 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe520106-d2ea-4059-830a-d095d795b70d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1801 microversion: 2.32 time: 0.800059 Oct 31 15:33:01.205627 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1758/3680] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:00 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1801 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:01.725025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75accbd0-07ac-4abc-a516-df41a56743a1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:01.727670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75accbd0-07ac-4abc-a516-df41a56743a1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:01.747386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75accbd0-07ac-4abc-a516-df41a56743a1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:01.748830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75accbd0-07ac-4abc-a516-df41a56743a1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:01.749649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75accbd0-07ac-4abc-a516-df41a56743a1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:01.751967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75accbd0-07ac-4abc-a516-df41a56743a1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:01.754554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75accbd0-07ac-4abc-a516-df41a56743a1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:01.755714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75accbd0-07ac-4abc-a516-df41a56743a1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:01.827745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:01.830697 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75accbd0-07ac-4abc-a516-df41a56743a1 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109946 Oct 31 15:33:01.835030 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1759/3681] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:33:01 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:33:02.220033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:02.220694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:02.232459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.232955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.233422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.234126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.234628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.235758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.399945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:02.412912 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b17a0b7-7636-49c5-8860-91b250f26874 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1537 microversion: 2.1 time: 1.458924 Oct 31 15:33:02.414194 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1923/3682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:00 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1537 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:02.740979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:02.761856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:02.764528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:02.769415 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2df03fb-d3de-4b22-a0f5-f4d4dc1146a3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1801 microversion: 2.32 time: 0.553348 Oct 31 15:33:02.770016 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1760/3683] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:02 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1801 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:33:02.844208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21239291-1e26-4fd0-a02d-fbedb54b5cfc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:02.858130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21239291-1e26-4fd0-a02d-fbedb54b5cfc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:02.867572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21239291-1e26-4fd0-a02d-fbedb54b5cfc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.868063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21239291-1e26-4fd0-a02d-fbedb54b5cfc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.868500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21239291-1e26-4fd0-a02d-fbedb54b5cfc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.882693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21239291-1e26-4fd0-a02d-fbedb54b5cfc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:02.883200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21239291-1e26-4fd0-a02d-fbedb54b5cfc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:02.884031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21239291-1e26-4fd0-a02d-fbedb54b5cfc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:02.952367 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21239291-1e26-4fd0-a02d-fbedb54b5cfc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112553 Oct 31 15:33:02.960104 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1924/3684] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:33:02 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:03.443018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:03.443955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:03.455135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.455784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.456345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.457165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.458021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.458635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.754580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:03.766047 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aca106f2-9f9d-4aaa-b243-1912c7d980b6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1542 microversion: 2.1 time: 0.328912 Oct 31 15:33:03.771172 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1761/3685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:03 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1542 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:03.800468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:03.801212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:03.823597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.824386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.825004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.825905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.826524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.827101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.965447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0010ee5a-b677-44bf-a85f-427323edbbbc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:03.967937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0010ee5a-b677-44bf-a85f-427323edbbbc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:03.980096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0010ee5a-b677-44bf-a85f-427323edbbbc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.983956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0010ee5a-b677-44bf-a85f-427323edbbbc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.984510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0010ee5a-b677-44bf-a85f-427323edbbbc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:03.985944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0010ee5a-b677-44bf-a85f-427323edbbbc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:03.998354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0010ee5a-b677-44bf-a85f-427323edbbbc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:03.999077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0010ee5a-b677-44bf-a85f-427323edbbbc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.056868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0010ee5a-b677-44bf-a85f-427323edbbbc tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092797 Oct 31 15:33:04.057759 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1762/3686] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:33:03 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:33:04.487473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.497284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.507668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:04.510176 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c41e988b-fbeb-4dbb-a5dd-5b725f65371d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1801 microversion: 2.32 time: 0.713846 Oct 31 15:33:04.511927 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1925/3687] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:03 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1801 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:04.794292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:04.795010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:04.807043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:04.814052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.814659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:04.817415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:04.821897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:04.824706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.070371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f9be3785-4775-4ca7-b311-61ecbe68d4d3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:05.073206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f9be3785-4775-4ca7-b311-61ecbe68d4d3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:05.087477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9be3785-4775-4ca7-b311-61ecbe68d4d3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.090136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9be3785-4775-4ca7-b311-61ecbe68d4d3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.090842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9be3785-4775-4ca7-b311-61ecbe68d4d3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.092824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9be3785-4775-4ca7-b311-61ecbe68d4d3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.095610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9be3785-4775-4ca7-b311-61ecbe68d4d3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.097280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9be3785-4775-4ca7-b311-61ecbe68d4d3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.187755 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f9be3785-4775-4ca7-b311-61ecbe68d4d3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120873 Oct 31 15:33:05.190395 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1926/3688] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:33:05 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:05.543344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:05.544302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:05.574115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.581092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.583042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.585681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:05.586929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:05.590695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:05.848821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:05.873981 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75d546b6-e7c3-4141-9047-b0f853081b33 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1542 microversion: 2.1 time: 1.084541 Oct 31 15:33:05.875058 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1763/3689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:04 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1542 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:06.203174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2aded28-e685-4c49-8b63-2171a593dfd7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:06.206097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2aded28-e685-4c49-8b63-2171a593dfd7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:06.224014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2aded28-e685-4c49-8b63-2171a593dfd7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.227757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2aded28-e685-4c49-8b63-2171a593dfd7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.228450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2aded28-e685-4c49-8b63-2171a593dfd7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.230954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2aded28-e685-4c49-8b63-2171a593dfd7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.232414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2aded28-e685-4c49-8b63-2171a593dfd7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.233714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2aded28-e685-4c49-8b63-2171a593dfd7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.348321 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2aded28-e685-4c49-8b63-2171a593dfd7 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149815 Oct 31 15:33:06.352633 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1764/3690] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:33:06 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633/os-volume_attachments => generated 25 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:33:06.433556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:06.443807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:06.466968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:06.468626 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f2275309-fbd7-4ca3-8c54-01ab4a82f417 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1848 microversion: 2.32 time: 0.930248 Oct 31 15:33:06.470773 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1927/3691] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:05 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1848 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:33:06.531098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:06.540464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:06.558668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.560265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.561478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.565485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.566277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.567040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.672245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5736b1d4-8696-4dcf-ba31-de0c873278ef req-05c1c6eb-b401-4650-aca0-a1b6e31b48d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "name": "network-vif-plugged", "status": "completed", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:06.690920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5736b1d4-8696-4dcf-ba31-de0c873278ef req-05c1c6eb-b401-4650-aca0-a1b6e31b48d0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.691407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5736b1d4-8696-4dcf-ba31-de0c873278ef req-05c1c6eb-b401-4650-aca0-a1b6e31b48d0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.691850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5736b1d4-8696-4dcf-ba31-de0c873278ef req-05c1c6eb-b401-4650-aca0-a1b6e31b48d0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.710324 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] HTTP exception thrown: Cannot 'reboot' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Request method failure captured: Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50/action HTTP/1.1 Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 28 Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-mPAZq-02OTEsnv8GMkJRDJDL-rAJdgEJHn39ABJutgfh2_1AZN2oCBsrYt27l5tKBr9RG945Kyk--1kSEQ-akNiYprUFz_R7VxoVIJfbKRGxwgEKLAB8nUjvzWuTNL6KRyvhFuZKw3wxu_FY2qhzM7Zf-aduk3Wugzl7BHJI8VXXg Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9275c27ad1ac40568e4dbc778857d333", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9275c27ad1ac40568e4dbc778857d333"}]}] Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b56e2ca778b04f7c9fc7590faacb4c1a Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: {"reboot": {"type": "HARD"}} Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: exception: Cannot 'reboot' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '6a4aa745-9180-42f8-9ccd-5c286351fd50', 'body': {'reboot': {'type': 'HARD'}}} Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:33:06.723141 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.728953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Returning 409 to user: Cannot 'reboot' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:33:06.733809 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dcb36b6b-4df7-423b-b910-804efa3d1730 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50/action" status: 409 len: 145 microversion: 2.1 time: 0.213517 Oct 31 15:33:06.739542 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1765/3692] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:06 2022] POST /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50/action => generated 145 bytes in 220 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:33:06.753836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:06.756839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:06.757011 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5736b1d4-8696-4dcf-ba31-de0c873278ef req-05c1c6eb-b401-4650-aca0-a1b6e31b48d0 service nova] Creating event network-vif-plugged:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:33:06.777093 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5736b1d4-8696-4dcf-ba31-de0c873278ef req-05c1c6eb-b401-4650-aca0-a1b6e31b48d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108430 Oct 31 15:33:06.777922 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1928/3693] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:33:06.781518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.785474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.789003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.792245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.793072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.795236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.899375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:06.900083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:06.912673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.916301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.916942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.921186 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] HTTP exception thrown: Cannot 'rebuild' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued Oct 31 15:33:06.922127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:06.924567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:06.925308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Request method failure captured: Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50/action HTTP/1.1 Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 65 Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-mPAZq-02OTEsnv8GMkJRDJDL-rAJdgEJHn39ABJutgfh2_1AZN2oCBsrYt27l5tKBr9RG945Kyk--1kSEQ-akNiYprUFz_R7VxoVIJfbKRGxwgEKLAB8nUjvzWuTNL6KRyvhFuZKw3wxu_FY2qhzM7Zf-aduk3Wugzl7BHJI8VXXg Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9275c27ad1ac40568e4dbc778857d333", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9275c27ad1ac40568e4dbc778857d333"}]}] Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b56e2ca778b04f7c9fc7590faacb4c1a Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: exception: Cannot 'rebuild' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '6a4aa745-9180-42f8-9ccd-5c286351fd50', 'body': {'rebuild': {'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6'}}} Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:33:06.940942 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued Oct 31 15:33:06.945650 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:06.952296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Returning 409 to user: Cannot 'rebuild' instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 while it is in vm_state rescued {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:33:06.956304 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b971f0c9-2b6c-49fd-a964-ec8ddfc7beaa tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "POST /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50/action" status: 409 len: 146 microversion: 2.1 time: 0.213450 Oct 31 15:33:06.959853 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1766/3694] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:06 2022] POST /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50/action => generated 146 bytes in 220 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:33:06.970819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:06.980554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:06.990372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:07.010082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.011709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.013791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.015891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.018190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.019952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.104663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:33:07.429635 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-22d5c9ef-adb9-45a5-93f4-02fdfb916a74 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 204 len: 0 microversion: 2.1 time: 0.462920 Oct 31 15:33:07.430234 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1767/3695] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:33:06 2022] DELETE /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:33:07.457267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:07.458235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:07.499351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.515610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.517539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.518474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:07.519498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:07.520319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:07.966513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:08.003994 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fdcf47f2-1ad2-465a-8442-1a1521d1ba4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1542 microversion: 2.1 time: 1.104439 Oct 31 15:33:08.007587 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1929/3696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:06 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1542 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:08.020777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:08.030790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:08.055903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:08.056905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:08.057589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:08.058498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:08.064593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:08.065298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:08.576437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:08.587645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-281b65f3-c38a-4d32-8db2-ead64cbf5c2c tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1688 microversion: 2.1 time: 1.146184 Oct 31 15:33:08.595786 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1768/3697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:07 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1688 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:08.602948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bc0755e8-e705-4231-bd0f-728650266953 req-81c78ff8-ae7a-4e6b-bda7-fd2f82d61d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "tag": "a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:08.653251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bc0755e8-e705-4231-bd0f-728650266953 req-81c78ff8-ae7a-4e6b-bda7-fd2f82d61d93 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:08.661143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bc0755e8-e705-4231-bd0f-728650266953 req-81c78ff8-ae7a-4e6b-bda7-fd2f82d61d93 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:08.661822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bc0755e8-e705-4231-bd0f-728650266953 req-81c78ff8-ae7a-4e6b-bda7-fd2f82d61d93 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:08.698635 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bc0755e8-e705-4231-bd0f-728650266953 req-81c78ff8-ae7a-4e6b-bda7-fd2f82d61d93 service nova] Creating event network-changed:a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:33:08.721476 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bc0755e8-e705-4231-bd0f-728650266953 req-81c78ff8-ae7a-4e6b-bda7-fd2f82d61d93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112940 Oct 31 15:33:08.722554 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1769/3698] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:08.827917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:08.865972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:08.872397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:08.879340 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cac98faf-ae11-4d36-8a62-36ba2466a5b3 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1848 microversion: 2.32 time: 0.868031 Oct 31 15:33:08.881765 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1930/3699] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:08 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1848 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:09.036492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:09.037733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:09.052548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.057496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.058456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.060460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.061377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.062726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.613450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:09.614877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:09.629654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.630802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.632601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.635523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.636235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.637000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.851077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:09.870006 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3cf5f72d-ce33-4cef-a58e-e0e5c0bcbaf4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1542 microversion: 2.1 time: 0.839727 Oct 31 15:33:09.889339 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1770/3700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:09 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1542 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:09.921276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:09.923375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:09.938962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.944088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.944594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:09.945410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:09.945888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:09.946322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:10.022372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:10.050599 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-422b4a31-fe90-4932-9ddb-b9f0f8dff4c4 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1688 microversion: 2.1 time: 0.440360 Oct 31 15:33:10.051830 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1931/3701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:09 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1688 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:10.661822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:10.678133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:10.683002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:10.705472 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5cd93354-e06f-463c-8506-dbdc4f1f5213 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1848 microversion: 2.32 time: 0.784742 Oct 31 15:33:10.724524 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1771/3702] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:09 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1848 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:10.901066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:10.901819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:10.914675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:10.918066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:10.918567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:10.919009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:10.923571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:10.924481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:10.926296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.076294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:11.077701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:11.119336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:11.127603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:11.128272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.132880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:11.133769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:11.135348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:11.738101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:11.759935 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a01f36c9-241c-4532-bd4b-483435d0eadd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1542 microversion: 2.1 time: 0.862572 Oct 31 15:33:11.762127 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1932/3703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:10 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1542 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:12.168023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1291723115", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "01124e9c-2cb1-4d41-af01-a1cdf0b1285b"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:12.299938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] validate_networks() for [('01124e9c-2cb1-4d41-af01-a1cdf0b1285b', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:33:12.791060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:12.815382 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9853cc9d-7075-48cd-8370-b59c44330b9b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1688 microversion: 2.1 time: 1.743616 Oct 31 15:33:12.816658 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1772/3704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:11 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1688 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:12.837778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:12.838836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:12.856400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.857177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.857862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:12.858755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:12.859389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:12.860737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.018643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:14.044144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:14.049648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:14.051641 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-62c6a2f6-3850-405b-acf4-6367faf42efe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1869 microversion: 2.32 time: 1.233604 Oct 31 15:33:14.063770 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1773/3705] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:12 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1869 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:14.069003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:14.072881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:14.097481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.099040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.099511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.100271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.100744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.101195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.252212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:33:14.257347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:33:14.258065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:33:14.259599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:33:14.260190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:33:14.303787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.307568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.310741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.312337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.314361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.316703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.405580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Getting quotas for project 2ddc3c4d4f214ecc8132c70e45b7190b. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:14.425889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Getting quotas for user 7b22303f0ad64228a497056ef4fd2321 and project 2ddc3c4d4f214ecc8132c70e45b7190b. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:14.444080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:33:14.446609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:33:14.531889 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7f56ccf-18d3-4bbb-8bda-16a47904d3db tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.768097 Oct 31 15:33:14.533009 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1933/3706] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:33:14.538267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:14.539551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:14.552979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.554204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.554909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:14.555883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:14.556679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:14.557397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:15.394328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:15.423751 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3748261-96ab-4fdb-a9cb-ff4b8ceccda3 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1688 microversion: 2.1 time: 0.871335 Oct 31 15:33:15.425768 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1934/3707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:14 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1688 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:15.440620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-582838556", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "01124e9c-2cb1-4d41-af01-a1cdf0b1285b"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:15.585855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] validate_networks() for [('01124e9c-2cb1-4d41-af01-a1cdf0b1285b', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:33:16.355222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:16.366945 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50393fe2-249d-4d8f-aca1-2d2352366f2b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1542 microversion: 2.1 time: 2.301735 Oct 31 15:33:16.367550 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1774/3708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:14 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1542 bytes in 2303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:16.381195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:16.384619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:16.397169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:16.400186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.402622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.403105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.403834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.406837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.407427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.667524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:33:16.667990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:33:16.668404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:33:16.668812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:33:16.669272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:33:16.688714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.689569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.691429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.701513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.702285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.702924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:16.760424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Getting quotas for project 2ddc3c4d4f214ecc8132c70e45b7190b. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:16.767440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Getting quotas for user 7b22303f0ad64228a497056ef4fd2321 and project 2ddc3c4d4f214ecc8132c70e45b7190b. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:16.806090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:33:16.808860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:33:16.933298 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48171f0a-ebe6-42ec-b30d-56ccf7672199 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.505977 Oct 31 15:33:16.941284 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1935/3709] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:33:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:33:16.951093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c484874e-4ca4-4192-877b-e87343f982f8 req-3c3f8b63-4acd-4801-a660-b9e7648417fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "tag": "843a9ed1-8632-4e46-98bb-0693efe5aa5b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:16.970629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c484874e-4ca4-4192-877b-e87343f982f8 req-3c3f8b63-4acd-4801-a660-b9e7648417fd service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:16.976806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c484874e-4ca4-4192-877b-e87343f982f8 req-3c3f8b63-4acd-4801-a660-b9e7648417fd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:16.977603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c484874e-4ca4-4192-877b-e87343f982f8 req-3c3f8b63-4acd-4801-a660-b9e7648417fd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:17.007480 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c484874e-4ca4-4192-877b-e87343f982f8 req-3c3f8b63-4acd-4801-a660-b9e7648417fd service nova] Creating event network-changed:843a9ed1-8632-4e46-98bb-0693efe5aa5b for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:33:17.015611 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c484874e-4ca4-4192-877b-e87343f982f8 req-3c3f8b63-4acd-4801-a660-b9e7648417fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072266 Oct 31 15:33:17.023559 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1936/3710] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:17.793693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:17.794603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:17.826734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:17.829028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:17.831887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:17.833314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:17.839723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:17.846729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:18.045213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:18.074776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:18.091044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:18.092297 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13ec02cb-fb8a-4d95-9a88-813f217bf71c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1869 microversion: 2.32 time: 1.721053 Oct 31 15:33:18.105355 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1775/3711] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:16 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1869 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:18.116860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-146162589", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "451", "networks": [{"uuid": "01124e9c-2cb1-4d41-af01-a1cdf0b1285b"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:19.061192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] validate_networks() for [('01124e9c-2cb1-4d41-af01-a1cdf0b1285b', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:33:19.133414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:19.157770 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8bd78830-3196-4f09-8bdc-ed032df28356 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1621 microversion: 2.1 time: 2.131517 Oct 31 15:33:19.160446 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1937/3712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:17 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1621 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:19.206189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:19.207253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:19.224135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:19.224967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:19.225766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:19.226879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:19.227606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:19.228265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:20.940848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:20.970455 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-443c7e99-b7ad-4522-8272-29b70d2773ed tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1542 microversion: 2.1 time: 1.808446 Oct 31 15:33:20.971371 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1938/3713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:19 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1542 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:20.998872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:20.999647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:21.016375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:21.021554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:21.022280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:21.030164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:21.033274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:21.035241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:22.607707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:22.644284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:22.648474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:22.653159 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f84e6eda-7bdb-4764-b11c-8673a50ed7c6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1890 microversion: 2.32 time: 1.678357 Oct 31 15:33:22.655825 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1939/3714] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:20 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1890 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:22.677285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:22.678520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:22.695597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.699385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.700145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:22.708368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:22.709195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:22.711204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.082074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:23.106082 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4ade3d67-6815-4998-a3aa-0576d194c6d5 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 200 len: 1621 microversion: 2.1 time: 0.443185 Oct 31 15:33:23.106941 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1940/3715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:22 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 1621 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:23.119335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:23.130077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:23.147506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.161920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.163726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.165852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.172691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.173805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.213685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:33:23.214278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:33:23.214562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:33:23.214973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:33:23.215384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:33:23.240424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.257894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.258362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.259508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.259993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.260834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.320084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:23.388196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Getting quotas for project 2ddc3c4d4f214ecc8132c70e45b7190b. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:23.416629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Getting quotas for user 7b22303f0ad64228a497056ef4fd2321 and project 2ddc3c4d4f214ecc8132c70e45b7190b. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:23.486054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:33:23.488459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:33:23.659042 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0fc761e5-3d0f-44f2-840e-e6e7ae508b33 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.564916 Oct 31 15:33:23.674820 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1776/3716] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:33:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 5581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:33:23.733056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d5f4f21f-e8b2-4f81-b081-a0fe7018b13c req-f164fb04-3b41-43b9-b15e-1846b119de56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70dad59f-00ca-480e-81e9-ca7bcdfcc633", "name": "network-vif-deleted", "tag": "db98faa2-da61-4f08-8efd-816f4eae0468"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:23.779372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d5f4f21f-e8b2-4f81-b081-a0fe7018b13c req-f164fb04-3b41-43b9-b15e-1846b119de56 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.780175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d5f4f21f-e8b2-4f81-b081-a0fe7018b13c req-f164fb04-3b41-43b9-b15e-1846b119de56 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.780777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d5f4f21f-e8b2-4f81-b081-a0fe7018b13c req-f164fb04-3b41-43b9-b15e-1846b119de56 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.807501 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d5f4f21f-e8b2-4f81-b081-a0fe7018b13c req-f164fb04-3b41-43b9-b15e-1846b119de56 service nova] Creating event network-vif-deleted:db98faa2-da61-4f08-8efd-816f4eae0468 for instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 on n-h1-858384-17 Oct 31 15:33:23.814966 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d5f4f21f-e8b2-4f81-b081-a0fe7018b13c req-f164fb04-3b41-43b9-b15e-1846b119de56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137754 Oct 31 15:33:23.821948 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1777/3717] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:23.827926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:23.832260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:23.847017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.849731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.854149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:23.855119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:23.855770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:23.856375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.293353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:24.311403 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75da3fa0-951e-4c6a-aa4c-e12d85b7345a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1542 microversion: 2.1 time: 1.199626 Oct 31 15:33:24.321519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1941/3718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:23 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1542 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:24.335721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b606440-f41b-4564-8bec-36397f619b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:24.336348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b606440-f41b-4564-8bec-36397f619b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:24.808934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b606440-f41b-4564-8bec-36397f619b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:24.839551 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b606440-f41b-4564-8bec-36397f619b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1220 microversion: 2.1 time: 0.514149 Oct 31 15:33:24.841239 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1942/3719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:24 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1220 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:24.872382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:24.882160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 70dad59f-00ca-480e-81e9-ca7bcdfcc633] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:24.910933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.912035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.914824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.918145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:24.927023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:24.929418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:24.979533 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] HTTP exception thrown: Instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 could not be found. Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Request method failure captured: Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 HTTP/1.1 Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-mPAZq-02OTEsnv8GMkJRDJDL-rAJdgEJHn39ABJutgfh2_1AZN2oCBsrYt27l5tKBr9RG945Kyk--1kSEQ-akNiYprUFz_R7VxoVIJfbKRGxwgEKLAB8nUjvzWuTNL6KRyvhFuZKw3wxu_FY2qhzM7Zf-aduk3Wugzl7BHJI8VXXg Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9275c27ad1ac40568e4dbc778857d333", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9275c27ad1ac40568e4dbc778857d333"}]}] Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b56e2ca778b04f7c9fc7590faacb4c1a Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 could not be found. Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '70dad59f-00ca-480e-81e9-ca7bcdfcc633'} Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 could not be found. Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 could not be found. Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:33:24.983278 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 could not be found. Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Returning 404 to user: Instance 70dad59f-00ca-480e-81e9-ca7bcdfcc633 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:33:24.990431 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f239b03-9dd0-4346-8357-48ba2fc18c94 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633" status: 404 len: 111 microversion: 2.1 time: 0.137512 Oct 31 15:33:24.993277 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1943/3720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:24 2022] GET /compute/v2.1/servers/70dad59f-00ca-480e-81e9-ca7bcdfcc633 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:33:25.003528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b665ac19-5855-455a-9a60-61b666a90107 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '.version_select at 0x7f16e0e809d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:25.085601 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b665ac19-5855-455a-9a60-61b666a90107 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142448848" status: 202 len: 0 microversion: 2.1 time: 0.089886 Oct 31 15:33:25.095589 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1944/3721] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 15:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142448848 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:33:25.212680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:25.228179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:25.237421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:25.251327 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5ade6042-7f12-4485-9f48-6863746a47f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1890 microversion: 2.32 time: 1.427625 Oct 31 15:33:25.261555 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1778/3722] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:23 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1890 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:25.347407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:25.348663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:25.378754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.379479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.380558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:25.381576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.384094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.394888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:25.870409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:25.871033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:25.889840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.890368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.892709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:25.893674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:25.899171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:25.899848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:26.171021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:26.183629 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a4113786-ae60-435c-a899-262b7ed69b50 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1272 microversion: 2.1 time: 0.318190 Oct 31 15:33:26.187331 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1779/3723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:25 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1272 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:26.197562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-94587f91-c040-4626-95c7-3255b37a52eb req-ac577708-b44f-49d1-8eed-cac397886832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "tag": "b00466ed-bfa7-4acf-8cbf-347445a38720"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:26.222089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-94587f91-c040-4626-95c7-3255b37a52eb req-ac577708-b44f-49d1-8eed-cac397886832 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:26.222727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-94587f91-c040-4626-95c7-3255b37a52eb req-ac577708-b44f-49d1-8eed-cac397886832 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:26.225093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-94587f91-c040-4626-95c7-3255b37a52eb req-ac577708-b44f-49d1-8eed-cac397886832 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:26.259213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-94587f91-c040-4626-95c7-3255b37a52eb req-ac577708-b44f-49d1-8eed-cac397886832 service nova] Creating event network-changed:b00466ed-bfa7-4acf-8cbf-347445a38720 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:33:26.271378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-94587f91-c040-4626-95c7-3255b37a52eb req-ac577708-b44f-49d1-8eed-cac397886832 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079792 Oct 31 15:33:26.272182 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1780/3724] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:26.290748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:26.291475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:26.310675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:26.311590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:26.312229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:26.314709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:26.317754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:26.318427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:26.723746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:27.562297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:27.586800 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-107b9318-b380-42eb-9fc8-7144c0de0610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1542 microversion: 2.1 time: 2.235389 Oct 31 15:33:27.606115 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1945/3725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:25 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1542 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:27.621424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:27.623635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:27.641895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:27.645918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:27.647069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:27.648168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:27.649336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:27.662109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:28.413974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:28.425392 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-50eea9cc-9734-4f20-803f-64b90eab3417 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1278 microversion: 2.1 time: 0.817923 Oct 31 15:33:28.444391 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1946/3726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:27 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1278 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:28.615913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:28.616604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:28.628191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:28.630164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:28.630896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:28.631665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:28.634016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:28.638081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:29.161606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.182005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.183975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.189773 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a9fefeb8-ebfc-462d-b1fa-42f9c8c008b0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1890 microversion: 2.32 time: 2.905857 Oct 31 15:33:29.205153 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1781/3727] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:26 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1890 bytes in 2908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:29.450960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:29.451789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:29.473346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:29.473854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:29.474299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:29.475029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:29.475489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:29.475915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:29.701010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.713431 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-963b7115-58e4-484e-97c3-a27e33f55949 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1541 microversion: 2.1 time: 1.105310 Oct 31 15:33:29.735961 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1947/3728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:28 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1541 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:29.878125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:29.926766 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b956365e-778c-48cb-84c2-63a916835cf3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1278 microversion: 2.1 time: 0.472533 Oct 31 15:33:29.928116 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1782/3729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:29 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1278 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:30.223822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:30.224555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:30.251609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:30.252528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:30.254303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:30.258065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:30.258777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:30.260765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:30.577639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4e7df279-5128-4bfd-9cfa-5c29c7a3763d req-8a3237b3-88e6-4009-9eff-b3d1913d4351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88dc2835-b836-4c07-9358-0f4a9d3ad32f", "tag": "c61594ed-7ccd-40ff-b1f7-a4a4bab21359"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:30.611350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4e7df279-5128-4bfd-9cfa-5c29c7a3763d req-8a3237b3-88e6-4009-9eff-b3d1913d4351 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:30.611562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4e7df279-5128-4bfd-9cfa-5c29c7a3763d req-8a3237b3-88e6-4009-9eff-b3d1913d4351 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:30.612009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4e7df279-5128-4bfd-9cfa-5c29c7a3763d req-8a3237b3-88e6-4009-9eff-b3d1913d4351 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:30.628486 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4e7df279-5128-4bfd-9cfa-5c29c7a3763d req-8a3237b3-88e6-4009-9eff-b3d1913d4351 service nova] Creating event network-changed:c61594ed-7ccd-40ff-b1f7-a4a4bab21359 for instance 88dc2835-b836-4c07-9358-0f4a9d3ad32f on n-h2-858384-17 Oct 31 15:33:30.634685 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4e7df279-5128-4bfd-9cfa-5c29c7a3763d req-8a3237b3-88e6-4009-9eff-b3d1913d4351 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.348494 Oct 31 15:33:30.636301 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1783/3730] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:33:30.748231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:30.749430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:30.765904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:30.799276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:30.802489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:30.803300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:30.804107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:30.812029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:31.146759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:31.170973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:31.201966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:31.210499 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd47623a-5ff7-416f-b1f8-37a4bad6f000 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.989194 Oct 31 15:33:31.213460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1948/3731] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:30 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:31.235575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2e63185a-468c-4fed-8bf3-650e008592d5 req-a87c4cf9-8055-4194-8f9b-b9900cbf7b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d5920-53d9-4a92-a425-fa5b05188607", "name": "network-vif-unplugged", "status": "completed", "tag": "0f659744-e2ea-4c48-aa1a-d1a62adc94e0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:31.283613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2e63185a-468c-4fed-8bf3-650e008592d5 req-a87c4cf9-8055-4194-8f9b-b9900cbf7b2e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:31.286688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2e63185a-468c-4fed-8bf3-650e008592d5 req-a87c4cf9-8055-4194-8f9b-b9900cbf7b2e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:31.287409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2e63185a-468c-4fed-8bf3-650e008592d5 req-a87c4cf9-8055-4194-8f9b-b9900cbf7b2e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:31.315160 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2e63185a-468c-4fed-8bf3-650e008592d5 req-a87c4cf9-8055-4194-8f9b-b9900cbf7b2e service nova] Creating event network-vif-unplugged:0f659744-e2ea-4c48-aa1a-d1a62adc94e0 for instance 1a1d5920-53d9-4a92-a425-fa5b05188607 on n-h1-858384-17 Oct 31 15:33:31.339597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-2e63185a-468c-4fed-8bf3-650e008592d5 req-a87c4cf9-8055-4194-8f9b-b9900cbf7b2e service nova] Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:33:31.378794 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2e63185a-468c-4fed-8bf3-650e008592d5 req-a87c4cf9-8055-4194-8f9b-b9900cbf7b2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162966 Oct 31 15:33:31.380004 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1949/3732] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:31.391310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:31.396944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:31.409851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:31.410676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:31.411339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:31.415808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:31.417574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:31.418385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:31.844809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:31.853269 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-460dd6df-e052-442b-957a-4b46efbfc071 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1278 microversion: 2.1 time: 0.471817 Oct 31 15:33:31.857221 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1950/3733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:31 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1278 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:32.243096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:32.244482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:32.274014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.274757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.276700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.287121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.293208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.297411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.306169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:32.694551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:32.711743 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-597ff6a0-b49c-49a8-8705-65d676b1721e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1541 microversion: 2.1 time: 1.971910 Oct 31 15:33:32.712455 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1784/3734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:30 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1541 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:32.730887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c9f2a21a-18cc-4f57-afab-269d1400070d req-9d1ca9f1-9ffd-4eab-a1ef-cf254f65d7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd860d0-e3b8-43e8-b192-90ff4e748034", "tag": "bd550dc2-82af-403f-8304-706ef625a855"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:32.756497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c9f2a21a-18cc-4f57-afab-269d1400070d req-9d1ca9f1-9ffd-4eab-a1ef-cf254f65d7f6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.757194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c9f2a21a-18cc-4f57-afab-269d1400070d req-9d1ca9f1-9ffd-4eab-a1ef-cf254f65d7f6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.757810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c9f2a21a-18cc-4f57-afab-269d1400070d req-9d1ca9f1-9ffd-4eab-a1ef-cf254f65d7f6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.790049 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c9f2a21a-18cc-4f57-afab-269d1400070d req-9d1ca9f1-9ffd-4eab-a1ef-cf254f65d7f6 service nova] Creating event network-changed:bd550dc2-82af-403f-8304-706ef625a855 for instance bcd860d0-e3b8-43e8-b192-90ff4e748034 on n-h1-858384-17 Oct 31 15:33:32.809083 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c9f2a21a-18cc-4f57-afab-269d1400070d req-9d1ca9f1-9ffd-4eab-a1ef-cf254f65d7f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081622 Oct 31 15:33:32.811256 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1785/3735] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:33:32.886763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:32.887489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:32.900827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:32.904845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.905444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.906623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.907763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:32.908531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:32.909221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:32.919481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:32.920914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:32.922905 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-183fb6b0-f6d9-48fe-b515-27ecaa131174 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.684613 Oct 31 15:33:32.938088 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1951/3736] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:32 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:33:33.321687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:33.372617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:33.382791 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc8771a6-7ef1-4db0-b3ad-c200e8452ac5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1278 microversion: 2.1 time: 0.502441 Oct 31 15:33:33.392692 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1786/3737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:32 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1278 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:33.742562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:33.743380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:33.759795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.760772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.761460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:33.762633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.764820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.766660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:33.952695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:33.955840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:33.964822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:33.968546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.970227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.973932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:33.976233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:33.977864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:33.978509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:34.026050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:34.034962 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a96b1b9-0814-4c6a-bee1-3c12b96c35ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1541 microversion: 2.1 time: 0.298111 Oct 31 15:33:34.053160 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1952/3738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:33 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1541 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:34.419743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:34.420501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:34.437905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:34.438569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:34.439191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:34.440028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:34.442566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:34.443897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:34.813481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=14 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:34.892437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:34.904036 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3692f4b2-3fea-41a7-a9f8-77ac5c318924 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 0.488011 Oct 31 15:33:34.909018 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1953/3739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:34 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:34.924728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a73200c4-b888-42ee-9448-cbd8f11bc8cf req-55d441e2-632d-42d9-84c8-a4ac9dfae67a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "tag": "4aea9160-063a-4d76-83d9-228c713aee2b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:34.953397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a73200c4-b888-42ee-9448-cbd8f11bc8cf req-55d441e2-632d-42d9-84c8-a4ac9dfae67a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:34.962297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a73200c4-b888-42ee-9448-cbd8f11bc8cf req-55d441e2-632d-42d9-84c8-a4ac9dfae67a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:34.966937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a73200c4-b888-42ee-9448-cbd8f11bc8cf req-55d441e2-632d-42d9-84c8-a4ac9dfae67a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.011909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a73200c4-b888-42ee-9448-cbd8f11bc8cf req-55d441e2-632d-42d9-84c8-a4ac9dfae67a service nova] Creating event network-changed:4aea9160-063a-4d76-83d9-228c713aee2b for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:33:35.028139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a73200c4-b888-42ee-9448-cbd8f11bc8cf req-55d441e2-632d-42d9-84c8-a4ac9dfae67a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104658 Oct 31 15:33:35.030819 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1954/3740] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:35.068907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:35.070600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:35.084293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.087392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.087879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.090297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.093224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.094094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.471441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:35.486702 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7cc6430-a47e-4863-a9f0-b3d1d1835307 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1541 microversion: 2.1 time: 0.419948 Oct 31 15:33:35.497162 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1955/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:35 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1541 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:35.935355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:35.936012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:35.951224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.951762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.952178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:35.953912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:35.954556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:35.955943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.272972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.292137 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-447bdca0-93c9-481d-871c-8aa40ddbb2ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 0.364094 Oct 31 15:33:36.294042 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1956/3742] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:35 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:36.507346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.519191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:36.522621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:36.542644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.547406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:36.549089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:36.550963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.551530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.552468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:36.553899 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-981c7bc1-68da-428c-9a86-58fc8944a790 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 2.605346 Oct 31 15:33:36.554549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:36.555230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.556004 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1787/3743] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:33 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:36.764683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-676f1fb2-6e5d-4643-b5fe-6d52fefe4728 req-45a03ad0-daaf-4027-8072-705abc6d5ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88dc2835-b836-4c07-9358-0f4a9d3ad32f", "name": "network-vif-plugged", "status": "completed", "tag": "c61594ed-7ccd-40ff-b1f7-a4a4bab21359"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:36.801604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-676f1fb2-6e5d-4643-b5fe-6d52fefe4728 req-45a03ad0-daaf-4027-8072-705abc6d5ac2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:36.804549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-676f1fb2-6e5d-4643-b5fe-6d52fefe4728 req-45a03ad0-daaf-4027-8072-705abc6d5ac2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:36.805547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-676f1fb2-6e5d-4643-b5fe-6d52fefe4728 req-45a03ad0-daaf-4027-8072-705abc6d5ac2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.844638 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-676f1fb2-6e5d-4643-b5fe-6d52fefe4728 req-45a03ad0-daaf-4027-8072-705abc6d5ac2 service nova] Creating event network-vif-plugged:c61594ed-7ccd-40ff-b1f7-a4a4bab21359 for instance 88dc2835-b836-4c07-9358-0f4a9d3ad32f on n-h2-858384-17 Oct 31 15:33:36.871334 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-676f1fb2-6e5d-4643-b5fe-6d52fefe4728 req-45a03ad0-daaf-4027-8072-705abc6d5ac2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110447 Oct 31 15:33:36.878059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:36.887555 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1788/3744] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:33:36.891023 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9bbfc944-d870-4a7e-8838-fc2a84da5978 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1541 microversion: 2.1 time: 0.377016 Oct 31 15:33:36.899866 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1957/3745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:36 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1541 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:36.906920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:36.907923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:36.930415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:36.931511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:36.932201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:36.933226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:36.934560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:36.935242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.318669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:37.319812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:37.325973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.326662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.327339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.328297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.328751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.329378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.528941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:37.538121 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0bf5e789-4965-4870-acbb-91b7ee0d55cc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 0.223993 Oct 31 15:33:37.542046 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1958/3746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:37 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:37.549631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b1709d0f-86b8-4c46-84f0-de9314ff71aa req-6c2cff4d-d51e-4c2d-9373-9aec9ba55600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1d5920-53d9-4a92-a425-fa5b05188607", "tag": "0f659744-e2ea-4c48-aa1a-d1a62adc94e0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:37.589440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b1709d0f-86b8-4c46-84f0-de9314ff71aa req-6c2cff4d-d51e-4c2d-9373-9aec9ba55600 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.589973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b1709d0f-86b8-4c46-84f0-de9314ff71aa req-6c2cff4d-d51e-4c2d-9373-9aec9ba55600 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.590434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b1709d0f-86b8-4c46-84f0-de9314ff71aa req-6c2cff4d-d51e-4c2d-9373-9aec9ba55600 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.623498 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b1709d0f-86b8-4c46-84f0-de9314ff71aa req-6c2cff4d-d51e-4c2d-9373-9aec9ba55600 service nova] Creating event network-changed:0f659744-e2ea-4c48-aa1a-d1a62adc94e0 for instance 1a1d5920-53d9-4a92-a425-fa5b05188607 on n-h1-858384-17 Oct 31 15:33:37.639903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-b1709d0f-86b8-4c46-84f0-de9314ff71aa req-6c2cff4d-d51e-4c2d-9373-9aec9ba55600 service nova] Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:33:37.651821 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b1709d0f-86b8-4c46-84f0-de9314ff71aa req-6c2cff4d-d51e-4c2d-9373-9aec9ba55600 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108520 Oct 31 15:33:37.652445 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1959/3747] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:37.670086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:37.670792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:37.679063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.679771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.680399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.682303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.683033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.683870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.830927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:37.844125 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9636b58-5f9f-4c09-819f-438e5d72fcac tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.946611 Oct 31 15:33:37.845823 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1789/3748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:36 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:37.868256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4299f691-2e68-41a5-9004-4efd43d5bc0c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1026529173"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:37.871084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4299f691-2e68-41a5-9004-4efd43d5bc0c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:37.893140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4299f691-2e68-41a5-9004-4efd43d5bc0c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.893780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4299f691-2e68-41a5-9004-4efd43d5bc0c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.894228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4299f691-2e68-41a5-9004-4efd43d5bc0c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:37.895022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4299f691-2e68-41a5-9004-4efd43d5bc0c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:37.895479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4299f691-2e68-41a5-9004-4efd43d5bc0c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:37.895789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4299f691-2e68-41a5-9004-4efd43d5bc0c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:38.260627 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4299f691-2e68-41a5-9004-4efd43d5bc0c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.395848 Oct 31 15:33:38.278165 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1790/3749] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:37 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 31 15:33:38.295503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:38.299387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:38.317596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:38.318440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:38.319647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:38.321359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:38.322063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:38.322964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:38.448058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:38.469728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:38.474399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:38.479551 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bfbc43e6-8dae-4511-a15f-11b6a222aa3e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.823334 Oct 31 15:33:38.494118 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1960/3750] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:37 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:38.574325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:38.575992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:38.589509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:38.591697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:38.592261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:38.595537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:38.596181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:38.597166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:39.193201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:39.202098 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4ba0482-5b8a-47d9-ac52-13ecd8f1af36 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 0.635181 Oct 31 15:33:39.213422 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1961/3751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:38 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:39.342401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:39.355765 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30037931-1d44-45d0-bc8b-92e644c64923 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1541 microversion: 2.1 time: 1.072902 Oct 31 15:33:39.356374 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1791/3752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:38 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1541 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:39.513110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:39.514912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:39.528113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:39.533016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:39.533776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:39.538116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:39.539010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:39.542802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.422244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1636667665", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "28f27807-ff21-47ea-b360-5363a5bebb1e"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:40.535849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] validate_networks() for [('28f27807-ff21-47ea-b360-5363a5bebb1e', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:33:40.773668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:40.797286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:40.810647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:40.815678 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba067937-a624-48c2-9933-af8ddd0b056c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 1.307335 Oct 31 15:33:40.840460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1962/3753] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:39 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:40.845464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-98736fc8-9bc7-421d-bd22-2c012badfe65 req-00955fd4-0014-4786-9f84-827bc2c72548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "tag": "a2bb9ed6-823d-43a5-b740-495112886f87"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:40.878789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-98736fc8-9bc7-421d-bd22-2c012badfe65 req-00955fd4-0014-4786-9f84-827bc2c72548 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.881337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-98736fc8-9bc7-421d-bd22-2c012badfe65 req-00955fd4-0014-4786-9f84-827bc2c72548 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.881793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-98736fc8-9bc7-421d-bd22-2c012badfe65 req-00955fd4-0014-4786-9f84-827bc2c72548 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.915013 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-98736fc8-9bc7-421d-bd22-2c012badfe65 req-00955fd4-0014-4786-9f84-827bc2c72548 service nova] Creating event network-changed:a2bb9ed6-823d-43a5-b740-495112886f87 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:33:40.929872 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-98736fc8-9bc7-421d-bd22-2c012badfe65 req-00955fd4-0014-4786-9f84-827bc2c72548 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087438 Oct 31 15:33:40.931872 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1963/3754] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:40.949322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:40.950166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:40.970698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.971221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.971732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:40.972348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:40.972811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:40.986155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.302262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:41.326035 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0cc2ea2a-3959-4dcc-8612-f91a1f5a6c68 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 0.385417 Oct 31 15:33:41.341237 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1964/3755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:40 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:41.348461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:41.349187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:41.352244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:41.367112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.367958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.368912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.370372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.371093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.371824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.560135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:41.572125 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c60fbcbc-06cd-4ff9-88fd-681548151d4e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1473 microversion: 2.1 time: 0.239932 Oct 31 15:33:41.586963 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1965/3756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:41 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1473 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:41.610132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f7447ba7-2cf2-4a1b-a0ad-eee5329c78b7 req-246453e5-5e2c-434a-8a2e-73fe51481ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "name": "network-vif-unplugged", "status": "completed", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:41.649108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f7447ba7-2cf2-4a1b-a0ad-eee5329c78b7 req-246453e5-5e2c-434a-8a2e-73fe51481ba9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.650053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f7447ba7-2cf2-4a1b-a0ad-eee5329c78b7 req-246453e5-5e2c-434a-8a2e-73fe51481ba9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.650833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f7447ba7-2cf2-4a1b-a0ad-eee5329c78b7 req-246453e5-5e2c-434a-8a2e-73fe51481ba9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.667225 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f7447ba7-2cf2-4a1b-a0ad-eee5329c78b7 req-246453e5-5e2c-434a-8a2e-73fe51481ba9 service nova] Creating event network-vif-unplugged:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:33:41.727352 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f7447ba7-2cf2-4a1b-a0ad-eee5329c78b7 req-246453e5-5e2c-434a-8a2e-73fe51481ba9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138616 Oct 31 15:33:41.728585 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1966/3757] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:41.851298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:41.852755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:41.888552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.889662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.893869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:41.900836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:41.916217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:41.921968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.338272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:42.357542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:42.362796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:42.364554 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23c3808b-bf28-4fcc-851a-7c62c6adbdad tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.523471 Oct 31 15:33:42.365926 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1967/3758] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:41 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:42.379250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:42.381392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:42.397820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.399246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.401531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.402691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.404201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.407294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.471914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:33:42.634306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:42.720632 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c39b5d0-9f0b-4b0e-86cd-3f9e81fbe71f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 204 len: 0 microversion: 2.1 time: 0.352397 Oct 31 15:33:42.724152 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1968/3759] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:33:42 2022] DELETE /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:33:42.743789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:42.744663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:42.764138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.764470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.764915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.766288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.766744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.767673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.852953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:33:42.853588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:33:42.853860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:33:42.854264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:33:42.854863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:33:42.877730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.878216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.878862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.879767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:42.880413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:42.881008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:42.936727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Getting quotas for project 32923016858e4585b6971ab42387f5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:42.952776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Getting quotas for user baff39dd91e34a559a81922f2ecff1c5 and project 32923016858e4585b6971ab42387f5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:42.981989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Going to run 2 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:33:42.985535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:33:43.067079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:33:43.123711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:43.133550 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d93333f9-1dd7-4714-9c70-801cd6c124c8 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 0.405701 Oct 31 15:33:43.139822 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1969/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:42 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:43.157706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:43.158535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:43.173274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.180713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.190901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.198074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.198931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.199576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.202741 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3129d871-e209-47bf-9bac-aab194a39e63 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.282371 Oct 31 15:33:43.206523 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1792/3761] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:33:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:33:43.225185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:43.227453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:43.245228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.245739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.246433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.247356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.248363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.249265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.606590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:43.623574 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6cf764b4-a2e3-4adf-a156-20844790ac25 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1470 microversion: 2.1 time: 0.481077 Oct 31 15:33:43.630180 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1970/3762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:43 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1470 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:43.641667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ed226e2a-ebc3-4bfd-86fe-5a2bfadeb79e req-cf7b17e0-e604-41f1-b4ca-d1518c1bf81a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba", "tag": "a72eed15-a869-40f6-9159-0cd7b080328d"}, {"name": "network-changed", "server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "tag": "ac976b0a-a5d1-4612-95b6-4eb2f35daf6d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:43.664047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ed226e2a-ebc3-4bfd-86fe-5a2bfadeb79e req-cf7b17e0-e604-41f1-b4ca-d1518c1bf81a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.668487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ed226e2a-ebc3-4bfd-86fe-5a2bfadeb79e req-cf7b17e0-e604-41f1-b4ca-d1518c1bf81a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.669230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ed226e2a-ebc3-4bfd-86fe-5a2bfadeb79e req-cf7b17e0-e604-41f1-b4ca-d1518c1bf81a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.706322 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ed226e2a-ebc3-4bfd-86fe-5a2bfadeb79e req-cf7b17e0-e604-41f1-b4ca-d1518c1bf81a service nova] Creating event network-changed:a72eed15-a869-40f6-9159-0cd7b080328d for instance fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba on n-h1-858384-17 Oct 31 15:33:43.707097 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ed226e2a-ebc3-4bfd-86fe-5a2bfadeb79e req-cf7b17e0-e604-41f1-b4ca-d1518c1bf81a service nova] Creating event network-changed:ac976b0a-a5d1-4612-95b6-4eb2f35daf6d for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:33:43.722500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ed226e2a-ebc3-4bfd-86fe-5a2bfadeb79e req-cf7b17e0-e604-41f1-b4ca-d1518c1bf81a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.084177 Oct 31 15:33:43.723637 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1971/3763] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:43.730673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:43.746190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:43.748315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Searching by: {'deleted': False, 'project_id': '32923016858e4585b6971ab42387f5ae'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:33:43.778420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.779410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.780191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.782175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.783293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.784078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.810038 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dfb17393-bfcb-4a49-a5e4-e2cf69a626bb tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.083114 Oct 31 15:33:43.811214 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1972/3764] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:33:43 2022] GET /compute/v2.1/servers => generated 677 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:43.824949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:43.826030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:43.840766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.843943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.846067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:43.846906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:43.848890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:43.849430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:44.532811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:44.552237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:44.555297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:44.563378 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6f51c00-ed24-42df-9ff1-93ed51a39f89 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.746912 Oct 31 15:33:44.569703 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1973/3765] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:43 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:44.583705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:44.584262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:44.641874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:44.642496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:44.643059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:44.644489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:44.647104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:44.647894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:44.821467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:44.827539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:44.831391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:44.836367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:44.838288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:44.840941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:45.006364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:33:45.030197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for user 4df669ecccf24e8e9b41574f29ba157b and project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:33:45.404402 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1cbb2362-89c5-47c8-9781-90615f8846e4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607/action" status: 202 len: 0 microversion: 2.1 time: 0.828372 Oct 31 15:33:45.404981 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1974/3766] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:33:44 2022] POST /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:33:45.447464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:45.458454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:45.488783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:45.490036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:45.490727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:45.491866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:45.494574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:45.495284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:46.536072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:46.572194 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e54d7c8-c086-4c1f-80f8-135106d078ed tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1506 microversion: 2.1 time: 3.348106 Oct 31 15:33:46.574672 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1793/3767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:43 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1506 bytes in 3368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:46.599920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:46.605856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:46.624979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=9 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:46.638718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:46.640849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:46.641977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:46.646066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:46.647432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:46.649476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:47.171950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:47.183859 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8481b150-910f-4152-86a2-2174bc1ebda3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1224 microversion: 2.1 time: 1.771810 Oct 31 15:33:47.213485 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1975/3768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:45 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1224 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:47.219534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-65c7b841-6771-4078-b43a-82979f2dc45c req-8183b669-5b18-4e35-9e56-7c3cf75fa94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd860d0-e3b8-43e8-b192-90ff4e748034", "name": "network-vif-plugged", "status": "completed", "tag": "bd550dc2-82af-403f-8304-706ef625a855"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:47.244065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-65c7b841-6771-4078-b43a-82979f2dc45c req-8183b669-5b18-4e35-9e56-7c3cf75fa94b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:47.244847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-65c7b841-6771-4078-b43a-82979f2dc45c req-8183b669-5b18-4e35-9e56-7c3cf75fa94b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:47.245493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-65c7b841-6771-4078-b43a-82979f2dc45c req-8183b669-5b18-4e35-9e56-7c3cf75fa94b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:47.259932 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-65c7b841-6771-4078-b43a-82979f2dc45c req-8183b669-5b18-4e35-9e56-7c3cf75fa94b service nova] Creating event network-vif-plugged:bd550dc2-82af-403f-8304-706ef625a855 for instance bcd860d0-e3b8-43e8-b192-90ff4e748034 on n-h1-858384-17 Oct 31 15:33:47.278990 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-65c7b841-6771-4078-b43a-82979f2dc45c req-8183b669-5b18-4e35-9e56-7c3cf75fa94b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063720 Oct 31 15:33:47.282935 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1976/3769] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:47.290835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:47.311215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:47.326652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:47.327145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:47.328139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:47.333957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:47.334513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:47.335178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:48.063441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:48.076546 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0a23f7fa-e43b-4a5f-b475-b5b00178544c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 1.497713 Oct 31 15:33:48.084314 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1794/3770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:46 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:48.100910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:48.102010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:48.129087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:48.130981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:48.132798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:48.135328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:48.135981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:48.139746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:48.519963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:48.528221 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-970198eb-5c31-47d2-ad35-f04f396507f5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1469 microversion: 2.1 time: 1.243844 Oct 31 15:33:48.531623 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1977/3771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:47 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1469 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:48.562985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:48.565377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:48.582628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:48.584129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:48.586108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:48.587711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:48.589643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:48.590460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:49.062944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:49.064774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:49.180667 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eab94916-d9ac-46d6-8349-ea8e3f459444 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1464 microversion: 2.1 time: 0.547792 Oct 31 15:33:49.180667 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1978/3772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:48 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1464 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:49.182417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:49.182417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:49.182417 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f961772-b639-469e-90f2-1eb023c6dbb0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 1.029682 Oct 31 15:33:49.182417 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1795/3773] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:48 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:49.182417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:49.182417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:49.189751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:49.191645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:49.200308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:49.201160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:49.201975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:49.205684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:49.206543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:49.207167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:49.219128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:49.225568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:49.227125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:49.227994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:49.228494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:49.241773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:49.326889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:49.414656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:49.422664 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5029fb4-efe3-4f99-b87a-676abf7c26ec tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1278 microversion: 2.1 time: 0.316714 Oct 31 15:33:49.426056 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1979/3774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:49 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1278 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:49.456516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2e88a769-a976-4036-a158-b6cafed423b2 req-1afca2de-0a97-4cf8-9ddf-ab8f230b68d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a4aa745-9180-42f8-9ccd-5c286351fd50", "name": "network-vif-deleted", "tag": "64770c5f-870a-4838-9f15-799163477f87"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:49.485401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2e88a769-a976-4036-a158-b6cafed423b2 req-1afca2de-0a97-4cf8-9ddf-ab8f230b68d2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:49.486157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2e88a769-a976-4036-a158-b6cafed423b2 req-1afca2de-0a97-4cf8-9ddf-ab8f230b68d2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:49.486728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2e88a769-a976-4036-a158-b6cafed423b2 req-1afca2de-0a97-4cf8-9ddf-ab8f230b68d2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:49.514722 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2e88a769-a976-4036-a158-b6cafed423b2 req-1afca2de-0a97-4cf8-9ddf-ab8f230b68d2 service nova] Creating event network-vif-deleted:64770c5f-870a-4838-9f15-799163477f87 for instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 on n-h1-858384-17 Oct 31 15:33:49.524354 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2e88a769-a976-4036-a158-b6cafed423b2 req-1afca2de-0a97-4cf8-9ddf-ab8f230b68d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078490 Oct 31 15:33:49.525090 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1980/3775] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:49.560440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:49.561342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:49.568625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:49.569288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:49.570009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:49.570868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:49.571461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:49.572202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.490451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:50.499913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:50.501469 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b5d96dc-9636-489c-8651-9fe248ddb4a4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 1.372762 Oct 31 15:33:50.509237 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1796/3776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:49 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:50.519332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a73781d1-2fe4-4929-8b64-80c585adeb1d req-e0a57391-60b7-47f2-9b52-b5dde29d463b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d5920-53d9-4a92-a425-fa5b05188607", "name": "network-vif-plugged", "status": "completed", "tag": "0f659744-e2ea-4c48-aa1a-d1a62adc94e0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:50.520154 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc66c3f2-a78e-4a39-a9b3-2de6d06ff63e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1469 microversion: 2.1 time: 0.964362 Oct 31 15:33:50.526308 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1981/3777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:49 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1469 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:50.548637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:50.549283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:50.554005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a73781d1-2fe4-4929-8b64-80c585adeb1d req-e0a57391-60b7-47f2-9b52-b5dde29d463b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.554505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a73781d1-2fe4-4929-8b64-80c585adeb1d req-e0a57391-60b7-47f2-9b52-b5dde29d463b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.554923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a73781d1-2fe4-4929-8b64-80c585adeb1d req-e0a57391-60b7-47f2-9b52-b5dde29d463b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.566891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.567640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.568246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.569107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.578800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.591784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.607952 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a73781d1-2fe4-4929-8b64-80c585adeb1d req-e0a57391-60b7-47f2-9b52-b5dde29d463b service nova] Creating event network-vif-plugged:0f659744-e2ea-4c48-aa1a-d1a62adc94e0 for instance 1a1d5920-53d9-4a92-a425-fa5b05188607 on n-h1-858384-17 Oct 31 15:33:50.629024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-a73781d1-2fe4-4929-8b64-80c585adeb1d req-e0a57391-60b7-47f2-9b52-b5dde29d463b service nova] Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:33:50.649039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a73781d1-2fe4-4929-8b64-80c585adeb1d req-e0a57391-60b7-47f2-9b52-b5dde29d463b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144697 Oct 31 15:33:50.660859 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1797/3778] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:50.666791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:50.667746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:50.675114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.676552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.677663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.678956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lazy-loading 'fault' on Instance uuid 6a4aa745-9180-42f8-9ccd-5c286351fd50 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:33:50.680526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.681025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.681491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.682206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.682665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.683093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.837546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:50.882214 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2668c2c8-73e8-46f7-a8e3-2a9a9ffef6b6 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 200 len: 1311 microversion: 2.1 time: 0.347978 Oct 31 15:33:50.898466 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1982/3779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:50 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 1311 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:50.912156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:50.912938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:50.922414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.934032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.934722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:50.935631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:50.936281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:50.936895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:51.723893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:51.743911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:51.767022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:51.770632 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bae61ace-629f-4564-8406-72d1485860c4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 1.106289 Oct 31 15:33:51.773187 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1798/3780] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:50 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:51.801224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3569d7bd-9bba-4b9b-94fd-f194a336bb07 req-dcaeb027-3a48-4618-8a58-3a49a07439d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "tag": "9d85ca81-1622-439d-857b-1c0c99b29b1a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:51.816514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3569d7bd-9bba-4b9b-94fd-f194a336bb07 req-dcaeb027-3a48-4618-8a58-3a49a07439d4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:51.817522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3569d7bd-9bba-4b9b-94fd-f194a336bb07 req-dcaeb027-3a48-4618-8a58-3a49a07439d4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:51.818110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3569d7bd-9bba-4b9b-94fd-f194a336bb07 req-dcaeb027-3a48-4618-8a58-3a49a07439d4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:51.840919 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3569d7bd-9bba-4b9b-94fd-f194a336bb07 req-dcaeb027-3a48-4618-8a58-3a49a07439d4 service nova] Creating event network-changed:9d85ca81-1622-439d-857b-1c0c99b29b1a for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:33:51.847265 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3569d7bd-9bba-4b9b-94fd-f194a336bb07 req-dcaeb027-3a48-4618-8a58-3a49a07439d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072387 Oct 31 15:33:51.848824 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1799/3781] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:51.856212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:51.857258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:51.864877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:51.865836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:51.866475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:51.871973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:51.873813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:51.875737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.035234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:52.051328 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51756965-9734-4bea-b1fa-fd4feb888d6a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1320 microversion: 2.1 time: 1.151443 Oct 31 15:33:52.066440 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1983/3782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:50 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1320 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:52.075360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:52.076755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:52.083869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.084846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.092036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.093320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.094175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.094911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.143534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:52.322900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:52.340423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-24fa71e4-984c-43d4-b813-02035c6aa37b tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 0.486378 Oct 31 15:33:52.386540 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1800/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:51 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:52.391623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:52.392234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: 6a4aa745-9180-42f8-9ccd-5c286351fd50] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:52.414497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.415004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.415450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.416173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.416633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.417067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.473661 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] HTTP exception thrown: Instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 could not be found. Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Request method failure captured: Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 HTTP/1.1 Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-mPAZq-02OTEsnv8GMkJRDJDL-rAJdgEJHn39ABJutgfh2_1AZN2oCBsrYt27l5tKBr9RG945Kyk--1kSEQ-akNiYprUFz_R7VxoVIJfbKRGxwgEKLAB8nUjvzWuTNL6KRyvhFuZKw3wxu_FY2qhzM7Zf-aduk3Wugzl7BHJI8VXXg Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9275c27ad1ac40568e4dbc778857d333", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9275c27ad1ac40568e4dbc778857d333"}]}] Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b56e2ca778b04f7c9fc7590faacb4c1a Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 could not be found. Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '6a4aa745-9180-42f8-9ccd-5c286351fd50'} Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 could not be found. Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 could not be found. Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:52.492110 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 could not be found. Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Returning 404 to user: Instance 6a4aa745-9180-42f8-9ccd-5c286351fd50 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:33:52.495843 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed5e158d-7511-455e-b7a2-23e86a9b6ceb tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50" status: 404 len: 111 microversion: 2.1 time: 0.107139 Oct 31 15:33:52.500761 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1801/3784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:52 2022] GET /compute/v2.1/servers/6a4aa745-9180-42f8-9ccd-5c286351fd50 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:33:52.520716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:52.521252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:52.540073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.540831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.541468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.542203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.542672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.544402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.610626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:33:52.844088 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b21add6-61ed-475a-8750-147ae92fb68b tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 204 len: 0 microversion: 2.1 time: 0.338369 Oct 31 15:33:52.846096 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1802/3785] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:33:52 2022] DELETE /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:33:52.866561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5a53c3bc-a639-484b-abfe-90ff3924ae31 req-4ab618bf-5ab4-46e9-b748-7748d46055a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba", "name": "network-vif-plugged", "status": "completed", "tag": "a72eed15-a869-40f6-9159-0cd7b080328d"}, {"server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "name": "network-vif-plugged", "status": "completed", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:52.888459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:52.905526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5a53c3bc-a639-484b-abfe-90ff3924ae31 req-4ab618bf-5ab4-46e9-b748-7748d46055a5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.906249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5a53c3bc-a639-484b-abfe-90ff3924ae31 req-4ab618bf-5ab4-46e9-b748-7748d46055a5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.907473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5a53c3bc-a639-484b-abfe-90ff3924ae31 req-4ab618bf-5ab4-46e9-b748-7748d46055a5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.908001 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a0371b0-114b-4080-9e69-6daa752e0d7c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1469 microversion: 2.1 time: 0.840234 Oct 31 15:33:52.909864 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1984/3786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:52 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1469 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:52.915271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:52.917444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:52.927077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:52.939565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.940142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.940582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.941369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.941835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.942332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.945378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5a53c3bc-a639-484b-abfe-90ff3924ae31 req-4ab618bf-5ab4-46e9-b748-7748d46055a5 service nova] Creating event network-vif-plugged:a72eed15-a869-40f6-9159-0cd7b080328d for instance fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba on n-h1-858384-17 Oct 31 15:33:52.947188 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5a53c3bc-a639-484b-abfe-90ff3924ae31 req-4ab618bf-5ab4-46e9-b748-7748d46055a5 service nova] Creating event network-vif-plugged:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:33:52.958898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5a53c3bc-a639-484b-abfe-90ff3924ae31 req-4ab618bf-5ab4-46e9-b748-7748d46055a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110643 Oct 31 15:33:52.960374 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1803/3787] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:52.967640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:52.969235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:52.977090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:52.979570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.980702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.981359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:52.982349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:52.983029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:52.984700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:53.304482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:53.320041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:53.321947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:53.323594 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-07e276b2-a4f3-4dcb-b93f-9ca52469d8ec tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.412134 Oct 31 15:33:53.324630 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1985/3788] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:52 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:53.331841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:53.333064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:53.339920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:53.340598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:53.341209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:53.342056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:53.342657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:53.344280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:53.619202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:53.631625 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8690dbdf-8768-4f08-a93c-33ba8dd83dc8 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.669734 Oct 31 15:33:53.634667 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1804/3789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:52 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:53.645391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:53.646301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:53.660512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:53.663249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:53.667319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:53.668400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:53.673526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:53.674287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:53.870900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:53.888915 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5002757-b275-4fab-80f0-b93ffc12a27b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1320 microversion: 2.1 time: 0.562512 Oct 31 15:33:53.891318 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1986/3790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:53 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1320 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:53.944958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:53.946495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:53.964824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:53.965746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:53.966846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:53.967815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:53.969188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:53.970027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.379784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:54.397059 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9aedec6b-e7b5-45d0-821d-d2f873a5376a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1320 microversion: 2.1 time: 0.760992 Oct 31 15:33:54.409704 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1805/3791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:53 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1320 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:54.414338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:54.415245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:54.434132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.435173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.436042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.437562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.438386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.439045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.531028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:54.539312 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-630f4a11-bde7-4cc1-b0c5-647cfa8b75e0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1469 microversion: 2.1 time: 0.605227 Oct 31 15:33:54.540440 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1987/3792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:53 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1469 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:54.545008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2b32ed0e-33ab-4f72-b2ac-05fb36922ad2 req-edf302bf-0141-476a-894e-4ddd674e7c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "923d2969-f29d-4087-bfdd-56c4c438352d", "tag": "0347eb4e-7425-4515-b2ea-b48b93ff05ea"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:54.555500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2b32ed0e-33ab-4f72-b2ac-05fb36922ad2 req-edf302bf-0141-476a-894e-4ddd674e7c81 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.556430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2b32ed0e-33ab-4f72-b2ac-05fb36922ad2 req-edf302bf-0141-476a-894e-4ddd674e7c81 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.557010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2b32ed0e-33ab-4f72-b2ac-05fb36922ad2 req-edf302bf-0141-476a-894e-4ddd674e7c81 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.583862 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2b32ed0e-33ab-4f72-b2ac-05fb36922ad2 req-edf302bf-0141-476a-894e-4ddd674e7c81 service nova] Creating event network-changed:0347eb4e-7425-4515-b2ea-b48b93ff05ea for instance 923d2969-f29d-4087-bfdd-56c4c438352d on n-h1-858384-17 Oct 31 15:33:54.598004 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2b32ed0e-33ab-4f72-b2ac-05fb36922ad2 req-edf302bf-0141-476a-894e-4ddd674e7c81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055108 Oct 31 15:33:54.600064 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1988/3793] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:54.661908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:54.662930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:54.678652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.679528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.680247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.681379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.682534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.685706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.872113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:54.887313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:54.892004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:54.895061 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0d83a04-c595-4601-87c9-914becf6de83 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.491403 Oct 31 15:33:54.910053 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1806/3794] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:54 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:54.921711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:54.926445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:54.940233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.941330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.942388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:54.942962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:54.943316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:54.944480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:54.945170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:55.116568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:55.126332 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22df6dc6-13f1-45a3-99e1-ac71b0705a6f tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 0.471400 Oct 31 15:33:55.147432 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1989/3795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:54 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:55.422774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:55.423613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:55.435496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:55.441704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:55.442423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:55.443355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:55.443981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:55.444563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.039620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:56.059101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:56.062554 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa11e70f-da8e-4d17-b80b-246f477aeac2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1320 microversion: 2.1 time: 1.139767 Oct 31 15:33:56.078601 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca4d1033-6b19-4124-af8d-cd02c76c94bf tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1512 microversion: 2.1 time: 0.660140 Oct 31 15:33:56.082916 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1807/3796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:54 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1320 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:56.084555 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1990/3797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:55 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1512 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:33:56.091097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:56.091774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:56.094444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:56.096315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:56.106487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:56.106837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:56.107283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.107998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:56.115468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:56.118656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:56.119240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:56.119724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.120397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.123641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:56.125833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:56.127421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.617696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:56.627960 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-982c0a18-4b60-4430-a14e-f882163369cf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1535 microversion: 2.1 time: 0.543814 Oct 31 15:33:56.633336 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1808/3798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:56 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1535 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:56.645490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:56.647969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:56.666181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:56.666987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:56.667671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:56.670145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:56.670866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:56.671530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.007896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:57.028636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:57.036291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:57.041322 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ee0624e-dcbf-4160-8bda-0b3dab859522 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.954349 Oct 31 15:33:57.043145 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1991/3799] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:56 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:57.059536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:57.065359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:57.104016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.104524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.109597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.110556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.114846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.115497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.372767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:57.383437 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98f4e47a-1d42-4fe7-8a16-4b7ded3414d3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1512 microversion: 2.1 time: 0.747098 Oct 31 15:33:57.386111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1809/3800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:56 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1512 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:57.395971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:57.396785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:57.415138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.418160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.418825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.421079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.421774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.422363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.920911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:57.934551 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f69bb99-635a-47f0-9429-bd3a4bcaf052 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1320 microversion: 2.1 time: 0.547211 Oct 31 15:33:57.935371 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1810/3801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:57 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1320 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:57.942217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:57.947336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:57.961297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.961995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.962632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:57.963531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:57.964380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:57.964943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.340516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56e2ca778b04f7c9fc7590faacb4c1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9275c27ad1ac40568e4dbc778857d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:58.350520 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5ebfc153-cc60-46b4-8043-8c9b570ee443 tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 200 len: 1521 microversion: 2.1 time: 1.304428 Oct 31 15:33:58.356145 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1992/3802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:57 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 1521 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:58.370927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:58.372404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:58.391679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.392916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.393545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.394425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.396045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.396665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.641420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:58.666002 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec596871-7b46-4d41-9b5b-e855fb840264 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034" status: 200 len: 1511 microversion: 2.1 time: 0.729339 Oct 31 15:33:58.670499 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1811/3803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:57 2022] GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034 => generated 1511 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:58.684530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7d104835-4773-44a1-89b4-0d86448f9ffd req-d845b66f-7124-4cd1-863e-c48406a4b47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d5920-53d9-4a92-a425-fa5b05188607", "name": "network-vif-unplugged", "status": "completed", "tag": "0f659744-e2ea-4c48-aa1a-d1a62adc94e0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:58.709241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7d104835-4773-44a1-89b4-0d86448f9ffd req-d845b66f-7124-4cd1-863e-c48406a4b47e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.709937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7d104835-4773-44a1-89b4-0d86448f9ffd req-d845b66f-7124-4cd1-863e-c48406a4b47e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.713424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7d104835-4773-44a1-89b4-0d86448f9ffd req-d845b66f-7124-4cd1-863e-c48406a4b47e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.771195 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7d104835-4773-44a1-89b4-0d86448f9ffd req-d845b66f-7124-4cd1-863e-c48406a4b47e service nova] Creating event network-vif-unplugged:0f659744-e2ea-4c48-aa1a-d1a62adc94e0 for instance 1a1d5920-53d9-4a92-a425-fa5b05188607 on n-h2-858384-17 Oct 31 15:33:58.794458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-7d104835-4773-44a1-89b4-0d86448f9ffd req-d845b66f-7124-4cd1-863e-c48406a4b47e service nova] Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:33:58.840669 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7d104835-4773-44a1-89b4-0d86448f9ffd req-d845b66f-7124-4cd1-863e-c48406a4b47e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.168173 Oct 31 15:33:58.846313 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1812/3804] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:58.854791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:58.855148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:58.857061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:58.877321 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60d12810-d540-407b-bc2f-ca799f83098e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1535 microversion: 2.1 time: 0.512365 Oct 31 15:33:58.878246 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1993/3805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:58 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1535 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:58.893600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.893600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.900679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.901672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.903738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.906331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.917551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:58.945874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:58.956593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:33:58.991859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.992353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.992793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:58.997638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:58.998135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:58.998568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.166947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:33:59.274320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:59.278807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:33:59.299001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:59.303077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:59.306478 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e42e749f-78ec-4fed-9375-8ea60fcb5935 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.458903 Oct 31 15:33:59.326344 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1813/3806] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:33:58 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:33:59.331658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:59.337458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-73ec2f36-ef80-44f6-bf1b-f8d0feab6ffc req-ac4ec742-377c-4882-8194-c1b9cacb990a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d", "tag": "972c2cca-3e9c-4179-ab61-2d3b1cac598b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:33:59.343426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.343915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.344379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.372501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73ec2f36-ef80-44f6-bf1b-f8d0feab6ffc req-ac4ec742-377c-4882-8194-c1b9cacb990a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.376640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73ec2f36-ef80-44f6-bf1b-f8d0feab6ffc req-ac4ec742-377c-4882-8194-c1b9cacb990a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.377945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73ec2f36-ef80-44f6-bf1b-f8d0feab6ffc req-ac4ec742-377c-4882-8194-c1b9cacb990a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.400775 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-73ec2f36-ef80-44f6-bf1b-f8d0feab6ffc req-ac4ec742-377c-4882-8194-c1b9cacb990a service nova] Creating event network-changed:972c2cca-3e9c-4179-ab61-2d3b1cac598b for instance cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d on n-h2-858384-17 Oct 31 15:33:59.409874 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-73ec2f36-ef80-44f6-bf1b-f8d0feab6ffc req-ac4ec742-377c-4882-8194-c1b9cacb990a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076182 Oct 31 15:33:59.410986 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1814/3807] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:33:59.416358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:59.417271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:59.424918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.425663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.426290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.427141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.438539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.439416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.792613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:33:59.810389 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2dcfb485-9e19-4c23-ae71-436aba822313 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1320 microversion: 2.1 time: 0.397945 Oct 31 15:33:59.825556 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1815/3808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:59 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1320 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:33:59.833168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:59.833796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] [instance: e38eb051-6410-4f8b-a4d6-19da70665a57] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:59.850583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.851189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.851813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.852505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.852980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.869071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] HTTP exception thrown: Instance e38eb051-6410-4f8b-a4d6-19da70665a57 could not be found. Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Request method failure captured: Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 HTTP/1.1 Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-mPAZq-02OTEsnv8GMkJRDJDL-rAJdgEJHn39ABJutgfh2_1AZN2oCBsrYt27l5tKBr9RG945Kyk--1kSEQ-akNiYprUFz_R7VxoVIJfbKRGxwgEKLAB8nUjvzWuTNL6KRyvhFuZKw3wxu_FY2qhzM7Zf-aduk3Wugzl7BHJI8VXXg Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9275c27ad1ac40568e4dbc778857d333", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9275c27ad1ac40568e4dbc778857d333"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9275c27ad1ac40568e4dbc778857d333"}]}] Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 9275c27ad1ac40568e4dbc778857d333 Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1629119123 Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: b56e2ca778b04f7c9fc7590faacb4c1a Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1629119123-project Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance e38eb051-6410-4f8b-a4d6-19da70665a57 could not be found. Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'e38eb051-6410-4f8b-a4d6-19da70665a57'} Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38eb051-6410-4f8b-a4d6-19da70665a57 could not be found. Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:33:59.898636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38eb051-6410-4f8b-a4d6-19da70665a57 could not be found. Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38eb051-6410-4f8b-a4d6-19da70665a57 could not be found. Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] Returning 404 to user: Instance e38eb051-6410-4f8b-a4d6-19da70665a57 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f221bf3e-b6b2-4f0f-8a96-0e4cc979b8fe tempest-ServerRescueNegativeTestJSON-1629119123 tempest-ServerRescueNegativeTestJSON-1629119123-project] 10.222.0.20 "GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57" status: 404 len: 111 microversion: 2.1 time: 0.067831 Oct 31 15:33:59.901538 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1816/3809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:59 2022] GET /compute/v2.1/servers/e38eb051-6410-4f8b-a4d6-19da70665a57 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:33:59.917420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:33:59.917967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:33:59.939606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.940122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.940568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:33:59.941377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:33:59.941857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:33:59.942297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.251139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b30aeacb-349b-4152-bc9d-9abe9119c3f6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.352106 Oct 31 15:34:00.251682 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1994/3810] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 31 15:33:58 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:00.282409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:00.289728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:00.294645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1291723115', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:00.313762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:00.315153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.315838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.316833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.317905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.318564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.328679 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fb66babb-78a9-4e8c-866e-f310f0a46be8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1535 microversion: 2.1 time: 0.422129 Oct 31 15:34:00.329653 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1817/3811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:33:59 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1535 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:00.335495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.341273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:00.341907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:00.358074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.359230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.359926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.360407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.360878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.361338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.556879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:00.675455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:00.682920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.691527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.692261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.918871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:00.934717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:00.937110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:00.942034 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-991bf381-faf9-4337-bc5a-b43b17be1652 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.606833 Oct 31 15:34:00.958269 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1818/3812] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:00 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:00.966503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:00.970176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:00.976759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.977609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.978276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:00.979244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:00.980038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:00.980721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:01.254317 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d97a9579-87ce-415b-9558-c4223a4bc9f2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1291723115" status: 200 len: 1515 microversion: 2.1 time: 0.976376 Oct 31 15:34:01.266148 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1995/3813] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:34:00 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1291723115 => generated 1515 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:01.287209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:01.298145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:01.299039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:01.312939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:01.313515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:01.313997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:01.314779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:01.315248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:01.315674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:01.455090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:01.627799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:01.644142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:01.644636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:01.645075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:01.987316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:02.000132 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8513a417-d5f5-4157-8201-9984e8655b57 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1320 microversion: 2.1 time: 1.039628 Oct 31 15:34:02.001177 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1819/3814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:00 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1320 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:02.006557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:02.008443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:02.015673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.017033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.018880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.019937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.021541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.022655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.243950 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b24d5fd-0f11-4aec-b877-a363126bf36a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.962670 Oct 31 15:34:02.246551 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1996/3815] 10.222.0.20 () {58 vars in 1173 bytes} [Mon Oct 31 15:34:01 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:02.251115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3c0fc687-1f7f-4be2-8a56-bb1f62dff017 req-f8617b19-0eff-4a2b-9f37-64a84f3a1107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38eb051-6410-4f8b-a4d6-19da70665a57", "name": "network-vif-deleted", "tag": "9ecfc92a-e2cd-40fc-81ca-477cef1fa879"}, {"name": "network-changed", "server_uuid": "1a1d5920-53d9-4a92-a425-fa5b05188607", "tag": "0f659744-e2ea-4c48-aa1a-d1a62adc94e0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:02.279103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3c0fc687-1f7f-4be2-8a56-bb1f62dff017 req-f8617b19-0eff-4a2b-9f37-64a84f3a1107 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.286063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3c0fc687-1f7f-4be2-8a56-bb1f62dff017 req-f8617b19-0eff-4a2b-9f37-64a84f3a1107 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.286809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3c0fc687-1f7f-4be2-8a56-bb1f62dff017 req-f8617b19-0eff-4a2b-9f37-64a84f3a1107 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.317970 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3c0fc687-1f7f-4be2-8a56-bb1f62dff017 req-f8617b19-0eff-4a2b-9f37-64a84f3a1107 service nova] Creating event network-vif-deleted:9ecfc92a-e2cd-40fc-81ca-477cef1fa879 for instance e38eb051-6410-4f8b-a4d6-19da70665a57 on n-h2-858384-17 Oct 31 15:34:02.318844 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3c0fc687-1f7f-4be2-8a56-bb1f62dff017 req-f8617b19-0eff-4a2b-9f37-64a84f3a1107 service nova] Creating event network-changed:0f659744-e2ea-4c48-aa1a-d1a62adc94e0 for instance 1a1d5920-53d9-4a92-a425-fa5b05188607 on n-h2-858384-17 Oct 31 15:34:02.328642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-3c0fc687-1f7f-4be2-8a56-bb1f62dff017 req-f8617b19-0eff-4a2b-9f37-64a84f3a1107 service nova] Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:34:02.346084 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3c0fc687-1f7f-4be2-8a56-bb1f62dff017 req-f8617b19-0eff-4a2b-9f37-64a84f3a1107 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.099652 Oct 31 15:34:02.346715 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1997/3816] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:02.353389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:02.355169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:02.387630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.388134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.388620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.389507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.390220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.390715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.468588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:02.477527 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c07d8096-3263-42f1-a5ba-163b4188f907 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1535 microversion: 2.1 time: 0.475139 Oct 31 15:34:02.486326 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1820/3817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:02 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1535 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:02.491466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:02.503311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:02.509860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.servers [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Removing options 'limit' from query {{(pid=120588) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:34:02.511118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:02.520197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.525827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.526471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.527374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.527893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.528377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.601964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:02.610588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:02.611088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:02.611529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:02.829434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:02.840041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:02.849180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:02.850471 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6938e212-b26f-444d-bded-d76418a8a5b8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.502027 Oct 31 15:34:02.861775 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1998/3818] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:02 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:03.024170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.025063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:03.032179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:03.046759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.047271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.047718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.048444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.048905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.049362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.100362 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f6ff3980-094e-4967-bab3-f1bc252793ed tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.612700 Oct 31 15:34:03.101834 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1821/3819] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 15:34:02 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:03.129850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.141098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:03.144413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:03.158657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.159971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.161259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.162939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.163650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.164511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.210342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:03.275650 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-927703ac-881c-4572-9da5-ebf1a12aca6a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.152539 Oct 31 15:34:03.276608 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1822/3820] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:03.291663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.299666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:03.300111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.servers [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Removing options 'limit' from query {{(pid=120588) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:34:03.300981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:03.306526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.306995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.307428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.308296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.310802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.310802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.346830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:03.385521 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c800938d-1c49-46bd-aa90-5bcd7736358a tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.098427 Oct 31 15:34:03.386125 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1823/3821] 10.222.0.20 () {58 vars in 1150 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:03.400012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.407567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:03.408235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:03.414132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.414616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.415050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.415771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.416227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.416649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.450166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:03.486868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dffd1201-f30d-4150-bff9-385c89969571 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.090811 Oct 31 15:34:03.487805 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1824/3822] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers => generated 1010 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:03.502941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.508706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:03.509416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:03.521697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.522252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.522700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.523442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.523903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.524336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.687924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:03.769357 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4de73d7-c6d8-40e2-8bf2-a7f8d6007dc6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.270135 Oct 31 15:34:03.770294 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1825/3823] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:34:03.775201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:03.775813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:03.784038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.785162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.785709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.786466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:03.786939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:03.787373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:03.985720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:03.995530 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e2e09d92-faaa-4428-865a-598cbe4506d9 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1535 microversion: 2.1 time: 0.224149 Oct 31 15:34:04.012350 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1826/3824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1535 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:04.020996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:04.027757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:04.028583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.servers [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Removing options 'limit' from query {{(pid=120588) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:34:04.029836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:04.037053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.037840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.038382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.039388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.040049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.040741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.064300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:04.083693 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0104dfed-30b3-4026-a1ee-76225ff8f03a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1320 microversion: 2.1 time: 1.063646 Oct 31 15:34:04.088880 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 1999/3825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1320 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:04.097616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:04.112924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:04.126212 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fed9bfcd-9933-4582-b8bc-5727511da129 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.128006 Oct 31 15:34:04.131156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.135954 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1827/3826] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 31 15:34:03 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:04.141337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bfb9c11e-c75c-4751-a02b-777213d06299 req-377fa209-d6cc-4bb9-bf60-121f9b361a7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923d2969-f29d-4087-bfdd-56c4c438352d", "name": "network-vif-plugged", "status": "completed", "tag": "0347eb4e-7425-4515-b2ea-b48b93ff05ea"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:04.142995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.143733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.144636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.147140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.147888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.163944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:04.184553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfb9c11e-c75c-4751-a02b-777213d06299 req-377fa209-d6cc-4bb9-bf60-121f9b361a7c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.185454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfb9c11e-c75c-4751-a02b-777213d06299 req-377fa209-d6cc-4bb9-bf60-121f9b361a7c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.186167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfb9c11e-c75c-4751-a02b-777213d06299 req-377fa209-d6cc-4bb9-bf60-121f9b361a7c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.219961 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bfb9c11e-c75c-4751-a02b-777213d06299 req-377fa209-d6cc-4bb9-bf60-121f9b361a7c service nova] Creating event network-vif-plugged:0347eb4e-7425-4515-b2ea-b48b93ff05ea for instance 923d2969-f29d-4087-bfdd-56c4c438352d on n-h1-858384-17 Oct 31 15:34:04.236453 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bfb9c11e-c75c-4751-a02b-777213d06299 req-377fa209-d6cc-4bb9-bf60-121f9b361a7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098767 Oct 31 15:34:04.237248 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1828/3827] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:04.242438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:04.249764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:04.250510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1291723115', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:04.256739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.257292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.257723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.258829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.259477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.259904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.400526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:04.566307 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a4b256d4-d155-4f6e-ade9-274ba3265ffb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1291723115" status: 200 len: 346 microversion: 2.1 time: 0.327821 Oct 31 15:34:04.567081 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1829/3828] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:34:04 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1291723115 => generated 346 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:04.584612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de84e36b-aa6d-488d-bcfe-acf602e739bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:04.606511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de84e36b-aa6d-488d-bcfe-acf602e739bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.607233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de84e36b-aa6d-488d-bcfe-acf602e739bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.607794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de84e36b-aa6d-488d-bcfe-acf602e739bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.800877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de84e36b-aa6d-488d-bcfe-acf602e739bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Going to try to stop instance {{(pid=120588) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:34:04.861498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:04.900256 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de84e36b-aa6d-488d-bcfe-acf602e739bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "POST /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f/action" status: 202 len: 0 microversion: 2.1 time: 0.324178 Oct 31 15:34:04.901033 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1830/3829] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:34:04 2022] POST /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:34:04.913508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:04.914106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:04.930650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.931265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.931831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:04.932608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:04.934388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:04.934731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.237032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:05.253454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:05.254908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:05.258465 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21d48eee-f3e8-41d7-96d2-c228665d762b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 1.167170 Oct 31 15:34:05.262097 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2000/3830] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:04 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:05.267936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:05.275574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:05.305568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.306087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.312415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.313549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.315360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.316759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.544299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:05.627506 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0caaa54-a761-41e5-8085-bcd9923794f0 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1522 microversion: 2.1 time: 0.718236 Oct 31 15:34:05.636370 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1831/3831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:04 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1522 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:05.648935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:05.667207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:05.678348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.679019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.679626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:05.682950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:05.683570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:05.684141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.098233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:06.117587 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2615c89f-c598-4bad-8491-298d60ae0b4a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1528 microversion: 2.1 time: 0.854204 Oct 31 15:34:06.118306 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2001/3832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:05 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1528 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:06.150001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:06.151018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:06.157578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.158643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.159364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.160232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.160969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.161744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.284831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:06.305109 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bbe3d4b1-8681-4d9d-9e35-c10a54e2d6af tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1320 microversion: 2.1 time: 0.666590 Oct 31 15:34:06.305925 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1832/3833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:05 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1320 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:06.312208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:06.313559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:06.324928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.325665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.327788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.328935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.329651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.330244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.887898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:06.913034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:06.914838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:06.918703 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14e8da9e-42dc-49c6-87fa-f23ee6b9e5f6 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.611684 Oct 31 15:34:06.922924 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1833/3834] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:06 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:06.946964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:06.947823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:06.957905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.958628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.959253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:06.960383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:06.961027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:06.962414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.240380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:07.261044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35c163cc-6478-4a86-9c57-826f6374ef43 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1528 microversion: 2.1 time: 1.116416 Oct 31 15:34:07.261803 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2002/3835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:06 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1528 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:07.289050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fae0aff3-fcca-4651-8fb1-cac73fa7dcbc tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:07.297347 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-fae0aff3-fcca-4651-8fb1-cac73fa7dcbc tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] HTTP exception thrown: Flavor 3efc2580-9540-4dec-95e5-3c22e44af6d3 could not be found. Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fae0aff3-fcca-4651-8fb1-cac73fa7dcbc tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Request method failure captured: Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/flavors/3efc2580-9540-4dec-95e5-3c22e44af6d3 HTTP/1.1 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-n9Ot1gCULTAkipmRtC6YsMFDI1xZJZKgGeghIcweYqQSWXAOVM85oppogDsFVFoahQbB-6ETTv9aQa_qQLzw8VcRKxYrkcpDB4bVUfJ369A22-T-prSBmz37lBUFHywXyQuV5tj-lMV2YZqIQTJWb2LCklMSa6f5NBtFCc5Fwf-BY Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: ab796477ef0c4239b1d64e1efd2dfbf5 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-MigrationsAdminTest-869982199 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab796477ef0c4239b1d64e1efd2dfbf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ab796477ef0c4239b1d64e1efd2dfbf5", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ab796477ef0c4239b1d64e1efd2dfbf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ab796477ef0c4239b1d64e1efd2dfbf5"}]}] Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-MigrationsAdminTest-869982199 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: ab796477ef0c4239b1d64e1efd2dfbf5 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-MigrationsAdminTest-869982199 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-MigrationsAdminTest-869982199-project-admin Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 6e11767fcd8c4fb0b0076cf738c16823 Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-MigrationsAdminTest-869982199-project-admin Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: exception: Flavor 3efc2580-9540-4dec-95e5-3c22e44af6d3 could not be found. Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '3efc2580-9540-4dec-95e5-3c22e44af6d3'} Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 3efc2580-9540-4dec-95e5-3c22e44af6d3 could not be found. Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 3efc2580-9540-4dec-95e5-3c22e44af6d3 could not be found. Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.316313 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:07.319741 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.319741 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:07.319741 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:07.319741 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:07.319741 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:07.319741 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:07.319741 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 3efc2580-9540-4dec-95e5-3c22e44af6d3 could not be found. Oct 31 15:34:07.319741 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:07.321038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fae0aff3-fcca-4651-8fb1-cac73fa7dcbc tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Returning 404 to user: Flavor 3efc2580-9540-4dec-95e5-3c22e44af6d3 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:07.322512 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fae0aff3-fcca-4651-8fb1-cac73fa7dcbc tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/3efc2580-9540-4dec-95e5-3c22e44af6d3" status: 404 len: 109 microversion: 2.1 time: 0.037866 Oct 31 15:34:07.323664 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2003/3836] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:07 2022] DELETE /compute/v2.1/flavors/3efc2580-9540-4dec-95e5-3c22e44af6d3 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:07.359226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:07.375283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:07.389242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.393736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.395531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.398557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:07.399288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:07.401334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:07.480079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:07.493213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fcec4981-cdb9-4bde-8081-d33225c920b1 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1522 microversion: 2.1 time: 0.568963 Oct 31 15:34:07.505956 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1834/3837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:06 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1522 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:07.548661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1658277681", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:07.644575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:34:08.216600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:08.235560 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d6a79a8-0779-47a8-8412-f1d6b1c883ee tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 200 len: 1507 microversion: 2.1 time: 0.893597 Oct 31 15:34:08.236971 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2004/3838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:07 2022] GET /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 1507 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:08.252352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:08.257776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:08.274291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.275125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.275861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.276786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.277475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.278432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.290508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:08.291103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:08.291399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:08.291813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:08.292226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:08.317400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.318296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.318949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.321016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.323039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.323618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.368046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:08.386976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Getting quotas for user 4df669ecccf24e8e9b41574f29ba157b and project 34b23d8ffada4f7b9b839976bc376bc4. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:08.389058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:08.416013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:08.420140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:08.522973 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-966b59e6-008d-4181-a403-d4578b6cf6ce tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.976071 Oct 31 15:34:08.530518 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1835/3839] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:34:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:34:08.535545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:08.536165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:08.558415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.561043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.562436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.563551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:08.564242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:08.565013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:08.935376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:08.947160 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8542754d-b637-4ef1-b8fa-103a73ecaada tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d" status: 200 len: 1320 microversion: 2.1 time: 0.415421 Oct 31 15:34:08.951604 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1836/3840] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:08 2022] GET /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:08.967008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:08.968216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:09.002124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.002635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.003078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.003807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.004266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.009561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.441422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:09.451420 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4dbb57c-92fc-4eca-b8e1-79ba2f4d349e tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1522 microversion: 2.1 time: 0.491361 Oct 31 15:34:09.454713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1837/3841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:08 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:09.465355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-999efbf6-6ea3-45e0-bf83-fc6049a60229 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:09.469097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-999efbf6-6ea3-45e0-bf83-fc6049a60229 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:09.513020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:09.529281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:09.552394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:09.558793 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a3dea26-ed77-47a1-a06e-1506e0fbbe16 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 1.320294 Oct 31 15:34:09.563933 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2005/3842] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:08 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:09.579966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6f5fabb9-3917-42f6-8b95-2d60e434bfde req-8e3f6330-89c1-40d9-a0c4-ace34dcb1b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d", "name": "network-vif-plugged", "status": "completed", "tag": "972c2cca-3e9c-4179-ab61-2d3b1cac598b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:09.629497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6f5fabb9-3917-42f6-8b95-2d60e434bfde req-8e3f6330-89c1-40d9-a0c4-ace34dcb1b3c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.630168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6f5fabb9-3917-42f6-8b95-2d60e434bfde req-8e3f6330-89c1-40d9-a0c4-ace34dcb1b3c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.633456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6f5fabb9-3917-42f6-8b95-2d60e434bfde req-8e3f6330-89c1-40d9-a0c4-ace34dcb1b3c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.681226 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6f5fabb9-3917-42f6-8b95-2d60e434bfde req-8e3f6330-89c1-40d9-a0c4-ace34dcb1b3c service nova] Creating event network-vif-plugged:972c2cca-3e9c-4179-ab61-2d3b1cac598b for instance cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d on n-h2-858384-17 Oct 31 15:34:09.701641 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6f5fabb9-3917-42f6-8b95-2d60e434bfde req-8e3f6330-89c1-40d9-a0c4-ace34dcb1b3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129788 Oct 31 15:34:09.708423 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2006/3843] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:09.752945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:09.757116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:09.779672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.780906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.781578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.782538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:09.783274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:09.784003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:09.902824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-999efbf6-6ea3-45e0-bf83-fc6049a60229 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:09.931515 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-999efbf6-6ea3-45e0-bf83-fc6049a60229 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1213 microversion: 2.1 time: 0.475524 Oct 31 15:34:09.932758 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1838/3844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:09 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1213 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:09.979438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:09.980465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:10.009070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.010311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.010939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.016761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.017720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.019321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.371475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:10.385077 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5a30a14f-f5f7-412b-86e7-5b56e25daed3 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d" status: 200 len: 1320 microversion: 2.1 time: 0.414224 Oct 31 15:34:10.393428 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1839/3845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:09 2022] GET /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d => generated 1320 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:10.480948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:10.481697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:10.488808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.489800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.491629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.493551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.495713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.496418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.765571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:10.777439 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-749d8b59-5784-46ff-83c7-1b5f1ad32b12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 1.067178 Oct 31 15:34:10.794028 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2007/3846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:09 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:10.802359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:10.803243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:10.816011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.816750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.817403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:10.818281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:10.818879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:10.819438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.178518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.189621 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b37ba23-af19-42ac-a3a0-234ec32f178f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1499 microversion: 2.1 time: 0.713519 Oct 31 15:34:11.190230 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1840/3847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:10 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1499 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:11.196508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a9818038-f6a1-4bb8-843c-a47d9e25fcfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2044053108"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:11.199047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a9818038-f6a1-4bb8-843c-a47d9e25fcfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:11.205942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9818038-f6a1-4bb8-843c-a47d9e25fcfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.206640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9818038-f6a1-4bb8-843c-a47d9e25fcfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.207467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9818038-f6a1-4bb8-843c-a47d9e25fcfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.208383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9818038-f6a1-4bb8-843c-a47d9e25fcfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.209149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9818038-f6a1-4bb8-843c-a47d9e25fcfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.209827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9818038-f6a1-4bb8-843c-a47d9e25fcfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.390407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:11.419350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.432529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.434285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.435562 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7a8cf60-0639-47e8-b30c-4d8ee60e0ae0 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.640480 Oct 31 15:34:11.437285 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2008/3848] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:10 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:11.458198 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a9818038-f6a1-4bb8-843c-a47d9e25fcfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.265179 Oct 31 15:34:11.458890 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1841/3849] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:34:11 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 31 15:34:11.463149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:11.463923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:11.465706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:11.472267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.472831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.472963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.473703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.474215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:11.474621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.475204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.475731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.482007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.483065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.483714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.484601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.485235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.485835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.517763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:11.556272 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ba24121-bca0-475d-849a-f14245d10fcb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.095952 Oct 31 15:34:11.557432 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1842/3850] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Oct 31 15:34:11 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:11.570006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:11.570006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:11.576004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.576489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.577564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.578211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.578830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.579683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.623617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:11.642699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.651066 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0ebfbc92-8fc9-47e0-8e74-dfe0d0ae1067 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1265 microversion: 2.1 time: 0.199861 Oct 31 15:34:11.652563 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2009/3851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:11 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:11.658124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:11.658961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:11.665475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.667317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.667932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.668785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.669492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.669802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.801709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:11.810518 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d257c06b-2107-443e-b2a1-b38f2c32542d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d" status: 200 len: 1320 microversion: 2.1 time: 0.251623 Oct 31 15:34:11.816962 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1843/3852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:11 2022] GET /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d => generated 1320 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:11.822384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6fb7665a-37c7-4d69-bf4f-e627c30f3aff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:11.832757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb7665a-37c7-4d69-bf4f-e627c30f3aff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.841529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb7665a-37c7-4d69-bf4f-e627c30f3aff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.842168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb7665a-37c7-4d69-bf4f-e627c30f3aff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.885728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6fb7665a-37c7-4d69-bf4f-e627c30f3aff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Going to try to start instance {{(pid=120588) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:34:11.955083 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6fb7665a-37c7-4d69-bf4f-e627c30f3aff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "POST /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f/action" status: 202 len: 0 microversion: 2.1 time: 0.134498 Oct 31 15:34:11.956492 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1844/3853] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:34:11 2022] POST /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:34:11.965108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4d84d16f-36f4-416a-817a-1f93ce3f5469 req-479369ac-1301-4462-8ed2-8ee2b26746b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d5920-53d9-4a92-a425-fa5b05188607", "name": "network-vif-plugged", "status": "completed", "tag": "0f659744-e2ea-4c48-aa1a-d1a62adc94e0"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:11.978082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4d84d16f-36f4-416a-817a-1f93ce3f5469 req-479369ac-1301-4462-8ed2-8ee2b26746b6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:11.978827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4d84d16f-36f4-416a-817a-1f93ce3f5469 req-479369ac-1301-4462-8ed2-8ee2b26746b6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:11.979417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4d84d16f-36f4-416a-817a-1f93ce3f5469 req-479369ac-1301-4462-8ed2-8ee2b26746b6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:11.994737 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4d84d16f-36f4-416a-817a-1f93ce3f5469 req-479369ac-1301-4462-8ed2-8ee2b26746b6 service nova] Creating event network-vif-plugged:0f659744-e2ea-4c48-aa1a-d1a62adc94e0 for instance 1a1d5920-53d9-4a92-a425-fa5b05188607 on n-h2-858384-17 Oct 31 15:34:12.001276 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4d84d16f-36f4-416a-817a-1f93ce3f5469 req-479369ac-1301-4462-8ed2-8ee2b26746b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042755 Oct 31 15:34:12.002677 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1845/3854] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:12.010958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:12.011896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:12.020028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.020758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.021258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.021976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.022474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.022903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.430717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:12.449442 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f0df681-32cb-46fe-949b-1a1fb1c84de2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.795676 Oct 31 15:34:12.453660 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2010/3855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:11 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:12.468182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:12.469085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:12.480476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.481281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.485593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.486916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.487951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.489418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.528392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:12.539282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:12.542102 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-faa58ef6-6f33-421d-98d8-faa8bb106ff9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1508 microversion: 2.1 time: 0.538039 Oct 31 15:34:12.543208 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1846/3856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:12 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1508 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:12.676879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:12.677527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:12.694491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.695108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.695556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.701168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.702010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.702940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.880259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:12.892503 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e50ea2b-c50c-4877-9439-640512fad20a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1271 microversion: 2.1 time: 0.219499 Oct 31 15:34:12.892979 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1847/3857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:12 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:12.899849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:12.901296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:12.910111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.910774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.911389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:12.912275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:12.912735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:12.913174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.002899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:13.013434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:13.015429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:13.016597 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-880c0afd-63d1-4170-907f-03d64e9e26ed tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.553058 Oct 31 15:34:13.017654 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2011/3858] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:12 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:13.356197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:13.367708 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d86801a3-3f49-4005-bad0-25eb81b032e4 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d" status: 200 len: 1508 microversion: 2.1 time: 0.473612 Oct 31 15:34:13.383657 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1848/3859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:12 2022] GET /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d => generated 1508 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:13.400808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:13.401588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:13.414925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.417848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.419064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.427497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.428703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.429557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.468799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:13.477680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:13.478823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:13.492324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.494767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.495339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.499928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.500690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.501277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.590209 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03e99fc6-1fc3-4a51-ad37-874da72d48fa tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d" status: 204 len: 0 microversion: 2.1 time: 0.199670 Oct 31 15:34:13.591415 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2012/3860] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:13 2022] DELETE /compute/v2.1/servers/cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:13.599536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:13.600771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:13.609888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.610698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.611281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:13.612469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:13.613198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:13.613867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.057583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:14.069766 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0b603d1-6de1-4bb0-9d54-5e141726366e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1687 microversion: 2.1 time: 0.596013 Oct 31 15:34:14.071202 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1849/3861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:13 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1687 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:14.090353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:14.092967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:14.100882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:14.102200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.102946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.103583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.104507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.105277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.106414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.108996 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6dc3dcb2-8c35-48a3-b7a6-21d66ae0d388 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1508 microversion: 2.1 time: 0.515221 Oct 31 15:34:14.113857 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2013/3862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:13 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1508 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:14.122755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:14.123365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:14.137964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.138680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.141856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.142778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.143464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.144091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.156423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: 923d2969-f29d-4087-bfdd-56c4c438352d] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:14.303295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-74b080e1-ab2a-4dfe-8ef9-bf4e86733744 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d" status: 204 len: 0 microversion: 2.1 time: 0.230616 Oct 31 15:34:14.303910 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1850/3863] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:14 2022] DELETE /compute/v2.1/servers/923d2969-f29d-4087-bfdd-56c4c438352d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:14.334120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:14.335225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2ad6241e-024c-49a5-aabd-675b96a4f64d req-979a0236-33d3-424a-9443-0165edc4fc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "name": "network-vif-unplugged", "status": "completed", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:14.349239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5573ddb-0c56-484a-b632-842a461066fe tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1271 microversion: 2.1 time: 0.234140 Oct 31 15:34:14.350430 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2014/3864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:14 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:14.362101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:14.367256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:14.367765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2ad6241e-024c-49a5-aabd-675b96a4f64d req-979a0236-33d3-424a-9443-0165edc4fc75 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.368276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2ad6241e-024c-49a5-aabd-675b96a4f64d req-979a0236-33d3-424a-9443-0165edc4fc75 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.368716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2ad6241e-024c-49a5-aabd-675b96a4f64d req-979a0236-33d3-424a-9443-0165edc4fc75 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.377420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.377906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.378342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.379032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:14.379501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:14.379920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:14.388588 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2ad6241e-024c-49a5-aabd-675b96a4f64d req-979a0236-33d3-424a-9443-0165edc4fc75 service nova] Creating event network-vif-unplugged:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:34:14.397836 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2ad6241e-024c-49a5-aabd-675b96a4f64d req-979a0236-33d3-424a-9443-0165edc4fc75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082794 Oct 31 15:34:14.399061 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1851/3865] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:14.487495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-735180206", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "28f27807-ff21-47ea-b360-5363a5bebb1e"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:14.558032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] validate_networks() for [('28f27807-ff21-47ea-b360-5363a5bebb1e', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:34:14.885726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:14.899698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:14.901429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:14.905777 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5e80faca-f1d4-4901-a76e-f75586d2fc6c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.553435 Oct 31 15:34:14.912530 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2015/3866] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:14 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:15.094499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:15.095273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:15.103118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.104069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.104863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.105883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.107203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.108950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.603262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:15.603942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:15.606889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:15.606889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:15.606889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:15.626297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.626970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.629221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.630079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.632895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.633473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.681556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Getting quotas for project 32923016858e4585b6971ab42387f5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:15.693166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:15.699749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:15.708922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Getting quotas for user baff39dd91e34a559a81922f2ecff1c5 and project 32923016858e4585b6971ab42387f5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:15.709801 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cbacc2aa-dbf5-4281-8722-55715c9a9079 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1687 microversion: 2.1 time: 0.619250 Oct 31 15:34:15.710791 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2016/3867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:15 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1687 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:15.715987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:15.716797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:15.732764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Going to run 2 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:15.736221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.736726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.737197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.737588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: ea70cd07-d395-49c9-9ef8-6f8a3c0091b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:15.738282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.738887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.744963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.785352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=ea70cd07-d395-49c9-9ef8-6f8a3c0091b3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:15.878210 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03dac68e-6880-4249-987e-5cdbf46e7654 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.396456 Oct 31 15:34:15.879880 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1852/3868] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:34:14 2022] POST /compute/v2.1/servers => generated 32 bytes in 1399 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 31 15:34:15.886719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:15.887810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:15.923552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.924458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.926105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:15.928584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:15.930398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:15.934899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:16.451177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:16.487655 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-325842a1-1a77-4624-aa9b-d918a539d465 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1508 microversion: 2.1 time: 0.765035 Oct 31 15:34:16.488683 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2017/3869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:15 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1508 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:16.493462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:16.498243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:16.507997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Searching by: {'deleted': False, 'project_id': '32923016858e4585b6971ab42387f5ae'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:16.530790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:16.531508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:16.531951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:16.532679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:16.533153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:16.533598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:16.600563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:16.696119 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dcfb4ffa-faf1-4619-b5c6-6732f5ff8362 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.206131 Oct 31 15:34:16.700626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2018/3870] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:34:16 2022] GET /compute/v2.1/servers => generated 1335 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:16.716248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:16.717215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:16.735480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:16.739100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:16.740934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:16.743656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:16.745997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:16.747717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:17.811681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:17.821645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a48255dc-59b2-4476-8e79-da781dfb7610 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1313 microversion: 2.1 time: 1.940164 Oct 31 15:34:17.826027 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1853/3871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:15 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1313 bytes in 1945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:17.839738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:17.840753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:17.855563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:17.861876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:17.862560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:17.863494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:17.864183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:17.864822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:18.142886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:18.152658 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-001eff7e-a255-4aa3-9d8f-1d145c9213dc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1213 microversion: 2.1 time: 0.323839 Oct 31 15:34:18.171815 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1854/3872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:17 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1213 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:18.183216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:18.186666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:18.201057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:18.202289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:18.204487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:18.207304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:18.207993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:18.209781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:18.394624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:18.412472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:18.430053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:18.433646 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9620cc65-d873-4b9c-9b63-df1b72e3eebe tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 1.729429 Oct 31 15:34:18.434267 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2019/3873] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:16 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:18.460100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c73e9725-e9a7-4bdb-a000-9e063282cea4 req-9db730cf-0478-4b98-bdff-f1a462a56a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "name": "network-vif-plugged", "status": "completed", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:18.496551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c73e9725-e9a7-4bdb-a000-9e063282cea4 req-9db730cf-0478-4b98-bdff-f1a462a56a83 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:18.499533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c73e9725-e9a7-4bdb-a000-9e063282cea4 req-9db730cf-0478-4b98-bdff-f1a462a56a83 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:18.499978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c73e9725-e9a7-4bdb-a000-9e063282cea4 req-9db730cf-0478-4b98-bdff-f1a462a56a83 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:18.536098 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c73e9725-e9a7-4bdb-a000-9e063282cea4 req-9db730cf-0478-4b98-bdff-f1a462a56a83 service nova] Creating event network-vif-plugged:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:34:18.551804 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c73e9725-e9a7-4bdb-a000-9e063282cea4 req-9db730cf-0478-4b98-bdff-f1a462a56a83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111159 Oct 31 15:34:18.554443 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2020/3874] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:18.587439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:18.604514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:18.646540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:18.650532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:18.653875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:18.674644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:18.675281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:18.675753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:19.099490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:19.116570 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25ef98b9-8fdf-47bb-883d-d432213039bc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 0.939106 Oct 31 15:34:19.117599 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1855/3875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:18 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:19.129306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:19.130153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:19.143582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:19.145027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:19.147377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:19.149028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:19.153887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:19.154514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:19.747588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:19.768294 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5607f9a8-f90f-49b2-ae9b-83d66c60d3b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1512 microversion: 2.1 time: 1.209933 Oct 31 15:34:19.770723 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2021/3876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:18 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1512 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:19.801875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:19.809616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:19.840859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:19.841526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:19.849524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:19.851579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:19.853925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:19.858981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:20.108052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:20.124573 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d79bcfdc-bf56-4f3e-b006-dc54584ab9f5 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1269 microversion: 2.1 time: 0.351005 Oct 31 15:34:20.136980 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2022/3877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:19 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1269 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:20.154384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9063e618-512d-4d3a-b9ef-b0d908d05c04 req-ad9a4634-0e10-41b8-acd4-9f740f58f7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "923d2969-f29d-4087-bfdd-56c4c438352d", "name": "network-vif-deleted", "tag": "0347eb4e-7425-4515-b2ea-b48b93ff05ea"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:20.178334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9063e618-512d-4d3a-b9ef-b0d908d05c04 req-ad9a4634-0e10-41b8-acd4-9f740f58f7f7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:20.179574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9063e618-512d-4d3a-b9ef-b0d908d05c04 req-ad9a4634-0e10-41b8-acd4-9f740f58f7f7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:20.180752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9063e618-512d-4d3a-b9ef-b0d908d05c04 req-ad9a4634-0e10-41b8-acd4-9f740f58f7f7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:20.197741 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9063e618-512d-4d3a-b9ef-b0d908d05c04 req-ad9a4634-0e10-41b8-acd4-9f740f58f7f7 service nova] Creating event network-vif-deleted:0347eb4e-7425-4515-b2ea-b48b93ff05ea for instance 923d2969-f29d-4087-bfdd-56c4c438352d on n-h1-858384-17 Oct 31 15:34:20.205633 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9063e618-512d-4d3a-b9ef-b0d908d05c04 req-ad9a4634-0e10-41b8-acd4-9f740f58f7f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066788 Oct 31 15:34:20.206766 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2023/3878] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:20.213413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:20.214560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:20.221658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:20.222836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:20.223505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:20.224568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:20.225286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:20.225975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:20.835568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:20.865170 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7437034-2a43-4890-98f5-e976c31ccfc1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1313 microversion: 2.1 time: 1.737447 Oct 31 15:34:20.865833 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1856/3879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:19 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1313 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:20.885823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:20.891312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:20.891807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.servers [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Removing options 'limit' from query {{(pid=120588) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:34:20.892613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:20.893760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:20.894272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:20.911901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:20.917993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:20.918795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:20.919422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:20.922065 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c262d9b8-e863-4e77-84ff-7f0dc8ec61ad tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.054218 Oct 31 15:34:20.941929 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1857/3880] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 31 15:34:20 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:34:20.947408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:20.948249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:20.955365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:20.956174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:20.956785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:20.957997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:20.958611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:20.959213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:21.284024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:21.303615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:21.306685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:21.309002 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a013b88c-86bd-4daf-8e52-995dc2882890 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 1.100215 Oct 31 15:34:21.310139 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2024/3881] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:20 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:21.326079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-864da1d2-0ca4-4d03-baa2-9ef23079bee7 req-0fa7320c-de54-4fe8-980c-77164011e36c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d", "name": "network-vif-unplugged", "status": "completed", "tag": "972c2cca-3e9c-4179-ab61-2d3b1cac598b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:21.347286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-864da1d2-0ca4-4d03-baa2-9ef23079bee7 req-0fa7320c-de54-4fe8-980c-77164011e36c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:21.348040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-864da1d2-0ca4-4d03-baa2-9ef23079bee7 req-0fa7320c-de54-4fe8-980c-77164011e36c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:21.348708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-864da1d2-0ca4-4d03-baa2-9ef23079bee7 req-0fa7320c-de54-4fe8-980c-77164011e36c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:21.372309 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-864da1d2-0ca4-4d03-baa2-9ef23079bee7 req-0fa7320c-de54-4fe8-980c-77164011e36c service nova] Creating event network-vif-unplugged:972c2cca-3e9c-4179-ab61-2d3b1cac598b for instance cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d on n-h2-858384-17 Oct 31 15:34:21.389594 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-864da1d2-0ca4-4d03-baa2-9ef23079bee7 req-0fa7320c-de54-4fe8-980c-77164011e36c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065515 Oct 31 15:34:21.390505 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2025/3882] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:21.397150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:21.400083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:21.426061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:21.426564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:21.427496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:21.428221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:21.429191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:21.429731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:21.554249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:21.578945 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf3fdda8-9e5d-47ba-a1af-7c6870cf26d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 0.635512 Oct 31 15:34:21.589807 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1858/3883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:20 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:21.612504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:21.614947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:21.634915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:21.635893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:21.636575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:21.637486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:21.638438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:21.639167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:22.052555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:22.063885 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-05f040df-0b3e-49d7-832b-bf45bfe23c04 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1275 microversion: 2.1 time: 0.472250 Oct 31 15:34:22.064073 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1859/3884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:21 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1275 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:22.090765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:22.091706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:22.117630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:22.118143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:22.118596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:22.119310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:22.130285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:22.130891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:22.307089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:22.316067 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c42cb9af-b9db-4108-8f8c-69361c9ed10f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1512 microversion: 2.1 time: 0.924085 Oct 31 15:34:22.316752 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2026/3885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:21 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1512 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:22.548541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ee51812-acc9-4cb3-997a-057c526978c8 tempest-ComputeTenantNetworksTest-214000280 tempest-ComputeTenantNetworksTest-214000280-project] Calling method '.version_select at 0x7f16e06e6280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:22.643048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:22.655977 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd0ff632-e5c3-42a5-ad00-b6e4736bc304 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1313 microversion: 2.1 time: 0.590882 Oct 31 15:34:22.662462 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1860/3886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:22 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:22.677637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:22.678252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:22.697204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:22.698045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:22.698700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:22.700058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:22.700715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:22.702437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.104433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:23.124921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:23.132262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:23.133531 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1bc78707-0817-4d83-a5a3-e5032935c987 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.469723 Oct 31 15:34:23.134109 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1861/3887] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:22 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:23.147981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:23.148604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:23.166172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.166678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.167120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.167832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.168509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.169121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.505638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:23.514065 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f30aa05f-16e8-4f0c-83db-53d6204d3877 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034" status: 200 len: 1511 microversion: 2.1 time: 0.378860 Oct 31 15:34:23.515645 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1862/3888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:23 2022] GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:23.529203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9d1783e9-2543-4457-bd54-0942824d84c1 req-37e487d8-3372-43ee-9561-15217242ce85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d", "name": "network-vif-deleted", "tag": "972c2cca-3e9c-4179-ab61-2d3b1cac598b"}, {"name": "network-changed", "server_uuid": "628b5ef1-37c0-4bd0-bdae-b030d95c657c", "tag": "b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:23.581566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9d1783e9-2543-4457-bd54-0942824d84c1 req-37e487d8-3372-43ee-9561-15217242ce85 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.582324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9d1783e9-2543-4457-bd54-0942824d84c1 req-37e487d8-3372-43ee-9561-15217242ce85 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.582753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9d1783e9-2543-4457-bd54-0942824d84c1 req-37e487d8-3372-43ee-9561-15217242ce85 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.625175 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9d1783e9-2543-4457-bd54-0942824d84c1 req-37e487d8-3372-43ee-9561-15217242ce85 service nova] Creating event network-vif-deleted:972c2cca-3e9c-4179-ab61-2d3b1cac598b for instance cf2607ad-6f6e-4b6f-8b29-bbc476a9f21d on n-h2-858384-17 Oct 31 15:34:23.625859 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9d1783e9-2543-4457-bd54-0942824d84c1 req-37e487d8-3372-43ee-9561-15217242ce85 service nova] Creating event network-changed:b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316 for instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c on n-h2-858384-17 Oct 31 15:34:23.642300 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9d1783e9-2543-4457-bd54-0942824d84c1 req-37e487d8-3372-43ee-9561-15217242ce85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.122476 Oct 31 15:34:23.646065 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1863/3889] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:23.656861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:23.657629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:23.678713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.678713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.678713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.680007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.680475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.680904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.825561 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3ee51812-acc9-4cb3-997a-057c526978c8 tempest-ComputeTenantNetworksTest-214000280 tempest-ComputeTenantNetworksTest-214000280-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 423 microversion: 2.1 time: 1.506993 Oct 31 15:34:23.832311 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2027/3890] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:34:22 2022] GET /compute/v2.1/os-tenant-networks => generated 423 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:23.832311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:23.832870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:23.850886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.854081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.855023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.856045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.861659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.862296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.927209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:23.936185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:23.941096 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7de9214-b515-46b9-b512-11e538d892e5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 0.293748 Oct 31 15:34:23.942521 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1864/3891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:23 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:23.963153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:23.964374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:23.981378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.982607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.983836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:23.985670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:23.987152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:23.989172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:24.047448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:24.082215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-736d4eea-e805-4e80-baa5-a3d16d6fe465 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1275 microversion: 2.1 time: 0.253979 Oct 31 15:34:24.104669 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2028/3892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:23 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1275 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:24.112967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:24.113687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:24.132405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:24.132939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:24.133401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:24.138124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:24.138852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:24.139737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:24.239990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:24.253694 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e724e4b5-c55f-45b5-b7b0-53c5e4aa98b4 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1512 microversion: 2.1 time: 0.304060 Oct 31 15:34:24.254815 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1865/3893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:23 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:24.259650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ddaec56-bbcb-40fe-9c89-925ba943dbb8 tempest-ComputeTenantNetworksTest-214000280 tempest-ComputeTenantNetworksTest-214000280-project] Calling method '.version_select at 0x7f16e0ff6b80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:24.457277 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ddaec56-bbcb-40fe-9c89-925ba943dbb8 tempest-ComputeTenantNetworksTest-214000280 tempest-ComputeTenantNetworksTest-214000280-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/7c9927c3-6a8a-4aab-836c-aca6d828183f" status: 200 len: 139 microversion: 2.1 time: 0.200926 Oct 31 15:34:24.458191 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1866/3894] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:34:24 2022] GET /compute/v2.1/os-tenant-networks/7c9927c3-6a8a-4aab-836c-aca6d828183f => generated 139 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:24.470620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:24.471233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:24.484985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:24.485775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:24.489046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:24.489980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:24.490868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:24.491591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:24.663416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:24.672364 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fba4c57b-0c3f-49cb-a4ec-322125cffaa6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1313 microversion: 2.1 time: 0.566038 Oct 31 15:34:24.674305 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2029/3895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:24 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:24.682687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:24.690665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:24.692169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:24.898739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:24.900069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:24.901771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:24.902815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:24.903810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:24.904974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:25.044543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:25.458909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:25.490013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:25.498579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:25.500324 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98563ad6-6c56-4823-8b99-7026064edb20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 1.040416 Oct 31 15:34:25.524432 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1867/3896] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:24 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:25.546114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:25.555612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:25.579182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:25.579683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:25.580152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:25.587444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:25.587444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:25.587769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:25.657328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=20 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:25.720880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=16 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:25.802799 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c0b5de29-63d6-4559-bc4e-f7e01ee691ca tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 345 microversion: 2.1 time: 1.124941 Oct 31 15:34:25.804633 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2030/3897] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Oct 31 15:34:24 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 345 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:25.818115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:25.819036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:25.829161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:25.833571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:25.834334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:25.851812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:25.852709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:25.853996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:26.027630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:26.046088 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-893e5354-e8d5-4f71-a09d-f639c04f0a74 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 0.516556 Oct 31 15:34:26.046632 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1868/3898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:25 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:26.084935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:26.097160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:26.136099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.136710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.137204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:26.141490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.144042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.144489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:26.352762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:26.370870 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f6060a5d-8a5e-44ac-889e-48b267e2b856 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.563691 Oct 31 15:34:26.371480 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2031/3899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:25 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:26.416139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:26.416763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:26.442360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.444878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.445548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:26.449657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:26.450306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:26.454517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:27.017351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:27.033047 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a9a585f6-79ea-4aff-acad-b189638a95c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1512 microversion: 2.1 time: 0.637316 Oct 31 15:34:27.036754 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2032/3900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:26 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1512 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:27.057734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:27.058595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:27.068839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:27.069571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:27.070896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:27.071834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:27.072489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:27.073141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:27.268312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:27.284480 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a12a370-dd88-4091-b509-09b4355d4f28 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1313 microversion: 2.1 time: 1.218826 Oct 31 15:34:27.285079 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1869/3901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:26 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1313 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:27.289640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:27.290240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:27.322927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:27.323416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:27.324015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:27.324898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:27.325535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:27.326124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:27.659573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:27.680171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:27.684701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:27.689624 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76958137-0ada-4151-8198-1604a677091a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.650944 Oct 31 15:34:27.691251 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2033/3902] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:27 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:27.710393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:27.712357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:27.729789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:27.732241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:27.735475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:27.737155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:27.739333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:27.745299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:27.905603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:27.927482 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60db402a-f92c-4eff-9ec1-92a10cfee4df tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034" status: 200 len: 1511 microversion: 2.1 time: 0.641279 Oct 31 15:34:27.928084 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1870/3903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:27 2022] GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034 => generated 1511 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:27.958696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-06ad0007-d417-464d-a681-5c2cd124067e req-fed2b6da-f5d3-4b98-bf20-1d64fb6bc327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea70cd07-d395-49c9-9ef8-6f8a3c0091b3", "tag": "802fb636-baba-41ed-beff-754054fcce47"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:27.968427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:27.971635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-06ad0007-d417-464d-a681-5c2cd124067e req-fed2b6da-f5d3-4b98-bf20-1d64fb6bc327 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:27.972640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-06ad0007-d417-464d-a681-5c2cd124067e req-fed2b6da-f5d3-4b98-bf20-1d64fb6bc327 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:27.973530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-06ad0007-d417-464d-a681-5c2cd124067e req-fed2b6da-f5d3-4b98-bf20-1d64fb6bc327 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.008711 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-06ad0007-d417-464d-a681-5c2cd124067e req-fed2b6da-f5d3-4b98-bf20-1d64fb6bc327 service nova] Creating event network-changed:802fb636-baba-41ed-beff-754054fcce47 for instance ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 on n-h1-858384-17 Oct 31 15:34:28.021637 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-06ad0007-d417-464d-a681-5c2cd124067e req-fed2b6da-f5d3-4b98-bf20-1d64fb6bc327 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067035 Oct 31 15:34:28.024477 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1871/3904] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:28.039818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:28.040720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:28.056870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:28.064493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:28.065681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.066575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:28.067193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:28.067778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.087224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:28.099712 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-414818af-d48a-4e01-a128-4a489d66e6b9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 0.406957 Oct 31 15:34:28.108922 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2034/3905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:27 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:28.120169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:28.129549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:28.150787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:28.151564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:28.152286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.153303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:28.163177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:28.163745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.816924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:28.822292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:28.830981 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3776cb0-601a-476c-bebd-875c8a421b65 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1512 microversion: 2.1 time: 0.720550 Oct 31 15:34:28.836369 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2035/3906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:28 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1512 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:28.850591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:28.851538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:28.869788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:28.870321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:28.870772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.877019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:28.877913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:28.878708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.880357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:28.897733 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0a18cb5c-8737-4d6d-9a85-4b0f636b3876 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.864168 Oct 31 15:34:28.915184 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1872/3907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:28 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:28.929947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7ffc9f7c-8dff-42d4-ac01-477ae9dc0d11 req-f32ef90b-efb0-4c66-8db7-dadc7af7e1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e56b30-7ed6-4292-ae54-5d1a5e83da66", "tag": "ccf07432-2874-4b7c-9dd0-e0fce7157e65"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:28.957528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7ffc9f7c-8dff-42d4-ac01-477ae9dc0d11 req-f32ef90b-efb0-4c66-8db7-dadc7af7e1a7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:28.958486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7ffc9f7c-8dff-42d4-ac01-477ae9dc0d11 req-f32ef90b-efb0-4c66-8db7-dadc7af7e1a7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:28.960780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7ffc9f7c-8dff-42d4-ac01-477ae9dc0d11 req-f32ef90b-efb0-4c66-8db7-dadc7af7e1a7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:28.989855 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7ffc9f7c-8dff-42d4-ac01-477ae9dc0d11 req-f32ef90b-efb0-4c66-8db7-dadc7af7e1a7 service nova] Creating event network-changed:ccf07432-2874-4b7c-9dd0-e0fce7157e65 for instance d7e56b30-7ed6-4292-ae54-5d1a5e83da66 on n-h1-858384-17 Oct 31 15:34:28.995295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7ffc9f7c-8dff-42d4-ac01-477ae9dc0d11 req-f32ef90b-efb0-4c66-8db7-dadc7af7e1a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078569 Oct 31 15:34:28.996245 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1873/3908] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:29.001980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:29.002865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:29.010824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.011593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.012229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.013408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.014246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.014874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.290517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:29.311020 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29a1dffd-20fc-4b5b-a869-1f69bb209928 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1313 microversion: 2.1 time: 0.473030 Oct 31 15:34:29.325363 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2036/3909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:28 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:29.342319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:29.349898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:29.350947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:29.358274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.361404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.362735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.364003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.364668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.366167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.439875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:29.499254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:29.518000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:29.522589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:29.523205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:29.526213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-93202b56-2232-4181-b7c8-2fae22620d0f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.528206 Oct 31 15:34:29.529809 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1874/3910] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:28 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:29.539438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:29.545715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:29.556200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.556990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.557639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.570090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.571097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.573216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.577181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.577181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.577181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.768909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bdde3336-b83a-414d-ae1e-0f71ecc14050 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.434529 Oct 31 15:34:29.769982 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2037/3911] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:34:29 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:29.802144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:29.808140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:29.809660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:29.915422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.916021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.916448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:29.917414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:29.919666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:29.923165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.037626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:30.090344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:30.102968 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be0a66d5-a61e-4d78-ad80-380e2362f068 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 0.570302 Oct 31 15:34:30.110005 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13cb3970-55e4-4e00-8360-3cfbcdb18bbb tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.311125 Oct 31 15:34:30.110578 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1875/3912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:29 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:30.115415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:30.121941 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2038/3913] 10.222.0.20 () {58 vars in 1150 bytes} [Mon Oct 31 15:34:29 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:30.129894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:30.131989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:30.147928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:30.149377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:30.157810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.165116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.172513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.173159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.174709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.175029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.175513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.176186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.176815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.178362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.179111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.180427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.479769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:30.659507 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c0bed90c-6d8d-4c13-a479-bdc57b705ec7 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.534734 Oct 31 15:34:30.667830 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2039/3914] 10.222.0.20 () {58 vars in 1212 bytes} [Mon Oct 31 15:34:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:30.673039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6a5cc821-5cff-4ea8-a8a8-b18b0da98da5 req-c0d90e62-f875-4b03-ab25-49d703d2676b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628b5ef1-37c0-4bd0-bdae-b030d95c657c", "name": "network-vif-plugged", "status": "completed", "tag": "b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:30.683518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6a5cc821-5cff-4ea8-a8a8-b18b0da98da5 req-c0d90e62-f875-4b03-ab25-49d703d2676b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.684037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6a5cc821-5cff-4ea8-a8a8-b18b0da98da5 req-c0d90e62-f875-4b03-ab25-49d703d2676b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.684754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6a5cc821-5cff-4ea8-a8a8-b18b0da98da5 req-c0d90e62-f875-4b03-ab25-49d703d2676b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.703232 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6a5cc821-5cff-4ea8-a8a8-b18b0da98da5 req-c0d90e62-f875-4b03-ab25-49d703d2676b service nova] Creating event network-vif-plugged:b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316 for instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c on n-h2-858384-17 Oct 31 15:34:30.711705 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6a5cc821-5cff-4ea8-a8a8-b18b0da98da5 req-c0d90e62-f875-4b03-ab25-49d703d2676b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042439 Oct 31 15:34:30.712785 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2040/3915] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:30.719076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:30.720077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:30.727210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.728558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.728558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.729560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.730025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.730455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.822000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:30.832003 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bafbd2df-417b-421c-9cd9-c1656f2803cd tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.719907 Oct 31 15:34:30.845980 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1876/3916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:30 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:30.850929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:30.861026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:30.886671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.888737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.889302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:30.894362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:30.894950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:30.896512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.551145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:31.566325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:31.567873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:31.570426 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ebdac150-40d6-49a7-a46d-ab699dd3234e tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.723285 Oct 31 15:34:31.578017 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1877/3917] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:30 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:31.600105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:31.626859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:31.629670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:31.650791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.652256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.653417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.656476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.659085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.659977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.721029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:31.733058 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4f546a6-bf7e-4320-aeaa-ec5d6fc98a2e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1313 microversion: 2.1 time: 1.018199 Oct 31 15:34:31.756809 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2041/3918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:30 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1313 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:31.764351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:31.766510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:31.774040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.774816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.775989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.777381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.778613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.779364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.834557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:31.939466 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97c4b034-ee52-49b6-8176-1ccd27d9f537 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.359899 Oct 31 15:34:31.941061 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1878/3919] 10.222.0.20 () {58 vars in 1196 bytes} [Mon Oct 31 15:34:31 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:31.954886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:31.955766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:31.987483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.988185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.988630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:31.989691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:31.989970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:31.991087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:32.204671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:32.222066 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6aea3d6e-3d6a-4fae-b3d4-f629ae38f54e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 0.462963 Oct 31 15:34:32.226024 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2042/3920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:31 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:32.234087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:32.255347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:32.256957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'name': '1291723115', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:32.261533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:32.265416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:32.266196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:32.266887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:32.267862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:32.268537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:32.269514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:32.274905 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-516974b0-fbbd-4bf8-955f-6efc1fb77235 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.332673 Oct 31 15:34:32.275518 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1879/3921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:31 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:32.400773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:32.480247 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-690aa1b9-235a-4d9b-86ab-549f72f4bb27 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?name=1291723115" status: 200 len: 346 microversion: 2.1 time: 0.252223 Oct 31 15:34:32.481544 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2043/3922] 10.222.0.20 () {58 vars in 1156 bytes} [Mon Oct 31 15:34:32 2022] GET /compute/v2.1/servers?name=1291723115 => generated 346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:32.495787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:32.501405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:32.506861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:32.519976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:32.521502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:32.522568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:32.523957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:32.526731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:32.528669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:32.608952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:32.609643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:32.621266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:32.621897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:32.622352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:32.623180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:32.626997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:32.628681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:32.669048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:32.768464 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d7089ec-d731-499b-a65f-2fa0489c6884 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.275848 Oct 31 15:34:32.769320 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1880/3923] 10.222.0.20 () {58 vars in 1154 bytes} [Mon Oct 31 15:34:32 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:32.784983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:32.786669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:32.797664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:32.798352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:32.799225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:32.801096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:32.801654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:32.802148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.014471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:33.030257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:33.035511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:33.037887 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fde3ca61-0ada-4627-a25f-5679e8068338 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.433831 Oct 31 15:34:33.058101 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2044/3924] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:32 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:33.087156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:33.093179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:33.097285 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0c71ad06-3c2d-41d2-965b-68060a573a1b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1313 microversion: 2.1 time: 0.323729 Oct 31 15:34:33.101485 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1881/3925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:32 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1313 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:33.105232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:33.109079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-129172311', 'deleted': False, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:34:33.125776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:33.127528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.128024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.128470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.143579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.144281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.144906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.253965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:33.254514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:33.276279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.276825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.277293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.278106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.278518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.278966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.419299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:34:33.531843 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5126d171-8c37-4f7d-8305-c3f70c835bc5 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-129172311" status: 200 len: 346 microversion: 2.1 time: 0.470324 Oct 31 15:34:33.533723 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2045/3926] 10.222.0.20 () {58 vars in 1228 bytes} [Mon Oct 31 15:34:33 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-129172311 => generated 346 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:33.541758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:33.542742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:33.550704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.551845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.552558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.553519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.554176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.554799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.813217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:33.828510 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1d0044e7-d2e1-4c8b-bff4-9a188d2e8c86 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.292528 Oct 31 15:34:33.829713 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2046/3927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:33 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:33.848419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:33.859695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:33.869050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.870003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.870512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.871266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:33.871920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:33.872529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:33.924435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:33.933186 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-605a5c2c-0012-4f7e-83a7-448f582827f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 0.684820 Oct 31 15:34:33.933385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:33.953161 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1882/3928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:33 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:34.074827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:34.075819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:34.096305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.099559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.104308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.105155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.111083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.117305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.118995 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f99b9c76-c7e6-4f16-85e6-67e3e5ecd9b3 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 204 len: 0 microversion: 2.1 time: 0.280131 Oct 31 15:34:34.122718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:34.126057 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2047/3929] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:33 2022] DELETE /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:34.145287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:34.146042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:34.152575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.159646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.160145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.160935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.161486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.161951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.487399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:34.500851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:34.501922 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8d259c69-43f8-43d2-b196-dc0a48fe4c0c tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1518 microversion: 2.1 time: 0.373512 Oct 31 15:34:34.504279 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2048/3930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:34 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1518 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:34.514494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:34.516186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:34.516565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:34.520226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:34.522385 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea303ca5-ed3f-456b-8a68-00c6d4895036 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.451593 Oct 31 15:34:34.525492 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1883/3931] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:34 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:34.531458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.532009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.532451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.533260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.533706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.534142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.586787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:34.856406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:34.857875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:34.858892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:34.867791 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-58cf640b-f5f3-4768-b439-291b0ac42c95 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1462 microversion: 2.1 time: 0.362281 Oct 31 15:34:34.871634 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2049/3932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:34 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1462 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:34.872219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.872844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.874084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.875050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.875724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.876542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.897247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41f40722-4a3c-4939-b21f-16bebca4a990 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:34.898669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41f40722-4a3c-4939-b21f-16bebca4a990 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:34.911645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41f40722-4a3c-4939-b21f-16bebca4a990 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.913697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41f40722-4a3c-4939-b21f-16bebca4a990 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.915346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41f40722-4a3c-4939-b21f-16bebca4a990 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:34.918540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41f40722-4a3c-4939-b21f-16bebca4a990 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:34.919390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41f40722-4a3c-4939-b21f-16bebca4a990 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:34.921030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41f40722-4a3c-4939-b21f-16bebca4a990 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.284212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:35.292880 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60a0bffc-a168-4e72-ba4a-7de377ad43c6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.440440 Oct 31 15:34:35.297402 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1884/3933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:34 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:35.307174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:35.308107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:35.323283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.325962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.327248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.328141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.337708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.338403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.388683 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41f40722-4a3c-4939-b21f-16bebca4a990 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1615 microversion: 2.1 time: 0.493735 Oct 31 15:34:35.390211 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2050/3934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:34 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1615 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:35.417479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:35.418436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:35.432495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.433359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.433997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.434911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:35.436263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:35.437208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:35.509191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6e11767fcd8c4fb0b0076cf738c16823', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab796477ef0c4239b1d64e1efd2dfbf5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:35.509926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] flavor_id is None. Assuming migration. {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 31 15:34:35.510466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:34:36.042522 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d56be04-c2cf-4d35-ab1f-05713ab20159 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c/action" status: 202 len: 0 microversion: 2.1 time: 0.626634 Oct 31 15:34:36.046337 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2051/3935] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:34:35 2022] POST /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:34:36.067539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:36.087153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:36.108387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.110646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.112813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.115924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.118278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.119340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.442332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:36.474383 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f00eeb5e-812a-47dd-8009-62e5ddb6cfea tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 1.173491 Oct 31 15:34:36.478262 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1885/3936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:35 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:36.490729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:36.494753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:36.522654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.523602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.525637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:36.527649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:36.531125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:36.532413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.075718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.086222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.097538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.099030 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea2ac3a9-e11d-4787-a946-722548e558f8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.617297 Oct 31 15:34:37.100103 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1886/3937] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:36 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:37.116832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:37.124499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:37.142633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.143388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.143997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.144876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.146662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.147489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.383960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.402794 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c77a5c0b-f624-4da9-a567-4c4557849a73 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1518 microversion: 2.1 time: 1.353513 Oct 31 15:34:37.403363 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2052/3938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:36 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1518 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:37.408452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:37.409053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:37.426194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.426893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.432028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.432953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.433593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.434166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.743989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:37.753396 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a608970-cc2f-481a-9d37-52c5316924c4 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1471 microversion: 2.1 time: 0.651041 Oct 31 15:34:37.757355 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1887/3939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:37 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1471 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:37.762811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:37.763630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:37.771862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.772946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.773400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:37.774299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:37.774869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:37.775544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.161403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:38.178158 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2b4b223-d087-4c04-9e13-90180c5fcb84 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.770567 Oct 31 15:34:38.179016 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2053/3940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:37 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:38.220151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:38.221169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:38.247367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.249353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.252674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.257507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.258208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.260208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.353449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:38.363369 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc813843-94fe-47dc-8d5e-f00bfd2f46d8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 0.604944 Oct 31 15:34:38.374396 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1888/3941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:37 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:38.436441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:38.438364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:38.474671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.478874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.479524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.482792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.488115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.491129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.778498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:38.789551 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b12331e8-55ba-4dbb-8dd4-d205a8e2b8bc tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1476 microversion: 2.1 time: 0.357477 Oct 31 15:34:38.805416 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1889/3942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:38 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1476 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:38.830772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-116acfc3-9b93-4b81-9341-2d2e87faf31e req-9906709f-5113-41c5-9eb5-208df83198ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba", "name": "network-vif-deleted", "tag": "a72eed15-a869-40f6-9159-0cd7b080328d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:38.877042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-116acfc3-9b93-4b81-9341-2d2e87faf31e req-9906709f-5113-41c5-9eb5-208df83198ad service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.877778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-116acfc3-9b93-4b81-9341-2d2e87faf31e req-9906709f-5113-41c5-9eb5-208df83198ad service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.878166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-116acfc3-9b93-4b81-9341-2d2e87faf31e req-9906709f-5113-41c5-9eb5-208df83198ad service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.903133 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-116acfc3-9b93-4b81-9341-2d2e87faf31e req-9906709f-5113-41c5-9eb5-208df83198ad service nova] Creating event network-vif-deleted:a72eed15-a869-40f6-9159-0cd7b080328d for instance fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba on n-h1-858384-17 Oct 31 15:34:38.924873 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-116acfc3-9b93-4b81-9341-2d2e87faf31e req-9906709f-5113-41c5-9eb5-208df83198ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127832 Oct 31 15:34:38.930016 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1890/3943] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:38.944973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:38.945948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:38.974589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.977871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.978526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:38.979677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:38.982232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:38.983960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:39.519723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:39.729276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.749302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.750713 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-39bf8dbb-3a74-4adb-a2ab-5c077d318664 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1471 microversion: 2.1 time: 0.818325 Oct 31 15:34:39.751831 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1891/3944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:38 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1471 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:39.765675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:39.766507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:39.768102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.769910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:39.771261 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67187faa-5356-4085-b145-250ba3eeacd4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 1.576448 Oct 31 15:34:39.777331 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2054/3945] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:38 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:39.783148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:39.798771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:39.800470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:39.803516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:39.804178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:39.805069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:39.808308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:39.811662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:39.835580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:39.836249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:39.836833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:39.837973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:39.838580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:39.839345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.164739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:40.174614 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f47b2eda-a92c-4e04-9713-224821b8075c tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.420777 Oct 31 15:34:40.190729 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1892/3946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:39 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:40.198939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:40.199810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:40.208850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.209745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.210354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.211410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.212018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.212575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.260740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.261444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.262049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.262641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lazy-loading 'fault' on Instance uuid fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:34:40.346044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:40.358854 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-68f1d140-42d0-4a96-8d18-12357787b517 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 200 len: 1310 microversion: 2.1 time: 0.165775 Oct 31 15:34:40.382894 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1893/3947] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:40 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 1310 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:40.782997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:40.784169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:40.796545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.808725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.812720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.814508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.815497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.816410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.874716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:40.904239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3b5adf40-0f82-4967-b659-49dbdf8f21d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1682 microversion: 2.1 time: 1.125589 Oct 31 15:34:40.905630 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2055/3948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:39 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1682 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:40.920956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:40.921838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:40.932035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.932703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.934790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:40.936244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:40.942473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:40.943294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.336194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.347418 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c35423bb-dd10-46d4-b820-bb132ae26489 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1471 microversion: 2.1 time: 0.571974 Oct 31 15:34:41.352094 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1894/3949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:40 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1471 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:41.372093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:41.374498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.394526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.396570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.397294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.398276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.399994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.401539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.796384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.811741 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-273326dc-2ce2-4a71-a400-00591a4268da tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.453964 Oct 31 15:34:41.813742 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1895/3950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:41 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:41.830513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.831228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-10aef035-0f51-414f-85b9-4322f62bfd2d req-4799f7ca-5a32-44f1-8384-2c81b95a4865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-plugged", "status": "completed", "tag": "ac976b0a-a5d1-4612-95b6-4eb2f35daf6d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:41.854459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.855291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-10aef035-0f51-414f-85b9-4322f62bfd2d req-4799f7ca-5a32-44f1-8384-2c81b95a4865 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.855883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-10aef035-0f51-414f-85b9-4322f62bfd2d req-4799f7ca-5a32-44f1-8384-2c81b95a4865 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.856361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-10aef035-0f51-414f-85b9-4322f62bfd2d req-4799f7ca-5a32-44f1-8384-2c81b95a4865 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.856948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:41.862905 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-baf6572f-06fd-489d-87dc-2b2695ca5efc tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.956073 Oct 31 15:34:41.864068 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2056/3951] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:40 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:41.874992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:41.886235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.887029 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-10aef035-0f51-414f-85b9-4322f62bfd2d req-4799f7ca-5a32-44f1-8384-2c81b95a4865 service nova] Creating event network-vif-plugged:ac976b0a-a5d1-4612-95b6-4eb2f35daf6d for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:34:41.892956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.893970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.894588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.895444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.895962 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-10aef035-0f51-414f-85b9-4322f62bfd2d req-4799f7ca-5a32-44f1-8384-2c81b95a4865 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080699 Oct 31 15:34:41.896202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.896763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.896875 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1896/3952] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:41.928175 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] HTTP exception thrown: Instance fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba could not be found. Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Request method failure captured: Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba HTTP/1.1 Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-q2PDX0yHQVRA2WYz8QsI6rs2B56hID8fsIETLP1epNR0DXeVwlmM2jmq0MYsPUfrIOl5CGmW3lW0brbr30hvNALgN3Z2Bnk-SrZqsyqk6PgNoEp6VRvm0RP_ifeL_orzQUBSUwxhKuitm080Q53VbfR1LlwCgT7wuROq3SIAluA5s Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 2ddc3c4d4f214ecc8132c70e45b7190b Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ListServerFiltersTestJSON-270913558 Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ddc3c4d4f214ecc8132c70e45b7190b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ddc3c4d4f214ecc8132c70e45b7190b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ddc3c4d4f214ecc8132c70e45b7190b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ddc3c4d4f214ecc8132c70e45b7190b"}]}] Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ListServerFiltersTestJSON-270913558 Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 2ddc3c4d4f214ecc8132c70e45b7190b Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-270913558 Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ListServerFiltersTestJSON-270913558-project Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 7b22303f0ad64228a497056ef4fd2321 Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ListServerFiltersTestJSON-270913558-project Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba could not be found. Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba'} Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba could not be found. Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba could not be found. Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:41.941718 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:41.945865 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:41.945865 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:41.945865 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:41.945865 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:41.945865 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:41.945865 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba could not be found. Oct 31 15:34:41.945865 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:41.946304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:41.946304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.947183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Returning 404 to user: Instance fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:41.950143 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-565a017b-9344-4471-993c-7b075ac4a2e9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba" status: 404 len: 111 microversion: 2.1 time: 0.084509 Oct 31 15:34:41.952175 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2057/3953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:41 2022] GET /compute/v2.1/servers/fa8c1282-89f6-4f5b-87e9-02d9bd9e04ba => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:41.954145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.955776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.957673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.958566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.962117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.962725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.965700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:41.966297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:41.984078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.987069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.987629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:41.989445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:41.990195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:41.990890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.064573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:42.267708 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-90e82add-4814-4aa4-a7d7-a85a8cfd8886 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034" status: 204 len: 0 microversion: 2.1 time: 0.311366 Oct 31 15:34:42.268543 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2058/3954] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:41 2022] DELETE /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:42.280713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.296366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.316746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.318024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.318564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.320801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.322618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.323312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.606255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:42.678918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:42.701555 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-18497c3c-a4b5-4c14-9be8-22b7ae4614fb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.762758 Oct 31 15:34:42.705202 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1897/3955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:41 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:42.724772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.728587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.742133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.742624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.743054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.743907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.744369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.744787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.790822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:42.810665 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3b830694-184f-458f-8540-05943d6752c6 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034" status: 200 len: 1517 microversion: 2.1 time: 0.536947 Oct 31 15:34:42.811900 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2059/3956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034 => generated 1517 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:42.841112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.841860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:42.852299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.853339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.854597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.858262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:42.858743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:42.861334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:42.974908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:42.986058 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-82bb3665-f914-42b0-9545-0dd874ceda97 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.278358 Oct 31 15:34:42.987384 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1898/3957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:42.993447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:42.994489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:43.003657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.004637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.005872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.006808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.007503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.008490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.033797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.046283 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41c38337-33cd-4e5c-b962-3b125f71e613 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.208043 Oct 31 15:34:43.047655 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2060/3958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:43.053838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:43.054465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:43.094633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.095699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.097449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.098544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.100249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.101970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.246686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=14 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:43.416009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.436094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.438975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.441101 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e15e584-c71d-45d8-ad4a-2863b5c332c5 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.391884 Oct 31 15:34:43.442150 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2061/3959] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:43 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:43.697021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:43.711427 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-19ecdb89-ce17-43f1-8a4f-50376e90d7be tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.716957 Oct 31 15:34:43.712660 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1899/3960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:42 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:43.835642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:43.836257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:43.851848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.853736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.854469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.856903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.858615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.859339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:43.951774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-01f54aad-b35a-4124-a34f-9b6ea47aeaa4 req-8f1a8789-615c-4b41-a9a6-c7222f99701d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea70cd07-d395-49c9-9ef8-6f8a3c0091b3", "name": "network-vif-plugged", "status": "completed", "tag": "802fb636-baba-41ed-beff-754054fcce47"}, {"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-plugged", "status": "completed", "tag": "a2bb9ed6-823d-43a5-b740-495112886f87"}, {"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-plugged", "status": "completed", "tag": "a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:43.979639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-01f54aad-b35a-4124-a34f-9b6ea47aeaa4 req-8f1a8789-615c-4b41-a9a6-c7222f99701d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:43.980185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-01f54aad-b35a-4124-a34f-9b6ea47aeaa4 req-8f1a8789-615c-4b41-a9a6-c7222f99701d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:43.980522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-01f54aad-b35a-4124-a34f-9b6ea47aeaa4 req-8f1a8789-615c-4b41-a9a6-c7222f99701d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.004904 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-01f54aad-b35a-4124-a34f-9b6ea47aeaa4 req-8f1a8789-615c-4b41-a9a6-c7222f99701d service nova] Creating event network-vif-plugged:802fb636-baba-41ed-beff-754054fcce47 for instance ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 on n-h1-858384-17 Oct 31 15:34:44.005442 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-01f54aad-b35a-4124-a34f-9b6ea47aeaa4 req-8f1a8789-615c-4b41-a9a6-c7222f99701d service nova] Creating event network-vif-plugged:a2bb9ed6-823d-43a5-b740-495112886f87 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:34:44.005934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-01f54aad-b35a-4124-a34f-9b6ea47aeaa4 req-8f1a8789-615c-4b41-a9a6-c7222f99701d service nova] Creating event network-vif-plugged:a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:34:44.025396 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-01f54aad-b35a-4124-a34f-9b6ea47aeaa4 req-8f1a8789-615c-4b41-a9a6-c7222f99701d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.077900 Oct 31 15:34:44.025988 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1900/3961] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:34:44.032179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:44.032870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:44.063223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.063711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.064300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.065176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.065769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.066338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.152760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:44.479799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:44.490723 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-683cfc53-adad-4177-9bf6-3d755081f7a5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.463531 Oct 31 15:34:44.496866 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1901/3962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:44 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:44.502771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:44.510792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:44.527472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.528228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.529048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.530980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.531795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.532450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.860010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:44.868934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-256d1e20-bfeb-4a0b-9fb3-9060e9f98ec2 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.369939 Oct 31 15:34:44.869558 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1902/3963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:44 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:44.925104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:44.928499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:44.948586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.948866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.950275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:44.953791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:44.955695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:44.958546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.095829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.109495 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7752171c-0b7b-4872-8237-7be694a4c1a9 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034" status: 200 len: 1517 microversion: 2.1 time: 1.278210 Oct 31 15:34:45.126820 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2062/3964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:43 2022] GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034 => generated 1517 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:45.422199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.436639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.437854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e472a87-3ba6-4e1e-a9a6-ad14e598285e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'create', calling method: .version_select at 0x7f16e0de51f0>, body: {"keypair": {"name": "tempest-keypair-327708484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNp92U+Z6SebSzZCDjiPy1pb27cr+Tnw9SuagI5RX1ugHrMU8rzln3yzzrJBXxKAIcAnBf/IiJgGAiJUChgqq3XEZZtI1m1qJouRaUHQ/VG6X0EayKGF1Ibuo7gtmExcw=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:45.439032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.440996 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aad79e45-66c4-4679-8edf-ef969a11fa6a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.547023 Oct 31 15:34:45.442145 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1903/3965] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:44 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:45.454877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:45.455506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:45.464272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.465044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.466239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.467377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.468273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-9e472a87-3ba6-4e1e-a9a6-ad14e598285e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Getting quotas for project fb97df11ae204a8d986977e32b44ada3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:45.468836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.470185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.475842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-9e472a87-3ba6-4e1e-a9a6-ad14e598285e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Getting quotas for user ef1e39433eb54ab6b5d2b28ddccd175b and project fb97df11ae204a8d986977e32b44ada3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:45.518611 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e472a87-3ba6-4e1e-a9a6-ad14e598285e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.389500 Oct 31 15:34:45.519851 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2063/3966] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:34:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:45.525568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:45.527029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:45.583134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.584241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.585638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.586859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.587949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.589146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.731579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:45.780403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:45.791384 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-932cf71d-1a74-46cd-9162-602732836b0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.347278 Oct 31 15:34:45.792529 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1904/3967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:45 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:45.835100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:45.838437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:45.855552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.862905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.865693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:45.868520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:45.869693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:45.889890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.166512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:46.176928 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1b3d0ace-d1ff-42a0-8788-3ec788bd110e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.361868 Oct 31 15:34:46.177876 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1905/3968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:45 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:46.188666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:46.193170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:46.205449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.206316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.207208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.208777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.209565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.210226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.389720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:46.404975 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-260d7818-a621-4d27-a4a9-ff3dc26e0dcf tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.224921 Oct 31 15:34:46.407683 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1906/3969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:46 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:46.416012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3fd1f51b-b8d9-4359-af18-ff5caa58f4c9 req-439bf4b6-d216-4a3e-be44-34eac92b866d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-plugged", "status": "completed", "tag": "b00466ed-bfa7-4acf-8cbf-347445a38720"}, {"server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "name": "network-vif-unplugged", "status": "completed", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}, {"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-plugged", "status": "completed", "tag": "9d85ca81-1622-439d-857b-1c0c99b29b1a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:46.416544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:46.425388 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d8ad61e-2a68-47b6-9706-9b0a75627982 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.904183 Oct 31 15:34:46.425980 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2064/3970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:45 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:46.447669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:46.448399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:46.462219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3fd1f51b-b8d9-4359-af18-ff5caa58f4c9 req-439bf4b6-d216-4a3e-be44-34eac92b866d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.465818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3fd1f51b-b8d9-4359-af18-ff5caa58f4c9 req-439bf4b6-d216-4a3e-be44-34eac92b866d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.468894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3fd1f51b-b8d9-4359-af18-ff5caa58f4c9 req-439bf4b6-d216-4a3e-be44-34eac92b866d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.481804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.484261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.486208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.490231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.497423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3fd1f51b-b8d9-4359-af18-ff5caa58f4c9 req-439bf4b6-d216-4a3e-be44-34eac92b866d service nova] Creating event network-vif-plugged:b00466ed-bfa7-4acf-8cbf-347445a38720 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:34:46.498655 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3fd1f51b-b8d9-4359-af18-ff5caa58f4c9 req-439bf4b6-d216-4a3e-be44-34eac92b866d service nova] Creating event network-vif-unplugged:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:34:46.509517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.513333 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3fd1f51b-b8d9-4359-af18-ff5caa58f4c9 req-439bf4b6-d216-4a3e-be44-34eac92b866d service nova] Creating event network-vif-plugged:9d85ca81-1622-439d-857b-1c0c99b29b1a for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:34:46.514326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.535075 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3fd1f51b-b8d9-4359-af18-ff5caa58f4c9 req-439bf4b6-d216-4a3e-be44-34eac92b866d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.125717 Oct 31 15:34:46.540953 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1907/3971] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:46.560725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:46.578188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:46.609576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.610104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.610556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.611294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.611757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.612184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.649174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:46.658302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:46.659590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:46.665870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lazy-loading 'fault' on Instance uuid bcd860d0-e3b8-43e8-b192-90ff4e748034 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:34:47.042898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.062048 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b0b62fc7-18a5-45cb-b0f7-780da930d80b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.512408 Oct 31 15:34:47.062723 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1908/3972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:46 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:47.101593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.111111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-aecfe5fb-2da0-4e44-a19b-bc6998c657a6 req-2d281d5d-d5f4-4cd1-8f61-9880f8bd66c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd860d0-e3b8-43e8-b192-90ff4e748034", "name": "network-vif-deleted", "tag": "bd550dc2-82af-403f-8304-706ef625a855"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:47.113254 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0a0b54c-bf4b-47e4-b832-bfa31a6aa06f tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034" status: 200 len: 1310 microversion: 2.1 time: 0.676391 Oct 31 15:34:47.115132 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2065/3973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:46 2022] GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034 => generated 1310 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:47.126977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:47.127700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:47.140503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.140695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aecfe5fb-2da0-4e44-a19b-bc6998c657a6 req-2d281d5d-d5f4-4cd1-8f61-9880f8bd66c1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.141288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aecfe5fb-2da0-4e44-a19b-bc6998c657a6 req-2d281d5d-d5f4-4cd1-8f61-9880f8bd66c1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.142024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aecfe5fb-2da0-4e44-a19b-bc6998c657a6 req-2d281d5d-d5f4-4cd1-8f61-9880f8bd66c1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.143454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.144070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.145012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.145815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.155015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.159407 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-aecfe5fb-2da0-4e44-a19b-bc6998c657a6 req-2d281d5d-d5f4-4cd1-8f61-9880f8bd66c1 service nova] Creating event network-vif-deleted:bd550dc2-82af-403f-8304-706ef625a855 for instance bcd860d0-e3b8-43e8-b192-90ff4e748034 on n-h1-858384-17 Oct 31 15:34:47.165462 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-aecfe5fb-2da0-4e44-a19b-bc6998c657a6 req-2d281d5d-d5f4-4cd1-8f61-9880f8bd66c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089590 Oct 31 15:34:47.168368 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1909/3974] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:47.175145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d7580a9-02c8-4f64-81ec-e8e2e6190a49 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:47.178936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d7580a9-02c8-4f64-81ec-e8e2e6190a49 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:47.188088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7580a9-02c8-4f64-81ec-e8e2e6190a49 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.188894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7580a9-02c8-4f64-81ec-e8e2e6190a49 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.189652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7580a9-02c8-4f64-81ec-e8e2e6190a49 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.190566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7580a9-02c8-4f64-81ec-e8e2e6190a49 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.191276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7580a9-02c8-4f64-81ec-e8e2e6190a49 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.191845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d7580a9-02c8-4f64-81ec-e8e2e6190a49 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.383542 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d7580a9-02c8-4f64-81ec-e8e2e6190a49 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.211199 Oct 31 15:34:47.387493 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1910/3975] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:34:47 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:34:47.426633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:47.428601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:47.460992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.465751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.467933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.471146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.471994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.475766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.881919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.911632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.917866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:47.922141 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7fd93cc9-0756-45d0-bca1-ed538c02a60a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.802936 Oct 31 15:34:47.927025 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2066/3976] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:47 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:47.940347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:47.941220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:47.958905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.959617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.961800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:47.964262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:47.964858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:47.967497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.318693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.327978 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dd8261a-01f8-45be-8dd9-a63aa718d29c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1671 microversion: 2.1 time: 0.935067 Oct 31 15:34:48.338079 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1911/3977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:47 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1671 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:48.343693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:48.349944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:48.358453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.360363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.360870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.361344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.362057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.362517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.362938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.369214 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76445247-a6bd-4405-9542-4959ed4e79ac tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.440856 Oct 31 15:34:48.369816 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2067/3978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:47 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:48.377169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:48.378049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: bcd860d0-e3b8-43e8-b192-90ff4e748034] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:48.405588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.406449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.407103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.408054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.408720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.409384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.433490 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] HTTP exception thrown: Instance bcd860d0-e3b8-43e8-b192-90ff4e748034 could not be found. Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Request method failure captured: Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034 HTTP/1.1 Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-q2PDX0yHQVRA2WYz8QsI6rs2B56hID8fsIETLP1epNR0DXeVwlmM2jmq0MYsPUfrIOl5CGmW3lW0brbr30hvNALgN3Z2Bnk-SrZqsyqk6PgNoEp6VRvm0RP_ifeL_orzQUBSUwxhKuitm080Q53VbfR1LlwCgT7wuROq3SIAluA5s Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 2ddc3c4d4f214ecc8132c70e45b7190b Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ListServerFiltersTestJSON-270913558 Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ddc3c4d4f214ecc8132c70e45b7190b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ddc3c4d4f214ecc8132c70e45b7190b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ddc3c4d4f214ecc8132c70e45b7190b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ddc3c4d4f214ecc8132c70e45b7190b"}]}] Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ListServerFiltersTestJSON-270913558 Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 2ddc3c4d4f214ecc8132c70e45b7190b Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-270913558 Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ListServerFiltersTestJSON-270913558-project Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 7b22303f0ad64228a497056ef4fd2321 Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ListServerFiltersTestJSON-270913558-project Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance bcd860d0-e3b8-43e8-b192-90ff4e748034 could not be found. Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'bcd860d0-e3b8-43e8-b192-90ff4e748034'} Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcd860d0-e3b8-43e8-b192-90ff4e748034 could not be found. Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcd860d0-e3b8-43e8-b192-90ff4e748034 could not be found. Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:48.436527 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:48.439870 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:48.439870 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:48.439870 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:48.439870 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:48.439870 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:48.439870 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcd860d0-e3b8-43e8-b192-90ff4e748034 could not be found. Oct 31 15:34:48.439870 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:34:48.441841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Returning 404 to user: Instance bcd860d0-e3b8-43e8-b192-90ff4e748034 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:48.442936 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5215104e-2d37-4c95-a5b7-f0050a172b85 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034" status: 404 len: 111 microversion: 2.1 time: 0.070424 Oct 31 15:34:48.447103 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2068/3979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:48 2022] GET /compute/v2.1/servers/bcd860d0-e3b8-43e8-b192-90ff4e748034 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:48.452458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:48.453297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:48.464780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.466154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.467457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.469111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.469808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.471357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.507547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:48.642158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:48.652327 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fdedf9f0-5749-4ee5-a247-56e85bc7bea3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.312854 Oct 31 15:34:48.655651 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26ccf479-5711-4795-b5fe-5d3eda57b5e2 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 204 len: 0 microversion: 2.1 time: 0.206569 Oct 31 15:34:48.656410 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1912/3980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:48 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:48.657091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2069/3981] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:48 2022] DELETE /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:48.664880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:48.665620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:48.675046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9e8e0e62-ea17-436e-b81b-454a3aef41b2 req-753cd861-0048-4a88-9ac8-66bae656bc16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-plugged", "status": "completed", "tag": "843a9ed1-8632-4e46-98bb-0693efe5aa5b"}, {"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-plugged", "status": "completed", "tag": "4aea9160-063a-4d76-83d9-228c713aee2b"}, {"server_uuid": "d7e56b30-7ed6-4292-ae54-5d1a5e83da66", "name": "network-vif-plugged", "status": "completed", "tag": "ccf07432-2874-4b7c-9dd0-e0fce7157e65"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:48.680708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.681520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.681861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.682713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.683311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.684055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.701474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9e8e0e62-ea17-436e-b81b-454a3aef41b2 req-753cd861-0048-4a88-9ac8-66bae656bc16 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.702061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9e8e0e62-ea17-436e-b81b-454a3aef41b2 req-753cd861-0048-4a88-9ac8-66bae656bc16 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.702489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9e8e0e62-ea17-436e-b81b-454a3aef41b2 req-753cd861-0048-4a88-9ac8-66bae656bc16 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.733674 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9e8e0e62-ea17-436e-b81b-454a3aef41b2 req-753cd861-0048-4a88-9ac8-66bae656bc16 service nova] Creating event network-vif-plugged:843a9ed1-8632-4e46-98bb-0693efe5aa5b for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:34:48.734488 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9e8e0e62-ea17-436e-b81b-454a3aef41b2 req-753cd861-0048-4a88-9ac8-66bae656bc16 service nova] Creating event network-vif-plugged:4aea9160-063a-4d76-83d9-228c713aee2b for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:34:48.735165 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9e8e0e62-ea17-436e-b81b-454a3aef41b2 req-753cd861-0048-4a88-9ac8-66bae656bc16 service nova] Creating event network-vif-plugged:ccf07432-2874-4b7c-9dd0-e0fce7157e65 for instance d7e56b30-7ed6-4292-ae54-5d1a5e83da66 on n-h1-858384-17 Oct 31 15:34:48.746919 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9e8e0e62-ea17-436e-b81b-454a3aef41b2 req-753cd861-0048-4a88-9ac8-66bae656bc16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.088069 Oct 31 15:34:48.747857 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2070/3982] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:48.956878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:48.957905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:48.971160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.972268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.972901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:48.974099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:48.974781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:48.975394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.153562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:49.169195 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd6f3843-5ed7-47e2-9b3a-c806944b7318 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1518 microversion: 2.1 time: 0.507924 Oct 31 15:34:49.170786 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1913/3983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:48 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1518 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:49.245638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:49.255177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:49.256780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:49.258072 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d79e79d6-97f6-4051-9c18-19642ffeeaf7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.306076 Oct 31 15:34:49.259291 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2071/3984] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:48 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:34:49.365597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:49.366916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:49.377343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.377942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.378580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.379354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.380045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.380628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.401012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:49.401669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:49.418641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.418943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.419417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.420759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.425437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.426199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.616522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:49.626793 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-929ba993-f42a-49e6-a959-f229a165c11b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1317 microversion: 2.1 time: 0.231703 Oct 31 15:34:49.628272 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2072/3985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:49 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:49.677275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:49.677966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:49.692641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.693177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.693772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.694838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:49.695178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:49.695610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:49.884026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:49.892836 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa1c6a09-9f13-4f7d-8d21-c89c31d4ac78 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.219793 Oct 31 15:34:49.894784 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2073/3986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:49 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:50.199449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:50.200445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:50.219553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:50.220137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.222118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.222710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.227079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.227872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.232561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.235377 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-698c8553-dad1-4353-9a4e-2b64dce6eab5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1671 microversion: 2.1 time: 0.876825 Oct 31 15:34:50.267013 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1914/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:49 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1671 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:50.292919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:50.293937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:50.309810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.311677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.312301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.313353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.314032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.314851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.883369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b22303f0ad64228a497056ef4fd2321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ddc3c4d4f214ecc8132c70e45b7190b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:50.920963 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b8636edd-d171-4239-aa81-c2ac25f8e8ff tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 200 len: 1518 microversion: 2.1 time: 0.725576 Oct 31 15:34:50.945549 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2074/3988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:50 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 1518 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:50.955335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:50.970464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:50.991482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:50.992516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:50.993633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:50.995080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:51.001022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:51.002034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:51.090236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:51.143362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:51.158887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:51.178727 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cbcac42b-8f56-40ba-9688-172d5c42ae80 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1878 microversion: 2.32 time: 0.880887 Oct 31 15:34:51.183524 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1915/3989] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:50 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1878 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:51.218803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:51.219860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:51.241283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:51.242127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:51.242749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:51.257764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:51.258539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:51.259157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:51.598114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:51.610422 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6be5d7a4-04ff-4d3b-b6a8-c5207ca41344 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1504 microversion: 2.1 time: 0.663230 Oct 31 15:34:51.638561 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2075/3990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:50 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1504 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:51.652378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1396787118", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2af85480-3783-4f77-9d0f-0b2295b53983"}], "security_groups": [{"name": "tempest-securitygroup--1690894065"}], "key_name": "tempest-keypair-327708484", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:52.057897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] validate_networks() for [('2af85480-3783-4f77-9d0f-0b2295b53983', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:34:52.623310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:52.637186 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9ca1f831-15f7-48ee-b419-f0a723fb5bf1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 1.445198 Oct 31 15:34:52.639034 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1916/3991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:51 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:52.658653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:52.661044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:52.675535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:52.676792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:52.677509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:52.678760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:52.680136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:52.682700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:52.939739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:34:52.940954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:34:52.942303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:34:52.943136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:34:52.943831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:34:52.960590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:52.963018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:52.963742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:52.965648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:52.967338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:52.971009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.008799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:53.022968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Getting quotas for project fb97df11ae204a8d986977e32b44ada3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:34:53.041258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Getting quotas for user ef1e39433eb54ab6b5d2b28ddccd175b and project fb97df11ae204a8d986977e32b44ada3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:34:53.079304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:34:53.092645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:34:53.190037 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5250367-45b5-46de-ad90-ec73dd124ddd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.548322 Oct 31 15:34:53.191797 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2076/3992] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:34:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:34:53.205558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:53.206200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: ea70cd07-d395-49c9-9ef8-6f8a3c0091b3] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:53.221055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.221652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.222148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.222882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.223350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.223837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.324975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:53.338417 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8dc1e260-2fa2-42e2-b1f3-4e67298d9706 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.696955 Oct 31 15:34:53.339397 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1917/3993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:52 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:53.344789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:53.345922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] [instance: 88dc2835-b836-4c07-9358-0f4a9d3ad32f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:53.362617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.366606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.367392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.368030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.368498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.368923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.397459 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] HTTP exception thrown: Instance 88dc2835-b836-4c07-9358-0f4a9d3ad32f could not be found. Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Request method failure captured: Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f HTTP/1.1 Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-q2PDX0yHQVRA2WYz8QsI6rs2B56hID8fsIETLP1epNR0DXeVwlmM2jmq0MYsPUfrIOl5CGmW3lW0brbr30hvNALgN3Z2Bnk-SrZqsyqk6PgNoEp6VRvm0RP_ifeL_orzQUBSUwxhKuitm080Q53VbfR1LlwCgT7wuROq3SIAluA5s Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 2ddc3c4d4f214ecc8132c70e45b7190b Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ListServerFiltersTestJSON-270913558 Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ddc3c4d4f214ecc8132c70e45b7190b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2ddc3c4d4f214ecc8132c70e45b7190b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2ddc3c4d4f214ecc8132c70e45b7190b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2ddc3c4d4f214ecc8132c70e45b7190b"}]}] Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ListServerFiltersTestJSON-270913558 Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 2ddc3c4d4f214ecc8132c70e45b7190b Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-270913558 Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ListServerFiltersTestJSON-270913558-project Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 7b22303f0ad64228a497056ef4fd2321 Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ListServerFiltersTestJSON-270913558-project Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 88dc2835-b836-4c07-9358-0f4a9d3ad32f could not be found. Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '88dc2835-b836-4c07-9358-0f4a9d3ad32f'} Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88dc2835-b836-4c07-9358-0f4a9d3ad32f could not be found. Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88dc2835-b836-4c07-9358-0f4a9d3ad32f could not be found. Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:53.399775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:53.404404 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:53.404404 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:53.404404 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:53.404404 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:53.404404 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:53.404404 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88dc2835-b836-4c07-9358-0f4a9d3ad32f could not be found. Oct 31 15:34:53.404404 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:53.406053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] Returning 404 to user: Instance 88dc2835-b836-4c07-9358-0f4a9d3ad32f could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:53.407052 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6bcc5325-f544-4557-af63-247d41454622 tempest-ListServerFiltersTestJSON-270913558 tempest-ListServerFiltersTestJSON-270913558-project] 10.222.0.20 "GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f" status: 404 len: 111 microversion: 2.1 time: 0.066580 Oct 31 15:34:53.407829 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1918/3994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:53 2022] GET /compute/v2.1/servers/88dc2835-b836-4c07-9358-0f4a9d3ad32f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:53.415282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-444fe727-35f2-4915-a55b-532a8a401093 req-0ad45f7e-dbbd-495f-afd7-82205d2a4f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88dc2835-b836-4c07-9358-0f4a9d3ad32f", "name": "network-vif-deleted", "tag": "c61594ed-7ccd-40ff-b1f7-a4a4bab21359"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:53.427637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-444fe727-35f2-4915-a55b-532a8a401093 req-0ad45f7e-dbbd-495f-afd7-82205d2a4f60 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.428374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-444fe727-35f2-4915-a55b-532a8a401093 req-0ad45f7e-dbbd-495f-afd7-82205d2a4f60 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.429035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-444fe727-35f2-4915-a55b-532a8a401093 req-0ad45f7e-dbbd-495f-afd7-82205d2a4f60 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.434337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:53.451110 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-444fe727-35f2-4915-a55b-532a8a401093 req-0ad45f7e-dbbd-495f-afd7-82205d2a4f60 service nova] Creating event network-vif-deleted:c61594ed-7ccd-40ff-b1f7-a4a4bab21359 for instance 88dc2835-b836-4c07-9358-0f4a9d3ad32f on n-h2-858384-17 Oct 31 15:34:53.459945 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-444fe727-35f2-4915-a55b-532a8a401093 req-0ad45f7e-dbbd-495f-afd7-82205d2a4f60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050327 Oct 31 15:34:53.462016 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1919/3995] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:53.473858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:53.474679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:53.484253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:53.486340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.487558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.488199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.489670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.491703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.492942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.500214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:53.509604 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-42c00c60-b58b-4b89-ba6b-c7c2621ee556 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3" status: 200 len: 1504 microversion: 2.1 time: 0.316688 Oct 31 15:34:53.514315 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2077/3996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:53 2022] GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:53.543520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-501fd833-33c2-43a8-b298-f3517f30d011 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:53.543520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-501fd833-33c2-43a8-b298-f3517f30d011 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:53.693342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-501fd833-33c2-43a8-b298-f3517f30d011 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:53.704094 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-501fd833-33c2-43a8-b298-f3517f30d011 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1237 microversion: 2.1 time: 0.176838 Oct 31 15:34:53.708918 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2078/3997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:53 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1237 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:53.730661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39fcb301-072d-4ca0-a665-0dba5c493396 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:53.735622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-39fcb301-072d-4ca0-a665-0dba5c493396 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:53.790798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39fcb301-072d-4ca0-a665-0dba5c493396 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.791312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39fcb301-072d-4ca0-a665-0dba5c493396 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.796562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39fcb301-072d-4ca0-a665-0dba5c493396 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.798097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39fcb301-072d-4ca0-a665-0dba5c493396 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.802730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39fcb301-072d-4ca0-a665-0dba5c493396 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.803208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39fcb301-072d-4ca0-a665-0dba5c493396 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.807933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:53.820517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:53.834320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:53.835633 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2fa60147-5631-41e7-831e-9044dad9c34c tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2828 microversion: 2.32 time: 0.371563 Oct 31 15:34:53.836216 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1920/3998] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:34:53 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2828 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:53.848930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:53.849457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: ea70cd07-d395-49c9-9ef8-6f8a3c0091b3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:53.864367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.864848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.870041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.870136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.881420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.884869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.895049 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-39fcb301-072d-4ca0-a665-0dba5c493396 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 200 len: 321 microversion: 2.1 time: 0.183096 Oct 31 15:34:53.895764 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2079/3999] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:34:53 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:53.918860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:53.924459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:53.943624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.944316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.949961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.955121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:53.955614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:53.956047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:53.989056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: ea70cd07-d395-49c9-9ef8-6f8a3c0091b3] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:54.269731 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-197c04ec-07e9-4e7a-b9cf-112ed3c0484d tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3" status: 204 len: 0 microversion: 2.1 time: 0.424262 Oct 31 15:34:54.275035 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1921/4000] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:53 2022] DELETE /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:54.288353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e07cdd41-15fc-4924-a810-bb2e9d7e0d3b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:54.299072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e07cdd41-15fc-4924-a810-bb2e9d7e0d3b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:54.318693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e07cdd41-15fc-4924-a810-bb2e9d7e0d3b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.323180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e07cdd41-15fc-4924-a810-bb2e9d7e0d3b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.327111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e07cdd41-15fc-4924-a810-bb2e9d7e0d3b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.328051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e07cdd41-15fc-4924-a810-bb2e9d7e0d3b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.328703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e07cdd41-15fc-4924-a810-bb2e9d7e0d3b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.329300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e07cdd41-15fc-4924-a810-bb2e9d7e0d3b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.506847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:54.525363 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-47961ae6-0ca1-4cbc-a689-fe08be82f90e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.623759 Oct 31 15:34:54.531000 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2080/4001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:53 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:54.556912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:54.557552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:54.609718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.611834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.616228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.618462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.619124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.623035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.672723 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e07cdd41-15fc-4924-a810-bb2e9d7e0d3b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.396019 Oct 31 15:34:54.686002 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1922/4002] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 31 15:34:54 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0/os-interface => generated 1831 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:34:54.693932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:54.696958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:54.714942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.715703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.716419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.718250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.721271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.722781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.791314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:34:54.947725 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bfdd490d-b12e-42fd-a7c0-891993bd6340 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 204 len: 0 microversion: 2.1 time: 0.264075 Oct 31 15:34:54.952843 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1923/4003] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:34:54 2022] DELETE /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:34:54.970145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:54.970850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:54.984274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.984958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.985735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:54.986772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:54.987374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:54.987942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.097926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:55.109380 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e6d5ead-da48-4985-beb4-ec745f65fe27 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1289 microversion: 2.1 time: 0.154640 Oct 31 15:34:55.110319 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1924/4004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:54 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1289 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:55.133160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:55.134996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: ea70cd07-d395-49c9-9ef8-6f8a3c0091b3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:55.152935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.153619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.154463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.155739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.155830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.156266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.385577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:55.398998 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dfd02e3a-8e26-4185-9fe0-87d03425ba7a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3" status: 200 len: 1510 microversion: 2.1 time: 0.279531 Oct 31 15:34:55.400474 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1925/4005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:55 2022] GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:55.554288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:55.555155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:55.570898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.574965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.579035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.582205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:55.585840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:55.587088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:55.830088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:55.842581 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aecd8005-c395-4c73-9f34-ac7e2b4f2da1 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.289709 Oct 31 15:34:55.843213 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1926/4006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:55 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:56.061022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.072510 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4fba29c3-f451-4257-99c6-cccc244ece1d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 1.540180 Oct 31 15:34:56.074911 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2081/4007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:54 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:56.104659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:56.105298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:56.112374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.112867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.120615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.121908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.123261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.124013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.134785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:56.135636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:56.146393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.146893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.147420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.148015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.148463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.154713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.241049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:56.416825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.436742 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54ae570d-9ed1-422f-ba09-ea5edd57965b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.335983 Oct 31 15:34:56.437447 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1927/4008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:56 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:56.448874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:56.449989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: ea70cd07-d395-49c9-9ef8-6f8a3c0091b3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:56.462829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.465836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.466558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.469382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.470657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.471159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.491933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.508014 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f31f6af8-d9cb-4a54-9ae9-07b5f72d6bc0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1295 microversion: 2.1 time: 0.377844 Oct 31 15:34:56.509096 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2082/4009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:56 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1295 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:56.518336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:56.519104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:56.534184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.534814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.535366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.537292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:56.541473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:56.542047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:56.974405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:56.986836 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4905d5cd-f5cf-4f41-a5b7-38324985d7b9 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3" status: 200 len: 1510 microversion: 2.1 time: 0.548281 Oct 31 15:34:57.003076 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1928/4010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:56 2022] GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 => generated 1510 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:57.016861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:57.019233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:57.033577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.034080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.034515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.035233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.035698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.039137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.356584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:57.371263 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ab4c372-3be1-496f-86be-2f8099d7aa09 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.366773 Oct 31 15:34:57.376032 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1929/4011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:57 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:57.500480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:57.517066 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4843807f-3399-46e8-8bf3-21d6d27f013f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 1.006770 Oct 31 15:34:57.518025 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2083/4012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:56 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:57.533570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:57.534255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:57.551200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:57.552647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:57.555591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.556626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.558051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.561868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.562616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.567720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.582714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.583216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.586971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.587818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.588298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.588730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.753307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:57.770359 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3479186b-e2cb-4159-b9a8-7a838698f277 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1295 microversion: 2.1 time: 0.239514 Oct 31 15:34:57.788225 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1930/4013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:57 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1295 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:57.795541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3b6c0667-83f2-4681-be1e-6a4adc4fa3c8 req-742396fb-40fc-4ab1-b826-a875d4245587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea70cd07-d395-49c9-9ef8-6f8a3c0091b3", "name": "network-vif-deleted", "tag": "802fb636-baba-41ed-beff-754054fcce47"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:57.808830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b6c0667-83f2-4681-be1e-6a4adc4fa3c8 req-742396fb-40fc-4ab1-b826-a875d4245587 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:57.811235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b6c0667-83f2-4681-be1e-6a4adc4fa3c8 req-742396fb-40fc-4ab1-b826-a875d4245587 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:57.811850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b6c0667-83f2-4681-be1e-6a4adc4fa3c8 req-742396fb-40fc-4ab1-b826-a875d4245587 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:57.830948 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3b6c0667-83f2-4681-be1e-6a4adc4fa3c8 req-742396fb-40fc-4ab1-b826-a875d4245587 service nova] Creating event network-vif-deleted:802fb636-baba-41ed-beff-754054fcce47 for instance ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 on n-h1-858384-17 Oct 31 15:34:57.838418 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3b6c0667-83f2-4681-be1e-6a4adc4fa3c8 req-742396fb-40fc-4ab1-b826-a875d4245587 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048723 Oct 31 15:34:57.845117 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1931/4014] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:34:58.025527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:58.028339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: ea70cd07-d395-49c9-9ef8-6f8a3c0091b3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:58.051871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.052393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.052846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.053602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.054088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.054482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.144210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.147158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.148286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.150505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lazy-loading 'fault' on Instance uuid ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:34:58.260978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.274506 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5b79622-7946-47ce-8789-d88f58046498 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3" status: 200 len: 1307 microversion: 2.1 time: 0.260988 Oct 31 15:34:58.277144 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1932/4015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:58 2022] GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 => generated 1307 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:58.408731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:58.409494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:58.421246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.423258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.426844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.430464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.432650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.433504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.473386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.490969 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a441bfe-919c-4069-9ac6-91c92ed734ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.945025 Oct 31 15:34:58.494078 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2084/4016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:57 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:58.758728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.766056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:34:58.768699 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0edf37a7-a230-4901-bbc1-be60403f3b1f tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.366882 Oct 31 15:34:58.787049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1035840382", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fa1888d6-b08a-4260-8505-69a899fd42e4"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:34:58.790799 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1933/4017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:58 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:58.801854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:58.805208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:58.818611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.819350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.819973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.822477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:58.823796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:58.825449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:58.938750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] validate_networks() for [('fa1888d6-b08a-4260-8505-69a899fd42e4', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:34:58.980346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:58.989152 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14252b85-0b04-4e83-abd6-ddcc96e53be5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1295 microversion: 2.1 time: 0.194641 Oct 31 15:34:58.990715 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1934/4018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:58 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1295 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:34:59.313264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:59.314631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: ea70cd07-d395-49c9-9ef8-6f8a3c0091b3] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:59.322517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.323312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.323976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.324982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.326495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.327257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.350852 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] HTTP exception thrown: Instance ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 could not be found. Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Request method failure captured: Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 HTTP/1.1 Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-rTPgyuhJCZhxQ-dx5i1a2Ty7m3cjWPVnaFniYC3E3yiFF6VzCnN7B6Zxu-eppFUPvQr28OHbD5NeqQC49BtwPNEUGU27G6xOyxgEsm_-KoYSxaF9NexXIaA2_9YweB_0kSZji4k6tvOypbfWSEZ8_PR4lAQ_bBlbQkfQ1MYtA5Hjg Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 32923016858e4585b6971ab42387f5ae Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-MultipleCreateTestJSON-1471596821 Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32923016858e4585b6971ab42387f5ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_32923016858e4585b6971ab42387f5ae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32923016858e4585b6971ab42387f5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/32923016858e4585b6971ab42387f5ae"}]}] Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-MultipleCreateTestJSON-1471596821 Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 32923016858e4585b6971ab42387f5ae Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1471596821 Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-MultipleCreateTestJSON-1471596821-project Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: baff39dd91e34a559a81922f2ecff1c5 Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-MultipleCreateTestJSON-1471596821-project Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 could not be found. Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'ea70cd07-d395-49c9-9ef8-6f8a3c0091b3'} Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 could not be found. Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 could not be found. Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:34:59.356595 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:59.360269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:34:59.360269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:34:59.360269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:34:59.360269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:34:59.360269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:34:59.360269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 could not be found. Oct 31 15:34:59.360269 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:34:59.360269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Returning 404 to user: Instance ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:34:59.360696 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e77b8f31-850f-4543-9663-1242a7a4381b tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3" status: 404 len: 111 microversion: 2.1 time: 0.059396 Oct 31 15:34:59.361231 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1935/4019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:59 2022] GET /compute/v2.1/servers/ea70cd07-d395-49c9-9ef8-6f8a3c0091b3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:34:59.372339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:59.375283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:59.393660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.394657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.397783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.398707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.404639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.405542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.681148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:34:59.692499 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0347b4ae-5cf8-477a-b391-ad0abe43bbfc tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1510 microversion: 2.1 time: 0.327121 Oct 31 15:34:59.693608 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1936/4020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:59 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:34:59.796451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:34:59.797065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:34:59.804350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.804840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.805310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:34:59.806010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:34:59.806469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:34:59.806888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.245246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:00.260286 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da7a213c-5474-4956-9d60-5b170726542e tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.468221 Oct 31 15:35:00.262499 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1937/4021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:34:59 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:00.272552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:00.273262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:00.290250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.290250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.290250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.290250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.290250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.290250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.396031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:00.405670 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58e8f4a3-4db5-444c-b5f4-e8dc63f9009d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1295 microversion: 2.1 time: 0.142031 Oct 31 15:35:00.421787 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1938/4022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:00 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1295 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:00.584357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a4eaee51-dbee-48f6-8852-0b184b6a2400 req-0283cfdd-4095-4ea9-a00e-e65a447914bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e56b30-7ed6-4292-ae54-5d1a5e83da66", "name": "network-vif-deleted", "tag": "ccf07432-2874-4b7c-9dd0-e0fce7157e65"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:00.597074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a4eaee51-dbee-48f6-8852-0b184b6a2400 req-0283cfdd-4095-4ea9-a00e-e65a447914bc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.597903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a4eaee51-dbee-48f6-8852-0b184b6a2400 req-0283cfdd-4095-4ea9-a00e-e65a447914bc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.598577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a4eaee51-dbee-48f6-8852-0b184b6a2400 req-0283cfdd-4095-4ea9-a00e-e65a447914bc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.614880 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a4eaee51-dbee-48f6-8852-0b184b6a2400 req-0283cfdd-4095-4ea9-a00e-e65a447914bc service nova] Creating event network-vif-deleted:ccf07432-2874-4b7c-9dd0-e0fce7157e65 for instance d7e56b30-7ed6-4292-ae54-5d1a5e83da66 on n-h1-858384-17 Oct 31 15:35:00.620746 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a4eaee51-dbee-48f6-8852-0b184b6a2400 req-0283cfdd-4095-4ea9-a00e-e65a447914bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040373 Oct 31 15:35:00.621588 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1939/4023] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:00.718678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:00.720172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:00.727652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.728369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.729030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.729993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.730692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.731326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.784913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:00.785690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:00.786385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:00.787084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lazy-loading 'fault' on Instance uuid d7e56b30-7ed6-4292-ae54-5d1a5e83da66 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:00.883886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baff39dd91e34a559a81922f2ecff1c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32923016858e4585b6971ab42387f5ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:00.897483 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2b648191-0921-4243-a277-9e33bd490ef6 tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 200 len: 1307 microversion: 2.1 time: 0.184951 Oct 31 15:35:00.898085 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1940/4024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:00 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:01.297759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:35:01.298888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:35:01.299889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:35:01.300660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:35:01.301508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:35:01.303322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:01.303938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:01.323143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.324098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.325089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.327073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.327757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.328606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.334061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.334779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.335575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.336525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.337157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.338027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.371409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:35:01.378004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for user 33e8230d70464e5da2cced0060bb1a31 and project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:35:01.406736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:35:01.426335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:35:01.541640 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2a42978-4ca2-469e-9657-a97f174ac97a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.758974 Oct 31 15:35:01.542688 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2085/4025] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:34:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:35:01.549342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:01.550326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:01.557712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.558476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.559082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.560267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:01.561216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:01.562456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:01.804938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:01.819399 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bacd4e30-4e18-43e9-bb2b-80eef8f8202a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.519740 Oct 31 15:35:01.833955 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1941/4026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:01 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:01.845296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e0fa83e-9b4f-4e0b-b3f6-8004480ebc3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:01.846540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6e0fa83e-9b4f-4e0b-b3f6-8004480ebc3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:01.945491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e0fa83e-9b4f-4e0b-b3f6-8004480ebc3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:01.971965 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e0fa83e-9b4f-4e0b-b3f6-8004480ebc3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1215 microversion: 2.1 time: 0.136341 Oct 31 15:35:01.973197 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1942/4027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:01 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:01.989580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:01.990598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] [instance: d7e56b30-7ed6-4292-ae54-5d1a5e83da66] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:02.002435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:02.007868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:02.008599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.009819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:02.010618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:02.011229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.049619 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] HTTP exception thrown: Instance d7e56b30-7ed6-4292-ae54-5d1a5e83da66 could not be found. Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Request method failure captured: Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 HTTP/1.1 Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-rTPgyuhJCZhxQ-dx5i1a2Ty7m3cjWPVnaFniYC3E3yiFF6VzCnN7B6Zxu-eppFUPvQr28OHbD5NeqQC49BtwPNEUGU27G6xOyxgEsm_-KoYSxaF9NexXIaA2_9YweB_0kSZji4k6tvOypbfWSEZ8_PR4lAQ_bBlbQkfQ1MYtA5Hjg Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 32923016858e4585b6971ab42387f5ae Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-MultipleCreateTestJSON-1471596821 Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32923016858e4585b6971ab42387f5ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_32923016858e4585b6971ab42387f5ae", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/32923016858e4585b6971ab42387f5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/32923016858e4585b6971ab42387f5ae"}]}] Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-MultipleCreateTestJSON-1471596821 Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 32923016858e4585b6971ab42387f5ae Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1471596821 Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-MultipleCreateTestJSON-1471596821-project Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: baff39dd91e34a559a81922f2ecff1c5 Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-MultipleCreateTestJSON-1471596821-project Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance d7e56b30-7ed6-4292-ae54-5d1a5e83da66 could not be found. Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'd7e56b30-7ed6-4292-ae54-5d1a5e83da66'} Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e56b30-7ed6-4292-ae54-5d1a5e83da66 could not be found. Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e56b30-7ed6-4292-ae54-5d1a5e83da66 could not be found. Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:02.051787 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:02.055303 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:02.055303 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:02.055303 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:02.055303 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:02.055303 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:02.055303 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e56b30-7ed6-4292-ae54-5d1a5e83da66 could not be found. Oct 31 15:35:02.055303 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:02.066636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] Returning 404 to user: Instance d7e56b30-7ed6-4292-ae54-5d1a5e83da66 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:02.068697 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d4d1a08-cf48-468a-a77c-9f2fb1255c5a tempest-MultipleCreateTestJSON-1471596821 tempest-MultipleCreateTestJSON-1471596821-project] 10.222.0.20 "GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66" status: 404 len: 111 microversion: 2.1 time: 0.088930 Oct 31 15:35:02.072727 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1943/4028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:01 2022] GET /compute/v2.1/servers/d7e56b30-7ed6-4292-ae54-5d1a5e83da66 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:02.314356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:02.331049 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c5396af-a644-4f57-9fea-108ca23c8f62 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1363 microversion: 2.1 time: 0.787034 Oct 31 15:35:02.334062 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2086/4029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:01 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1363 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:02.850758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:02.851299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9608147f-5782-49c1-84ae-2a8dcd0c3dfc req-9cfb47fc-c866-4bdd-8f17-f4d6d7e58e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "tag": "a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:02.851869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:02.873825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9608147f-5782-49c1-84ae-2a8dcd0c3dfc req-9cfb47fc-c866-4bdd-8f17-f4d6d7e58e82 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:02.874371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9608147f-5782-49c1-84ae-2a8dcd0c3dfc req-9cfb47fc-c866-4bdd-8f17-f4d6d7e58e82 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:02.874809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9608147f-5782-49c1-84ae-2a8dcd0c3dfc req-9cfb47fc-c866-4bdd-8f17-f4d6d7e58e82 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.879373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:02.880103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:02.882680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.883954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:02.898804 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9608147f-5782-49c1-84ae-2a8dcd0c3dfc req-9cfb47fc-c866-4bdd-8f17-f4d6d7e58e82 service nova] Creating event network-changed:a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:35:02.918378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:02.920210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:02.920526 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9608147f-5782-49c1-84ae-2a8dcd0c3dfc req-9cfb47fc-c866-4bdd-8f17-f4d6d7e58e82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073520 Oct 31 15:35:02.921475 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2087/4030] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:02.998641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:03.002604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:03.010897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.011670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.012297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:03.013363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.014277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.026019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:03.799231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:03.819753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:03.828374 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b26841d-4820-4ebb-84dd-98948baf124d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1267 microversion: 2.1 time: 0.834450 Oct 31 15:35:03.833807 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2088/4031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:02 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1267 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:03.838076 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-80e864f0-2a36-4ddc-92b0-6ae89446b513 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1476 microversion: 2.1 time: 0.993556 Oct 31 15:35:03.838985 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1944/4032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:02 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1476 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:03.856183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:03.860758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:03.880347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.881185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.882084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:03.883373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:03.884947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:03.885678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.467128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:04.488161 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c28b73fa-83ab-44b4-8770-55e20f615172 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1363 microversion: 2.1 time: 0.651115 Oct 31 15:35:04.488772 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2089/4033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:03 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1363 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:04.858834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:04.860661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:04.866862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:04.868185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:04.878890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.880538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.882633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.883640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.885536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.886243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.886752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.887420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.887877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:04.890766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:04.892829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:04.893401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:05.045282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:05.054549 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc1d1894-a5f9-4d75-a599-1521572398a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1273 microversion: 2.1 time: 0.200430 Oct 31 15:35:05.085239 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1945/4034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:04 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:05.289018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:05.299474 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a956ba04-de3a-4b86-8ffe-3b9820aceb2c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1475 microversion: 2.1 time: 0.436340 Oct 31 15:35:05.312990 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2090/4035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:04 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1475 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:05.500174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8822fc8c-206e-4025-9336-ec589a8103af req-1127e2b4-f430-42cc-a8f1-e646febe1564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9c1f89-62a1-429b-9a22-45e7b9541232", "tag": "1edba9ff-814f-4b53-b948-2ee6e58f5fc5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:05.518505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:05.519956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:05.565113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:05.566363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:05.567207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:05.568144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:05.571118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:05.571849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:05.572871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8822fc8c-206e-4025-9336-ec589a8103af req-1127e2b4-f430-42cc-a8f1-e646febe1564 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:05.577004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8822fc8c-206e-4025-9336-ec589a8103af req-1127e2b4-f430-42cc-a8f1-e646febe1564 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:05.577656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8822fc8c-206e-4025-9336-ec589a8103af req-1127e2b4-f430-42cc-a8f1-e646febe1564 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:05.631162 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8822fc8c-206e-4025-9336-ec589a8103af req-1127e2b4-f430-42cc-a8f1-e646febe1564 service nova] Creating event network-changed:1edba9ff-814f-4b53-b948-2ee6e58f5fc5 for instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 on n-h2-858384-17 Oct 31 15:35:05.645508 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8822fc8c-206e-4025-9336-ec589a8103af req-1127e2b4-f430-42cc-a8f1-e646febe1564 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157573 Oct 31 15:35:05.646782 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1946/4036] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:05.924980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-049e29b9-d4e8-4a21-884f-0b28d5b2d949 req-e65c5007-0ae1-40ad-9165-6d1410c705b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628b5ef1-37c0-4bd0-bdae-b030d95c657c", "name": "network-vif-unplugged", "status": "completed", "tag": "b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:05.952752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-049e29b9-d4e8-4a21-884f-0b28d5b2d949 req-e65c5007-0ae1-40ad-9165-6d1410c705b3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:05.953277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-049e29b9-d4e8-4a21-884f-0b28d5b2d949 req-e65c5007-0ae1-40ad-9165-6d1410c705b3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:05.953721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-049e29b9-d4e8-4a21-884f-0b28d5b2d949 req-e65c5007-0ae1-40ad-9165-6d1410c705b3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:05.992800 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-049e29b9-d4e8-4a21-884f-0b28d5b2d949 req-e65c5007-0ae1-40ad-9165-6d1410c705b3 service nova] Creating event network-vif-unplugged:b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316 for instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c on n-h1-858384-17 Oct 31 15:35:06.020526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-049e29b9-d4e8-4a21-884f-0b28d5b2d949 req-e65c5007-0ae1-40ad-9165-6d1410c705b3 service nova] Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:35:06.032884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:06.039591 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-049e29b9-d4e8-4a21-884f-0b28d5b2d949 req-e65c5007-0ae1-40ad-9165-6d1410c705b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120466 Oct 31 15:35:06.040354 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1947/4037] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:35:06.041945 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22dbc2af-bb57-4672-bce6-9711331cfaf8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1363 microversion: 2.1 time: 0.532635 Oct 31 15:35:06.046863 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2091/4038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:05 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1363 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:06.088300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:06.091598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:06.102096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.102590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.103031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:06.103734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.104196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.104618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:06.597055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:06.597710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:06.604765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.605296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.606002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:06.607422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:06.608516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:06.609822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:07.142455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:07.151307 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba16c0cb-3915-432f-83c0-93c05d461b89 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 1.071139 Oct 31 15:35:07.151903 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1948/4039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:06 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:07.164476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:07.171736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:07.181019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:07.186415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:07.186942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:07.187769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:07.188313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:07.188809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:07.438579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:07.446816 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-589326ff-f811-4c83-a103-a5d3442ce636 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1475 microversion: 2.1 time: 1.120353 Oct 31 15:35:07.448237 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2092/4040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:06 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1475 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:07.818158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:07.831910 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e5ef2a1-a013-4548-ac33-097d10f58523 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1363 microversion: 2.1 time: 0.671638 Oct 31 15:35:07.835458 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1949/4041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:07 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1363 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:08.122422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8736bd49-00af-430a-89ab-8e8b477cc07e req-4b945dbe-35f3-4449-822a-37b83124a643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628b5ef1-37c0-4bd0-bdae-b030d95c657c", "tag": "b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:08.174906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:08.176228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:08.198471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8736bd49-00af-430a-89ab-8e8b477cc07e req-4b945dbe-35f3-4449-822a-37b83124a643 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.199399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8736bd49-00af-430a-89ab-8e8b477cc07e req-4b945dbe-35f3-4449-822a-37b83124a643 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.202188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8736bd49-00af-430a-89ab-8e8b477cc07e req-4b945dbe-35f3-4449-822a-37b83124a643 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.209595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.212659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.215205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.216222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.219837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.222430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.254381 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8736bd49-00af-430a-89ab-8e8b477cc07e req-4b945dbe-35f3-4449-822a-37b83124a643 service nova] Creating event network-changed:b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316 for instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c on n-h1-858384-17 Oct 31 15:35:08.275827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-8736bd49-00af-430a-89ab-8e8b477cc07e req-4b945dbe-35f3-4449-822a-37b83124a643 service nova] Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:35:08.294341 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8736bd49-00af-430a-89ab-8e8b477cc07e req-4b945dbe-35f3-4449-822a-37b83124a643 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175454 Oct 31 15:35:08.295990 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2093/4042] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:08.474229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:08.475694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:08.486614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.487460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.488621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.489762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:08.490668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:08.491407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:08.979977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:08.990325 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-325ce246-c041-47ce-931d-f8b787ab6e5b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1475 microversion: 2.1 time: 0.521793 Oct 31 15:35:08.994229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2094/4043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:08 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1475 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:09.002630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:09.003253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:09.023893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.024397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.025034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.027891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:09.028930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:09.029407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:09.221938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:09.236928 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e7ba233-5b3a-44c3-8ba1-f4a5b6da086a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 1.064504 Oct 31 15:35:09.239242 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1950/4044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:08 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:09.679637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:09.690984 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-444e3a23-6472-475a-88e8-a9071b3c8957 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1363 microversion: 2.1 time: 0.694963 Oct 31 15:35:09.691915 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2095/4045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:08 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1363 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:10.017728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:10.018333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:10.032757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:10.033556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:10.034324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:10.035211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:10.035822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:10.036399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:10.263538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:10.264686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:10.276164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:10.276930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:10.278930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:10.279875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:10.280506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:10.281117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:10.882047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:10.899383 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c06085b-80be-4523-ad55-7c163f3549a3 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1475 microversion: 2.1 time: 0.880717 Oct 31 15:35:10.900418 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1951/4046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:10 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1475 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:10.910627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:10.911487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:10.926620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:10.927376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:10.927969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:10.928844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:10.929676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:10.930305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.348168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:11.389155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=18 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:11.636830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:11.676521 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8046b230-2d56-441f-93e8-3f9338492e7f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1363 microversion: 2.1 time: 0.774616 Oct 31 15:35:11.677800 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1952/4047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:10 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1363 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:11.719081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3acd3e40-a31d-4ff7-8f64-af67dc51c0ed req-30d990f1-8f4a-42c9-9c97-6bd145010572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a9c1f89-62a1-429b-9a22-45e7b9541232", "name": "network-vif-plugged", "status": "completed", "tag": "1edba9ff-814f-4b53-b948-2ee6e58f5fc5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:11.757243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3acd3e40-a31d-4ff7-8f64-af67dc51c0ed req-30d990f1-8f4a-42c9-9c97-6bd145010572 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.757691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:11.759964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3acd3e40-a31d-4ff7-8f64-af67dc51c0ed req-30d990f1-8f4a-42c9-9c97-6bd145010572 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.760787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3acd3e40-a31d-4ff7-8f64-af67dc51c0ed req-30d990f1-8f4a-42c9-9c97-6bd145010572 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.787950 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1d6f007-68bc-4428-91a0-70c7c8845ec7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 1.530951 Oct 31 15:35:11.788650 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2096/4048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:10 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:11.799739 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3acd3e40-a31d-4ff7-8f64-af67dc51c0ed req-30d990f1-8f4a-42c9-9c97-6bd145010572 service nova] Creating event network-vif-plugged:1edba9ff-814f-4b53-b948-2ee6e58f5fc5 for instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 on n-h2-858384-17 Oct 31 15:35:11.811508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-95b00eed-8894-4dce-900f-af13061bfa9f req-b5ccdf35-4a73-47a3-b16d-2b0a8a883ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee0b7012-4606-4145-b69e-1ec621c768a7", "tag": "4214b8bf-52b7-43f9-9a0f-a03454093256"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:11.815907 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3acd3e40-a31d-4ff7-8f64-af67dc51c0ed req-30d990f1-8f4a-42c9-9c97-6bd145010572 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134237 Oct 31 15:35:11.816808 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1953/4049] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:11.841695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-95b00eed-8894-4dce-900f-af13061bfa9f req-b5ccdf35-4a73-47a3-b16d-2b0a8a883ba7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.845063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-95b00eed-8894-4dce-900f-af13061bfa9f req-b5ccdf35-4a73-47a3-b16d-2b0a8a883ba7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.845854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-95b00eed-8894-4dce-900f-af13061bfa9f req-b5ccdf35-4a73-47a3-b16d-2b0a8a883ba7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.883874 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-95b00eed-8894-4dce-900f-af13061bfa9f req-b5ccdf35-4a73-47a3-b16d-2b0a8a883ba7 service nova] Creating event network-changed:4214b8bf-52b7-43f9-9a0f-a03454093256 for instance ee0b7012-4606-4145-b69e-1ec621c768a7 on n-h1-858384-17 Oct 31 15:35:11.889873 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-95b00eed-8894-4dce-900f-af13061bfa9f req-b5ccdf35-4a73-47a3-b16d-2b0a8a883ba7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093252 Oct 31 15:35:11.891105 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2097/4050] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:11.929408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:11.930595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:11.947746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.949193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.949656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:11.952449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:11.952940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:11.958006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.035717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:12.618309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:12.622162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:12.635497 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11586a3b-c6da-45c5-9312-023fed9b7b98 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1473 microversion: 2.1 time: 0.710761 Oct 31 15:35:12.636992 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1954/4051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:11 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1473 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:12.716897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:12.718247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:12.735881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.736620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.737263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.738129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.738733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.739334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.822355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:12.823225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:12.836026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.843034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.843614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:12.844390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:12.844878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:12.845608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:13.114012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:13.132192 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7331999-9dbe-4956-a71f-f914e634d9cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1363 microversion: 2.1 time: 0.419288 Oct 31 15:35:13.141229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2098/4052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:12 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:13.668826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:13.673407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:13.698063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:13.699498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:13.703298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:13.709370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:13.712468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:13.717008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:13.846558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:13.865305 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00ef9adb-d2e4-472a-a1b0-64c61c381460 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 1.039827 Oct 31 15:35:13.866071 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1955/4053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:12 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:14.094456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.112175 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-31055268-33a4-4b97-a282-e6f3823212c7 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1470 microversion: 2.1 time: 0.452518 Oct 31 15:35:14.115524 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2099/4054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:13 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1470 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:14.145186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8988f76-24e5-4898-8d10-ecf8a328a47b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:14.145742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8988f76-24e5-4898-8d10-ecf8a328a47b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:14.156097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:14.156717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:14.181359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.186263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8988f76-24e5-4898-8d10-ecf8a328a47b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.186634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.187167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.187325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8988f76-24e5-4898-8d10-ecf8a328a47b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.187908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8988f76-24e5-4898-8d10-ecf8a328a47b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.188024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.189057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.189756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.190196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8988f76-24e5-4898-8d10-ecf8a328a47b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.192477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8988f76-24e5-4898-8d10-ecf8a328a47b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.193091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8988f76-24e5-4898-8d10-ecf8a328a47b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.516254 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8988f76-24e5-4898-8d10-ecf8a328a47b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "POST /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c/action" status: 202 len: 0 microversion: 2.1 time: 0.379768 Oct 31 15:35:14.516884 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1956/4055] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:14 2022] POST /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:14.534106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:14.537731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:14.551616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.552680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.553155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.553891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.554420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.554839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.621902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:14.638901 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8d83d6b-f453-4396-bbf5-36b235588f26 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1548 microversion: 2.1 time: 0.486670 Oct 31 15:35:14.639517 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2100/4056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:14 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1548 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:14.667798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b69563ad-9381-494d-a519-8562790c97cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:14.668854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b69563ad-9381-494d-a519-8562790c97cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:14.681469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b69563ad-9381-494d-a519-8562790c97cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.682522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b69563ad-9381-494d-a519-8562790c97cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.683159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b69563ad-9381-494d-a519-8562790c97cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.685117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b69563ad-9381-494d-a519-8562790c97cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.685899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b69563ad-9381-494d-a519-8562790c97cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.686609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b69563ad-9381-494d-a519-8562790c97cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.736167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:14.936810 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b69563ad-9381-494d-a519-8562790c97cd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.274004 Oct 31 15:35:14.937470 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2101/4057] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:35:14 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:35:14.943861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:14.944474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:14.963172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.964186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.964521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:14.970437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:14.971105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:14.973443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:15.635163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:15.654916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:15.659493 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-229d61df-9d01-4813-a4ec-7bb4eef71bad tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1469 microversion: 2.1 time: 1.133970 Oct 31 15:35:15.662262 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1957/4058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:14 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1469 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:15.667706 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-63998807-cb89-45a1-8a26-8fe9dfcdbaa4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 0.728321 Oct 31 15:35:15.668303 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2102/4059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:14 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:16.503534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ea95a950-24bd-4adf-97d5-431fdc166a55 req-91c3487e-429d-4c26-87fa-7cb0a9760686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628b5ef1-37c0-4bd0-bdae-b030d95c657c", "name": "network-vif-plugged", "status": "completed", "tag": "b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:16.531171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ea95a950-24bd-4adf-97d5-431fdc166a55 req-91c3487e-429d-4c26-87fa-7cb0a9760686 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.537908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ea95a950-24bd-4adf-97d5-431fdc166a55 req-91c3487e-429d-4c26-87fa-7cb0a9760686 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.538783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ea95a950-24bd-4adf-97d5-431fdc166a55 req-91c3487e-429d-4c26-87fa-7cb0a9760686 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:16.692077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:16.693292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:16.702186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.702945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.707928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:16.709287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.710153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.710774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:16.891177 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ea95a950-24bd-4adf-97d5-431fdc166a55 req-91c3487e-429d-4c26-87fa-7cb0a9760686 service nova] Creating event network-vif-plugged:b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316 for instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c on n-h1-858384-17 Oct 31 15:35:16.897911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-ea95a950-24bd-4adf-97d5-431fdc166a55 req-91c3487e-429d-4c26-87fa-7cb0a9760686 service nova] Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:35:16.910901 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ea95a950-24bd-4adf-97d5-431fdc166a55 req-91c3487e-429d-4c26-87fa-7cb0a9760686 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.410909 Oct 31 15:35:16.916703 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1958/4060] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:16.924879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:16.925965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:16.934542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:16.941794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.942276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.942712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:16.945081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:16.945981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:16.946760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:17.351691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.368760 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cb5fa551-5514-4bae-9b77-c0d4876df33d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 0.449964 Oct 31 15:35:17.372496 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1959/4061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:16 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:17.441297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:17.452703 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-368890f7-41d3-47eb-b856-ab839e06f293 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1469 microversion: 2.1 time: 0.765980 Oct 31 15:35:17.454026 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2103/4062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:16 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1469 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:18.398327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:18.400079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:18.410185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.411037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.411636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.412878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.413661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.414241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.480837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:18.483774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:18.496418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.502099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.502938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.504002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:18.504762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:18.505370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:18.767965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:18.785774 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-311a6770-335a-44a9-8be2-e271614aceef tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 0.392061 Oct 31 15:35:18.813666 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1960/4063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:18 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:19.065379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:19.086714 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d82a4eba-bba3-4308-86cd-812e8811fde5 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1469 microversion: 2.1 time: 0.605646 Oct 31 15:35:19.091642 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2104/4064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:18 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1469 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:19.390273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1136531733", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "67e74aca-f96a-4e67-bca9-d949a1845699"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:19.477583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] validate_networks() for [('67e74aca-f96a-4e67-bca9-d949a1845699', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:35:19.813288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:19.813958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:19.826770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.833840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.838262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:19.839333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:19.843382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:19.845286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.338537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:35:20.338955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:35:20.339779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:35:20.340462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:35:20.341163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:35:20.358626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.360134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.363494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.364516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:20.365080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.367220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.367735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.379009 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95d64e31-1916-4388-bb5f-623ac0a377ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 0.569998 Oct 31 15:35:20.391541 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2105/4065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:19 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:20.408680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-321da647-a964-4f17-a4f5-00ba16335a1e req-4bfda32d-f5a4-406a-bf00-8b54193b9c6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9c1f89-62a1-429b-9a22-45e7b9541232", "tag": "1edba9ff-814f-4b53-b948-2ee6e58f5fc5"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:20.426101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Getting quotas for project e39e5fd1536b4827910710309dd125b1. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:35:20.434609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-321da647-a964-4f17-a4f5-00ba16335a1e req-4bfda32d-f5a4-406a-bf00-8b54193b9c6a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.437795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-321da647-a964-4f17-a4f5-00ba16335a1e req-4bfda32d-f5a4-406a-bf00-8b54193b9c6a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.439303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-321da647-a964-4f17-a4f5-00ba16335a1e req-4bfda32d-f5a4-406a-bf00-8b54193b9c6a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.441508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Getting quotas for user 7a102b25680d42a991b6ee7a61cc2339 and project e39e5fd1536b4827910710309dd125b1. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:35:20.469441 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-321da647-a964-4f17-a4f5-00ba16335a1e req-4bfda32d-f5a4-406a-bf00-8b54193b9c6a service nova] Creating event network-changed:1edba9ff-814f-4b53-b948-2ee6e58f5fc5 for instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 on n-h2-858384-17 Oct 31 15:35:20.482850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:35:20.484202 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-321da647-a964-4f17-a4f5-00ba16335a1e req-4bfda32d-f5a4-406a-bf00-8b54193b9c6a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080106 Oct 31 15:35:20.485302 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2106/4066] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:20.497969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:20.500938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:20.502417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:35:20.514810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.516561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.518646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.519670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:20.521923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:20.522617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:20.677300 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de9941e7-f04d-420e-b86e-92ac1446fb57 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479747 Oct 31 15:35:20.682031 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1961/4067] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:35:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:35:20.697679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd62dd64-cdfb-45fd-8893-5690389f48df tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:20.698608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd62dd64-cdfb-45fd-8893-5690389f48df tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:20.814131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd62dd64-cdfb-45fd-8893-5690389f48df tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:20.844730 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd62dd64-cdfb-45fd-8893-5690389f48df tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1216 microversion: 2.1 time: 0.153350 Oct 31 15:35:20.854272 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1962/4068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:20 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1216 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:21.408617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:21.408915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:21.426435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:21.426946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:21.427414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:21.428128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:21.428590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:21.450364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:21.667256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:21.728303 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b09fb6cb-2a11-47b5-a23e-a34935bf11ab tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1469 microversion: 2.1 time: 1.231053 Oct 31 15:35:21.749196 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2107/4069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:20 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1469 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:21.877043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8cdaf6a-7538-478b-9495-9f984174062b tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:21.877615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8cdaf6a-7538-478b-9495-9f984174062b tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:21.960154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:21.977769 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1151a928-24a2-4bba-b4be-9e4f2cf4bc18 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 0.573383 Oct 31 15:35:21.997411 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1963/4070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:21 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:21.998951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c8cdaf6a-7538-478b-9495-9f984174062b tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:22.041868 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8cdaf6a-7538-478b-9495-9f984174062b tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1216 microversion: 2.1 time: 0.169099 Oct 31 15:35:22.060918 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2108/4071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:21 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1216 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:22.765938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:22.767436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:22.784997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:22.785569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:22.786032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:22.786910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:22.787701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:22.790387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.004437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:23.005656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:23.037770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.042838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.044907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.049008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.049712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.050353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.539282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:23.554704 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f225009-757c-404d-94c5-8c2079d01c57 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1469 microversion: 2.1 time: 0.793153 Oct 31 15:35:23.556017 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1964/4072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:22 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1469 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:23.561695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:23.562688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:23.569079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.570014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.570681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.589883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.590578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.590736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.767728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:23.792233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:23.808730 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-139f54d5-11bf-41dd-99da-aeb59c80e415 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1274 microversion: 2.1 time: 0.251347 Oct 31 15:35:23.814423 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee0b9a68-1a0a-415f-956c-a9a6a6607243 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 0.814189 Oct 31 15:35:23.818602 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2109/4073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:22 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:23.826736 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1965/4074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:23 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:23.922870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d2df5f29-50a7-4bdd-b2e8-44ffe67f3499 req-7d7115e0-d393-460f-a41e-46f2941ffe22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628b5ef1-37c0-4bd0-bdae-b030d95c657c", "name": "network-vif-unplugged", "status": "completed", "tag": "b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:23.937182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:23.939784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2df5f29-50a7-4bdd-b2e8-44ffe67f3499 req-7d7115e0-d393-460f-a41e-46f2941ffe22 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:23.941007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2df5f29-50a7-4bdd-b2e8-44ffe67f3499 req-7d7115e0-d393-460f-a41e-46f2941ffe22 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:23.941601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2df5f29-50a7-4bdd-b2e8-44ffe67f3499 req-7d7115e0-d393-460f-a41e-46f2941ffe22 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:23.987032 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d2df5f29-50a7-4bdd-b2e8-44ffe67f3499 req-7d7115e0-d393-460f-a41e-46f2941ffe22 service nova] Creating event network-vif-unplugged:b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316 for instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c on n-h2-858384-17 Oct 31 15:35:24.008026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-d2df5f29-50a7-4bdd-b2e8-44ffe67f3499 req-7d7115e0-d393-460f-a41e-46f2941ffe22 service nova] Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:35:24.025815 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d2df5f29-50a7-4bdd-b2e8-44ffe67f3499 req-7d7115e0-d393-460f-a41e-46f2941ffe22 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108757 Oct 31 15:35:24.027304 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2110/4075] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:24.585211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:24.585825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:24.598073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:24.598727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:24.599509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:24.600257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:24.600728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:24.601194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:24.836549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:24.837520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:24.856691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:24.869875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:24.875401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:24.877317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:24.877995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:24.878457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.046811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.060122 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b0d354e1-9f1f-44d3-8729-54a6d1bf6626 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1274 microversion: 2.1 time: 0.228240 Oct 31 15:35:25.061566 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2111/4076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:24 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1274 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:25.069113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:25.070063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:25.078355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.079367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.080024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.081623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.083007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.083934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.429932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.442649 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8695357-4389-479d-849f-378132ca335b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 0.377296 Oct 31 15:35:25.443519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2112/4077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:25 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:25.518893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7f73c015-ec22-49c2-8bb0-c1636d756700 req-c8f21acd-9078-4fbd-aa6e-3d91d7c19f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0b7012-4606-4145-b69e-1ec621c768a7", "name": "network-vif-plugged", "status": "completed", "tag": "4214b8bf-52b7-43f9-9a0f-a03454093256"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:25.565192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7f73c015-ec22-49c2-8bb0-c1636d756700 req-c8f21acd-9078-4fbd-aa6e-3d91d7c19f2e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:25.566058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7f73c015-ec22-49c2-8bb0-c1636d756700 req-c8f21acd-9078-4fbd-aa6e-3d91d7c19f2e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:25.566660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7f73c015-ec22-49c2-8bb0-c1636d756700 req-c8f21acd-9078-4fbd-aa6e-3d91d7c19f2e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:25.601756 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7f73c015-ec22-49c2-8bb0-c1636d756700 req-c8f21acd-9078-4fbd-aa6e-3d91d7c19f2e service nova] Creating event network-vif-plugged:4214b8bf-52b7-43f9-9a0f-a03454093256 for instance ee0b7012-4606-4145-b69e-1ec621c768a7 on n-h1-858384-17 Oct 31 15:35:25.618156 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7f73c015-ec22-49c2-8bb0-c1636d756700 req-c8f21acd-9078-4fbd-aa6e-3d91d7c19f2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105861 Oct 31 15:35:25.622205 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2113/4078] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:25.986350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:25.997296 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64b8c8d3-d437-4e4d-a124-74a4e61699f0 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1469 microversion: 2.1 time: 1.415934 Oct 31 15:35:26.001201 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1966/4079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:24 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1469 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:26.095200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-90eb854d-762c-4005-b057-1d9e1d163ab3 req-c6f4a605-ccb8-42cd-acc4-0e483b632a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628b5ef1-37c0-4bd0-bdae-b030d95c657c", "tag": "b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:26.098435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:26.099095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:26.114502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:26.116060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:26.117220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-90eb854d-762c-4005-b057-1d9e1d163ab3 req-c6f4a605-ccb8-42cd-acc4-0e483b632a34 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:26.117752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-90eb854d-762c-4005-b057-1d9e1d163ab3 req-c6f4a605-ccb8-42cd-acc4-0e483b632a34 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:26.118227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-90eb854d-762c-4005-b057-1d9e1d163ab3 req-c6f4a605-ccb8-42cd-acc4-0e483b632a34 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:26.118530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:26.121943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:26.122726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:26.123388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:26.142614 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-90eb854d-762c-4005-b057-1d9e1d163ab3 req-c6f4a605-ccb8-42cd-acc4-0e483b632a34 service nova] Creating event network-changed:b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316 for instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c on n-h2-858384-17 Oct 31 15:35:26.153807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-90eb854d-762c-4005-b057-1d9e1d163ab3 req-c6f4a605-ccb8-42cd-acc4-0e483b632a34 service nova] Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:35:26.185076 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-90eb854d-762c-4005-b057-1d9e1d163ab3 req-c6f4a605-ccb8-42cd-acc4-0e483b632a34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094479 Oct 31 15:35:26.188864 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1967/4080] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:26.467243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:26.467956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:26.487085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:26.488985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:26.490366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:26.491443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:26.493847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:26.495143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:27.029703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:27.040040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:27.055547 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c80b174c-ff42-4912-a43c-d5223627e5a5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1315 microversion: 2.1 time: 0.593291 Oct 31 15:35:27.058714 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a029a44f-f916-436c-84cd-0b2e4db480e7 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1316 microversion: 2.1 time: 0.974287 Oct 31 15:35:27.060259 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1968/4081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:26 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:27.071062 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2114/4082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:26 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1316 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:27.097662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:27.098521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:27.110117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:27.110626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:27.111068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:27.111788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:27.112250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:27.112681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:27.534614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:27.546585 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f037a76d-8b1c-409a-aa0c-b16e83838aa8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1469 microversion: 2.1 time: 0.484546 Oct 31 15:35:27.547832 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1969/4083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:27 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1469 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:28.078123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7850cce5-0667-4090-b6b9-59e8992a21a9 req-652e7d01-305f-4e74-b106-4ef1d7e9b22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75878f1c-fd1a-40c3-94e2-6ae177ad7a93", "tag": "10efd012-83ea-496f-b1c1-c9624c9185ec"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:28.086807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:28.087483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:28.099853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.100345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.100778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.100937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7850cce5-0667-4090-b6b9-59e8992a21a9 req-652e7d01-305f-4e74-b106-4ef1d7e9b22f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.101506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.101971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.102419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7850cce5-0667-4090-b6b9-59e8992a21a9 req-652e7d01-305f-4e74-b106-4ef1d7e9b22f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.102563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.102864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7850cce5-0667-4090-b6b9-59e8992a21a9 req-652e7d01-305f-4e74-b106-4ef1d7e9b22f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.126390 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7850cce5-0667-4090-b6b9-59e8992a21a9 req-652e7d01-305f-4e74-b106-4ef1d7e9b22f service nova] Creating event network-changed:10efd012-83ea-496f-b1c1-c9624c9185ec for instance 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 on n-h1-858384-17 Oct 31 15:35:28.139217 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7850cce5-0667-4090-b6b9-59e8992a21a9 req-652e7d01-305f-4e74-b106-4ef1d7e9b22f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065254 Oct 31 15:35:28.142990 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2115/4084] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:28.154802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:28.171268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:28.193442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.193953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.203761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.206281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.206936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.208457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.458191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:28.471822 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45b869cb-2142-4f1f-817a-6ae9cac16c12 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1316 microversion: 2.1 time: 0.326722 Oct 31 15:35:28.472700 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2116/4085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:28 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:28.520792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:28.532872 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a23f208-ca60-4228-a1eb-b260e7ebe481 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1503 microversion: 2.1 time: 0.450550 Oct 31 15:35:28.533515 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1970/4086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:28 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:28.556952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff85f3dd-0a71-45a8-ace4-330e35a347a9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:28.563591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff85f3dd-0a71-45a8-ace4-330e35a347a9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.564089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff85f3dd-0a71-45a8-ace4-330e35a347a9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.566829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff85f3dd-0a71-45a8-ace4-330e35a347a9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.586149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:28.587117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:28.599224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.599733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.600183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.602438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.602921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.603363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.625679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff85f3dd-0a71-45a8-ace4-330e35a347a9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:35:28.697534 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff85f3dd-0a71-45a8-ace4-330e35a347a9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7/action" status: 202 len: 0 microversion: 2.1 time: 0.141539 Oct 31 15:35:28.697534 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2117/4087] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:28 2022] POST /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:28.709103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:28.709944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:28.719538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.720076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.720540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.721288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:28.722054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:28.722996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:28.995849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:29.019245 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06fa1be2-cad5-4538-bf6e-29c744cbeb77 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1469 microversion: 2.1 time: 0.441129 Oct 31 15:35:29.042272 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1971/4088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:28 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1469 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:29.335859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:29.346859 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-384904d2-d8b0-44c0-8a81-0ebe7d71c512 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.643700 Oct 31 15:35:29.347472 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2118/4089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:28 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:29.503164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:29.503821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:29.517705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:29.518572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:29.520628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:29.521586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:29.524034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:29.524812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:29.532604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:30.051044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:30.052086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:30.063945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:30.066242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:30.067770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:30.068923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:30.071117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:30.076796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:30.081504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:30.086139 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ddc83640-6b43-4b66-be11-b94e9aae02b3 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1316 microversion: 2.1 time: 0.589680 Oct 31 15:35:30.097280 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1972/4090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:29 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1316 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:30.370550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:30.371296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:30.383223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:30.383660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:30.384093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:30.384798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:30.385447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:30.386016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:30.397230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:30.506869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:30.525031 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-74ca827d-68ff-4150-a9cb-3e389f2180ff tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1462 microversion: 2.1 time: 0.477281 Oct 31 15:35:30.528948 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2119/4091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:30 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1462 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:30.826341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:31.049227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:31.070296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2cb7dbe0-8e95-4d9d-92a6-e3de630882d8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:31.071190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2cb7dbe0-8e95-4d9d-92a6-e3de630882d8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:31.073503 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0cc71bd-c90b-482b-bc9a-532f9a5163ab tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.706751 Oct 31 15:35:31.076048 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1973/4092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:30 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:31.083141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cb7dbe0-8e95-4d9d-92a6-e3de630882d8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.083654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cb7dbe0-8e95-4d9d-92a6-e3de630882d8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.084086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cb7dbe0-8e95-4d9d-92a6-e3de630882d8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.084792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cb7dbe0-8e95-4d9d-92a6-e3de630882d8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.085919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cb7dbe0-8e95-4d9d-92a6-e3de630882d8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.086357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cb7dbe0-8e95-4d9d-92a6-e3de630882d8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.127752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:31.129455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:31.152296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.155678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.156207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.159971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.160603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.161220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.461255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:31.474813 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2cb7dbe0-8e95-4d9d-92a6-e3de630882d8 tempest-MigrationsAdminTest-869982199 tempest-MigrationsAdminTest-869982199-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1615 microversion: 2.1 time: 0.921339 Oct 31 15:35:31.476635 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2120/4093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:30 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1615 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:31.508685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:31.509957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:31.517541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.518186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.518757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.519562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.520122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.520802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.554119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:31.674743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:31.702114 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3173f9f5-43cd-40cc-8058-eaef70468066 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1316 microversion: 2.1 time: 0.582785 Oct 31 15:35:31.705263 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1974/4094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:31 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:31.741956 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba71a997-1f11-47da-822a-beab76b19946 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "DELETE /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 204 len: 0 microversion: 2.1 time: 0.237236 Oct 31 15:35:31.742522 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2121/4095] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:31 2022] DELETE /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:35:31.752379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:31.753009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:31.763676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.764174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.764612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:31.765360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:31.773951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:31.774419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:32.114313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:32.115017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:32.128895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:32.136100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:32.137972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:32.138450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:32.139203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:32.142612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:32.143449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:32.161813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:32.186704 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4885b1d8-be5e-406a-9504-885be33b9137 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1468 microversion: 2.1 time: 0.439029 Oct 31 15:35:32.189468 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1975/4096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:31 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1468 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:32.532302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:32.544209 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-332e9301-18ff-4eff-9f0b-60f5a281f174 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.441592 Oct 31 15:35:32.545907 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2122/4097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:32 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:32.734187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:32.735391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:32.743842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:32.744659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:32.745613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:32.747120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:32.747856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:32.748623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:33.103744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-42c66e2e-c47b-4c08-9d60-d6b9adb2cfdf req-9f950256-69b7-4500-a609-a0506a1efc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628b5ef1-37c0-4bd0-bdae-b030d95c657c", "name": "network-vif-plugged", "status": "completed", "tag": "b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:33.129935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-42c66e2e-c47b-4c08-9d60-d6b9adb2cfdf req-9f950256-69b7-4500-a609-a0506a1efc0f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:33.130424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-42c66e2e-c47b-4c08-9d60-d6b9adb2cfdf req-9f950256-69b7-4500-a609-a0506a1efc0f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:33.130841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-42c66e2e-c47b-4c08-9d60-d6b9adb2cfdf req-9f950256-69b7-4500-a609-a0506a1efc0f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:33.163484 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-42c66e2e-c47b-4c08-9d60-d6b9adb2cfdf req-9f950256-69b7-4500-a609-a0506a1efc0f service nova] Creating event network-vif-plugged:b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316 for instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c on n-h2-858384-17 Oct 31 15:35:33.173299 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-42c66e2e-c47b-4c08-9d60-d6b9adb2cfdf req-9f950256-69b7-4500-a609-a0506a1efc0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070318 Oct 31 15:35:33.174358 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2123/4098] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:35:33.219396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:33.220462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:33.235518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:33.238215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:33.238914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:33.240906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:33.241798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:33.243430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:33.325499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:33.342606 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cfaec1d1-aaf7-48ab-a428-5030e435232c tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1316 microversion: 2.1 time: 0.612638 Oct 31 15:35:33.343302 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1976/4099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:32 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:33.571297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:33.571864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:33.582635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:33.583412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:33.584322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:33.585378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:33.586138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:33.586840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:33.773057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:33.783374 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-812d1103-111c-4776-8963-84875f47b7a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.219220 Oct 31 15:35:33.803654 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1977/4100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:33 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:33.833947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:33.843453 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4758013d-1dfa-4b56-a5b7-dc8558944eef tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1468 microversion: 2.1 time: 0.630146 Oct 31 15:35:33.844416 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2124/4101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:33 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1468 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:34.324237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-999387244", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "e2d970bf-e647-4b2b-89cb-a68b05aa69d5"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:34.368788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:34.369435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:34.388537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.389045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.389512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.390226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.391783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.392444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.395492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] validate_networks() for [('e2d970bf-e647-4b2b-89cb-a68b05aa69d5', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:35:34.739285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:34.756301 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7035ae30-9455-42dc-92cb-eec62d5dee5e tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1316 microversion: 2.1 time: 0.392240 Oct 31 15:35:34.769387 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2125/4102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:34 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:34.818514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:34.818928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:34.832001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.841426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.844262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:34.845728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:34.849526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:34.851742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.196767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:35.211167 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b89ca0aa-6a60-4ac0-b20a-d92ef33707a0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.402776 Oct 31 15:35:35.211808 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2126/4103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:34 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:35.224977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:35.225343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:35:35.225635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:35.226095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:35:35.226712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:35:35.227255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:35:35.227942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:35:35.237237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.237705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.238206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.241173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.241650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.242112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.243363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.245635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.249510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.257995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.258536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.259463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.301191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Getting quotas for project 01c5cf21a2a94c689ab6f1031aa24fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:35:35.309183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.309704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.311914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Getting quotas for user b7b46c7632a049e080b5133736734fdc and project 01c5cf21a2a94c689ab6f1031aa24fdd. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:35:35.317312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.318111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lazy-loading 'fault' on Instance uuid 628b5ef1-37c0-4bd0-bdae-b030d95c657c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:35.338651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:35:35.363087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:35:35.397735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:35.410013 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23ae0f8e-f439-46fb-8f0f-cdbb2e318a46 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 200 len: 1303 microversion: 2.1 time: 0.196783 Oct 31 15:35:35.410936 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2127/4104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:35 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 1303 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:35.426593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0358a3c7-9cd3-43ec-bb33-408ed21c8bb2 req-dcff79f9-2069-4429-89c1-29e8b96f8793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628b5ef1-37c0-4bd0-bdae-b030d95c657c", "name": "network-vif-deleted", "tag": "b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:35.446104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0358a3c7-9cd3-43ec-bb33-408ed21c8bb2 req-dcff79f9-2069-4429-89c1-29e8b96f8793 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.446825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0358a3c7-9cd3-43ec-bb33-408ed21c8bb2 req-dcff79f9-2069-4429-89c1-29e8b96f8793 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.450205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0358a3c7-9cd3-43ec-bb33-408ed21c8bb2 req-dcff79f9-2069-4429-89c1-29e8b96f8793 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.453586 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7fa35560-5891-49a4-bf90-1d109f4e5c3a tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.507318 Oct 31 15:35:35.454246 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1978/4105] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:35:35.469568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d4f67e9-503e-43e2-9e38-867970d98948 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:35.472394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d4f67e9-503e-43e2-9e38-867970d98948 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:35.472761 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0358a3c7-9cd3-43ec-bb33-408ed21c8bb2 req-dcff79f9-2069-4429-89c1-29e8b96f8793 service nova] Creating event network-vif-deleted:b0f9f42e-63ff-4a42-b4e4-f78a7a9a3316 for instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c on n-h2-858384-17 Oct 31 15:35:35.483397 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0358a3c7-9cd3-43ec-bb33-408ed21c8bb2 req-dcff79f9-2069-4429-89c1-29e8b96f8793 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060818 Oct 31 15:35:35.484233 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2128/4106] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:35.523019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e64244b1-d5dd-48f0-b484-93f299c5052c req-a8e09bc0-1f67-413a-8b5f-f63208839318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75878f1c-fd1a-40c3-94e2-6ae177ad7a93", "name": "network-vif-plugged", "status": "completed", "tag": "10efd012-83ea-496f-b1c1-c9624c9185ec"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:35.550445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e64244b1-d5dd-48f0-b484-93f299c5052c req-a8e09bc0-1f67-413a-8b5f-f63208839318 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.552594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e64244b1-d5dd-48f0-b484-93f299c5052c req-a8e09bc0-1f67-413a-8b5f-f63208839318 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.554657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e64244b1-d5dd-48f0-b484-93f299c5052c req-a8e09bc0-1f67-413a-8b5f-f63208839318 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.596072 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e64244b1-d5dd-48f0-b484-93f299c5052c req-a8e09bc0-1f67-413a-8b5f-f63208839318 service nova] Creating event network-vif-plugged:10efd012-83ea-496f-b1c1-c9624c9185ec for instance 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 on n-h1-858384-17 Oct 31 15:35:35.611167 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e64244b1-d5dd-48f0-b484-93f299c5052c req-a8e09bc0-1f67-413a-8b5f-f63208839318 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113358 Oct 31 15:35:35.614220 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2129/4107] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:35.641318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d4f67e9-503e-43e2-9e38-867970d98948 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:35.661833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d4f67e9-503e-43e2-9e38-867970d98948 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:35.663706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d4f67e9-503e-43e2-9e38-867970d98948 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:35.667184 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d4f67e9-503e-43e2-9e38-867970d98948 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1261 microversion: 2.26 time: 0.202733 Oct 31 15:35:35.668708 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1979/4108] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:35 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:35.783296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:35.784668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:35.797358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.799075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.799856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:35.801256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:35.801738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:35.802173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.170560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:36.178708 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23749b47-236f-4ddd-8c0c-ffa328a298f8 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1316 microversion: 2.1 time: 0.400348 Oct 31 15:35:36.186111 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2130/4109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:35 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1316 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:36.240237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:36.240884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:36.255071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.256241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.258258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.260408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.263006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.265056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.440051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:36.441186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 628b5ef1-37c0-4bd0-bdae-b030d95c657c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:36.456960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.457571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.458123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.459427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.460138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.461219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.504359 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] HTTP exception thrown: Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c could not be found. Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Request method failure captured: Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c HTTP/1.1 Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-n8rLHF2MgaOa0h4gx0-EmBO96XWw3g9lU6Bg5iI2O_lVtnQJpE3U2gknoHK8KnJtkyfK8f7dcIB9k4Ox18ScCR6RCrl6s0042b2DQihWWbBHGfjQ35MLJ_fkZ8BCzs2C7fxwN2BKkAJSzEuuWpWXLIJaWrjQlAU8tO36Nwzc5DH0g Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 34b23d8ffada4f7b9b839976bc376bc4 Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b23d8ffada4f7b9b839976bc376bc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b23d8ffada4f7b9b839976bc376bc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b23d8ffada4f7b9b839976bc376bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b23d8ffada4f7b9b839976bc376bc4"}]}] Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 34b23d8ffada4f7b9b839976bc376bc4 Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-MigrationsAdminTest-1939194696-project Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4df669ecccf24e8e9b41574f29ba157b Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-MigrationsAdminTest-1939194696-project Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c could not be found. Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '628b5ef1-37c0-4bd0-bdae-b030d95c657c'} Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c could not be found. Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c could not be found. Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:36.506500 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:36.510053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:36.510053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:36.510053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:36.510053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:36.510053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:36.510053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c could not be found. Oct 31 15:35:36.510053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:36.512286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Returning 404 to user: Instance 628b5ef1-37c0-4bd0-bdae-b030d95c657c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:36.514052 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e97472f6-4fcd-4eb2-a613-51326c87232a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c" status: 404 len: 111 microversion: 2.1 time: 0.079282 Oct 31 15:35:36.521054 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2131/4110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:36 2022] GET /compute/v2.1/servers/628b5ef1-37c0-4bd0-bdae-b030d95c657c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:36.526465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:36.530088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:36.530810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:36.538846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.539642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.540947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.541757 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c8e8339f-4fad-4cf7-ad43-5085c0eac34b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.306935 Oct 31 15:35:36.542197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.542793 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1980/4111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:36 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:36.543730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.545121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.597806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:36.699082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:36.700074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:36.709590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.709979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.710406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.714105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.715294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.716959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.723132 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10f7c806-7300-4481-b97b-90694715b3cd tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 204 len: 0 microversion: 2.1 time: 0.199887 Oct 31 15:35:36.724444 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2132/4112] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:36 2022] DELETE /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:35:36.735491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:36.736302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:36.744385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.744992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.745578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.746283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:36.746769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:36.747290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:36.810875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:36.820863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:36.823187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:36.825205 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-508db7d8-8285-4c30-9fe0-bc837ecc40eb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1313 microversion: 2.26 time: 0.130329 Oct 31 15:35:36.825943 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1981/4113] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:36 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1313 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:36.999660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:37.015000 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6cff943-e149-4569-8d48-d12aa2e93937 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1534 microversion: 2.1 time: 0.285730 Oct 31 15:35:37.015830 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2133/4114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:36 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1534 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:37.211981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.212923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:37.219985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.221265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.221878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.222777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.223411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.224226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.366709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:37.377350 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63b9c8f1-956f-46f2-9baa-3e8ed5ac37c4 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1504 microversion: 2.1 time: 0.169830 Oct 31 15:35:37.378580 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1982/4115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:37.404878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18b6f00b-9503-4e48-a552-7836052f6247 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.404878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-18b6f00b-9503-4e48-a552-7836052f6247 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:37.410757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18b6f00b-9503-4e48-a552-7836052f6247 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.411628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18b6f00b-9503-4e48-a552-7836052f6247 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.414990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18b6f00b-9503-4e48-a552-7836052f6247 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.416429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18b6f00b-9503-4e48-a552-7836052f6247 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.424120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18b6f00b-9503-4e48-a552-7836052f6247 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.424398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18b6f00b-9503-4e48-a552-7836052f6247 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.520209 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-18b6f00b-9503-4e48-a552-7836052f6247 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.121408 Oct 31 15:35:37.521349 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2134/4116] 10.222.0.20 () {58 vars in 1296 bytes} [Mon Oct 31 15:35:37 2022] DELETE /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93/os-server-password => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:35:37.532966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8bf1647e-2136-43da-b3e4-475c9317c3eb tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.533508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bf1647e-2136-43da-b3e4-475c9317c3eb tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:37.539982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf1647e-2136-43da-b3e4-475c9317c3eb tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.540479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf1647e-2136-43da-b3e4-475c9317c3eb tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.540918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf1647e-2136-43da-b3e4-475c9317c3eb tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.541653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf1647e-2136-43da-b3e4-475c9317c3eb tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.542107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf1647e-2136-43da-b3e4-475c9317c3eb tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.542522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bf1647e-2136-43da-b3e4-475c9317c3eb tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.570872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.571509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:37.579540 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8bf1647e-2136-43da-b3e4-475c9317c3eb tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.052492 Oct 31 15:35:37.590311 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1983/4117] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93/os-server-password => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:35:37.593547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.596116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.596116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.596722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.597317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.598284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.598897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:37.599009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.606964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.607459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.609749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:37.610662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.611708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.612303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.612803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.661099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:37.766696 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-44501e24-e6cb-472c-a3c1-c2a56179c4d6 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 204 len: 0 microversion: 2.1 time: 0.174385 Oct 31 15:35:37.773292 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1984/4118] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:37 2022] DELETE /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:35:37.788458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:37.789670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:37.797018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.797868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.798529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.799874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:37.800515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:37.801118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:37.988682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:37.998782 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-44177025-01e4-4ccb-b2a7-a0ea4a3e72b1 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1510 microversion: 2.1 time: 0.223611 Oct 31 15:35:37.999573 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1985/4119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:38.004587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:38.005215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:38.014983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:38.015479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:38.015985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:38.016710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:38.017170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:38.017640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:38.019675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:38.043909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-70d65102-c1f1-4c04-a232-a50c5263fee5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.476214 Oct 31 15:35:38.057766 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2135/4120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:38.067988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:38.068704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:38.076653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:38.077172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:38.077601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:38.078307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:38.078757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:38.079176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:38.155195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:38.187198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:38.189866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:38.202122 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-979cb3ad-df72-4b80-bc34-c0a6919d3a90 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1313 microversion: 2.26 time: 0.201524 Oct 31 15:35:38.208338 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1986/4121] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:37 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:38.368594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:38.377060 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67cc4c42-5793-4491-824e-cfcd47aa2dfa tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1534 microversion: 2.1 time: 0.317618 Oct 31 15:35:38.377682 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2136/4122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:38 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1534 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:39.024588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:39.025872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:39.034990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.035482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.043713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.044604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.045032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.045517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.071101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:39.073387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:39.082590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.083423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.084055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.084954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.085618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.086441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.273215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:39.286266 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26aecaf9-b8c7-4d9f-97d9-e43f9f719129 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1510 microversion: 2.1 time: 0.265616 Oct 31 15:35:39.289410 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1987/4123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:39 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:39.296422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:39.297290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:39.304499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.305412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.306055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.307020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.307717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.308384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.408637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:39.422758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:39.425010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:39.426416 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63e1b75f-60b8-4b2f-a19a-313052907ffd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1319 microversion: 2.26 time: 0.135592 Oct 31 15:35:39.427205 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1988/4124] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:39 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1319 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:39.442606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:39.443588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:39.457712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.458204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.459067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.459785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.460241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.460831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:39.464006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:39.728759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:39.743150 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2b717b4-71d7-4ed9-92fd-e45033b1f9d2 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1534 microversion: 2.1 time: 0.313888 Oct 31 15:35:39.745861 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1989/4125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:39 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1534 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:39.809811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:39.819052 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-325dcabf-3db1-4d09-87e0-a36383f5da37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.751692 Oct 31 15:35:39.819888 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2137/4126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:39 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:39.969569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-144e7d20-2f43-4b51-87a0-cc7449a63dfe req-d4591df0-f26c-4906-a749-a2b937637632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75878f1c-fd1a-40c3-94e2-6ae177ad7a93", "name": "network-vif-deleted", "tag": "10efd012-83ea-496f-b1c1-c9624c9185ec"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:39.989831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:39.992550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-144e7d20-2f43-4b51-87a0-cc7449a63dfe req-d4591df0-f26c-4906-a749-a2b937637632 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:39.993119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-144e7d20-2f43-4b51-87a0-cc7449a63dfe req-d4591df0-f26c-4906-a749-a2b937637632 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:39.993597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-144e7d20-2f43-4b51-87a0-cc7449a63dfe req-d4591df0-f26c-4906-a749-a2b937637632 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.039713 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-144e7d20-2f43-4b51-87a0-cc7449a63dfe req-d4591df0-f26c-4906-a749-a2b937637632 service nova] Creating event network-vif-deleted:10efd012-83ea-496f-b1c1-c9624c9185ec for instance 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 on n-h1-858384-17 Oct 31 15:35:40.048831 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-144e7d20-2f43-4b51-87a0-cc7449a63dfe req-d4591df0-f26c-4906-a749-a2b937637632 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083853 Oct 31 15:35:40.050353 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1990/4127] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:35:40.318997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:40.321689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:40.339365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.343180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.346593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.347734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.350611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.352273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.440019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.440790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.441422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.442041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lazy-loading 'fault' on Instance uuid 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:40.462356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:40.464327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:40.475234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.476348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.477410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.478377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.479149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.480971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.548453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a102b25680d42a991b6ee7a61cc2339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39e5fd1536b4827910710309dd125b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:40.564314 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9b9d4824-c570-4299-82d6-5231d168ef4d tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 200 len: 1306 microversion: 2.1 time: 0.249848 Oct 31 15:35:40.569170 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2138/4128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:40 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:40.581829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:40.618140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:40.630958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:40.634266 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-66e43685-1a9c-4ec8-8974-04198ee8aae5 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1319 microversion: 2.26 time: 0.182000 Oct 31 15:35:40.635357 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1991/4129] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:40 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:40.772034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:40.772656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:40.781729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.782588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.783228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.784277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.784937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.785645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.844749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:40.845562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:40.853690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.853690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.853961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.861455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:40.862073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:40.862963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:40.967007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:40.978742 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-130efe04-6842-4e27-bf44-f1ccfa177859 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 200 len: 1492 microversion: 2.1 time: 0.213664 Oct 31 15:35:40.979428 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2139/4130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:40 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 1492 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:41.001260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9203b015-9ba2-4083-aa5e-9b0cd9879ce7 req-c9b4371c-574c-40e1-8145-d4f5a24802cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1d5920-53d9-4a92-a425-fa5b05188607", "name": "network-vif-deleted", "tag": "0f659744-e2ea-4c48-aa1a-d1a62adc94e0"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:41.041025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9203b015-9ba2-4083-aa5e-9b0cd9879ce7 req-c9b4371c-574c-40e1-8145-d4f5a24802cf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.049030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9203b015-9ba2-4083-aa5e-9b0cd9879ce7 req-c9b4371c-574c-40e1-8145-d4f5a24802cf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.049550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9203b015-9ba2-4083-aa5e-9b0cd9879ce7 req-c9b4371c-574c-40e1-8145-d4f5a24802cf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.087290 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9203b015-9ba2-4083-aa5e-9b0cd9879ce7 req-c9b4371c-574c-40e1-8145-d4f5a24802cf service nova] Creating event network-vif-deleted:0f659744-e2ea-4c48-aa1a-d1a62adc94e0 for instance 1a1d5920-53d9-4a92-a425-fa5b05188607 on n-h2-858384-17 Oct 31 15:35:41.102955 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9203b015-9ba2-4083-aa5e-9b0cd9879ce7 req-c9b4371c-574c-40e1-8145-d4f5a24802cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120447 Oct 31 15:35:41.103928 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2140/4131] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:41.182763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:41.193227 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5909255d-fb50-4118-8acf-6a43a743e207 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.352429 Oct 31 15:35:41.213276 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1992/4132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:40 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:41.591260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:41.591957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] [instance: 75878f1c-fd1a-40c3-94e2-6ae177ad7a93] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:41.601809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.603208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.605640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.606775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.607463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.608411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.644894 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] HTTP exception thrown: Instance 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 could not be found. Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Request method failure captured: Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 HTTP/1.1 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-s3I-Jun1sNGefWGboxSBTfWvQeATxoF3ZWjBqZQkbBwV5pBwvJrdzJOElslEsGbpfnvRmerSowulSMGKmu-qhCZ2_MRnG0x48L_LHEqLcWGfS0DN_CjnoZ4SD7-yG96hBkU8xQiQmCFPGialIia27N12QURHNuhe8rgEcBDsxy2N0 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: e39e5fd1536b4827910710309dd125b1 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerPasswordTestJSON-1902413883 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e39e5fd1536b4827910710309dd125b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e39e5fd1536b4827910710309dd125b1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e39e5fd1536b4827910710309dd125b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e39e5fd1536b4827910710309dd125b1"}]}] Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerPasswordTestJSON-1902413883 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: e39e5fd1536b4827910710309dd125b1 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1902413883 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerPasswordTestJSON-1902413883-project Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 7a102b25680d42a991b6ee7a61cc2339 Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerPasswordTestJSON-1902413883-project Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 could not be found. Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '75878f1c-fd1a-40c3-94e2-6ae177ad7a93'} Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 could not be found. Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 could not be found. Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:41.646767 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 could not be found. Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] Returning 404 to user: Instance 75878f1c-fd1a-40c3-94e2-6ae177ad7a93 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a8327a5-462c-4f74-a445-922f2fa22052 tempest-ServerPasswordTestJSON-1902413883 tempest-ServerPasswordTestJSON-1902413883-project] 10.222.0.20 "GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93" status: 404 len: 111 microversion: 2.1 time: 0.062819 Oct 31 15:35:41.650648 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2141/4133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:41 2022] GET /compute/v2.1/servers/75878f1c-fd1a-40c3-94e2-6ae177ad7a93 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:41.663002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:41.663906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:41.673383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.674289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.674943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:41.676634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:41.677352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:41.679029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.006588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:42.007342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 1a1d5920-53d9-4a92-a425-fa5b05188607] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:42.022707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.023435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.023893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.028046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.028640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.030955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.052724 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] HTTP exception thrown: Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 could not be found. Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Request method failure captured: Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 HTTP/1.1 Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-n8rLHF2MgaOa0h4gx0-EmBO96XWw3g9lU6Bg5iI2O_lVtnQJpE3U2gknoHK8KnJtkyfK8f7dcIB9k4Ox18ScCR6RCrl6s0042b2DQihWWbBHGfjQ35MLJ_fkZ8BCzs2C7fxwN2BKkAJSzEuuWpWXLIJaWrjQlAU8tO36Nwzc5DH0g Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 34b23d8ffada4f7b9b839976bc376bc4 Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b23d8ffada4f7b9b839976bc376bc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b23d8ffada4f7b9b839976bc376bc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b23d8ffada4f7b9b839976bc376bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b23d8ffada4f7b9b839976bc376bc4"}]}] Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 34b23d8ffada4f7b9b839976bc376bc4 Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-MigrationsAdminTest-1939194696-project Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4df669ecccf24e8e9b41574f29ba157b Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-MigrationsAdminTest-1939194696-project Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 could not be found. Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '1a1d5920-53d9-4a92-a425-fa5b05188607'} Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 could not be found. Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 could not be found. Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:42.055418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.059039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:42.059039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:42.059039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:42.059039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:42.059039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:42.059039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 could not be found. Oct 31 15:35:42.059039 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:42.061084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Returning 404 to user: Instance 1a1d5920-53d9-4a92-a425-fa5b05188607 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:42.062166 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9c850e5-0318-42ba-8d35-89a19c1f3d6a tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607" status: 404 len: 111 microversion: 2.1 time: 0.060129 Oct 31 15:35:42.063231 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2142/4134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:42 2022] GET /compute/v2.1/servers/1a1d5920-53d9-4a92-a425-fa5b05188607 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:42.072897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c989380-781d-4583-bb72-35243216547c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '.version_select at 0x7f16e1cb63a0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:42.098376 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c989380-781d-4583-bb72-35243216547c tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194593652" status: 202 len: 0 microversion: 2.1 time: 0.028886 Oct 31 15:35:42.099812 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2143/4135] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 15:35:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1194593652 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:35:42.220786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:42.221922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:42.237351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.238447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.239821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.240749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.242727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.243777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.486254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:42.499499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:42.501966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:42.503525 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7688b0a5-cc04-45c8-a2dc-f86c002abfa4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1361 microversion: 2.26 time: 0.845971 Oct 31 15:35:42.504600 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1993/4136] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:41 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1361 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:42.701078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:42.701996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:42.713060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.716436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.717083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:42.720142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:42.721193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:42.721820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:43.042346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:43.061182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:43.074800 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bca24da9-f0b6-4399-91e4-39bd3135c83b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.858034 Oct 31 15:35:43.076067 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2144/4137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:42 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:43.083843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:43.085592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:43.087254 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d06d464d-764a-4fc8-806b-a90b1979a024 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2947 microversion: 2.32 time: 0.390602 Oct 31 15:35:43.088324 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1994/4138] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:42 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2947 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:43.116988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd59f346-5207-4ff1-b556-3381a66d276a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:43.118840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd59f346-5207-4ff1-b556-3381a66d276a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:43.127013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd59f346-5207-4ff1-b556-3381a66d276a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:43.127767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd59f346-5207-4ff1-b556-3381a66d276a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:43.128405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd59f346-5207-4ff1-b556-3381a66d276a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:43.129357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd59f346-5207-4ff1-b556-3381a66d276a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:43.130095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd59f346-5207-4ff1-b556-3381a66d276a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:43.130816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd59f346-5207-4ff1-b556-3381a66d276a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:43.522117 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd59f346-5207-4ff1-b556-3381a66d276a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.408021 Oct 31 15:35:43.526782 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2145/4139] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 31 15:35:43 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0/os-interface => generated 1831 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:43.539603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:43.541383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:43.549402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:43.550479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:43.552294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:43.554952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:43.555741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:43.556515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:43.832565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:43.842250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:43.849265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:43.850532 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7623af42-7575-4362-9bdb-bd2432ea264d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1361 microversion: 2.26 time: 0.325300 Oct 31 15:35:43.858344 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1995/4140] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:43 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:35:44.104578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:44.105891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:44.113953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:44.114723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:44.115163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:44.115874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:44.116333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:44.116757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:44.836485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:44.850201 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-740bbe9b-8610-4057-8fc2-2c3c6186d4a3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.749654 Oct 31 15:35:44.851915 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2146/4141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:44 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:44.888232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:44.890352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:44.898604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:44.899307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:44.899926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:44.900791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:44.901431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:44.902065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:44.985763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fa936d61-cd69-42e8-a1a9-7c433b4275f0 req-546d8d90-49bd-49cd-9923-ed78a30f8c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5632a5a6-078e-42a7-b128-4124be821e9c", "tag": "ce0bee89-b74c-4b5f-ba06-4b8734c10333"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:45.022198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fa936d61-cd69-42e8-a1a9-7c433b4275f0 req-546d8d90-49bd-49cd-9923-ed78a30f8c0c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.026523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fa936d61-cd69-42e8-a1a9-7c433b4275f0 req-546d8d90-49bd-49cd-9923-ed78a30f8c0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.029466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fa936d61-cd69-42e8-a1a9-7c433b4275f0 req-546d8d90-49bd-49cd-9923-ed78a30f8c0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.064098 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fa936d61-cd69-42e8-a1a9-7c433b4275f0 req-546d8d90-49bd-49cd-9923-ed78a30f8c0c service nova] Creating event network-changed:ce0bee89-b74c-4b5f-ba06-4b8734c10333 for instance 5632a5a6-078e-42a7-b128-4124be821e9c on n-h2-858384-17 Oct 31 15:35:45.086309 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fa936d61-cd69-42e8-a1a9-7c433b4275f0 req-546d8d90-49bd-49cd-9923-ed78a30f8c0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113042 Oct 31 15:35:45.087608 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2147/4142] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:45.255492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:45.278841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:45.283611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:45.285029 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-24a62706-67ca-4a7a-a316-3eafcd506ecb tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1361 microversion: 2.26 time: 0.401924 Oct 31 15:35:45.286324 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1996/4143] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:44 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:45.661654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:45.662233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:45.677377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.679455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.682411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.683457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.684370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.686193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.764689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:45.878364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:45.879138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:45.881929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:45.883970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:45.921939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.922615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:45.922758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.931442 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d261d0b-2bc7-4dd9-8d2d-0d88b632ec0b tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "DELETE /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 204 len: 0 microversion: 2.1 time: 0.274391 Oct 31 15:35:45.940843 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2148/4144] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:45 2022] DELETE /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:35:45.943989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.947943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.951799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.954092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.958404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:45.967767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:45.990415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.990922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.993995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:45.994823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:45.995319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:45.996575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:46.482630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:46.499611 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c5c1519-1fa5-423b-9944-fa44da817219 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.625080 Oct 31 15:35:46.513474 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1997/4145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:45 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:46.515041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:46.517075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:46.533538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:46.535173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:46.538505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:46.541755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:46.544776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:46.545664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:46.810460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:46.818986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:46.820435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:46.821154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:46.822227 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-84669c34-1b3b-4763-a751-8df27aac4556 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1361 microversion: 2.26 time: 0.318288 Oct 31 15:35:46.822806 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1998/4146] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:46 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:46.832251 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a00e322b-36e4-4d7b-aa30-0439f865f553 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1469 microversion: 2.1 time: 0.889205 Oct 31 15:35:46.837145 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2149/4147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:45 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1469 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:47.532368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:47.533949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:47.551710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.552123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.552561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:47.557418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.557418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.568075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:47.817007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:47.831921 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-18a9a684-5397-4bfb-9271-f44bebaffe70 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.305382 Oct 31 15:35:47.835060 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 1999/4148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:47 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:47.879587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:47.881010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:47.882544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:47.890573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:47.903087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.906122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.907862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.909100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:47.910126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.910857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.911583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.912948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:47.913933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:47.914190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:47.917082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:47.917844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:48.180362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:48.190336 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8d5209c-22bc-4634-b652-24e13c8d23b8 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1469 microversion: 2.1 time: 0.315155 Oct 31 15:35:48.201343 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2000/4149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:47 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1469 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:48.451771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:48.463621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:48.474285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-420b8e17-3801-4859-bc49-71308e5811ea req-64225eca-81fe-4ca0-8b81-6e3ab183fd85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e4c90d-51a5-43da-bd79-bb99662db232", "name": "network-vif-deleted", "tag": "2e5a8b47-d95d-4dbf-852e-51ad01cbe282"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:48.479131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:48.483538 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f8efa542-9011-4fd6-bb2a-b409c72f0519 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1361 microversion: 2.26 time: 0.612986 Oct 31 15:35:48.505550 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2150/4150] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:47 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1361 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:48.507632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-420b8e17-3801-4859-bc49-71308e5811ea req-64225eca-81fe-4ca0-8b81-6e3ab183fd85 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:48.508297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-420b8e17-3801-4859-bc49-71308e5811ea req-64225eca-81fe-4ca0-8b81-6e3ab183fd85 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:48.508876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-420b8e17-3801-4859-bc49-71308e5811ea req-64225eca-81fe-4ca0-8b81-6e3ab183fd85 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:48.534830 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-420b8e17-3801-4859-bc49-71308e5811ea req-64225eca-81fe-4ca0-8b81-6e3ab183fd85 service nova] Creating event network-vif-deleted:2e5a8b47-d95d-4dbf-852e-51ad01cbe282 for instance 17e4c90d-51a5-43da-bd79-bb99662db232 on n-h2-858384-17 Oct 31 15:35:48.545086 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-420b8e17-3801-4859-bc49-71308e5811ea req-64225eca-81fe-4ca0-8b81-6e3ab183fd85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076373 Oct 31 15:35:48.547161 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2001/4151] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:35:48.864777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:48.865430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:48.886288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:48.889328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:48.889840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:48.890977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:48.891445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:48.892259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.217888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:49.218648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:49.235448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.238114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.238703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.240683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.241701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.242679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.306747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.307580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.308759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.309493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lazy-loading 'fault' on Instance uuid 17e4c90d-51a5-43da-bd79-bb99662db232 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:49.361000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:49.369632 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e2f1305-f206-47fc-9ce3-6a274f889674 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 200 len: 1303 microversion: 2.1 time: 0.158439 Oct 31 15:35:49.370063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:49.372429 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2002/4152] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:49 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 1303 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:49.385785 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7346af33-4be4-4ed1-88bf-ce7fe7f9be6c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.527712 Oct 31 15:35:49.387653 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2151/4153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:48 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:49.511102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:49.512001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:49.530509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.531173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.531639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.532394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:49.532864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:49.539036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:49.862417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:49.874396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:49.876038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:49.877962 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2d583a5-a0cb-4c7b-ae89-454520e01a57 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1361 microversion: 2.26 time: 0.371912 Oct 31 15:35:49.878813 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2003/4154] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:49 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:50.420088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:50.420705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 17e4c90d-51a5-43da-bd79-bb99662db232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:50.420838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:50.421580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:50.428357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.428504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.428869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.429011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.429326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.429451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.430269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.430915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.431374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.435148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.435640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.436242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.447083 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] HTTP exception thrown: Instance 17e4c90d-51a5-43da-bd79-bb99662db232 could not be found. Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Request method failure captured: Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 HTTP/1.1 Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-n8rLHF2MgaOa0h4gx0-EmBO96XWw3g9lU6Bg5iI2O_lVtnQJpE3U2gknoHK8KnJtkyfK8f7dcIB9k4Ox18ScCR6RCrl6s0042b2DQihWWbBHGfjQ35MLJ_fkZ8BCzs2C7fxwN2BKkAJSzEuuWpWXLIJaWrjQlAU8tO36Nwzc5DH0g Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 34b23d8ffada4f7b9b839976bc376bc4 Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b23d8ffada4f7b9b839976bc376bc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b23d8ffada4f7b9b839976bc376bc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b23d8ffada4f7b9b839976bc376bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b23d8ffada4f7b9b839976bc376bc4"}]}] Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 34b23d8ffada4f7b9b839976bc376bc4 Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-MigrationsAdminTest-1939194696-project Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4df669ecccf24e8e9b41574f29ba157b Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-MigrationsAdminTest-1939194696-project Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 17e4c90d-51a5-43da-bd79-bb99662db232 could not be found. Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '17e4c90d-51a5-43da-bd79-bb99662db232'} Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e4c90d-51a5-43da-bd79-bb99662db232 could not be found. Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e4c90d-51a5-43da-bd79-bb99662db232 could not be found. Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:50.449107 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:50.452887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:50.452887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:50.452887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:50.452887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:50.452887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:50.452887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e4c90d-51a5-43da-bd79-bb99662db232 could not be found. Oct 31 15:35:50.452887 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:35:50.454501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Returning 404 to user: Instance 17e4c90d-51a5-43da-bd79-bb99662db232 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:50.455819 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1051927-27dd-48ae-95ba-0aa6e23a2cbf tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232" status: 404 len: 111 microversion: 2.1 time: 0.040381 Oct 31 15:35:50.460532 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2152/4155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:50 2022] GET /compute/v2.1/servers/17e4c90d-51a5-43da-bd79-bb99662db232 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:50.466063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:50.467001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:50.474345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.475076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.475706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.476597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.477611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.478250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.521681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:50.553629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:50.597585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:50.607086 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca479a7f-c7cd-4493-bda1-b04ebf94175b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.191213 Oct 31 15:35:50.607687 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2004/4156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:50 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:50.637865 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-20cb6dec-40e1-42ea-9a7b-2b0811ce0abc tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 204 len: 0 microversion: 2.1 time: 0.175255 Oct 31 15:35:50.639318 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2153/4157] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:35:50 2022] DELETE /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:35:50.649900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:50.651066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:50.659833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.660521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.661115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.662278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.663293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.663724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.820469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:50.835456 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c0fc057-385d-4eb1-b67e-4f79bd5ca8d6 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1468 microversion: 2.1 time: 0.191360 Oct 31 15:35:50.842733 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2005/4158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:50 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1468 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:50.908942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:50.909739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:50.920516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.920939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.923627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:50.925889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:50.928154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:50.928666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.149604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a8e6eb3a-439c-452b-aa64-99c2fffa42b7 req-20e8cabf-7463-44be-9eca-efd7bd7bede8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5632a5a6-078e-42a7-b128-4124be821e9c", "name": "network-vif-plugged", "status": "completed", "tag": "ce0bee89-b74c-4b5f-ba06-4b8734c10333"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:51.152763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:51.161985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:51.164031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:51.165502 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29a69d57-6984-4e6d-a14c-4c026a95a832 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1361 microversion: 2.26 time: 0.262570 Oct 31 15:35:51.166488 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2154/4159] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:50 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1361 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:51.177629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a8e6eb3a-439c-452b-aa64-99c2fffa42b7 req-20e8cabf-7463-44be-9eca-efd7bd7bede8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.177629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a8e6eb3a-439c-452b-aa64-99c2fffa42b7 req-20e8cabf-7463-44be-9eca-efd7bd7bede8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.177629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a8e6eb3a-439c-452b-aa64-99c2fffa42b7 req-20e8cabf-7463-44be-9eca-efd7bd7bede8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.203703 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a8e6eb3a-439c-452b-aa64-99c2fffa42b7 req-20e8cabf-7463-44be-9eca-efd7bd7bede8 service nova] Creating event network-vif-plugged:ce0bee89-b74c-4b5f-ba06-4b8734c10333 for instance 5632a5a6-078e-42a7-b128-4124be821e9c on n-h2-858384-17 Oct 31 15:35:51.211226 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a8e6eb3a-439c-452b-aa64-99c2fffa42b7 req-20e8cabf-7463-44be-9eca-efd7bd7bede8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068065 Oct 31 15:35:51.212320 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2006/4160] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:51.632300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:51.635535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:51.645768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.646969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.647701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.649444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.650104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.650848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.696929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:51.764471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1461767735", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": "none"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:51.857933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:35:51.858729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:35:51.864473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:35:51.864473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:35:51.864473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:35:51.875382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.875927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.876364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.877167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.877797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.878383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.884077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:51.895073 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c2764b5c-3059-4f41-b240-9adfb639b196 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.267769 Oct 31 15:35:51.896390 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2007/4161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:51 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:35:51.899792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Getting quotas for project 9820ac6f38634ea3b325664518ca0bfd. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:35:51.903029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:51.903644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:51.909545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.910350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.911070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.911932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:51.912543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:51.912967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:51.918475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Getting quotas for user 6c8e3d08b7e146abb5e0f538b89617b0 and project 9820ac6f38634ea3b325664518ca0bfd. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:35:51.932735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:35:51.935259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:35:52.008745 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d7e2f16-b4fd-439e-bd02-a7558efaa43a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.578180 Oct 31 15:35:52.009774 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2155/4162] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:35:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:35:52.022993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3636e36-0fe5-4c5a-8b57-180ac8be6fd1 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:52.024402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3636e36-0fe5-4c5a-8b57-180ac8be6fd1 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:52.096534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3636e36-0fe5-4c5a-8b57-180ac8be6fd1 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.108742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3636e36-0fe5-4c5a-8b57-180ac8be6fd1 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.112481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3636e36-0fe5-4c5a-8b57-180ac8be6fd1 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.116571 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3636e36-0fe5-4c5a-8b57-180ac8be6fd1 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1278 microversion: 2.54 time: 0.098228 Oct 31 15:35:52.119770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2156/4163] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:52 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:52.154108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.166213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-320e3484-be97-48da-b8b4-c0694ab93e63 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1468 microversion: 2.1 time: 0.268653 Oct 31 15:35:52.173701 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2008/4164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:51 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:52.196047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:52.197999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:52.219506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.220460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.221050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.221962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.222575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.223153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.496316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.513627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.516071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:52.517945 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e554ce25-98d3-43a9-8686-f3eb4964a4ce tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1361 microversion: 2.26 time: 0.326446 Oct 31 15:35:52.528395 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2157/4165] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:52 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:52.744000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9bdc82a3-081e-4444-be3d-b6f6b87f86b2 req-27ea3bf0-8d15-41f3-bcb5-4fd44e54019d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edf57d1-6672-4b8b-a2a8-c9732d43bd25", "name": "network-vif-deleted", "tag": "4c8f254a-78b3-496f-8ba7-c0aa11279f47"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:52.760201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9bdc82a3-081e-4444-be3d-b6f6b87f86b2 req-27ea3bf0-8d15-41f3-bcb5-4fd44e54019d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.761205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9bdc82a3-081e-4444-be3d-b6f6b87f86b2 req-27ea3bf0-8d15-41f3-bcb5-4fd44e54019d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.762260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9bdc82a3-081e-4444-be3d-b6f6b87f86b2 req-27ea3bf0-8d15-41f3-bcb5-4fd44e54019d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.794828 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9bdc82a3-081e-4444-be3d-b6f6b87f86b2 req-27ea3bf0-8d15-41f3-bcb5-4fd44e54019d service nova] Creating event network-vif-deleted:4c8f254a-78b3-496f-8ba7-c0aa11279f47 for instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 on n-h1-858384-17 Oct 31 15:35:52.801627 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9bdc82a3-081e-4444-be3d-b6f6b87f86b2 req-27ea3bf0-8d15-41f3-bcb5-4fd44e54019d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061898 Oct 31 15:35:52.802784 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2009/4166] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:52.923340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:52.924667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:52.945554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.947214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.947896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:52.949496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:52.950214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:52.951481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.130628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dab2f086-431c-40e1-8672-0832aa44c4a5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.131470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dab2f086-431c-40e1-8672-0832aa44c4a5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.139603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab2f086-431c-40e1-8672-0832aa44c4a5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.140668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab2f086-431c-40e1-8672-0832aa44c4a5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.141547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab2f086-431c-40e1-8672-0832aa44c4a5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.142751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab2f086-431c-40e1-8672-0832aa44c4a5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.143650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab2f086-431c-40e1-8672-0832aa44c4a5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.144302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dab2f086-431c-40e1-8672-0832aa44c4a5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.179984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:53.181370 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dab2f086-431c-40e1-8672-0832aa44c4a5 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/ips" status: 200 len: 144 microversion: 2.1 time: 0.055155 Oct 31 15:35:53.182752 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2010/4167] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:35:53 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/ips => generated 144 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:35:53.189608 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-494aba84-1c8f-483b-ad05-05783f688e10 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1513 microversion: 2.1 time: 0.273375 Oct 31 15:35:53.190204 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2158/4168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:52 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:53.191543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.192636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.203340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.204306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.205072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.206852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.207694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.208323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.208824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.209471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.221342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.222122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.222743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.223724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.224382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.225006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.281546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.282107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.287246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.287952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lazy-loading 'fault' on Instance uuid 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:53.315508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:53.325604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:53.327440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:53.328630 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-af8e53bc-d69d-4ab8-a98f-eafb36709df7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1274 microversion: 2.54 time: 0.142228 Oct 31 15:35:53.329204 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2011/4169] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:53 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:53.353897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df669ecccf24e8e9b41574f29ba157b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b23d8ffada4f7b9b839976bc376bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:53.367546 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2f70fac-8bab-432e-9dca-883ccbcfad73 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 200 len: 1302 microversion: 2.1 time: 0.172767 Oct 31 15:35:53.368488 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2159/4170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:53 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 1302 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:53.556826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.557042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.582440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.582940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.583375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.584257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.586712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.587597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.772675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:53.781722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:53.783272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:53.784559 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04553a27-2d68-45ff-8fa8-da9d441dd62d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1544 microversion: 2.26 time: 0.233048 Oct 31 15:35:53.785230 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2012/4171] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:53 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1544 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:53.812308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e557eee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.822904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.824445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.825400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.826054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:53.833628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.834420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.835011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.835869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.836476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.837047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.870079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.877609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.878350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.898415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.899145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.899797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.932025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:53.953565 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d57abf5-7286-4625-816a-2a53e629b26e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1767939610" status: 201 len: 0 microversion: 2.26 time: 0.145850 Oct 31 15:35:53.954704 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2160/4172] 10.222.0.20 () {62 vars in 1380 bytes} [Mon Oct 31 15:35:53 2022] PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1767939610 => generated 0 bytes in 148 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 15:35:53.965143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a90dc1d-2658-44a9-8b1f-ee12ab20eb4e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e57720d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:53.975473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a90dc1d-2658-44a9-8b1f-ee12ab20eb4e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:53.976380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a90dc1d-2658-44a9-8b1f-ee12ab20eb4e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:53.977241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a90dc1d-2658-44a9-8b1f-ee12ab20eb4e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:53.994857 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a90dc1d-2658-44a9-8b1f-ee12ab20eb4e tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1767939610" status: 204 len: 0 microversion: 2.26 time: 0.034241 Oct 31 15:35:53.996124 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2013/4173] 10.222.0.20 () {60 vars in 1361 bytes} [Mon Oct 31 15:35:53 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1767939610 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:54.004749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e557eb80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.014960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.015463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.015909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.016398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:54.023362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.024104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.024744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.026301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.028175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.028842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.057347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.058527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.059185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.079887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:54.106486 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d5015ba-1c2f-4752-b47c-eb50e6bafbcd tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.105834 Oct 31 15:35:54.111393 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2161/4174] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 31 15:35:53 2022] DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:54.118318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bdf96bc4-8a5f-42ac-b781-7b95a01dd9f1 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e5772820>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.129698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdf96bc4-8a5f-42ac-b781-7b95a01dd9f1 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.130527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdf96bc4-8a5f-42ac-b781-7b95a01dd9f1 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.131174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdf96bc4-8a5f-42ac-b781-7b95a01dd9f1 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.153455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bdf96bc4-8a5f-42ac-b781-7b95a01dd9f1 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 200 len: 12 microversion: 2.26 time: 0.036080 Oct 31 15:35:54.154517 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2014/4175] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 31 15:35:54 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:54.167819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e1654280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.201362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.201933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.202774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.203329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:54.209833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.210404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.211160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.212311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.213265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.213910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.224565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.225295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:54.232746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.233413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.234139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.235096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.235860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.237787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.260325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.261120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.261772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.274045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.274821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.275481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.327346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:54.366241 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af207413-3627-4082-9b9e-66e40d2b0843 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-929164584" status: 201 len: 0 microversion: 2.26 time: 0.204892 Oct 31 15:35:54.368035 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2162/4176] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Oct 31 15:35:54 2022] PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-929164584 => generated 0 bytes in 208 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 31 15:35:54.398641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.399486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:54.419785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.423184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.426359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.427324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.428504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.429636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.465801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:54.477981 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1903574d-ec40-41e9-9457-dba05935ba71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1490 microversion: 2.1 time: 0.259229 Oct 31 15:35:54.479488 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2015/4177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:54 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1490 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:54.488038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6ac898a5-0b1f-4ec2-a678-a6b0a5b7ca93 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e0e8c8b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.506806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ac898a5-0b1f-4ec2-a678-a6b0a5b7ca93 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.507624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ac898a5-0b1f-4ec2-a678-a6b0a5b7ca93 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.508308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ac898a5-0b1f-4ec2-a678-a6b0a5b7ca93 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.520030 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6ac898a5-0b1f-4ec2-a678-a6b0a5b7ca93 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 200 len: 35 microversion: 2.26 time: 0.038134 Oct 31 15:35:54.520977 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2016/4178] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 31 15:35:54 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 35 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:54.533312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.534524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] [instance: 2edf57d1-6672-4b8b-a2a8-c9732d43bd25] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:54.545396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.546091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.546623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.547566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.548245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.548893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.566169 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] HTTP exception thrown: Instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 could not be found. Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Request method failure captured: Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 HTTP/1.1 Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-n8rLHF2MgaOa0h4gx0-EmBO96XWw3g9lU6Bg5iI2O_lVtnQJpE3U2gknoHK8KnJtkyfK8f7dcIB9k4Ox18ScCR6RCrl6s0042b2DQihWWbBHGfjQ35MLJ_fkZ8BCzs2C7fxwN2BKkAJSzEuuWpWXLIJaWrjQlAU8tO36Nwzc5DH0g Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 34b23d8ffada4f7b9b839976bc376bc4 Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b23d8ffada4f7b9b839976bc376bc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34b23d8ffada4f7b9b839976bc376bc4", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34b23d8ffada4f7b9b839976bc376bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34b23d8ffada4f7b9b839976bc376bc4"}]}] Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 34b23d8ffada4f7b9b839976bc376bc4 Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-MigrationsAdminTest-1939194696 Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-MigrationsAdminTest-1939194696-project Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 4df669ecccf24e8e9b41574f29ba157b Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-MigrationsAdminTest-1939194696-project Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 could not be found. Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '2edf57d1-6672-4b8b-a2a8-c9732d43bd25'} Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 could not be found. Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 could not be found. Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:35:54.568199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:54.571784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:35:54.571784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:35:54.571784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:35:54.571784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:35:54.571784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:35:54.571784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 could not be found. Oct 31 15:35:54.571784 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:35:54.573888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] Returning 404 to user: Instance 2edf57d1-6672-4b8b-a2a8-c9732d43bd25 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:35:54.575005 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9d93a5a-c5fc-4c6d-8d40-cfb9fbf04883 tempest-MigrationsAdminTest-1939194696 tempest-MigrationsAdminTest-1939194696-project] 10.222.0.20 "GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25" status: 404 len: 111 microversion: 2.1 time: 0.046379 Oct 31 15:35:54.575796 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2017/4179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:54 2022] GET /compute/v2.1/servers/2edf57d1-6672-4b8b-a2a8-c9732d43bd25 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:35:54.584287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3f12021-9504-44c1-871d-dfc60fa40cb5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:54.587216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e3f12021-9504-44c1-871d-dfc60fa40cb5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:54.595581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3f12021-9504-44c1-871d-dfc60fa40cb5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.596367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3f12021-9504-44c1-871d-dfc60fa40cb5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.597288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3f12021-9504-44c1-871d-dfc60fa40cb5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.598652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3f12021-9504-44c1-871d-dfc60fa40cb5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.599541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3f12021-9504-44c1-871d-dfc60fa40cb5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.615639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3f12021-9504-44c1-871d-dfc60fa40cb5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.656569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:54.675969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:54.681161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:54.687458 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2bab076-495c-489a-8fcf-50e4b34e1971 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1336 microversion: 2.54 time: 0.317972 Oct 31 15:35:54.688070 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2163/4180] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:54 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1336 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:54.703099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e14a0e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.719023 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e3f12021-9504-44c1-871d-dfc60fa40cb5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 200 len: 184 microversion: 2.1 time: 0.141612 Oct 31 15:35:54.723975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.723975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.723975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.723975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:54.724505 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2018/4181] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:35:54 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 184 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:54.739043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:54.739819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:54.742939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.745174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.745661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.746484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.746842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.747281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.777227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.778428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.779413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.780881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.800070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.803175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.821348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:54.822065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:54.830252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:54.921864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:54.974993 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-28ab4114-42b3-464a-9099-9328a411383c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-929164584" status: 204 len: 0 microversion: 2.26 time: 0.285817 Oct 31 15:35:54.975622 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2164/4182] 10.222.0.20 () {60 vars in 1361 bytes} [Mon Oct 31 15:35:54 2022] DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-929164584 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:54.987690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea0645c4-cb16-45a0-8e30-7c518109251d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e14e1310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.013015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea0645c4-cb16-45a0-8e30-7c518109251d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.014147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea0645c4-cb16-45a0-8e30-7c518109251d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.014956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea0645c4-cb16-45a0-8e30-7c518109251d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.045745 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea0645c4-cb16-45a0-8e30-7c518109251d tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 200 len: 12 microversion: 2.26 time: 0.062818 Oct 31 15:35:55.054554 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2165/4183] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 31 15:35:54 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 12 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:55.072608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e14a0280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.088639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.090088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.103395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.106710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:55.157685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.172753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.173350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.174121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.174598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.175028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.195608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:55.238785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.240289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.243560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.265219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:55.284892 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4782e92-5e81-4bb8-ab02-8411c367e37b tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.228827 Oct 31 15:35:55.285945 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2166/4184] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 31 15:35:55 2022] DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:55.296650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e15285e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.307667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.308355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.309843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.311399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:55.317675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.318158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.318587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.319282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.319730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.320244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.355395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.356302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.357020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.370456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.371306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.371866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.426783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:55.458742 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-803512c6-bac1-4908-9a8f-f38082df1573 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-477243397" status: 201 len: 0 microversion: 2.26 time: 0.166874 Oct 31 15:35:55.459685 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2167/4185] 10.222.0.20 () {62 vars in 1377 bytes} [Mon Oct 31 15:35:55 2022] PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-477243397 => generated 0 bytes in 169 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 31 15:35:55.472163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e14bf700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.498715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.499436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.499768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.500258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:55.507794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.508280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.508708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.509426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.509877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.510297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.546234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.547018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.547134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.559690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.560177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.560613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.607314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:55.608022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:55.623710 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cabd8e9f-4cf1-43bb-9d79-7e2af537e5a4 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.898088 Oct 31 15:35:55.625481 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2019/4186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:54 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:55.640763 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b37194d-600d-4932-8b26-32da5abc2108 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1822157906" status: 201 len: 0 microversion: 2.26 time: 0.174240 Oct 31 15:35:55.648525 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2168/4187] 10.222.0.20 () {62 vars in 1380 bytes} [Mon Oct 31 15:35:55 2022] PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1822157906 => generated 0 bytes in 183 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 15:35:55.652490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e574adc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.654374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.654815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:55.665054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.668891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.669792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.669918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.670650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.671414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.671947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.672662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.673235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.673498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:55.694304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.695040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.695658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.699621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.703108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.703866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.739606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.740459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.741194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.768022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:55.828660 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d1252387-a335-438d-9ff9-177adc953443 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.181052 Oct 31 15:35:55.834777 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2020/4188] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 31 15:35:55 2022] DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:55.855609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:55.858478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:55.879455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.880108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.880780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:55.885767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:55.886758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:55.887364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.065323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:56.077236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:56.078965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:56.080637 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70a33fae-c2dd-4ddb-bf89-79b1904624d7 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1336 microversion: 2.54 time: 0.238579 Oct 31 15:35:56.094033 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2021/4189] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:55 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1336 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:56.109285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c267891-c072-4a97-a076-049b818d22ab tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e0ef8f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.118266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c267891-c072-4a97-a076-049b818d22ab tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.119010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c267891-c072-4a97-a076-049b818d22ab tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.119644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c267891-c072-4a97-a076-049b818d22ab tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.131133 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c267891-c072-4a97-a076-049b818d22ab tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 200 len: 12 microversion: 2.26 time: 0.035862 Oct 31 15:35:56.132097 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2022/4190] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 31 15:35:56 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 12 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:56.147381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e0ef8c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.156209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.156694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.157381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.158644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.165729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.166506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.167463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.168731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.169593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.170236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.208068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.208681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.209819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.224811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:56.264298 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e413244d-239c-4af8-8bea-f356a1b8b4ba tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.121644 Oct 31 15:35:56.265001 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2023/4191] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 31 15:35:56 2022] DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:56.275677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e0ef8430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.287615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.288132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.288573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.289070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.297285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.297655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.298060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.298765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.299221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.300115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.338841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.340339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.341027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.351069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.352006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.352666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.405782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:56.427456 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cfaf50fd-5a29-48b1-938f-9324ad168077 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1830477106" status: 201 len: 0 microversion: 2.26 time: 0.156716 Oct 31 15:35:56.437406 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2024/4192] 10.222.0.20 () {62 vars in 1380 bytes} [Mon Oct 31 15:35:56 2022] PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1830477106 => generated 0 bytes in 167 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 15:35:56.443544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e574a940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.455753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.456723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.457381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.458114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.464922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.465816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.466471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.467370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.468016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.468652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.473592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:56.547237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.548619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.550882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.579365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.579941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.581909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.640619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:56.646187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:56.668543 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51660634-1784-4ca6-9cc6-df1685c658fa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 1.016127 Oct 31 15:35:56.672949 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-603b26af-bbf2-4547-9115-cc54837ad9db tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1185399316" status: 201 len: 0 microversion: 2.26 time: 0.234023 Oct 31 15:35:56.678250 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2169/4194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:55 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:56.678403 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2025/4194] 10.222.0.20 () {62 vars in 1380 bytes} [Mon Oct 31 15:35:56 2022] PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags/tempest-tag-1185399316 => generated 0 bytes in 236 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 31 15:35:56.701987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Action: 'update_all', calling method: .version_select at 0x7f16e0d15790>, body: {"tags": ["tempest-tag-1654299379", "tempest-tag-576592267"]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:56.705620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.706332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.715596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.715926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.716114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.716418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.716851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.716961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.717400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.717623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.718036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.721302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.724451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.724947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.725423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.726442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.727032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.727468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.763979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.764448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.764894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.809077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:56.854057 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-061d8af3-f97e-4d99-b349-ae391ef05664 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 200 len: 61 microversion: 2.26 time: 0.161542 Oct 31 15:35:56.856199 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2170/4195] 10.222.0.20 () {62 vars in 1312 bytes} [Mon Oct 31 15:35:56 2022] PUT /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 61 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:56.871847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c33eb138-e94b-4d21-a3f2-218a36d4ad7c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e5571af0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.887371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c33eb138-e94b-4d21-a3f2-218a36d4ad7c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.887869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c33eb138-e94b-4d21-a3f2-218a36d4ad7c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.888314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c33eb138-e94b-4d21-a3f2-218a36d4ad7c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.912252 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c33eb138-e94b-4d21-a3f2-218a36d4ad7c tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 200 len: 61 microversion: 2.26 time: 0.046801 Oct 31 15:35:56.916106 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2171/4196] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Oct 31 15:35:56 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 61 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:56.928424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '.version_select at 0x7f16e14cbd30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:56.950281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.950778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.951226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.951718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:56.967744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.969421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.972189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:56.972496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:56.972981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:56.974321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.032881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:57.044194 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b88a49b-57c7-4edc-89a6-241e6e8ec9ee tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.342657 Oct 31 15:35:57.046753 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2026/4197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:56 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:57.051736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91503e29-aa50-4b09-9252-713bd2e1f270 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cbdc8ea-60da-4223-a42e-04ae45546cff"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:57.054374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91503e29-aa50-4b09-9252-713bd2e1f270 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:57.063879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91503e29-aa50-4b09-9252-713bd2e1f270 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.064942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91503e29-aa50-4b09-9252-713bd2e1f270 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.065905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.066578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.066981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.071494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91503e29-aa50-4b09-9252-713bd2e1f270 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.074411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91503e29-aa50-4b09-9252-713bd2e1f270 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.075317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91503e29-aa50-4b09-9252-713bd2e1f270 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.076089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91503e29-aa50-4b09-9252-713bd2e1f270 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.088212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'flavor' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:35:57.113853 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19d6db4f-642c-4ba8-9d36-481c0bba69d7 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags" status: 204 len: 0 microversion: 2.26 time: 0.192648 Oct 31 15:35:57.114479 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2172/4198] 10.222.0.20 () {60 vars in 1295 bytes} [Mon Oct 31 15:35:56 2022] DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c/tags => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:57.123633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:57.125792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:57.136319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.136980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.137785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.138655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.139126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.139793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.411574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:57.421275 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e4f4a77-6160-4bc4-affd-e9245fb1ab9d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.305660 Oct 31 15:35:57.433501 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2173/4199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:57 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:57.445851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:57.445851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:57.464802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.470952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.471444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.474180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.474971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.475745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.526964 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91503e29-aa50-4b09-9252-713bd2e1f270 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.478656 Oct 31 15:35:57.528791 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2027/4200] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:35:57 2022] POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:35:57.544384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:57.546355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:57.579697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.580716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.583546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.584518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.585575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.586585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.646797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:57.660879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:57.662419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:57.663543 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-36c53b32-6dee-4f00-a176-e45370495485 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1357 microversion: 2.54 time: 0.240173 Oct 31 15:35:57.677655 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2174/4201] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:57 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:57.688598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:35:57.692429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a42ba62c-3701-4cc4-872c-3957bb0553a8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Action: 'create', calling method: .version_select at 0x7f16e17cd4c0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1315514125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp3vgtMQA4P1cMKxYy4VxQrbnhYvLfXeWn0qNJJDT7EYHMPc5juR4HpEII7oswWZQQL7LR0RWMFD8knKRRzMmCY3CjJ6+GhOfonmO0wzd3EeuuzuGsPkSwzEnarUn7f1w=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:57.710691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a42ba62c-3701-4cc4-872c-3957bb0553a8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Getting quotas for project 9820ac6f38634ea3b325664518ca0bfd. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:35:57.713033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:57.718663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-a42ba62c-3701-4cc4-872c-3957bb0553a8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Getting quotas for user 6c8e3d08b7e146abb5e0f538b89617b0 and project 9820ac6f38634ea3b325664518ca0bfd. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:35:57.805695 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a42ba62c-3701-4cc4-872c-3957bb0553a8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.115450 Oct 31 15:35:57.806530 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2175/4202] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 31 15:35:57 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 31 15:35:57.832282 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5101f8c-1ce4-458b-8b76-4fc54856dfed tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 204 len: 0 microversion: 2.26 time: 0.300987 Oct 31 15:35:57.833057 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2028/4203] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:35:57 2022] DELETE /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:35:57.836289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1315514125", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:57.843138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:57.847173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:57.848564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:57.858365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.859429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.860094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.861372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.862576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.863173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.867868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.875950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.875950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:57.875950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:57.875950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:57.875950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.038421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:35:58.038860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:35:58.039333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:35:58.039877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:35:58.040296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:35:58.111330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:58.122173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:58.128798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:58.130937 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-055d2939-338d-4200-af81-4ef4db182088 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1550 microversion: 2.26 time: 0.292384 Oct 31 15:35:58.147094 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2029/4204] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:57 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1550 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:58.158612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-359054671", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fa1888d6-b08a-4260-8505-69a899fd42e4"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:35:58.161451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:58.170014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:58.170598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:58.171044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.171766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:58.173180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:58.173894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.177007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:58.221621 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-58166729-fe38-40d8-9765-498fa18e3eb3 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "POST /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e/action" status: 202 len: 1140 microversion: 2.54 time: 0.401679 Oct 31 15:35:58.225175 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2176/4205] 10.222.0.20 () {62 vars in 1320 bytes} [Mon Oct 31 15:35:57 2022] POST /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e/action => generated 1140 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 15:35:58.244092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] validate_networks() for [('fa1888d6-b08a-4260-8505-69a899fd42e4', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:35:58.246696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:58.247875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:58.254352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:58.254842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:58.255281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.255985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:58.256644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:58.256873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.340516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:58.367557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:58.369737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:58.372438 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1054e8fb-c521-4351-9f05-ff7c7a207ce8 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.130120 Oct 31 15:35:58.385076 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2177/4206] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:58 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:58.783134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:35:58.783700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:35:58.784283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:35:58.784732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:35:58.785255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:35:58.796515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:58.797004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:58.797786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.798686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:58.799301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:58.799897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:58.814065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:35:58.822897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:35:58.830832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for user 33e8230d70464e5da2cced0060bb1a31 and project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:35:58.846218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:35:58.849281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:35:58.939819 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c886665d-ccdc-4fec-8a99-a71f87ff6c24 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790902 Oct 31 15:35:58.941258 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2030/4207] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:35:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:35:58.960755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c68a779-e554-4090-b0c2-1c47cb127a4f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:58.962516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c68a779-e554-4090-b0c2-1c47cb127a4f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:59.048669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7c68a779-e554-4090-b0c2-1c47cb127a4f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.058704 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c68a779-e554-4090-b0c2-1c47cb127a4f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1214 microversion: 2.1 time: 0.103454 Oct 31 15:35:59.059379 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2178/4208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:35:58 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:35:59.163497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:59.164117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:59.181226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.183602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.186124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.187184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.188943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.194252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.401574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:35:59.402746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:35:59.421236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.422711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.423677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.427303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:35:59.433647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:35:59.437518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:35:59.559230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.575652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.578908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.583684 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6949bb26-3929-4488-a0e8-5aa2a95f0c8f tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1550 microversion: 2.26 time: 0.426198 Oct 31 15:35:59.590544 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2031/4209] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:59 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1550 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:35:59.765785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.779201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.783556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:35:59.789313 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c14dbf5c-889a-4bff-987e-80d4c160047b tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.388195 Oct 31 15:35:59.789960 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2179/4210] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:35:59 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:00.083466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:00.084364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:00.101931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.103314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.104444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.107830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.110012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.110561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.253899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:00.278453 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-821ce867-4184-42cc-9517-c02c8a5fdcdd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1210 microversion: 2.1 time: 0.199207 Oct 31 15:36:00.281521 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2032/4211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:00 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1210 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:00.421662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-11a34453-189c-426a-9cba-248b98af7c76 req-79e1db28-5d1d-489e-a458-34a4f254878a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5632a5a6-078e-42a7-b128-4124be821e9c", "name": "network-vif-deleted", "tag": "ce0bee89-b74c-4b5f-ba06-4b8734c10333"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:00.484000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-11a34453-189c-426a-9cba-248b98af7c76 req-79e1db28-5d1d-489e-a458-34a4f254878a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.484688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-11a34453-189c-426a-9cba-248b98af7c76 req-79e1db28-5d1d-489e-a458-34a4f254878a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.485174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-11a34453-189c-426a-9cba-248b98af7c76 req-79e1db28-5d1d-489e-a458-34a4f254878a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.522132 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-11a34453-189c-426a-9cba-248b98af7c76 req-79e1db28-5d1d-489e-a458-34a4f254878a service nova] Creating event network-vif-deleted:ce0bee89-b74c-4b5f-ba06-4b8734c10333 for instance 5632a5a6-078e-42a7-b128-4124be821e9c on n-h2-858384-17 Oct 31 15:36:00.539874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-08def0f2-dd9e-476b-92ce-5d3ee269db47 tempest-QuotaClassesAdmin257Test-1316202543 tempest-QuotaClassesAdmin257Test-1316202543-project-admin] Calling method '.version_select at 0x7f16e17cd4c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:00.546911 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-11a34453-189c-426a-9cba-248b98af7c76 req-79e1db28-5d1d-489e-a458-34a4f254878a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131097 Oct 31 15:36:00.557342 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2033/4212] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:00.585214 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-08def0f2-dd9e-476b-92ce-5d3ee269db47 tempest-QuotaClassesAdmin257Test-1316202543 tempest-QuotaClassesAdmin257Test-1316202543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.366916 Oct 31 15:36:00.592518 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2180/4213] 10.222.0.20 () {60 vars in 1226 bytes} [Mon Oct 31 15:36:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:36:00.601925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdf3f118-328e-4f75-a600-5e3b7c8befa9 tempest-QuotaClassesAdmin257Test-1316202543 tempest-QuotaClassesAdmin257Test-1316202543-project-admin] Action: 'update', calling method: .version_select at 0x7f16e5696280>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:00.627083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:00.627083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:00.658191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.658690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.659132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.659855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.660315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.665417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.778106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.778802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.779905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.781157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lazy-loading 'fault' on Instance uuid 5632a5a6-078e-42a7-b128-4124be821e9c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:36:00.840741 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdf3f118-328e-4f75-a600-5e3b7c8befa9 tempest-QuotaClassesAdmin257Test-1316202543 tempest-QuotaClassesAdmin257Test-1316202543-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.243373 Oct 31 15:36:00.842513 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2034/4214] 10.222.0.20 () {62 vars in 1247 bytes} [Mon Oct 31 15:36:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:36:00.848411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:00.850300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:00.858953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.860302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.860997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.862570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:00.863257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:00.863971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:00.898560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:00.913870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:00.918816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7b46c7632a049e080b5133736734fdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01c5cf21a2a94c689ab6f1031aa24fdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:00.920069 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d7af8d1-52c4-4f98-939f-2f6cd52a9dd6 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 200 len: 1351 microversion: 2.26 time: 0.305863 Oct 31 15:36:00.923885 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2181/4215] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:00 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 1351 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:00.939322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84fe775d-9995-4e6a-81ed-f242ff70ebd5 tempest-QuotaClassesAdmin257Test-1316202543 tempest-QuotaClassesAdmin257Test-1316202543-project-admin] Calling method '.version_select at 0x7f16e148f4c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:00.969010 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-84fe775d-9995-4e6a-81ed-f242ff70ebd5 tempest-QuotaClassesAdmin257Test-1316202543 tempest-QuotaClassesAdmin257Test-1316202543-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.041108 Oct 31 15:36:00.969710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:00.969867 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2182/4216] 10.222.0.20 () {60 vars in 1226 bytes} [Mon Oct 31 15:36:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:36:00.985889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:00.988711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:00.994243 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-498afac7-dd11-474f-92da-7ba40d1d0332 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.150224 Oct 31 15:36:00.998199 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2035/4217] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:00 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:01.013312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89f0434f-0003-46ee-bff9-00d28dfd9247 tempest-QuotaClassesAdmin257Test-1316202543 tempest-QuotaClassesAdmin257Test-1316202543-project-admin] Action: 'update', calling method: .version_select at 0x7f16e148f280>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:01.170645 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89f0434f-0003-46ee-bff9-00d28dfd9247 tempest-QuotaClassesAdmin257Test-1316202543 tempest-QuotaClassesAdmin257Test-1316202543-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.193349 Oct 31 15:36:01.185098 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2183/4218] 10.222.0.20 () {62 vars in 1247 bytes} [Mon Oct 31 15:36:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:36:01.311572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:01.312858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:01.325996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:01.326847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:01.329711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:01.331297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:01.332262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:01.335100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:01.546427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:01.556276 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b070f8e-b8fe-4e63-8c0f-17b471e34b08 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1272 microversion: 2.1 time: 0.249417 Oct 31 15:36:01.556875 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2036/4219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:01 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:01.951123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:01.951749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] [instance: 5632a5a6-078e-42a7-b128-4124be821e9c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:01.954792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:01.973523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:01.974216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:01.974797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:01.976237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:01.976860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:01.977476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:02.012249 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] HTTP exception thrown: Instance 5632a5a6-078e-42a7-b128-4124be821e9c could not be found. Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Request method failure captured: Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c HTTP/1.1 Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-tFnS1cqz3m1fpxe9dvLKF0dvg_LW8KuvICmQ25m1KGz3n2gvSH272A1Ph16qSYNo78gWG4rLEa6ppgQZgDQqzC8tmzMWdx0SUllII6mKaCbHp5TbYysDEgqNrlliqkJQRtPF8DZf0bd427_W_tTZQjWQ2XyVMpGWQoz6TZ_BrzJuw Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.26 Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 01c5cf21a2a94c689ab6f1031aa24fdd Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerTagsTestJSON-1719459912 Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01c5cf21a2a94c689ab6f1031aa24fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_01c5cf21a2a94c689ab6f1031aa24fdd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/01c5cf21a2a94c689ab6f1031aa24fdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/01c5cf21a2a94c689ab6f1031aa24fdd"}]}] Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerTagsTestJSON-1719459912 Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 01c5cf21a2a94c689ab6f1031aa24fdd Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerTagsTestJSON-1719459912 Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerTagsTestJSON-1719459912-project Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: b7b46c7632a049e080b5133736734fdc Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerTagsTestJSON-1719459912-project Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 5632a5a6-078e-42a7-b128-4124be821e9c could not be found. Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '5632a5a6-078e-42a7-b128-4124be821e9c'} Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5632a5a6-078e-42a7-b128-4124be821e9c could not be found. Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5632a5a6-078e-42a7-b128-4124be821e9c could not be found. Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:02.015017 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:02.023464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:02.023464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:02.023464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:02.023464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:02.023464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:02.023464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5632a5a6-078e-42a7-b128-4124be821e9c could not be found. Oct 31 15:36:02.023464 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:02.025700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:02.027310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:02.037473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] Returning 404 to user: Instance 5632a5a6-078e-42a7-b128-4124be821e9c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:02.038831 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b0efba92-4c2e-408e-bf4b-e09ae8132cc4 tempest-ServerTagsTestJSON-1719459912 tempest-ServerTagsTestJSON-1719459912-project] 10.222.0.20 "GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c" status: 404 len: 111 microversion: 2.26 time: 0.091711 Oct 31 15:36:02.043805 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2184/4220] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:01 2022] GET /compute/v2.1/servers/5632a5a6-078e-42a7-b128-4124be821e9c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:36:02.051881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:02.052646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:02.053377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:02.054337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:02.055145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:02.055843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:02.183962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:02.197233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:02.203457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:02.206315 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d28ee49-e243-4357-9085-a4ec79c5ae01 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.185955 Oct 31 15:36:02.207583 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2037/4221] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:02 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:02.582919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:02.585119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:02.606572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:02.607503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:02.612518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:02.616238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:02.617499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:02.624080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:03.146217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:03.162310 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-79944f71-a6f9-4353-8400-71797a6b1302 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1314 microversion: 2.1 time: 0.583789 Oct 31 15:36:03.164214 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2185/4222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:02 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:03.238327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:03.239634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:03.253964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:03.256957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:03.257599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:03.258601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:03.259422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:03.261563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:03.673552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:03.687733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:03.695066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:03.697664 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01dcdd8d-6167-48ea-a4ff-7f4a4f54dfd6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.462928 Oct 31 15:36:03.700294 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2038/4223] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:03 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:04.193054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:04.193822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:04.216709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:04.217252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:04.220419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:04.223835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:04.226972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:04.227455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:04.732276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:04.732809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:04.756951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:04.757523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:04.757977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:04.758748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:04.770383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:04.772263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:04.849260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:05.013670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:05.022406 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f8234220-9516-41e9-ae84-3d184fe6f825 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1314 microversion: 2.1 time: 0.834181 Oct 31 15:36:05.023002 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2186/4224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:04 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1314 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:05.041497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c0a485dd-1253-44f7-8665-d44b47df4113 req-e2a2c944-aa44-4004-8fb0-103aa3bfd10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b165c325-3036-4286-aa6f-a4eda48c22ca", "tag": "0ddd42f3-ebc5-4fbb-b793-b13e396d56cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:05.074418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c0a485dd-1253-44f7-8665-d44b47df4113 req-e2a2c944-aa44-4004-8fb0-103aa3bfd10f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:05.075886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c0a485dd-1253-44f7-8665-d44b47df4113 req-e2a2c944-aa44-4004-8fb0-103aa3bfd10f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:05.077328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c0a485dd-1253-44f7-8665-d44b47df4113 req-e2a2c944-aa44-4004-8fb0-103aa3bfd10f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:05.113277 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c0a485dd-1253-44f7-8665-d44b47df4113 req-e2a2c944-aa44-4004-8fb0-103aa3bfd10f service nova] Creating event network-changed:0ddd42f3-ebc5-4fbb-b793-b13e396d56cc for instance b165c325-3036-4286-aa6f-a4eda48c22ca on n-h1-858384-17 Oct 31 15:36:05.124340 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c0a485dd-1253-44f7-8665-d44b47df4113 req-e2a2c944-aa44-4004-8fb0-103aa3bfd10f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094926 Oct 31 15:36:05.128780 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2187/4225] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:05.209941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:05.218570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:05.220031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:05.225921 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3339c84-e36e-41ac-8c8f-4cd01992348d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.499962 Oct 31 15:36:05.230906 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2039/4226] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:04 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:06.057283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:06.058769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:06.076685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:06.077334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:06.077977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:06.078720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:06.083450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:06.084423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:06.252682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:06.256469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:06.274934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:06.279187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:06.286623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:06.287819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:06.289916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:06.291699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:06.706281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:06.722607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:06.733415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:06.735840 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9e58b19e-7cb8-4bbb-841b-a4f4132664ac tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.486925 Oct 31 15:36:06.736905 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2040/4227] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:06 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:06.737472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:06.750898 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-370cd62d-1d04-4032-b01d-7f83bf9f6169 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1314 microversion: 2.1 time: 0.696992 Oct 31 15:36:06.752141 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2188/4228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:06 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:07.768767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:07.769577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:07.789166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:07.792320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:07.792947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:07.796122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:07.796792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:07.799439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:08.140561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:08.151214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:08.157419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:08.159084 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-559f10a7-8dc8-4ef2-8ecc-9b912bf0ccd4 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.395732 Oct 31 15:36:08.162464 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2189/4229] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:07 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:08.178198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:08.186011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:08.194426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:08.194951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:08.195471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:08.207172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:08.207694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:08.208145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:08.309723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cb5237b1-046b-426e-85f2-3a671b9e1ed0 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Calling method '.version_select at 0x7f16e5785f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:08.647116 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cb5237b1-046b-426e-85f2-3a671b9e1ed0 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/70e9dff92d35414db349be5f67aaefdb" status: 200 len: 371 microversion: 2.1 time: 1.037004 Oct 31 15:36:08.662805 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2041/4230] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:36:07 2022] GET /compute/v2.1/os-quota-sets/70e9dff92d35414db349be5f67aaefdb => generated 371 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:08.674810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5cd2afd-ac3f-46cd-b495-2f7c59a96fe2 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0f12c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:08.810257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:08.957083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cd2afd-ac3f-46cd-b495-2f7c59a96fe2 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:08.958048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cd2afd-ac3f-46cd-b495-2f7c59a96fe2 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:08.958785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cd2afd-ac3f-46cd-b495-2f7c59a96fe2 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:08.960011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cd2afd-ac3f-46cd-b495-2f7c59a96fe2 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:08.961252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cd2afd-ac3f-46cd-b495-2f7c59a96fe2 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:08.961858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cd2afd-ac3f-46cd-b495-2f7c59a96fe2 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:08.972787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:08.986771 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-43b2a6af-c1f5-4225-b40a-e41a39bac3b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1314 microversion: 2.1 time: 0.812262 Oct 31 15:36:08.988103 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2190/4231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:08 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:09.101638 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5cd2afd-ac3f-46cd-b495-2f7c59a96fe2 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/70e9dff92d35414db349be5f67aaefdb" status: 200 len: 328 microversion: 2.1 time: 0.437172 Oct 31 15:36:09.112568 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2042/4232] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:36:08 2022] PUT /compute/v2.1/os-quota-sets/70e9dff92d35414db349be5f67aaefdb => generated 328 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:09.116427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7a2ef0a1-52f4-4c84-b838-8423643ac593 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:09.135141 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7a2ef0a1-52f4-4c84-b838-8423643ac593 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/70e9dff92d35414db349be5f67aaefdb" status: 202 len: 0 microversion: 2.1 time: 0.022238 Oct 31 15:36:09.137105 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2191/4233] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:36:09 2022] DELETE /compute/v2.1/os-quota-sets/70e9dff92d35414db349be5f67aaefdb => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:36:09.146835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b3fc36ea-3df6-4296-9fd7-92b6414cf7fb tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Calling method '.version_select at 0x7f16e0e55ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:09.196854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:09.197833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:09.206535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:09.207307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:09.208048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:09.209095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:09.209818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:09.210404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:09.269807 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b3fc36ea-3df6-4296-9fd7-92b6414cf7fb tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/70e9dff92d35414db349be5f67aaefdb" status: 200 len: 371 microversion: 2.1 time: 0.128038 Oct 31 15:36:09.270410 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2043/4234] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 15:36:09 2022] GET /compute/v2.1/os-quota-sets/70e9dff92d35414db349be5f67aaefdb => generated 371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:36:09.339714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:09.369231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:09.382853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:09.384112 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ac40393-ba1b-492a-b525-7c75de3db517 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.193235 Oct 31 15:36:09.384696 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2192/4235] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:09 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:09.550288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a656166e-dbed-48bb-977f-aee2383b784d tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Calling method '.version_select at 0x7f16e0f51820>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:09.852883 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a656166e-dbed-48bb-977f-aee2383b784d tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/815d3223b79140849b2d675cac77514f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.306965 Oct 31 15:36:09.855182 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2044/4236] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:36:09 2022] GET /compute/v2.1/os-quota-sets/815d3223b79140849b2d675cac77514f/defaults => generated 371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:10.016344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:10.017496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:10.031815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:10.032478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:10.033941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:10.036011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:10.038143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:10.040114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:10.413641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:10.414419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:10.426891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:10.427479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:10.427985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:10.428918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:10.430788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:10.433279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:10.484684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:10.493403 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be1ee1fc-6deb-4b50-9bc1-7c6cd58e6f71 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1314 microversion: 2.1 time: 0.481893 Oct 31 15:36:10.506485 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2193/4237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:10 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:10.511917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1aebb14e-0fb1-440b-adae-ed56feb170f3 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Action: 'update', calling method: .version_select at 0x7f16e1503820>, body: {"quota_set": {"ram": "5120"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:10.666132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:10.680863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:10.686588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:10.688937 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00c0421a-1e58-42c7-b827-666b041b7644 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.279530 Oct 31 15:36:10.689876 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2045/4238] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:10 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:10.889217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1aebb14e-0fb1-440b-adae-ed56feb170f3 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:10.890240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1aebb14e-0fb1-440b-adae-ed56feb170f3 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:10.890839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1aebb14e-0fb1-440b-adae-ed56feb170f3 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:10.891958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1aebb14e-0fb1-440b-adae-ed56feb170f3 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:10.892619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1aebb14e-0fb1-440b-adae-ed56feb170f3 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:10.893306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1aebb14e-0fb1-440b-adae-ed56feb170f3 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:10.988664 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1aebb14e-0fb1-440b-adae-ed56feb170f3 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/0840bd3bd1454e588d4b8a49c4aba3da" status: 200 len: 328 microversion: 2.1 time: 0.480767 Oct 31 15:36:10.989849 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2194/4239] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:36:10 2022] PUT /compute/v2.1/os-quota-sets/0840bd3bd1454e588d4b8a49c4aba3da => generated 328 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:11.002110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea35fee0-f51e-435d-b269-642e7c42ad41 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Calling method '.version_select at 0x7f16e168adc0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:11.411503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea35fee0-f51e-435d-b269-642e7c42ad41 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:11.414382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea35fee0-f51e-435d-b269-642e7c42ad41 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:11.414876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea35fee0-f51e-435d-b269-642e7c42ad41 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:11.415677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea35fee0-f51e-435d-b269-642e7c42ad41 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:11.416153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea35fee0-f51e-435d-b269-642e7c42ad41 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:11.417107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea35fee0-f51e-435d-b269-642e7c42ad41 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:11.471870 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea35fee0-f51e-435d-b269-642e7c42ad41 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/0840bd3bd1454e588d4b8a49c4aba3da/detail" status: 200 len: 916 microversion: 2.1 time: 0.471864 Oct 31 15:36:11.481708 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2046/4240] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:36:10 2022] GET /compute/v2.1/os-quota-sets/0840bd3bd1454e588d4b8a49c4aba3da/detail => generated 916 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:11.532262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:11.532825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:11.545706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:11.549806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:11.550348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:11.551097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:11.551573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:11.552131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:11.721166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:11.723006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:11.745571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:11.748406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:11.750352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:11.752284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:11.754487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:11.755701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:11.950262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:11.966231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:11.967830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:11.970213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-500a4ce0-c8cf-45d7-b77d-10058f901dfd tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.252433 Oct 31 15:36:11.972165 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2047/4241] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:11 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:11.981585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0e55430>, body: {"quota_set": {"ram": "2048"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:12.124986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:12.137483 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bb3da22-b452-4c28-9a2d-7662c593d504 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1314 microversion: 2.1 time: 0.609348 Oct 31 15:36:12.141833 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2195/4242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:11 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:12.318439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:12.321764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:12.324624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:12.330307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:12.331065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:12.331894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:12.428682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:12.429212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:12.429660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:12.430404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:12.430873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:12.431307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:12.483718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:12.585783 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0221c4ce-3ffd-4077-80ca-e163cfd95784 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/0840bd3bd1454e588d4b8a49c4aba3da?user_id=db1a9086fa1e448882d28c7f8b9a40f4" status: 200 len: 328 microversion: 2.1 time: 0.612075 Oct 31 15:36:12.589821 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2048/4243] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:36:11 2022] PUT /compute/v2.1/os-quota-sets/0840bd3bd1454e588d4b8a49c4aba3da?user_id=db1a9086fa1e448882d28c7f8b9a40f4 => generated 328 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:12.602114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-518be04e-af32-4486-b391-1f0e9ff16eb5 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Calling method '.version_select at 0x7f16e17cd4c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:12.767663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=29 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:12.832675 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-518be04e-af32-4486-b391-1f0e9ff16eb5 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/0840bd3bd1454e588d4b8a49c4aba3da?user_id=db1a9086fa1e448882d28c7f8b9a40f4" status: 200 len: 370 microversion: 2.1 time: 0.232064 Oct 31 15:36:12.836599 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2196/4244] 10.222.0.20 () {58 vars in 1323 bytes} [Mon Oct 31 15:36:12 2022] GET /compute/v2.1/os-quota-sets/0840bd3bd1454e588d4b8a49c4aba3da?user_id=db1a9086fa1e448882d28c7f8b9a40f4 => generated 370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:13.002009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:13.002637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:13.013166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:13.018151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:13.022097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:13.022878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:13.023363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:13.024034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:13.169646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:13.170261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:13.180290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:13.207259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:13.208247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:13.211481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:13.212173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:13.214354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:13.658590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:13.674377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45363a2e-11e4-4572-b3ac-2abf5d88c947 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1314 microversion: 2.1 time: 0.503142 Oct 31 15:36:13.675098 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2197/4245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:13 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:13.686826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cbc85cf1-a37d-4dda-9346-9e275b4dd19e tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Calling method '.version_select at 0x7f16e17cdc10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:14.004656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:14.038581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:14.043391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:14.048027 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b68262a9-2f30-4a6b-a0e3-9fcef28102a5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 1.050512 Oct 31 15:36:14.049254 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2049/4246] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:12 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:14.164409 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cbc85cf1-a37d-4dda-9346-9e275b4dd19e tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/815d3223b79140849b2d675cac77514f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.487023 Oct 31 15:36:14.188447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be4d22e2-af83-4261-9631-c9a37f67fc39 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Action: 'update', calling method: .version_select at 0x7f16e5762700>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:14.198013 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2198/4247] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 15:36:13 2022] GET /compute/v2.1/os-quota-sets/815d3223b79140849b2d675cac77514f/defaults => generated 371 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:14.313236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be4d22e2-af83-4261-9631-c9a37f67fc39 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:14.315551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be4d22e2-af83-4261-9631-c9a37f67fc39 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:14.319466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be4d22e2-af83-4261-9631-c9a37f67fc39 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:14.323692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be4d22e2-af83-4261-9631-c9a37f67fc39 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:14.324303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be4d22e2-af83-4261-9631-c9a37f67fc39 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:14.324661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be4d22e2-af83-4261-9631-c9a37f67fc39 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:14.644908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a254d72d-367c-4f3f-a899-a70fb42402f9 req-483cd251-6c1d-4669-b102-440826f49b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b165c325-3036-4286-aa6f-a4eda48c22ca", "name": "network-vif-plugged", "status": "completed", "tag": "0ddd42f3-ebc5-4fbb-b793-b13e396d56cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:14.741881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a254d72d-367c-4f3f-a899-a70fb42402f9 req-483cd251-6c1d-4669-b102-440826f49b0d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:14.742476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a254d72d-367c-4f3f-a899-a70fb42402f9 req-483cd251-6c1d-4669-b102-440826f49b0d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:14.742804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a254d72d-367c-4f3f-a899-a70fb42402f9 req-483cd251-6c1d-4669-b102-440826f49b0d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:14.825704 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a254d72d-367c-4f3f-a899-a70fb42402f9 req-483cd251-6c1d-4669-b102-440826f49b0d service nova] Creating event network-vif-plugged:0ddd42f3-ebc5-4fbb-b793-b13e396d56cc for instance b165c325-3036-4286-aa6f-a4eda48c22ca on n-h1-858384-17 Oct 31 15:36:14.862319 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a254d72d-367c-4f3f-a899-a70fb42402f9 req-483cd251-6c1d-4669-b102-440826f49b0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223126 Oct 31 15:36:14.886441 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2199/4248] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:14.940159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:14.944491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:14.987440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:14.998914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:14.999374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:15.003561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:15.004156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:15.008734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:15.027985 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be4d22e2-af83-4261-9631-c9a37f67fc39 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/815d3223b79140849b2d675cac77514f" status: 200 len: 329 microversion: 2.1 time: 0.844968 Oct 31 15:36:15.046148 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2050/4249] 10.222.0.20 () {60 vars in 1263 bytes} [Mon Oct 31 15:36:14 2022] PUT /compute/v2.1/os-quota-sets/815d3223b79140849b2d675cac77514f => generated 329 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:15.057289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fef25dfc-db0b-4bfe-a6eb-3467abd39ee9 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Action: 'update', calling method: .version_select at 0x7f16e13bac10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:15.672880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef25dfc-db0b-4bfe-a6eb-3467abd39ee9 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:15.677993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef25dfc-db0b-4bfe-a6eb-3467abd39ee9 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:15.679368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef25dfc-db0b-4bfe-a6eb-3467abd39ee9 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:15.681294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef25dfc-db0b-4bfe-a6eb-3467abd39ee9 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:15.683592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef25dfc-db0b-4bfe-a6eb-3467abd39ee9 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:15.684928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fef25dfc-db0b-4bfe-a6eb-3467abd39ee9 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:15.786043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:15.805481 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53a8aaa7-111e-42dd-8b88-f32919f13cf7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1314 microversion: 2.1 time: 0.915299 Oct 31 15:36:15.817839 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2200/4250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:14 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1314 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:15.838268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:15.840678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:15.844992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=2,nova_api:UPDATE=7,nova_api:DELETE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:15.848823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:15.849529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:15.850121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:15.850986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:15.851685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:15.852264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:15.991046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:16.019456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:16.021478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:16.023276 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-92ed7522-2747-4a53-aab9-df70c7ff0386 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.203861 Oct 31 15:36:16.025077 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2201/4251] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:15 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:16.151861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=98,nova_cell0:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:16.194843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=26,nova_api:UPDATE=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:16.221256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0514edc1-9cd8-4525-91c9-899efe17794c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:16.239554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0514edc1-9cd8-4525-91c9-899efe17794c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:16.242236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0514edc1-9cd8-4525-91c9-899efe17794c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:16.242757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0514edc1-9cd8-4525-91c9-899efe17794c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:16.279761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:16.293203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0514edc1-9cd8-4525-91c9-899efe17794c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:36:16.361084 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fef25dfc-db0b-4bfe-a6eb-3467abd39ee9 tempest-QuotasAdminTestJSON-2005805260 tempest-QuotasAdminTestJSON-2005805260-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/815d3223b79140849b2d675cac77514f" status: 200 len: 329 microversion: 2.1 time: 1.313699 Oct 31 15:36:16.377867 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2051/4252] 10.222.0.20 () {60 vars in 1263 bytes} [Mon Oct 31 15:36:15 2022] PUT /compute/v2.1/os-quota-sets/815d3223b79140849b2d675cac77514f => generated 329 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:16.407255 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0514edc1-9cd8-4525-91c9-899efe17794c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/action" status: 202 len: 0 microversion: 2.1 time: 0.190173 Oct 31 15:36:16.412989 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2202/4253] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:16 2022] POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:16.427708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:16.428386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:16.442466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:16.443208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:16.445598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:16.448043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:16.450653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:16.451298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:16.832071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:16.833332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:16.848370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:16.854546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:16.855209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:16.856107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:16.856714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:16.857623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:16.934342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:16.961607 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0411cb3-a303-4d2c-9100-d72ca05136fa tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.526006 Oct 31 15:36:16.962601 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2052/4254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:16 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:17.052445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:17.052984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:17.076769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:17.077306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:17.077751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:17.078470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:17.078929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:17.079359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:17.122213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:17.132233 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b505894-765f-450f-895e-f44f90d2cb45 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1314 microversion: 2.1 time: 0.304851 Oct 31 15:36:17.151108 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2203/4255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:16 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:17.292256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:17.301556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:17.303155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:17.304365 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09740e9f-ae66-4940-a8d0-afa6793be413 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.256776 Oct 31 15:36:17.305450 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2053/4256] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:17 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:17.903393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-636588393", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": "none"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:17.995373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:17.997339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:18.012977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:36:18.013425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:36:18.014044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:36:18.014457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:36:18.016175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:36:18.018660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.021238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.022538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.023443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.025447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.027914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.037859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.040537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.041159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.047049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.048995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.051277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.119155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Getting quotas for project 5bef7fc31ab640718bddf778ee9b19f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:36:18.126680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Getting quotas for user 0f558f2ad0b146538ad11058f8b55dbe and project 5bef7fc31ab640718bddf778ee9b19f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:36:18.144581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:36:18.147256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 7e43a145-1922-4010-a9ab-d038dd3fb9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:36:18.235981 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-18170820-28aa-43d2-b325-c8b164527573 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.547294 Oct 31 15:36:18.237277 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2204/4257] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:36:18.241989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:18.242763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:18.252530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.253416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.254032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.255067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.255680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.256276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.497745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:18.518884 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8692985-dda2-4337-bfcb-a87eba2a183a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1501 microversion: 2.1 time: 0.280351 Oct 31 15:36:18.519488 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2205/4258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:18 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1501 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:18.528379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17d49f9a-6a4d-43f4-b5ad-692b4985a5de tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:18.529246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17d49f9a-6a4d-43f4-b5ad-692b4985a5de tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 7e43a145-1922-4010-a9ab-d038dd3fb9c5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:18.617652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-17d49f9a-6a4d-43f4-b5ad-692b4985a5de tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:18.629414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-17d49f9a-6a4d-43f4-b5ad-692b4985a5de tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:18.632583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:18.643230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-17d49f9a-6a4d-43f4-b5ad-692b4985a5de tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:18.645962 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17d49f9a-6a4d-43f4-b5ad-692b4985a5de tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5" status: 200 len: 1277 microversion: 2.47 time: 0.121462 Oct 31 15:36:18.648085 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cec60e3c-6e3b-4b38-8f71-576966fedf1c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.660883 Oct 31 15:36:18.648728 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2054/4259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:17 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:18.649074 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2206/4260] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:18 2022] GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:18.678155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:18.680947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:18.700821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5e1db40b-bc17-4d31-9991-af333ba9d1f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:18.707602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.709842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e1db40b-bc17-4d31-9991-af333ba9d1f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:18.712788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.714122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.715236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.718371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.720399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.734881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1db40b-bc17-4d31-9991-af333ba9d1f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.736158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1db40b-bc17-4d31-9991-af333ba9d1f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.738694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1db40b-bc17-4d31-9991-af333ba9d1f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.739752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1db40b-bc17-4d31-9991-af333ba9d1f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:18.742605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1db40b-bc17-4d31-9991-af333ba9d1f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:18.743226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1db40b-bc17-4d31-9991-af333ba9d1f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:18.867359 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5e1db40b-bc17-4d31-9991-af333ba9d1f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 14 microversion: 2.1 time: 0.184406 Oct 31 15:36:18.867359 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2207/4261] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:18 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:18.928964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1560127000", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": "none"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:18.979567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:18.995200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:18.997388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:18.998770 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33e82e5c-b2c8-4e64-be61-8e313010aca6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.328096 Oct 31 15:36:19.000811 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2055/4262] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:18 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:19.036463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:36:19.036885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:36:19.037565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:36:19.037964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:36:19.038522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:36:19.061426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:19.062339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:19.063448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:19.065490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:19.067286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:19.067848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:19.105540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Getting quotas for project 5bef7fc31ab640718bddf778ee9b19f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:36:19.114692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Getting quotas for user 0f558f2ad0b146538ad11058f8b55dbe and project 5bef7fc31ab640718bddf778ee9b19f7. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:36:19.130951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:36:19.133595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:36:19.195777 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24b20669-f844-4c11-83b8-389bd9a4e1ec tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.271379 Oct 31 15:36:19.196675 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2208/4263] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:36:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 273 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:36:19.209414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aff9996f-a51b-4198-84ad-4bf89b13c07c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:19.212306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aff9996f-a51b-4198-84ad-4bf89b13c07c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:19.315313 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aff9996f-a51b-4198-84ad-4bf89b13c07c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "PUT /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 992 microversion: 2.47 time: 0.111068 Oct 31 15:36:19.316519 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2056/4264] 10.222.0.20 () {62 vars in 1297 bytes} [Mon Oct 31 15:36:19 2022] PUT /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 992 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:36:19.342371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c6e4325-7cc0-43dc-8a0b-7025deea41d6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:19.343073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c6e4325-7cc0-43dc-8a0b-7025deea41d6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:19.504280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c6e4325-7cc0-43dc-8a0b-7025deea41d6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:19.519396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c6e4325-7cc0-43dc-8a0b-7025deea41d6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:19.524555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c6e4325-7cc0-43dc-8a0b-7025deea41d6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:19.527551 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c6e4325-7cc0-43dc-8a0b-7025deea41d6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1278 microversion: 2.47 time: 0.192027 Oct 31 15:36:19.551878 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2209/4265] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:19 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:19.677030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:19.679729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:19.692729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:19.694407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:19.699629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:19.702168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:19.702832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:19.703615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:19.883401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20103dab-e581-4f9b-ac63-2cdb4e338864 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:19.898432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-20103dab-e581-4f9b-ac63-2cdb4e338864 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:19.908246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20103dab-e581-4f9b-ac63-2cdb4e338864 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:19.908676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20103dab-e581-4f9b-ac63-2cdb4e338864 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:19.909364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20103dab-e581-4f9b-ac63-2cdb4e338864 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:19.910537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20103dab-e581-4f9b-ac63-2cdb4e338864 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:19.912011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20103dab-e581-4f9b-ac63-2cdb4e338864 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:19.912832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20103dab-e581-4f9b-ac63-2cdb4e338864 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:19.971427 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-20103dab-e581-4f9b-ac63-2cdb4e338864 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 14 microversion: 2.1 time: 0.096920 Oct 31 15:36:19.975902 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2210/4266] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:19 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:36:20.030946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:20.031717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:20.049353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:20.049847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:20.054951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:20.056684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:20.065583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:20.066390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:20.182392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:20.192253 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dcb00cc-f07a-4b90-9795-a45a97cd6675 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.520008 Oct 31 15:36:20.193582 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2057/4267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:19 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:20.246381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:20.276579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:20.282167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:20.287381 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e287ade-9394-473d-b196-e220fe952391 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.262620 Oct 31 15:36:20.301602 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2211/4268] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:20 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:20.560099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:20.561985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:20.578391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:20.581982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:20.584319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:20.586260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:20.587026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:20.587676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:20.726626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:20.737733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:20.740674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:20.742106 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a141bf54-1ea6-4d4a-8feb-66c7152d20eb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1274 microversion: 2.47 time: 0.188067 Oct 31 15:36:20.742682 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2058/4269] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:20 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:20.983890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85339948-ba15-46a5-9538-4ac586ac2681 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:20.986182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85339948-ba15-46a5-9538-4ac586ac2681 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:20.993138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85339948-ba15-46a5-9538-4ac586ac2681 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:20.993672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85339948-ba15-46a5-9538-4ac586ac2681 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:20.994338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85339948-ba15-46a5-9538-4ac586ac2681 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:20.995659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85339948-ba15-46a5-9538-4ac586ac2681 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:20.996116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85339948-ba15-46a5-9538-4ac586ac2681 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:20.996733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85339948-ba15-46a5-9538-4ac586ac2681 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:21.039227 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85339948-ba15-46a5-9538-4ac586ac2681 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 14 microversion: 2.1 time: 0.059389 Oct 31 15:36:21.040652 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2212/4270] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:20 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:21.217756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:21.219122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:21.226850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:21.228324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:21.229009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:21.230174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:21.231139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:21.231765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:21.320416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:21.321113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:21.344198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:21.344686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:21.345114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:21.345842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:21.346292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:21.346712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:21.445112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:21.457012 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a19ca5ca-9542-4ef4-999f-8a90188087ef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.243851 Oct 31 15:36:21.458423 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2059/4271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:21 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:21.772669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:21.773315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:21.792237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:21.793973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:21.794877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:21.796718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:21.797378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:21.798623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:21.893248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:21.907338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:21.909619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:21.911427 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ac57a1e1-e082-4e0d-9d9c-f0e1e4886b7c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1330 microversion: 2.47 time: 0.145611 Oct 31 15:36:21.912729 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2060/4272] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:21 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1330 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:21.968985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:21.983766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:21.985679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:21.986910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26d02efc-0e88-4ee9-a18c-188646c7a859 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.671008 Oct 31 15:36:21.996336 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2213/4273] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:21 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:22.052514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5f2a2763-8f0e-4284-b4ea-f0d07c4ad109 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:22.054781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5f2a2763-8f0e-4284-b4ea-f0d07c4ad109 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:22.064855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f2a2763-8f0e-4284-b4ea-f0d07c4ad109 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:22.065332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f2a2763-8f0e-4284-b4ea-f0d07c4ad109 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:22.066886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f2a2763-8f0e-4284-b4ea-f0d07c4ad109 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:22.067607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f2a2763-8f0e-4284-b4ea-f0d07c4ad109 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:22.068076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f2a2763-8f0e-4284-b4ea-f0d07c4ad109 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:22.069846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f2a2763-8f0e-4284-b4ea-f0d07c4ad109 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:22.123777 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5f2a2763-8f0e-4284-b4ea-f0d07c4ad109 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 14 microversion: 2.1 time: 0.075616 Oct 31 15:36:22.125466 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2061/4274] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:22 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:22.347696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1013397924", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:22.424027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:36:22.483465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:22.485085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:22.495279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:22.496250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:22.496901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:22.497926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:22.498581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:22.499215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:22.710247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:22.723541 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c97d5ee-d19b-4a71-8ae2-5f9df5be337b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.244319 Oct 31 15:36:22.725874 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2062/4275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:22 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:22.830340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:36:22.830761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:36:22.831232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:36:22.831637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:36:22.832045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:36:22.863469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:22.864204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:22.865283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:22.866270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:22.866884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:22.867470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:22.909356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Getting quotas for project 0e1f0673c23a488ba6ed1ddb6bf0a7a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:36:22.919416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Getting quotas for user 9e2d510b1c0c499da5df11be5dcbc0de and project 0e1f0673c23a488ba6ed1ddb6bf0a7a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:36:22.933985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:36:22.936503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:36:22.943877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:22.945058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:22.955281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:22.956032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:22.956638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:22.959671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:22.960375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:22.960988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:23.019671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:23.023521 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6bc073f6-6193-4f61-888f-0f303a50dfb3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925806 Oct 31 15:36:23.033266 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2214/4276] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:36:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:36:23.038411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:23.039031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:23.055917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:23.056037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:23.056432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:23.057768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:23.058206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:23.058628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:23.125300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:23.138293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:23.139840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:23.141038 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73fdf96d-914d-4009-83a5-6097894f5657 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1348 microversion: 2.47 time: 0.201085 Oct 31 15:36:23.142048 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2063/4277] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:22 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1348 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:23.146879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e3dbd58-05b4-4c3f-ad72-408ba7f9689e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:23.147494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e3dbd58-05b4-4c3f-ad72-408ba7f9689e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:23.244652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e3dbd58-05b4-4c3f-ad72-408ba7f9689e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:23.266420 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e3dbd58-05b4-4c3f-ad72-408ba7f9689e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1222 microversion: 2.1 time: 0.122814 Oct 31 15:36:23.267344 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2064/4278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:23 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:23.293193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74c27b2a-8780-4e22-866a-d48385d51a3f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:23.296650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74c27b2a-8780-4e22-866a-d48385d51a3f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:23.318575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c27b2a-8780-4e22-866a-d48385d51a3f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:23.319905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c27b2a-8780-4e22-866a-d48385d51a3f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:23.320645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c27b2a-8780-4e22-866a-d48385d51a3f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:23.324443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c27b2a-8780-4e22-866a-d48385d51a3f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:23.326104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c27b2a-8780-4e22-866a-d48385d51a3f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:23.328031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c27b2a-8780-4e22-866a-d48385d51a3f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:23.414998 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-74c27b2a-8780-4e22-866a-d48385d51a3f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 14 microversion: 2.1 time: 0.129201 Oct 31 15:36:23.417337 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2065/4279] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:23 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:23.632848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:23.641373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:23.643108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:23.649588 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51936210-1d1c-41df-8a28-dd8e1f2f5094 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.615108 Oct 31 15:36:23.653056 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2215/4280] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:23 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:23.750503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:23.752524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:23.761447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:23.762698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:23.763579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:23.765076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:23.765797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:23.766497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:23.936635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:23.948257 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6cda8257-8699-40e8-a05f-3960d86aec63 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.201730 Oct 31 15:36:23.949649 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2066/4281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:23 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:24.168900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:24.169452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:24.178792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.179300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.179744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.185032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.186474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.186951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.291088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:24.292864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:24.299632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.300117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.300549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.301271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.301963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.302634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.336743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:24.350233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:24.351682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:24.355321 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2ca39e7b-0ca9-4d02-bf92-92cd949584fa tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1336 microversion: 2.47 time: 0.191109 Oct 31 15:36:24.369153 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2216/4282] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:24 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1336 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:24.377869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:24.411598 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca16f964-1706-415b-aa56-24d45f4ccf20 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1218 microversion: 2.1 time: 0.124170 Oct 31 15:36:24.425236 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2067/4283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:24 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:24.428280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d500da75-f114-4eb1-a737-e70757a7b9f1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:24.430822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d500da75-f114-4eb1-a737-e70757a7b9f1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:24.451091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d500da75-f114-4eb1-a737-e70757a7b9f1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.451592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d500da75-f114-4eb1-a737-e70757a7b9f1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.452033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d500da75-f114-4eb1-a737-e70757a7b9f1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.452749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d500da75-f114-4eb1-a737-e70757a7b9f1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.453362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d500da75-f114-4eb1-a737-e70757a7b9f1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.453663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d500da75-f114-4eb1-a737-e70757a7b9f1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.612888 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d500da75-f114-4eb1-a737-e70757a7b9f1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 14 microversion: 2.1 time: 0.188819 Oct 31 15:36:24.613678 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2217/4284] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:24 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:24.683787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:24.684792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:24.694323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.694885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.695409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.696197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.696758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.697281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.800226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:24.811288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:24.812908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:24.814491 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-62b35589-d4ae-4363-a851-eb43e4883471 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1409 microversion: 2.54 time: 0.137043 Oct 31 15:36:24.815829 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2068/4285] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:24 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1409 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:24.974641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:24.975462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:24.984893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.985516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.986045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:24.987108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:24.987718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:24.988333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.326476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:25.339043 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e9bf894-8aae-44ff-a01b-d09747e75958 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.368922 Oct 31 15:36:25.340059 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2218/4286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:24 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:25.384778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:25.387275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:25.396012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.397076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.397764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.398889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.399513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.400098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.439843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:25.440744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:25.449020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.449881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.450535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.451469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.452108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.452867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.532313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:25.544672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:25.560911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:25.562609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:25.563947 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f2d6972d-9143-4411-ac4f-bc413fff9062 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1336 microversion: 2.47 time: 0.184255 Oct 31 15:36:25.570827 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3fdb4dca-9f7a-4465-b191-525cb54914e5 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1274 microversion: 2.1 time: 0.136005 Oct 31 15:36:25.572182 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2219/4287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:25 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1274 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:25.594344 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2069/4288] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:25 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1336 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:25.625283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be55fa25-4a54-4180-b8c3-c64c863272f7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:25.628661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be55fa25-4a54-4180-b8c3-c64c863272f7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:25.643974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be55fa25-4a54-4180-b8c3-c64c863272f7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.644615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be55fa25-4a54-4180-b8c3-c64c863272f7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.646361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be55fa25-4a54-4180-b8c3-c64c863272f7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.648222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be55fa25-4a54-4180-b8c3-c64c863272f7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.649939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be55fa25-4a54-4180-b8c3-c64c863272f7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.653524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be55fa25-4a54-4180-b8c3-c64c863272f7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.841473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=13 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:25.847564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:25.848499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:25.857182 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be55fa25-4a54-4180-b8c3-c64c863272f7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 14 microversion: 2.1 time: 0.235621 Oct 31 15:36:25.858513 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2220/4289] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:25 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:25.877502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.879119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.883031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:25.883958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:25.885781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:25.886241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:26.133168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:26.151512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:26.153203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:26.154448 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cbe89647-d997-4549-a375-da3132109f4a tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1415 microversion: 2.54 time: 0.314050 Oct 31 15:36:26.159694 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2070/4290] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:25 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1415 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:26.364783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:26.366212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:26.374582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:26.383337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:26.384061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:26.387201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:26.388274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:26.390121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:26.595416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:26.596067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:26.605012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:26.605574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:26.617406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:26.621829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:26.622286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:26.622735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:26.760078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:26.768885 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-511cf2a6-38cc-495f-ae7c-68b6985cf62e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.408556 Oct 31 15:36:26.770069 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2221/4291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:26 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:26.782863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:26.784093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:26.803680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:26.809002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:26.809726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:26.811265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:26.814796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:26.815116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:26.837373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:26.852474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:26.859275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:26.860696 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d8e5bfa-157b-44fd-a7a5-92accab47812 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1357 microversion: 2.47 time: 0.269132 Oct 31 15:36:26.864443 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2071/4292] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:26 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1357 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:26.899333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-506a33db-5efa-45cd-99df-b504d1c49e0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:26.902882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-506a33db-5efa-45cd-99df-b504d1c49e0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:26.910532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-506a33db-5efa-45cd-99df-b504d1c49e0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:26.911546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-506a33db-5efa-45cd-99df-b504d1c49e0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:26.912213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-506a33db-5efa-45cd-99df-b504d1c49e0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:26.913182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-506a33db-5efa-45cd-99df-b504d1c49e0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:26.913914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-506a33db-5efa-45cd-99df-b504d1c49e0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:26.914566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-506a33db-5efa-45cd-99df-b504d1c49e0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.014189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:27.037026 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5573f34f-b560-4c88-90d1-ea07a7904b77 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1280 microversion: 2.1 time: 0.264799 Oct 31 15:36:27.056219 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2222/4293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:26 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:27.056219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:27.063811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:27.072256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.074885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.075504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.079539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.080489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.081115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.174914 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-506a33db-5efa-45cd-99df-b504d1c49e0a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 14 microversion: 2.1 time: 0.299890 Oct 31 15:36:27.176236 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2072/4294] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:26 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 14 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:27.187782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:27.189259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:27.215935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.216772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.217664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.218954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.221430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.223671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.253845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:27.300052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:36:27.302463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:36:27.303225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:36:27.303927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:36:27.305526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:36:27.457150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:27.458549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:27.473511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:27.475186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:27.476417 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6768ea87-9e1d-483e-93f6-22df4ca2c55e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1415 microversion: 2.54 time: 0.293446 Oct 31 15:36:27.481188 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2073/4295] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:27 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1415 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:27.486308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.488030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.488665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.496827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.497570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.499600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.599543 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d67191e-3025-4d95-8732-76d38b01e013 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "POST /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff/action" status: 202 len: 1079 microversion: 2.47 time: 0.549143 Oct 31 15:36:27.603243 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2223/4296] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:36:27 2022] POST /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff/action => generated 1079 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 31 15:36:27.625398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:27.626001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:27.640166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.641080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.642324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.643707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.644391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.644995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.764412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:27.782075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:27.784404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:27.785660 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-af8e882a-4e39-46a7-aa12-49e491949660 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.169216 Oct 31 15:36:27.788183 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2074/4297] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:27 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:27.800529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:27.801478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:27.810980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.813385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.815126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:27.816570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:27.820323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:27.822036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.064554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:28.065362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:28.072802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.073360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.073845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.074554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.075010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.075461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.178336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:28.188126 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65a697dc-ef9b-44b9-a440-59577129c81e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.392005 Oct 31 15:36:28.188889 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2224/4298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:27 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:28.204308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0bc355b5-342e-406a-8082-1902c90deed9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:28.207891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0bc355b5-342e-406a-8082-1902c90deed9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:28.222637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc355b5-342e-406a-8082-1902c90deed9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.223229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc355b5-342e-406a-8082-1902c90deed9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.223707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc355b5-342e-406a-8082-1902c90deed9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.224436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc355b5-342e-406a-8082-1902c90deed9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.224887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc355b5-342e-406a-8082-1902c90deed9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.225673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0bc355b5-342e-406a-8082-1902c90deed9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.265692 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0bc355b5-342e-406a-8082-1902c90deed9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 14 microversion: 2.1 time: 0.075073 Oct 31 15:36:28.269396 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2225/4299] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:28 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:36:28.299603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:28.310109 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3da05671-3ccc-4cd0-a676-ad20aae2f73b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1322 microversion: 2.1 time: 0.250194 Oct 31 15:36:28.311121 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2075/4300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:28 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:28.505215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:28.506183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:28.510362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:28.516545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.516980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.517688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.518537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.519095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.519732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.604947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:28.615309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:28.617524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:28.620411 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0e27384b-fc64-40d9-92bf-6c24afaea2f5 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1400 microversion: 2.54 time: 0.119887 Oct 31 15:36:28.645533 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2226/4301] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:28 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1400 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:28.659481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-82ed9d4d-5a8e-4f1e-b0dc-693702879921 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '.version_select at 0x7f16e16760d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:28.703722 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-82ed9d4d-5a8e-4f1e-b0dc-693702879921 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1315514125" status: 204 len: 0 microversion: 2.54 time: 0.055678 Oct 31 15:36:28.704357 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2076/4302] 10.222.0.20 () {60 vars in 1319 bytes} [Mon Oct 31 15:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1315514125 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:36:28.721893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:28.722399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:28.736323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.737320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.738043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.738915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.739528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.740244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.817788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:36:28.820701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:28.821882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:28.841083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.842570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.848575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.848893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:28.850823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:28.851274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:28.978276 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9691d0ad-d703-4863-a5d7-8cb76f24d4e6 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "DELETE /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 204 len: 0 microversion: 2.54 time: 0.255797 Oct 31 15:36:28.978276 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2227/4303] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:36:28 2022] DELETE /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:36:28.991194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:28.992011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:29.002493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.003002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.003510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.004232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.004746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.005270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.055399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:29.070192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:29.077754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:29.078685 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-81bffd4e-12ac-4027-8116-592956f6dfa6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.262559 Oct 31 15:36:29.079517 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2077/4304] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:28 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:29.109178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1e1f5e83-2fc6-4d43-a9e9-b0ba4877bdfc req-65de0f5e-1503-4603-a58c-d177ae31eecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29364441-505e-4133-af7a-6b399a308502", "tag": "a5d8d040-6c51-476e-befe-dfc3576104af"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:29.124644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1e1f5e83-2fc6-4d43-a9e9-b0ba4877bdfc req-65de0f5e-1503-4603-a58c-d177ae31eecd service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.125163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1e1f5e83-2fc6-4d43-a9e9-b0ba4877bdfc req-65de0f5e-1503-4603-a58c-d177ae31eecd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.125608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1e1f5e83-2fc6-4d43-a9e9-b0ba4877bdfc req-65de0f5e-1503-4603-a58c-d177ae31eecd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.139264 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1e1f5e83-2fc6-4d43-a9e9-b0ba4877bdfc req-65de0f5e-1503-4603-a58c-d177ae31eecd service nova] Creating event network-changed:a5d8d040-6c51-476e-befe-dfc3576104af for instance 29364441-505e-4133-af7a-6b399a308502 on n-h2-858384-17 Oct 31 15:36:29.145930 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1e1f5e83-2fc6-4d43-a9e9-b0ba4877bdfc req-65de0f5e-1503-4603-a58c-d177ae31eecd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044585 Oct 31 15:36:29.146514 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2078/4305] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:29.150160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:29.164277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:29.169473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:29.170731 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f4072c8-3435-4ae6-9f65-00226cee14db tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1406 microversion: 2.54 time: 0.189749 Oct 31 15:36:29.173039 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2228/4306] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:28 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:29.215282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:29.216165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:29.227756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.228287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.229627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.230702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.232479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.232479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.276787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7404d45-30dc-473c-9c8f-42aa18aa4b97 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:29.279559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f7404d45-30dc-473c-9c8f-42aa18aa4b97 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:29.293410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7404d45-30dc-473c-9c8f-42aa18aa4b97 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.295063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7404d45-30dc-473c-9c8f-42aa18aa4b97 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.297360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7404d45-30dc-473c-9c8f-42aa18aa4b97 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.298369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7404d45-30dc-473c-9c8f-42aa18aa4b97 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.301780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7404d45-30dc-473c-9c8f-42aa18aa4b97 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.302502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7404d45-30dc-473c-9c8f-42aa18aa4b97 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.370563 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7404d45-30dc-473c-9c8f-42aa18aa4b97 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action" status: 200 len: 8206 microversion: 2.1 time: 0.098032 Oct 31 15:36:29.375846 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2229/4307] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:29 2022] POST /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca/action => generated 8206 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:29.380192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:29.381052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:29.389829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.390413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.390922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.391706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.392334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.393018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.522592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:29.553505 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6036de63-3bb2-4e5f-8647-170a60ab7406 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.330326 Oct 31 15:36:29.553505 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2079/4308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:29 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:29.553505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:29.553505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:29.571036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.571537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.571978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.573393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:29.573858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:29.574284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:29.690930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:29.705829 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccefbcd1-9809-4bc6-a864-004878aeb5c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1322 microversion: 2.1 time: 0.333049 Oct 31 15:36:29.708341 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2230/4309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:29 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:29.992907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.003043 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-639f556e-d97f-48da-b9cb-fae1f45d6308 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.461908 Oct 31 15:36:30.014072 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2080/4310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:29 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:30.036141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:30.037688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:30.045893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.046521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.047052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.047843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.048368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.049510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.108956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:30.109594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:30.117643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.118383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.118897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.120651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.121429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.122280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.217086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.225698 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f2a1eba4-e51e-4e78-925c-d0150fb4914e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.193453 Oct 31 15:36:30.226899 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2231/4311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:30 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:30.232812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:30.233727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:30.237788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.242487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.243566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.245049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.246363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.246892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.247391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.253192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.255038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.258311 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d514095e-a5db-4653-ba78-b0f96dba5db3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.154931 Oct 31 15:36:30.260868 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2081/4312] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:30 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:30.268066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:30.269527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:30.278642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.279704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.280432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.281365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.282371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.282986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.379050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.400473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.407173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.408920 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6193d79d-6ead-437c-8436-6b1ea560f01e tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1406 microversion: 2.54 time: 0.180623 Oct 31 15:36:30.410744 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2232/4313] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:30 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:30.460433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.470242 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-232d1684-2722-45b0-97ad-98b65f35038e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.207909 Oct 31 15:36:30.471554 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2082/4314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:30 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:30.494325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:30.495683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:30.502920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.503521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.504065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.505167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.505857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.506353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.568506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:30.569166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:30.590709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.591224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.591676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.592414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.592885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.594486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.600293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:30.864424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:30.875121 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4eea431-32af-40f5-afea-694a9753eb12 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.315437 Oct 31 15:36:30.876514 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2083/4315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:30 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:30.892318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:30.897212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:30.904322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.904897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.905494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:30.906214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:30.906685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:30.907373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.064854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:31.076630 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d167027c-d300-459e-8ef9-00df23a90d4e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1322 microversion: 2.1 time: 0.198775 Oct 31 15:36:31.077408 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2084/4316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:30 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:31.290721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:31.292182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:31.304681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.305721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.306905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.310213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.310821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.312141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.399390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:31.405563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:31.409993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:31.411465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:31.412651 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91a03124-a2e0-4e02-ba6c-73041080fde7 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.126005 Oct 31 15:36:31.425162 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2085/4317] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:31 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:31.428996 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3aef77ab-33ac-4f9c-af4e-d13d4d4f04e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.939018 Oct 31 15:36:31.430729 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2233/4318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:30 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:31.438706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:31.439615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:31.446679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.447536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.448756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.449728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.450426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.451075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.459047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:31.460030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:31.474550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.475772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.481667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.483368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.484597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.486456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.521038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:31.523305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.523788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.524222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.524659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lazy-loading 'fault' on Instance uuid 34fc99c2-53f3-4349-8e82-2b41fe80e07e {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:36:31.601360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Locking {{(pid=120587) lock /opt/stack/nova/nova/compute/api.py:4846}} Oct 31 15:36:31.621319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:31.632350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:31.634407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c8e3d08b7e146abb5e0f538b89617b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820ac6f38634ea3b325664518ca0bfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:31.636649 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-678f3364-f66c-4a38-b844-c1b9b71b3f0d tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 200 len: 1411 microversion: 2.54 time: 0.201880 Oct 31 15:36:31.646981 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2086/4319] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:31 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 1411 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:31.737525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:31.745754 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4fee2e8a-7ee9-4681-ae08-bd5b4c66a720 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.291316 Oct 31 15:36:31.751278 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2234/4320] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:31 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:31.757446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:31.758148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:31.777792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.781943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.788405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.789605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.793683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.794477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.905053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:31.905983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:31.918486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.922444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.923119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:31.926162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:31.928097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:31.928755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.085319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:32.096579 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-805a687f-166b-4cd7-8742-4b70c9456a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.343148 Oct 31 15:36:32.108758 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2087/4321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:31 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:32.124711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:32.125224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:32.126056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:32.134149 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8bb0d03-117b-4fbd-b2ce-8642a0a0ff0f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.234152 Oct 31 15:36:32.135538 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2235/4322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:31 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:32.135979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.136713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.137955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.139143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.139616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.140042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.148618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c679998-9dae-4ce7-a4ba-d930ddff34e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:32.164282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c679998-9dae-4ce7-a4ba-d930ddff34e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.164785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c679998-9dae-4ce7-a4ba-d930ddff34e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.169010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c679998-9dae-4ce7-a4ba-d930ddff34e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.202455 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-6c679998-9dae-4ce7-a4ba-d930ddff34e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] HTTP exception thrown: Instance 78294b47-c54e-47ff-b715-d93117bef42f is locked Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c679998-9dae-4ce7-a4ba-d930ddff34e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Request method failure captured: Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action HTTP/1.1 Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 15 Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-pihMoS1lrMFnbEBCE6im_zb2InyUzY2oThjFX9uAdMTRl14xGqD-jMSZE26wIdrBRKGZdj0fhdoCm04cRDKzmlD6YgLdNVJOqAa1j5PfjCenA2rpmcB3IRRDEHNHdn0C9fxCVNu4gZyN1n5Rx1oeD39zVZQ2TMo2ESLLyN8flkT_I Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f99b34e7ae9b44b5a9666b17fa41570e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f99b34e7ae9b44b5a9666b17fa41570e"}]}] Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-167388906 Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 33e8230d70464e5da2cced0060bb1a31 Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: {"os-stop": {}} Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 78294b47-c54e-47ff-b715-d93117bef42f is locked Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '78294b47-c54e-47ff-b715-d93117bef42f', 'body': {'os-stop': {}}} Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 78294b47-c54e-47ff-b715-d93117bef42f is locked Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 78294b47-c54e-47ff-b715-d93117bef42f is locked Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78294b47-c54e-47ff-b715-d93117bef42f is locked Oct 31 15:36:32.204257 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.209377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c679998-9dae-4ce7-a4ba-d930ddff34e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Returning 409 to user: Instance 78294b47-c54e-47ff-b715-d93117bef42f is locked {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:32.209377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c679998-9dae-4ce7-a4ba-d930ddff34e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 409 len: 107 microversion: 2.1 time: 0.069865 Oct 31 15:36:32.213006 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2236/4323] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:32 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 107 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:36:32.223216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:32.223743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:32.230224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.230719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.231175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.231950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.232436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.232913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.319733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Unlocking {{(pid=120587) unlock /opt/stack/nova/nova/compute/api.py:4875}} Oct 31 15:36:32.368714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:32.378511 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-84a2b05c-de14-41f8-b195-89eb7aa31967 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1322 microversion: 2.1 time: 0.259074 Oct 31 15:36:32.379928 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2088/4324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:32 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:32.399787 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae64175c-e842-4362-b7b0-5e9a4127f306 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.185115 Oct 31 15:36:32.401153 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2237/4325] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:32 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:32.409730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba6d77c4-7484-4089-9f54-72a0bfcf2034 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:32.416010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba6d77c4-7484-4089-9f54-72a0bfcf2034 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.416679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba6d77c4-7484-4089-9f54-72a0bfcf2034 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.417154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba6d77c4-7484-4089-9f54-72a0bfcf2034 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.442441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba6d77c4-7484-4089-9f54-72a0bfcf2034 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Going to try to stop instance {{(pid=120588) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:36:32.443652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:32.444439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:32.455307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.455902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.456584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.457574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.458114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.460623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.496904 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba6d77c4-7484-4089-9f54-72a0bfcf2034 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.090914 Oct 31 15:36:32.498375 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2089/4326] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:32 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:32.508216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:32.509311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:32.526018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.527168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.528204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.529198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.529830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.530381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.566038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:32.577274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:32.578971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:32.580636 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee7fa9e3-d039-4b23-8e00-d1412b970eb8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.142956 Oct 31 15:36:32.597604 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2238/4327] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:32 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:32.668462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:32.669004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] [instance: 34fc99c2-53f3-4349-8e82-2b41fe80e07e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:32.675646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.676507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.677171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.678122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:32.678805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:32.679476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:32.699350 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] HTTP exception thrown: Instance 34fc99c2-53f3-4349-8e82-2b41fe80e07e could not be found. Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Request method failure captured: Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e HTTP/1.1 Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-tX_h25YHQVXnu-r5put1QbPfuw5z_DzRfrv9vdjasPfv2gH43yRKo0noVhDyAJbJP098WUdXHUVHjc_M6G5wFjpPh5B3YY_-0g1vQWNYbgN52bfwW34scoXKiXGgruO8v5vMhdOSlYaCrPyPLGgOWZTAyLO8vKhtGrJHqopFyXJBo Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.54 Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 9820ac6f38634ea3b325664518ca0bfd Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerShowV254Test-1663068694 Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9820ac6f38634ea3b325664518ca0bfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9820ac6f38634ea3b325664518ca0bfd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9820ac6f38634ea3b325664518ca0bfd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9820ac6f38634ea3b325664518ca0bfd"}]}] Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerShowV254Test-1663068694 Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 9820ac6f38634ea3b325664518ca0bfd Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerShowV254Test-1663068694 Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerShowV254Test-1663068694-project Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 6c8e3d08b7e146abb5e0f538b89617b0 Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerShowV254Test-1663068694-project Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 34fc99c2-53f3-4349-8e82-2b41fe80e07e could not be found. Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '34fc99c2-53f3-4349-8e82-2b41fe80e07e'} Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34fc99c2-53f3-4349-8e82-2b41fe80e07e could not be found. Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34fc99c2-53f3-4349-8e82-2b41fe80e07e could not be found. Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:32.701058 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34fc99c2-53f3-4349-8e82-2b41fe80e07e could not be found. Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] Returning 404 to user: Instance 34fc99c2-53f3-4349-8e82-2b41fe80e07e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cb3406f3-069d-448a-b504-b05b1b5f6e05 tempest-ServerShowV254Test-1663068694 tempest-ServerShowV254Test-1663068694-project] 10.222.0.20 "GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e" status: 404 len: 111 microversion: 2.54 time: 0.038435 Oct 31 15:36:32.708805 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2239/4328] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:32 2022] GET /compute/v2.1/servers/34fc99c2-53f3-4349-8e82-2b41fe80e07e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:36:33.070678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:33.082689 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-768aa786-6931-471c-b55b-b956c45ba310 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.578436 Oct 31 15:36:33.084316 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2090/4329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:32 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:33.157406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:33.158772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=25 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:33.163071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:33.163676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:33.173160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:33.173160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:33.173160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:33.173684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:33.174357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:33.174943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:33.375725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a7015109-347c-4a38-a75a-d02451acd9fc req-0c8910ce-5327-44b9-a068-ca1554aa9c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29364441-505e-4133-af7a-6b399a308502", "name": "network-vif-plugged", "status": "completed", "tag": "a5d8d040-6c51-476e-befe-dfc3576104af"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:33.394609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:33.409856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:33.411257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7015109-347c-4a38-a75a-d02451acd9fc req-0c8910ce-5327-44b9-a068-ca1554aa9c9b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:33.412092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7015109-347c-4a38-a75a-d02451acd9fc req-0c8910ce-5327-44b9-a068-ca1554aa9c9b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:33.414326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7015109-347c-4a38-a75a-d02451acd9fc req-0c8910ce-5327-44b9-a068-ca1554aa9c9b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:33.428820 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4ab7175a-96f5-4942-9082-5fe4f315614f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.264667 Oct 31 15:36:33.430224 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2240/4330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:33 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:33.435895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:33.436502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:33.443752 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a7015109-347c-4a38-a75a-d02451acd9fc req-0c8910ce-5327-44b9-a068-ca1554aa9c9b service nova] Creating event network-vif-plugged:a5d8d040-6c51-476e-befe-dfc3576104af for instance 29364441-505e-4133-af7a-6b399a308502 on n-h2-858384-17 Oct 31 15:36:33.454269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:33.455079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:33.455461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:33.456188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:33.456647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:33.457468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:33.458072 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a7015109-347c-4a38-a75a-d02451acd9fc req-0c8910ce-5327-44b9-a068-ca1554aa9c9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089343 Oct 31 15:36:33.462077 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2091/4331] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:36:33.610560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:33.611704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:33.622908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:33.623691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:33.624197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:33.625115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:33.625815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:33.626455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:33.726235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:33.736209 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ad7a6a0-c2b1-40ab-8343-9004c23bfe7e tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1322 microversion: 2.1 time: 0.304920 Oct 31 15:36:33.737243 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2241/4332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:33 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:33.755625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:33.766585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:33.768560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:33.769882 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d43b497a-11f3-477d-9b4f-ddcf5ec28212 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.163778 Oct 31 15:36:33.771041 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2092/4333] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:33 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:34.110566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:34.114492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:34.123899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.124987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.125627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:34.126543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.127384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.127974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:34.320453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:34.354754 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-293461ed-d5f6-471e-9d27-22ffbbb17303 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.245590 Oct 31 15:36:34.355649 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2242/4334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:34 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:34.459098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:34.459790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:34.482738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.483814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.487021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:34.488644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.490342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.491365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:34.666909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:34.677999 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-42bd40b9-6c31-4dba-a8d2-c91bdff0f02d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.223033 Oct 31 15:36:34.679113 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2093/4335] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:34 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:34.760753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:34.761322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:34.785219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.792815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.793388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:34.794143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.796865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.797362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:34.799103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:34.799968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:34.811715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.812496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.813013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:34.813626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:34.814296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:34.814946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:34.912638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:34.924157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:34.934917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:34.936251 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b90613bd-f69a-47c1-955c-ec9fa62ebf92 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.142045 Oct 31 15:36:34.940671 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2094/4336] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:34 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:35.103932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:35.116837 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f9e0af2e-7708-40ed-b225-7d6ba9b21b48 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1322 microversion: 2.1 time: 0.359444 Oct 31 15:36:35.118231 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2243/4337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:34 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:35.381659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:35.382563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:35.391627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:35.392438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:35.393108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:35.394078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:35.394795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:35.395822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:35.631541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:35.642877 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1af4416d-601c-49f2-82c6-5ceed1e8e8e2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.264826 Oct 31 15:36:35.658908 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2095/4338] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:35 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:35.705233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:35.706153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:35.717502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:35.718806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:35.719782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:35.721735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:35.722994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:35.722994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:35.976081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:35.977088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:35.985646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:35.986369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:35.987062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:35.987999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:35.988844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:35.989528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:35.998519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:36.007380 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b448c9a-d5eb-45e3-b27b-3e7608006ab6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.307313 Oct 31 15:36:36.027645 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2244/4339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:35 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:36.127978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:36.148062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:36.149172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:36.150508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:36.152094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:36.153833 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b4b1af6-f73c-4b5c-8fca-9c3c2c3680f4 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.181397 Oct 31 15:36:36.157715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:36.158224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:36.158680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:36.159389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:36.159845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:36.160511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:36.169187 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2096/4340] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:35 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:36.334318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:36.345373 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95f832a9-dd2c-4e97-8e11-e223ae2666ec tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1472 microversion: 2.1 time: 0.201633 Oct 31 15:36:36.362290 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2245/4341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:36 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:36.674411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:36.675180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:36.687726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:36.688231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:36.688833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:36.691423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:36.692926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:36.694117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:36.767384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c547e189-e626-4bd1-9f3e-89255451c051 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:36.767904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c547e189-e626-4bd1-9f3e-89255451c051 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] [instance: de29678c-282f-43d7-bc0e-a1c48f70773d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:36.776602 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c547e189-e626-4bd1-9f3e-89255451c051 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] HTTP exception thrown: Instance de29678c-282f-43d7-bc0e-a1c48f70773d could not be found. Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c547e189-e626-4bd1-9f3e-89255451c051 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Request method failure captured: Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/de29678c-282f-43d7-bc0e-a1c48f70773d/action HTTP/1.1 Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 15 Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-t12F28GzcaweLHiiLsEqv8ruXlgR3E-RUW2UxkNl3EW9nn_xA84uTBaRvw6VM9CbBeni2AXQOzv7c9-ZgLqUdpceTygoY-j2In0TeERPqG9YFRFeIto2Ph4nc0MxFuqiG29cppEUoZJhn-G8LzCf-4FWjeXgCJoTrShJ0FsM24_K0 Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3eabfe36d70c4cb4b63d69af8d67d3fd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}] Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 72da6da06552458b80ff99d5043c1868 Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: {"migrate": {}} Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance de29678c-282f-43d7-bc0e-a1c48f70773d could not be found. Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'de29678c-282f-43d7-bc0e-a1c48f70773d', 'body': {'migrate': {}}} Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de29678c-282f-43d7-bc0e-a1c48f70773d could not be found. Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de29678c-282f-43d7-bc0e-a1c48f70773d could not be found. Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:36.779275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:36.797657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:36.797657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:36.797657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:36.797657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:36.797657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de29678c-282f-43d7-bc0e-a1c48f70773d could not be found. Oct 31 15:36:36.797657 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:36.797657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c547e189-e626-4bd1-9f3e-89255451c051 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Returning 404 to user: Instance de29678c-282f-43d7-bc0e-a1c48f70773d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:36.797657 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c547e189-e626-4bd1-9f3e-89255451c051 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/de29678c-282f-43d7-bc0e-a1c48f70773d/action" status: 404 len: 111 microversion: 2.1 time: 0.412051 Oct 31 15:36:36.797657 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2097/4342] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:36 2022] POST /compute/v2.1/servers/de29678c-282f-43d7-bc0e-a1c48f70773d/action => generated 111 bytes in 413 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:36:37.038211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:37.039561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:37.053017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.053957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.054579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.055474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.060405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.061210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.079524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:37.088871 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7550ed6c-b1d1-464f-b6e5-3dd155134983 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.419801 Oct 31 15:36:37.092635 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2246/4343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:36 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:37.097833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1640807775", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:37.202051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:36:37.316925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:37.330707 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e80335ac-e737-4dc6-99ab-3b65094f232f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.297831 Oct 31 15:36:37.331937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2098/4344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:37 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:37.341359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:37.342308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:37.349203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.350015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.350715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.351821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.352963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.354178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.436596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:37.446287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:37.448314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:37.449768 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cb77aec7-1b7a-46d5-9546-414d7d93a90e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.116399 Oct 31 15:36:37.450587 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2099/4345] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:37 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:37.868883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:36:37.870176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:36:37.871255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:36:37.871923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:36:37.872568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:36:37.884345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.886594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.887410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.888405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:37.889109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:37.889939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:37.920362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Getting quotas for project 0e1f0673c23a488ba6ed1ddb6bf0a7a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:36:37.926983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Getting quotas for user 9e2d510b1c0c499da5df11be5dcbc0de and project 0e1f0673c23a488ba6ed1ddb6bf0a7a8. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:36:37.949296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:36:37.953418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:36:38.041592 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f381f8be-092f-4a72-985c-fbc684fca2cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946579 Oct 31 15:36:38.044605 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2247/4346] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:36:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:36:38.062141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-056583ff-351a-484b-a4c7-7bc9e0635dad tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:38.063125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-056583ff-351a-484b-a4c7-7bc9e0635dad tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:38.128234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:38.129955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:38.156682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.157339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.157786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.158501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.158964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.162944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.197000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-056583ff-351a-484b-a4c7-7bc9e0635dad tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:38.210459 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-056583ff-351a-484b-a4c7-7bc9e0635dad tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1222 microversion: 2.1 time: 0.157910 Oct 31 15:36:38.211060 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2100/4347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:38 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:38.360277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:38.361318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:38.372813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.375958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.378502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.379253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.379907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.381195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.417269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:38.646089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:38.668288 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-97a7c35c-c3c6-4a79-804c-841fd96e2161 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.551902 Oct 31 15:36:38.668999 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2248/4348] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:38 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:38.674059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:38.685949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:38.692354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.692943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.693476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.694496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:38.695180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:38.696079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:38.781810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:38.802103 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-784cb239-660c-44e1-b9db-990cd1820075 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.438704 Oct 31 15:36:38.810446 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2101/4349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:38 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:38.824303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:38.836294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:38.838003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:38.852748 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c169515b-d929-4512-a8c5-e13dc10b388b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.182407 Oct 31 15:36:38.878456 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2249/4350] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:38 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:39.244741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:39.245795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:39.284822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:39.285392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:39.285835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:39.289305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:39.295479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:39.298722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:39.499620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:39.509061 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e9b2cf7-1b8f-4a69-b8f9-d70bf82c4eff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1218 microversion: 2.1 time: 0.269896 Oct 31 15:36:39.521483 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2102/4351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:39 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1218 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:39.706365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:39.706984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:39.721050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:39.724492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:39.726120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:39.728345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:39.729968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:39.732875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:39.838357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:39.839205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:39.846190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:39.846790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:39.847752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:39.848128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:39.848949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:39.849462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:40.064112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:40.085423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21f3c58c-bb9f-45fd-a2a8-593c00765c89 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.252562 Oct 31 15:36:40.101759 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2103/4352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:39 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:40.116677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:40.117325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:40.143467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:40.144694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:40.145365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:40.146089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:40.147206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:40.147822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:40.336452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:40.349209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:40.351002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:40.352387 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-994fdab0-1603-46f4-80cb-59151461c547 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.249452 Oct 31 15:36:40.365735 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2104/4353] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:40 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:40.546597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:40.547588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:40.555888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:40.557312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:40.557948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:40.558971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:40.559764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:40.560934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:40.640263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:40.662451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:40.673263 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b8a1bd9-16db-465f-9121-d8a3007539b1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.970235 Oct 31 15:36:40.676053 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2250/4354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:39 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:40.712685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:40.724863 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-422e32be-4630-4be8-8845-bdb86f2e4e4b tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1280 microversion: 2.1 time: 0.182588 Oct 31 15:36:40.734009 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2105/4355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:40 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1280 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:41.115272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:41.117409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:41.135444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:41.136209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:41.137119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:41.138412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:41.141625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:41.143526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:41.380438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:41.381046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:41.394361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:41.398808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:41.399432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:41.400580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:41.401384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:41.401982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:41.531639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:41.547100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:41.548638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:41.557204 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b6087aa8-9808-40df-8239-90f36d7dca25 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.180201 Oct 31 15:36:41.557749 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2106/4356] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:41 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:41.597957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:41.614637 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad97dc4a-feb2-47f7-b2ed-bd9e191ab168 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.505520 Oct 31 15:36:41.615507 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2251/4357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:41 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:41.706852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:41.707881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:41.720876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:41.722168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:41.724044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:41.727864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:41.730289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:41.732251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:41.757215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:41.758150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:41.776242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:41.777298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:41.780533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:41.781605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:41.786189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:41.788708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:42.157012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:42.170576 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f768a36-8e2b-4839-940c-9353daf2168c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.467173 Oct 31 15:36:42.173448 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2107/4358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:41 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:42.345986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:42.357470 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02b3a66f-d34e-4c09-b5f2-ce2d7b8746d2 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1322 microversion: 2.1 time: 0.605762 Oct 31 15:36:42.361534 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2252/4359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:41 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:42.587228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:42.588623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:42.599757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:42.601868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:42.602514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:42.604991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:42.605689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:42.607421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:42.640481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:42.641181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:42.658573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:42.666759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:42.667677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:42.668842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:42.669488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:42.670067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:42.732437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:42.745042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:42.747965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:42.750366 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed825124-6d20-4084-ad7f-e31d6cac84d8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.167253 Oct 31 15:36:42.753854 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2108/4360] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:42 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:43.127410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:43.161847 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0446a25b-5eb6-437c-88d7-6afe353f005a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.524021 Oct 31 15:36:43.163479 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2253/4361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:42 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:43.206105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:43.207183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:43.241095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.243282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.243911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.257950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.259405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.260352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.393798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:43.395035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:43.413624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.416567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.417628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.419132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.420190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.422926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.719819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:43.733448 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-653a37ca-68e9-4845-be52-815bdd60bbee tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1322 microversion: 2.1 time: 0.351451 Oct 31 15:36:43.734286 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2254/4362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:43 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:43.768367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:43.781824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:43.782439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:43.785170 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26e4a605-9fa2-4c7f-9537-6c1485ae0924 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1656 microversion: 2.1 time: 0.588019 Oct 31 15:36:43.786297 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2109/4363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:43 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1656 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:43.815784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.818464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28881872-c48c-4def-9cab-8eaa8e48cba8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:43.819214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.819849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.823910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.825119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.827676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.847899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28881872-c48c-4def-9cab-8eaa8e48cba8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:43.854132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28881872-c48c-4def-9cab-8eaa8e48cba8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:43.854895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28881872-c48c-4def-9cab-8eaa8e48cba8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:43.913321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28881872-c48c-4def-9cab-8eaa8e48cba8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Going to try to start instance {{(pid=120588) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:36:44.006925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:44.021585 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28881872-c48c-4def-9cab-8eaa8e48cba8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.208778 Oct 31 15:36:44.022727 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2110/4364] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:43 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:44.030507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:44.032111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:44.032696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:44.033335 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e0caa21-f464-46e1-8b94-6d5ba0ed33b9 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.255353 Oct 31 15:36:44.034268 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2255/4365] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:43 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:44.036101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:44.055097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:44.055680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:44.060476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:44.063919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:44.064590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:44.065217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:44.190995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:44.191876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:44.199285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:44.199925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:44.200460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:44.201524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:44.202222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:44.202880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:44.421905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:44.433345 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b196a04-d123-4dfb-b710-7a454b5508f6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1665 microversion: 2.1 time: 0.405258 Oct 31 15:36:44.434447 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2111/4366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:44 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1665 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:44.445298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5a3da32f-9868-4762-8d99-043aacb8c09f req-fc6b171c-6ff4-44f9-bb7f-e342f5f5fd92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f788f27-50ff-4efc-88b7-18770764de0e", "tag": "adbdb96f-395c-40c8-a3b6-83f8c5585894"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:44.468016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5a3da32f-9868-4762-8d99-043aacb8c09f req-fc6b171c-6ff4-44f9-bb7f-e342f5f5fd92 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:44.471582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5a3da32f-9868-4762-8d99-043aacb8c09f req-fc6b171c-6ff4-44f9-bb7f-e342f5f5fd92 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:44.473622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5a3da32f-9868-4762-8d99-043aacb8c09f req-fc6b171c-6ff4-44f9-bb7f-e342f5f5fd92 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:44.505295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5a3da32f-9868-4762-8d99-043aacb8c09f req-fc6b171c-6ff4-44f9-bb7f-e342f5f5fd92 service nova] Creating event network-changed:adbdb96f-395c-40c8-a3b6-83f8c5585894 for instance 8f788f27-50ff-4efc-88b7-18770764de0e on n-h1-858384-17 Oct 31 15:36:44.516754 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5a3da32f-9868-4762-8d99-043aacb8c09f req-fc6b171c-6ff4-44f9-bb7f-e342f5f5fd92 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079742 Oct 31 15:36:44.522786 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2112/4367] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:44.762047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:44.762911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:44.784259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:44.789282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:44.789942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:44.792861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:44.797293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:44.800720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:45.284210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:45.300473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:45.305879 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe148d79-da57-4658-9ee1-c64c75a17dc2 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 1.118606 Oct 31 15:36:45.308632 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e909cc3f-3f62-4d07-a6cf-f46a6775344c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1322 microversion: 2.1 time: 0.554646 Oct 31 15:36:45.309212 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2256/4368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:44 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:45.321505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:45.324985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:45.327791 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2113/4369] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:44 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1322 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:45.353646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:45.353646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:45.353646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:45.353646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:45.353646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:45.353646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:45.473455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:45.473455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:45.483796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:45.484303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:45.484743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:45.485487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:45.485943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:45.486371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:45.558326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:45.589006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:45.593999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:45.596440 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3ed53eb-4366-4656-8060-7cab8d80a8b8 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.285540 Oct 31 15:36:45.599026 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2257/4370] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:45 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:45.925453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:45.935415 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-709b30f2-b616-4845-8ee6-cbc5892f7b76 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1665 microversion: 2.1 time: 0.478066 Oct 31 15:36:45.954039 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2114/4371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:45 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1665 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:46.346508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:46.348110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:46.349010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:46.350016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:46.368053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:46.369552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:46.386795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:46.387358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:46.388561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:46.389026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:46.391244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:46.391586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:46.392272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:46.392996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:46.394021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:46.394678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:46.764150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:46.784320 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f08d3aea-61a0-4e79-8f94-5bd043890319 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1722 microversion: 2.1 time: 0.446234 Oct 31 15:36:46.784921 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2115/4372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:46 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1722 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:46.790974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:46.793843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:46.822972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:46.823447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:46.830238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:46.835105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:46.835612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:46.836040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:46.941461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:46.985454 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad390cad-20b9-474e-9287-fa26bd5f9e34 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1322 microversion: 2.1 time: 0.645364 Oct 31 15:36:46.986351 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2258/4373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:46 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1322 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:47.050586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:47.067167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:47.069363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:47.071290 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47c80aa5-f6aa-4fa5-8b86-fffb84189aef tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.284700 Oct 31 15:36:47.075443 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2116/4374] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:46 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:47.608378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:47.608993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:47.637098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:47.638197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:47.638796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:47.640434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:47.641555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:47.642424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:47.815841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:47.816544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:47.828316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:47.836185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:47.836754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:47.840621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:47.841244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:47.843342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:47.903275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:47.905075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:47.937654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:48.050430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:48.062712 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-72956a91-9f34-4d1c-8193-e0361fb59ba1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 1.071939 Oct 31 15:36:48.063322 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2259/4375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:46 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:48.067897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:48.068507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:48.085770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.086571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.087236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.088141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.089097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.089764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.201196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:48.372540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:48.392578 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80df92e6-20c7-4ce9-8ca1-b401869234ff tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1322 microversion: 2.1 time: 0.324456 Oct 31 15:36:48.393896 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2260/4376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:48 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:48.413387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:48.414239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:48.424100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.424976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.425657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.427117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.428540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.429214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.709971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:48.720120 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-751afef1-d49d-42e1-b1dd-c54721b03d2e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.322647 Oct 31 15:36:48.734059 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2261/4377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:48 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:48.756385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:48.757005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:48.768697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.775101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.775703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.776590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.777017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.777531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.811058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:48.831192 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-42979480-c6fe-4bec-99ca-f028232a9598 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1699 microversion: 2.1 time: 1.019180 Oct 31 15:36:48.832385 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2117/4378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:47 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1699 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:48.841089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:48.841592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:48.864250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.889191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.889942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.891118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:48.891814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:48.892411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:48.995688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Unlocking {{(pid=120588) unlock /opt/stack/nova/nova/compute/api.py:4875}} Oct 31 15:36:49.143803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:49.154572 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92208157-01b7-4199-aff3-9a89124a8198 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.320423 Oct 31 15:36:49.158088 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2118/4379] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:48 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:49.163767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c52fcb7-7bbc-4503-a806-8c5bbb31acd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:49.170918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:49.179688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:49.183700 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c036e07-9afe-433c-a5d5-ca50a19d3587 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.448450 Oct 31 15:36:49.186313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c52fcb7-7bbc-4503-a806-8c5bbb31acd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:49.190874 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2262/4380] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:48 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:49.193164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c52fcb7-7bbc-4503-a806-8c5bbb31acd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:49.197444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c52fcb7-7bbc-4503-a806-8c5bbb31acd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:49.199522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:49.210666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:49.223837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:49.224920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:49.226221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:49.227547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:49.229529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:49.230489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:49.280287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c52fcb7-7bbc-4503-a806-8c5bbb31acd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Going to try to start instance {{(pid=120588) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:36:49.421786 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c52fcb7-7bbc-4503-a806-8c5bbb31acd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/action" status: 202 len: 0 microversion: 2.1 time: 0.261928 Oct 31 15:36:49.422781 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2119/4381] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:49 2022] POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:49.442737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:49.455872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:49.463574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:49.469070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:49.469776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:49.470752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:49.471431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:49.476300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:49.754463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:49.762640 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de73d3cc-b12f-4270-8773-90a02d660c04 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.570096 Oct 31 15:36:49.763228 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2263/4382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:49 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:49.787274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:49.788155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:49.823364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:49.824938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:49.828868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:49.831580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:49.833707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:49.835275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:50.183763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:50.199095 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e473f9c4-7705-4601-86a3-0cdcbdd3ad61 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1708 microversion: 2.1 time: 0.432619 Oct 31 15:36:50.201432 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2264/4383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:49 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1708 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:50.207809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:50.210415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:50.224509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:50.228823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:50.234532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:50.235639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:50.236340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:50.236986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:50.335596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:50.372885 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cb840e9d-777e-46d2-b648-ea538a9c53db tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1322 microversion: 2.1 time: 0.948041 Oct 31 15:36:50.374180 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2120/4384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:49 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1322 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:50.381966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:50.402430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:50.412706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:50.417118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:50.417926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:50.419179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:50.419876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:50.420505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:50.518385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:50.542137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:50.544121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:50.548337 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2bf78c9a-5669-4421-874b-98664cbf9131 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.168650 Oct 31 15:36:50.548963 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2121/4385] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:50 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:50.563902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:50.583340 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a370964-5637-429b-8ea1-034a652a04c3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.380604 Oct 31 15:36:50.584200 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2265/4386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:50 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:50.618062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:50.619892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:50.635672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:50.636131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:50.638277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:50.639024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:50.640591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:50.641598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:50.965037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:50.981371 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c6c325e-312e-44e1-ba68-f3e9f5a39359 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.368467 Oct 31 15:36:50.982267 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2122/4387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:50 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:51.010161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4bf52978-cdc4-4309-8542-68ae41dc2cf2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:51.010910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4bf52978-cdc4-4309-8542-68ae41dc2cf2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:51.020745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:51.022523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bf52978-cdc4-4309-8542-68ae41dc2cf2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.023025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bf52978-cdc4-4309-8542-68ae41dc2cf2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.023497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bf52978-cdc4-4309-8542-68ae41dc2cf2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.034279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bf52978-cdc4-4309-8542-68ae41dc2cf2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.034768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bf52978-cdc4-4309-8542-68ae41dc2cf2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.035210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bf52978-cdc4-4309-8542-68ae41dc2cf2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.139440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:51.188016 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4bf52978-cdc4-4309-8542-68ae41dc2cf2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.182715 Oct 31 15:36:51.188670 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2266/4388] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:51 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:51.200945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:51.201600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:51.214894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.215487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.215935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.216663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.217139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.217577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.229532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:51.230309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:51.253407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.253972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.254391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.264644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.265157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.265623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.590665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:51.612904 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14f26a3d-c0f9-4a75-b6ec-a5a56ad2366a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1674 microversion: 2.1 time: 0.411401 Oct 31 15:36:51.614059 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2123/4389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:51 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1674 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:51.647252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:51.648310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:51.664427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.665951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.670518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.672257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.674137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.677489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.926428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:51.937501 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2426b42a-17c0-4032-846e-ae634acf6dfd tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1708 microversion: 2.1 time: 0.713144 Oct 31 15:36:51.957350 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2267/4390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:51 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1708 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:51.964516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e7577cb9-5187-47d2-a25a-ee2554157b62 req-e507c05c-1c6d-427d-8b99-ff79a0d5cece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f788f27-50ff-4efc-88b7-18770764de0e", "name": "network-vif-plugged", "status": "completed", "tag": "adbdb96f-395c-40c8-a3b6-83f8c5585894"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:51.977706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e7577cb9-5187-47d2-a25a-ee2554157b62 req-e507c05c-1c6d-427d-8b99-ff79a0d5cece service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:51.978671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e7577cb9-5187-47d2-a25a-ee2554157b62 req-e507c05c-1c6d-427d-8b99-ff79a0d5cece service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:51.979421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e7577cb9-5187-47d2-a25a-ee2554157b62 req-e507c05c-1c6d-427d-8b99-ff79a0d5cece service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:51.995851 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e7577cb9-5187-47d2-a25a-ee2554157b62 req-e507c05c-1c6d-427d-8b99-ff79a0d5cece service nova] Creating event network-vif-plugged:adbdb96f-395c-40c8-a3b6-83f8c5585894 for instance 8f788f27-50ff-4efc-88b7-18770764de0e on n-h1-858384-17 Oct 31 15:36:52.003689 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e7577cb9-5187-47d2-a25a-ee2554157b62 req-e507c05c-1c6d-427d-8b99-ff79a0d5cece service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044659 Oct 31 15:36:52.006154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2268/4391] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:36:52.016074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:52.018189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:52.026335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:52.027522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:52.028120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:52.029005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:52.029884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:52.030474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:52.080128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:52.097253 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-079c515b-1eae-4957-9a59-bd64b41dad9f tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1322 microversion: 2.1 time: 0.462054 Oct 31 15:36:52.101486 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2124/4392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:51 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:52.191847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:52.200747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:52.208514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:52.209978 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9f60a61-d9e5-471c-a25a-c0cc37fa4756 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.202186 Oct 31 15:36:52.213704 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2269/4393] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:52 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:52.643743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:52.644378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:52.662899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:52.669020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:52.670676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:52.672589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:52.674080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:52.677266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:52.972408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:52.973239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:53.002304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:53.002868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:53.004231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:53.005749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:53.006237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:53.007907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:53.298142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:53.307273 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83d26815-7131-4aee-b25b-ecb55b794eda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1654 microversion: 2.1 time: 0.670392 Oct 31 15:36:53.331443 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2125/4394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:52 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1654 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:53.336631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:53.338104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:53.344585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:53.345945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:53.346583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:53.347471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:53.348090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:53.348787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:53.392433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:53.426655 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bb86cbf-1039-43dc-992f-319817d147ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1712 microversion: 2.1 time: 0.464947 Oct 31 15:36:53.437310 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2270/4395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:52 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1712 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:53.464559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:53.465192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:53.487607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:53.488731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:53.490257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:53.491705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:53.494645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:53.497791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:53.794642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:53.804051 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1e79aac-4e0c-40b2-89c6-a84d83120c5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1322 microversion: 2.1 time: 0.471179 Oct 31 15:36:53.808221 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2126/4396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:53 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:53.822328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07fe95eb-b10b-4094-8c8f-9d7dbaa316e9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:53.823014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07fe95eb-b10b-4094-8c8f-9d7dbaa316e9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:53.839582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07fe95eb-b10b-4094-8c8f-9d7dbaa316e9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:53.840289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07fe95eb-b10b-4094-8c8f-9d7dbaa316e9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:53.842465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:53.842800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07fe95eb-b10b-4094-8c8f-9d7dbaa316e9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:53.844271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07fe95eb-b10b-4094-8c8f-9d7dbaa316e9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:53.846715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07fe95eb-b10b-4094-8c8f-9d7dbaa316e9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:53.847425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07fe95eb-b10b-4094-8c8f-9d7dbaa316e9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:53.851318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:53.852824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:53.862345 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f0f1566-1f84-4375-a1b8-90f72872ae51 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.423812 Oct 31 15:36:53.863493 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2271/4397] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:53 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:53.984139 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07fe95eb-b10b-4094-8c8f-9d7dbaa316e9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.174458 Oct 31 15:36:53.988717 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2127/4398] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:53 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:53.998786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:53.999493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:54.014988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:54.015477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:54.015905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:54.017751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:54.019671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:54.020710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:54.312394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:54.328225 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-187545c3-1d2b-4128-a132-bf78391a3a34 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1661 microversion: 2.1 time: 0.336116 Oct 31 15:36:54.331489 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2272/4399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:53 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1661 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:54.833417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:54.834139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:54.850322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:54.850815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:54.859764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:54.860660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:54.861732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:54.862366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:54.894436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:54.895236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:54.907640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:54.909879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:54.911653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:54.914049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:54.916330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:54.918999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:55.138353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:55.148045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:55.150853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:55.152072 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61eb259f-0d11-43f1-a1a7-138bf6cef44c tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.262019 Oct 31 15:36:55.162832 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2273/4400] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:54 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:55.218899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:55.228544 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8a2984d-a3a3-4f2d-b90f-c960222447d4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1472 microversion: 2.1 time: 0.401392 Oct 31 15:36:55.229782 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2128/4401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:54 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1472 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:55.255897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:55.256365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:55.265733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:55.268214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:55.268855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:55.269726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:55.270352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:55.270948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:55.298084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lazy-loading 'flavor' on Instance uuid 8f788f27-50ff-4efc-88b7-18770764de0e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:36:55.361581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:55.362446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:55.372551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:55.374311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:55.375149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:55.378359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:55.379148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:55.379808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:55.443261 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5062967b-8630-4921-ae1a-14e159625bce tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e/action" status: 202 len: 0 microversion: 2.1 time: 0.193318 Oct 31 15:36:55.447665 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2274/4402] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:55 2022] POST /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:36:55.452869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f108566-2512-4e6d-af80-6d6c06ad54f6 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:55.465472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2f108566-2512-4e6d-af80-6d6c06ad54f6 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:55.479303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f108566-2512-4e6d-af80-6d6c06ad54f6 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:55.481378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f108566-2512-4e6d-af80-6d6c06ad54f6 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:55.489290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f108566-2512-4e6d-af80-6d6c06ad54f6 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:55.490401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f108566-2512-4e6d-af80-6d6c06ad54f6 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:55.500754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f108566-2512-4e6d-af80-6d6c06ad54f6 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:55.501420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f108566-2512-4e6d-af80-6d6c06ad54f6 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:55.803619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:55.807603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:55.818503 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57eb34ad-10f7-4939-bcf6-f0fed5a9e498 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.461292 Oct 31 15:36:55.832249 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2129/4403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:55 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:55.852356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:55.873262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:55.892157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:55.894644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:55.897526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:55.898476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:55.907160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:55.907777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:56.141990 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f108566-2512-4e6d-af80-6d6c06ad54f6 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1633 microversion: 2.1 time: 0.693019 Oct 31 15:36:56.142582 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2275/4404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:55 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1633 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:56.153917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:56.172228 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd940696-f51d-439b-bdeb-3907fe1a241c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.326860 Oct 31 15:36:56.176585 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2130/4405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:55 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:56.197088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:56.198098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:56.207422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:56.207918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:56.208355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:56.209060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:56.209544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:56.209975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:56.304751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:56.315559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:56.317854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:56.319588 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-281a4382-dc75-4bef-ad17-507c3b505d81 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.126426 Oct 31 15:36:56.320496 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2131/4406] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:56 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:36:56.327420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:56.328337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:56.335271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:56.335858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:56.336375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:56.338141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:56.339488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:56.339995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:56.531089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-64752033", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "38e646c3-cc89-4d1f-a379-32cc46e6dba8"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:56.533640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:56.543353 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f304aa9-5273-44c2-8071-f6e891b7aa57 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.221632 Oct 31 15:36:56.545732 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2132/4407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:56 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:56.586569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:56.587551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:56.595277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:56.595779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:56.596214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:56.596922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:56.597505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:56.597947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:56.623551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] validate_networks() for [('38e646c3-cc89-4d1f-a379-32cc46e6dba8', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:36:56.810006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:56.818679 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f157800e-c55d-423c-ab15-3058aa2d63a7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.253418 Oct 31 15:36:56.821633 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2133/4408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:56 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:56.844764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:56.845626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:56.856083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:56.856908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:56.857446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:56.859176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:56.859862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:56.860584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.129916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:57.142040 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c10fe682-f69c-44de-add8-d04d8956211a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.301024 Oct 31 15:36:57.154929 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2134/4409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:56 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:36:57.175262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e6452d9-f175-41d7-bcd2-1bfae1d39dd4 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:57.181616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5e6452d9-f175-41d7-bcd2-1bfae1d39dd4 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:57.199625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:57.205354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e6452d9-f175-41d7-bcd2-1bfae1d39dd4 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.206555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e6452d9-f175-41d7-bcd2-1bfae1d39dd4 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.210715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e6452d9-f175-41d7-bcd2-1bfae1d39dd4 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.214230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e6452d9-f175-41d7-bcd2-1bfae1d39dd4 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.217455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e6452d9-f175-41d7-bcd2-1bfae1d39dd4 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.219166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e6452d9-f175-41d7-bcd2-1bfae1d39dd4 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.366676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:36:57.370016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:36:57.370959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:36:57.371539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:36:57.372125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:36:57.388092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.388921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.389873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.391078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.391750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.392369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.419243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Getting quotas for project 9007bf5774b34185b0cdc39044f016ea. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:36:57.427569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Getting quotas for user f6de4d3b24d24f4c922f8eee737c2966 and project 9007bf5774b34185b0cdc39044f016ea. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:36:57.447748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:36:57.450808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:36:57.516718 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c4437dfd-1658-4c96-be0e-eee4382a9c4d tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.360325 Oct 31 15:36:57.516936 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e6452d9-f175-41d7-bcd2-1bfae1d39dd4 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1616 microversion: 2.1 time: 0.345261 Oct 31 15:36:57.518172 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2276/4410] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:36:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:36:57.521675 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2135/4411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:57 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1616 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:57.523500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:57.525520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:57.533389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.534132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.534750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:57.535683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.536884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.537321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:57.537726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.538506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.577287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.579482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.580244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.581570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.583302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.584420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.717348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:57.737982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:57.740004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:57.741917 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-868a0e15-b46f-4849-b5c3-d4032dd6a9e5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.219074 Oct 31 15:36:57.757266 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2136/4412] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:57 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:57.768718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-19911866-6af0-467f-8d5f-498874068b5c tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:57.769812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-19911866-6af0-467f-8d5f-498874068b5c tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:57.847720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:57.862309 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52fb3b37-13ab-4969-bf06-e887e2b0eab7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.342124 Oct 31 15:36:57.896335 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2277/4413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:57 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:57.909439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:57.910030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:57.932092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.944736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.945329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.946607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:57.946940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:57.947390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:57.971728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-19911866-6af0-467f-8d5f-498874068b5c tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:57.983765 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-19911866-6af0-467f-8d5f-498874068b5c tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1226 microversion: 2.1 time: 0.224948 Oct 31 15:36:57.985326 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2137/4414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:57 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1226 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:58.023894 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] HTTP exception thrown: Cannot 'migrate' instance 8f788f27-50ff-4efc-88b7-18770764de0e while it is in vm_state suspended Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Request method failure captured: Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e/action HTTP/1.1 Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 15 Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-t12F28GzcaweLHiiLsEqv8ruXlgR3E-RUW2UxkNl3EW9nn_xA84uTBaRvw6VM9CbBeni2AXQOzv7c9-ZgLqUdpceTygoY-j2In0TeERPqG9YFRFeIto2Ph4nc0MxFuqiG29cppEUoZJhn-G8LzCf-4FWjeXgCJoTrShJ0FsM24_K0 Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3eabfe36d70c4cb4b63d69af8d67d3fd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}] Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 72da6da06552458b80ff99d5043c1868 Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: {"migrate": {}} Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: exception: Cannot 'migrate' instance 8f788f27-50ff-4efc-88b7-18770764de0e while it is in vm_state suspended Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8f788f27-50ff-4efc-88b7-18770764de0e', 'body': {'migrate': {}}} Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f788f27-50ff-4efc-88b7-18770764de0e in vm_state suspended. Cannot resize while the instance is in this state. Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:36:58.028014 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 8f788f27-50ff-4efc-88b7-18770764de0e while it is in vm_state suspended Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 8f788f27-50ff-4efc-88b7-18770764de0e while it is in vm_state suspended Oct 31 15:36:58.031868 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.034730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Returning 409 to user: Cannot 'migrate' instance 8f788f27-50ff-4efc-88b7-18770764de0e while it is in vm_state suspended {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:58.036273 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-86e51dd6-ae5d-4673-9bb7-6f70dda2c430 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e/action" status: 409 len: 148 microversion: 2.1 time: 0.135959 Oct 31 15:36:58.037042 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2278/4415] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:57 2022] POST /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e/action => generated 148 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:36:58.049706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36463619-02f5-409d-9e7d-959ec2d9ce2c tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36463619-02f5-409d-9e7d-959ec2d9ce2c tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Request method failure captured: Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502/action HTTP/1.1 Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 39 Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-t12F28GzcaweLHiiLsEqv8ruXlgR3E-RUW2UxkNl3EW9nn_xA84uTBaRvw6VM9CbBeni2AXQOzv7c9-ZgLqUdpceTygoY-j2In0TeERPqG9YFRFeIto2Ph4nc0MxFuqiG29cppEUoZJhn-G8LzCf-4FWjeXgCJoTrShJ0FsM24_K0 Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3eabfe36d70c4cb4b63d69af8d67d3fd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}] Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 72da6da06552458b80ff99d5043c1868 Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: {"os-resetState": {"state": "invalid"}} Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '29364441-505e-4133-af7a-6b399a308502', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'invalid' Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:36:58.057775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36463619-02f5-409d-9e7d-959ec2d9ce2c tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:58.062623 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-36463619-02f5-409d-9e7d-959ec2d9ce2c tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502/action" status: 400 len: 144 microversion: 2.1 time: 0.016454 Oct 31 15:36:58.066326 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2138/4416] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:58 2022] POST /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:36:58.073035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7bccee4-8744-494f-ae21-347f84dc47fa tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7bccee4-8744-494f-ae21-347f84dc47fa tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Request method failure captured: Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502/action HTTP/1.1 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 31 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-t12F28GzcaweLHiiLsEqv8ruXlgR3E-RUW2UxkNl3EW9nn_xA84uTBaRvw6VM9CbBeni2AXQOzv7c9-ZgLqUdpceTygoY-j2In0TeERPqG9YFRFeIto2Ph4nc0MxFuqiG29cppEUoZJhn-G8LzCf-4FWjeXgCJoTrShJ0FsM24_K0 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3eabfe36d70c4cb4b63d69af8d67d3fd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}] Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 72da6da06552458b80ff99d5043c1868 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: {"os-resetState": {"state": 1}} Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '29364441-505e-4133-af7a-6b399a308502', 'body': {'os-resetState': {'state': 1}}} Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 1 Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 31 15:36:58.076991 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.082486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7bccee4-8744-494f-ae21-347f84dc47fa tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:58.083965 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7bccee4-8744-494f-ae21-347f84dc47fa tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502/action" status: 400 len: 120 microversion: 2.1 time: 0.014623 Oct 31 15:36:58.091051 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2279/4417] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:36:58 2022] POST /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502/action => generated 120 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:36:58.098925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-593125d3-aee8-4653-8c43-3b0143641978 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:36:58.101618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-593125d3-aee8-4653-8c43-3b0143641978 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Failed to fetch instance by id 999 {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:36:58.105909 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-593125d3-aee8-4653-8c43-3b0143641978 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-593125d3-aee8-4653-8c43-3b0143641978 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Request method failure captured: Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 37 Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-t12F28GzcaweLHiiLsEqv8ruXlgR3E-RUW2UxkNl3EW9nn_xA84uTBaRvw6VM9CbBeni2AXQOzv7c9-ZgLqUdpceTygoY-j2In0TeERPqG9YFRFeIto2Ph4nc0MxFuqiG29cppEUoZJhn-G8LzCf-4FWjeXgCJoTrShJ0FsM24_K0 Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3eabfe36d70c4cb4b63d69af8d67d3fd", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3eabfe36d70c4cb4b63d69af8d67d3fd"}]}] Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3eabfe36d70c4cb4b63d69af8d67d3fd Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1509177327 Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 72da6da06552458b80ff99d5043c1868 Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1509177327-project-admin Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: {"os-resetState": {"state": "error"}} Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 999 could not be found. Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:36:58.117209 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:36:58.123319 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:36:58.123319 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 31 15:36:58.123319 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:36:58.125242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-593125d3-aee8-4653-8c43-3b0143641978 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:36:58.126209 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-593125d3-aee8-4653-8c43-3b0143641978 tempest-ServersAdminNegativeTestJSON-1509177327 tempest-ServersAdminNegativeTestJSON-1509177327-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.036557 Oct 31 15:36:58.129606 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2139/4418] 10.222.0.20 () {60 vars in 1179 bytes} [Mon Oct 31 15:36:58 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:36:58.142114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:58.143267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:58.151948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:58.152525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:58.153028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:58.166690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:58.171585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:58.173617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:58.238432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:36:58.400170 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc8a8ea2-d6c7-4604-9b68-847a197231fd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 204 len: 0 microversion: 2.1 time: 0.264914 Oct 31 15:36:58.402403 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2280/4419] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:36:58 2022] DELETE /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:36:58.413720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:58.414629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:58.423168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:58.424216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:58.424660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:58.425543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:58.426008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:58.426436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:58.627005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:58.636188 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f70ea7f1-707f-4257-89a9-50c60952e4a6 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1469 microversion: 2.1 time: 0.228883 Oct 31 15:36:58.636777 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2140/4420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:58 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:58.776843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:58.777724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:58.788599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:58.790230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:58.790640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:58.791501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:58.792195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:58.792691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:58.898124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:58.909882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:58.911372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:58.912559 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1df9f122-00cb-495a-a45c-4431c688cad5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1366 microversion: 2.47 time: 0.143104 Oct 31 15:36:58.917213 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2281/4421] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:58 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:36:59.012103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:59.012730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:59.025312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:59.029403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:59.029893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:59.030629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:59.031093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:59.031519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:59.112274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:59.125681 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3aebd1cd-793b-4722-80ef-6683b6d8201a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1230 microversion: 2.1 time: 0.117200 Oct 31 15:36:59.126641 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2141/4422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:59 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1230 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:59.660330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:59.661803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:59.673221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:59.674356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:59.674979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:59.676076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:59.676685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:36:59.677337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:36:59.697302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:36:59.952594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:36:59.957633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:36:59.966910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:36:59.988807 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2ec95150-b3ed-4067-b2c2-c60eed97cff4 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1469 microversion: 2.1 time: 0.332653 Oct 31 15:36:59.994258 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2282/4423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:36:59 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1469 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:36:59.997638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:36:59.998610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:00.001036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:00.001993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:00.003685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:00.006869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:00.139011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:00.148940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:00.151946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:00.152841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:00.156468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:00.157805 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a105ce0b-cab2-492b-b0a7-cfbc3a67e2ba tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1372 microversion: 2.47 time: 0.215488 Oct 31 15:37:00.159766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:00.160573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:00.177157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:00.177956 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2142/4424] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:36:59 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:00.178125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:00.178125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:00.178125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:00.284945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:00.295078 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d5c4165-ca09-4ec9-ae4f-c43e6562cbeb tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1278 microversion: 2.1 time: 0.149142 Oct 31 15:37:00.296414 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2283/4425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:00 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1278 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:00.518079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8d86953a-5651-4d67-b8b2-35812520801a req-c729c38d-e684-4c5b-9c43-778cf2b33652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f788f27-50ff-4efc-88b7-18770764de0e", "name": "network-vif-deleted", "tag": "adbdb96f-395c-40c8-a3b6-83f8c5585894"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:00.536564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8d86953a-5651-4d67-b8b2-35812520801a req-c729c38d-e684-4c5b-9c43-778cf2b33652 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:00.537749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8d86953a-5651-4d67-b8b2-35812520801a req-c729c38d-e684-4c5b-9c43-778cf2b33652 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:00.538557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8d86953a-5651-4d67-b8b2-35812520801a req-c729c38d-e684-4c5b-9c43-778cf2b33652 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:00.559129 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8d86953a-5651-4d67-b8b2-35812520801a req-c729c38d-e684-4c5b-9c43-778cf2b33652 service nova] Creating event network-vif-deleted:adbdb96f-395c-40c8-a3b6-83f8c5585894 for instance 8f788f27-50ff-4efc-88b7-18770764de0e on n-h1-858384-17 Oct 31 15:37:00.570930 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8d86953a-5651-4d67-b8b2-35812520801a req-c729c38d-e684-4c5b-9c43-778cf2b33652 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054974 Oct 31 15:37:00.574326 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2143/4426] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:01.013275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:01.013960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:01.031761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:01.035788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:01.036315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:01.037170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:01.041933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:01.042465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:01.137745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:01.138387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:01.141086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:01.142294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lazy-loading 'fault' on Instance uuid 8f788f27-50ff-4efc-88b7-18770764de0e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:37:01.192552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:01.193500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:01.218131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:01.220454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:01.221302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:01.222898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:01.229823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:01.230718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:01.327313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:01.338912 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-47939a9b-43d2-437d-ba2c-8b0822660c09 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 200 len: 1312 microversion: 2.1 time: 0.330042 Oct 31 15:37:01.362165 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2284/4427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:01 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 1312 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:01.370492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:01.371110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:01.380502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:01.382604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:01.383464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:01.384862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:01.385349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:01.385833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:01.485829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:01.490480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:01.495560 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bf0d92de-284e-438e-839e-a77ed1f28adf tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1284 microversion: 2.1 time: 0.131547 Oct 31 15:37:01.499850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:01.502965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:01.504415 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e713a040-dfa3-4bf7-8ee5-8f8db6a43385 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1372 microversion: 2.47 time: 0.317832 Oct 31 15:37:01.505095 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2144/4428] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:01 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1372 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:01.512207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2285/4429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:01 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:02.372983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:02.373737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 8f788f27-50ff-4efc-88b7-18770764de0e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:02.384307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.384954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.385631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.386747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.387399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.388169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.403730 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] HTTP exception thrown: Instance 8f788f27-50ff-4efc-88b7-18770764de0e could not be found. Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Request method failure captured: Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e HTTP/1.1 Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-t0zoq81C5nq4zLutQApWNtBZM57E5P6oSeCTsb64Lo5PHDmVFNvuUz7MIEiR_jCaFFvvACLnqJzCaEBh8TdCv4Ym7TrKsSMyDkKilGrUGQx60dRdHbImoldoowDcLCzwJa6CNaJ2hhGNXZpGloKy2hfqcTG4fZ0NIGqUre9B_SZyY Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 0e1f0673c23a488ba6ed1ddb6bf0a7a8 Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-550220946 Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e1f0673c23a488ba6ed1ddb6bf0a7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e1f0673c23a488ba6ed1ddb6bf0a7a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e1f0673c23a488ba6ed1ddb6bf0a7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e1f0673c23a488ba6ed1ddb6bf0a7a8"}]}] Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersAdminNegativeTestJSON-550220946 Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 0e1f0673c23a488ba6ed1ddb6bf0a7a8 Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-550220946 Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersAdminNegativeTestJSON-550220946-project Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 9e2d510b1c0c499da5df11be5dcbc0de Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersAdminNegativeTestJSON-550220946-project Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 8f788f27-50ff-4efc-88b7-18770764de0e could not be found. Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '8f788f27-50ff-4efc-88b7-18770764de0e'} Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f788f27-50ff-4efc-88b7-18770764de0e could not be found. Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f788f27-50ff-4efc-88b7-18770764de0e could not be found. Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:02.405558 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:02.409823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:02.409823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:02.409823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:02.409823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:02.409823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:02.409823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:02.409823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f788f27-50ff-4efc-88b7-18770764de0e could not be found. Oct 31 15:37:02.409823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:02.409823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Returning 404 to user: Instance 8f788f27-50ff-4efc-88b7-18770764de0e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:02.410386 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7c04f72-8c22-4c47-bf56-23cb03e1aa5c tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e" status: 404 len: 111 microversion: 2.1 time: 0.042393 Oct 31 15:37:02.413273 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2145/4430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:02 2022] GET /compute/v2.1/servers/8f788f27-50ff-4efc-88b7-18770764de0e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:02.420615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:02.421236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:02.428992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.431847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.433070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.434636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.435898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.437936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.474595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:37:02.518810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:02.519506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:02.532522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.533031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.533496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.534198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.534826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.545479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.590306 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba3a3836-24de-4cef-94af-443585a38ae8 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 204 len: 0 microversion: 2.1 time: 0.173201 Oct 31 15:37:02.591361 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2286/4431] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:37:02 2022] DELETE /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:37:02.598563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:02.599384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:02.606009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.606587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.607108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.607888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.608420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.608921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.695138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:02.709267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:02.711398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:02.713807 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71dfef34-03df-4829-8957-a49fc06e270b tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1357 microversion: 2.47 time: 0.120614 Oct 31 15:37:02.714582 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2287/4432] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:02 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1357 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:02.720067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:02.721657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:02.732441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.733467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.738175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.739007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.739722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.740078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.795353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:02.805503 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db813da7-2497-44a3-b66f-f9a7e4533cc0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1326 microversion: 2.1 time: 0.290564 Oct 31 15:37:02.808068 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2146/4433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:02 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1326 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:02.813654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:02.819581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:02.820635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Searching by: {'deleted': False, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:37:02.840195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.846766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.847297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.850416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:02.850906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:02.851340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:02.894664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:02.904001 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f285ab29-9084-4d35-8623-9c3af30ccb7a tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1478 microversion: 2.1 time: 0.188320 Oct 31 15:37:02.906596 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2288/4434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:02 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1478 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:03.088081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:37:03.220535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8795363c-e5e3-4ec7-a6b3-5a013960cf00 req-58ef1c06-37a7-4c5e-8fa4-fd1308f7105d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed81a388-59b2-4601-b3e6-81b5dd3139b1", "tag": "d9028bfd-fe47-4f17-98c6-4d4612a93ae8"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:03.235379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8795363c-e5e3-4ec7-a6b3-5a013960cf00 req-58ef1c06-37a7-4c5e-8fa4-fd1308f7105d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.236215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8795363c-e5e3-4ec7-a6b3-5a013960cf00 req-58ef1c06-37a7-4c5e-8fa4-fd1308f7105d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.236867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8795363c-e5e3-4ec7-a6b3-5a013960cf00 req-58ef1c06-37a7-4c5e-8fa4-fd1308f7105d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:03.251337 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8795363c-e5e3-4ec7-a6b3-5a013960cf00 req-58ef1c06-37a7-4c5e-8fa4-fd1308f7105d service nova] Creating event network-changed:d9028bfd-fe47-4f17-98c6-4d4612a93ae8 for instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 on n-h1-858384-17 Oct 31 15:37:03.257274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:03.261700 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8795363c-e5e3-4ec7-a6b3-5a013960cf00 req-58ef1c06-37a7-4c5e-8fa4-fd1308f7105d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352762 Oct 31 15:37:03.262412 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2289/4435] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:03.266285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.266761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.267619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:03.283134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:03.284642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:03.349503 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2cc24f8-acef-44ec-929e-a2eb1f97cbf2 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.539365 Oct 31 15:37:03.350122 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2147/4436] 10.222.0.20 () {60 vars in 1187 bytes} [Mon Oct 31 15:37:02 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:03.389762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:03.390360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:03.397050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.397709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.398435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:03.399170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.400399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.400399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:03.435044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:37:03.540604 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3c25f53-241c-4ee0-bf19-4aab032787b5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 204 len: 0 microversion: 2.47 time: 0.156454 Oct 31 15:37:03.544676 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2290/4437] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:37:03 2022] DELETE /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:37:03.552168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:03.553064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:03.559330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.559872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.560509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:03.561277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.561931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.562630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:03.637533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:03.645981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:03.647429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:03.648747 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a7eacf1-84c6-4d74-b4e1-e89e8de381f6 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1363 microversion: 2.47 time: 0.102385 Oct 31 15:37:03.649708 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2148/4438] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:03 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1363 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:37:03.833388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:03.834225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:03.841366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.842168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.842703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:03.843807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.844505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.845181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:03.934413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:03.935034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:03.948143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.948887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.949517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:03.950389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:03.951012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:03.951635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:04.112209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:04.122598 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b92e0138-f943-4f8e-b469-979737a6bb02 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1326 microversion: 2.1 time: 0.293670 Oct 31 15:37:04.123516 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2291/4439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:03 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1326 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:04.143654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:04.165465 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e38db69-147f-499c-9e73-c1bb71ee71cd tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1478 microversion: 2.1 time: 0.234176 Oct 31 15:37:04.166065 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2149/4440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:03 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1478 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:04.681841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:04.683333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:04.695036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:04.696107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:04.696714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:04.697956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:04.698578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:04.699148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:04.858595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:04.872024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:04.876135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:04.878666 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-154e3c0f-ead5-404d-8207-16c6a77d89f3 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1363 microversion: 2.47 time: 0.202417 Oct 31 15:37:04.886113 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2292/4441] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:04 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:04.938052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-84f8fd96-e0bf-4237-8d40-fc0015cac2d6 req-6d296658-7c02-4b47-a30e-bbd2b3978b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29364441-505e-4133-af7a-6b399a308502", "name": "network-vif-deleted", "tag": "a5d8d040-6c51-476e-befe-dfc3576104af"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:04.949372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-84f8fd96-e0bf-4237-8d40-fc0015cac2d6 req-6d296658-7c02-4b47-a30e-bbd2b3978b62 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:04.950098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-84f8fd96-e0bf-4237-8d40-fc0015cac2d6 req-6d296658-7c02-4b47-a30e-bbd2b3978b62 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:04.950694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-84f8fd96-e0bf-4237-8d40-fc0015cac2d6 req-6d296658-7c02-4b47-a30e-bbd2b3978b62 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:04.963168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:04.965915 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-84f8fd96-e0bf-4237-8d40-fc0015cac2d6 req-6d296658-7c02-4b47-a30e-bbd2b3978b62 service nova] Creating event network-vif-deleted:a5d8d040-6c51-476e-befe-dfc3576104af for instance 29364441-505e-4133-af7a-6b399a308502 on n-h2-858384-17 Oct 31 15:37:04.971362 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-84f8fd96-e0bf-4237-8d40-fc0015cac2d6 req-6d296658-7c02-4b47-a30e-bbd2b3978b62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036999 Oct 31 15:37:04.972571 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2150/4442] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:05.145686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:05.146141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:05.158110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:05.160032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:05.164374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:05.167392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:05.168006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:05.168556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:05.200372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:05.201524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:05.210453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:05.211393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:05.230677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:05.245469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:05.246275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:05.246973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:05.409220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e2d510b1c0c499da5df11be5dcbc0de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e1f0673c23a488ba6ed1ddb6bf0a7a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:05.422200 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4fe0438-b02b-4891-b3e7-9b0ce0608e01 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 200 len: 1436 microversion: 2.1 time: 0.234582 Oct 31 15:37:05.423722 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2151/4443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:05 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 1436 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:05.464497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:05.474292 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-64f28e3f-596e-4731-a0a0-017146d48b8f tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1326 microversion: 2.1 time: 0.332490 Oct 31 15:37:05.474903 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2293/4444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:05 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1326 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:05.916562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:05.917094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:05.926409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:05.927258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:05.927932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:05.928990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:05.929918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:05.931713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:05.974796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:05.975521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:05.975958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:05.976496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lazy-loading 'fault' on Instance uuid 80b82796-0e2a-4dc0-b837-32a0098110ff {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:37:06.022701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:06.038424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:06.041243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:06.043331 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c80bc388-a551-4253-8649-4a1a28d9faee tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 200 len: 1368 microversion: 2.47 time: 0.131769 Oct 31 15:37:06.044467 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2152/4445] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:05 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 1368 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:06.448738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:06.449411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] [instance: 29364441-505e-4133-af7a-6b399a308502] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:06.456164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:06.456646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:06.457081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:06.457803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:06.458425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:06.458850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:06.476319 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] HTTP exception thrown: Instance 29364441-505e-4133-af7a-6b399a308502 could not be found. Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Request method failure captured: Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 HTTP/1.1 Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-t0zoq81C5nq4zLutQApWNtBZM57E5P6oSeCTsb64Lo5PHDmVFNvuUz7MIEiR_jCaFFvvACLnqJzCaEBh8TdCv4Ym7TrKsSMyDkKilGrUGQx60dRdHbImoldoowDcLCzwJa6CNaJ2hhGNXZpGloKy2hfqcTG4fZ0NIGqUre9B_SZyY Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 0e1f0673c23a488ba6ed1ddb6bf0a7a8 Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-550220946 Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e1f0673c23a488ba6ed1ddb6bf0a7a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e1f0673c23a488ba6ed1ddb6bf0a7a8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e1f0673c23a488ba6ed1ddb6bf0a7a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e1f0673c23a488ba6ed1ddb6bf0a7a8"}]}] Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersAdminNegativeTestJSON-550220946 Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 0e1f0673c23a488ba6ed1ddb6bf0a7a8 Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-550220946 Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersAdminNegativeTestJSON-550220946-project Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 9e2d510b1c0c499da5df11be5dcbc0de Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersAdminNegativeTestJSON-550220946-project Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 29364441-505e-4133-af7a-6b399a308502 could not be found. Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '29364441-505e-4133-af7a-6b399a308502'} Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29364441-505e-4133-af7a-6b399a308502 could not be found. Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29364441-505e-4133-af7a-6b399a308502 could not be found. Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:06.478569 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29364441-505e-4133-af7a-6b399a308502 could not be found. Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] Returning 404 to user: Instance 29364441-505e-4133-af7a-6b399a308502 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-07c77882-e384-4965-8ab5-0ad762da61c3 tempest-ServersAdminNegativeTestJSON-550220946 tempest-ServersAdminNegativeTestJSON-550220946-project] 10.222.0.20 "GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502" status: 404 len: 111 microversion: 2.1 time: 0.036738 Oct 31 15:37:06.483116 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2294/4446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:06 2022] GET /compute/v2.1/servers/29364441-505e-4133-af7a-6b399a308502 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:06.498850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:06.499720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:06.506391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:06.506895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:06.507382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:06.508222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:06.508946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:06.509767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:06.711412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:06.731090 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23c8564c-95ea-4a72-b7a1-79b36c074324 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1326 microversion: 2.1 time: 0.236240 Oct 31 15:37:06.731885 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2153/4447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:06 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1326 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:07.070003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:07.070613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 80b82796-0e2a-4dc0-b837-32a0098110ff] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:07.084540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:07.086700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:07.087999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:07.091129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:07.092590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:07.093220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:07.125855 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] HTTP exception thrown: Instance 80b82796-0e2a-4dc0-b837-32a0098110ff could not be found. Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Request method failure captured: Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff HTTP/1.1 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-txIQzSTFFLdSyWM_-g3-Fiedy4V3VkYNxcwGLooonxjppi06d7tCEQ1FPP98m8YvrNRbtaMDJ_5JaGB9Otr01gl5E3otg7cN0oxxL8B7Tv-gmAqyTWz40swWrG1rRp_qPQ70dh5_1EMmpegMqNWJcp8v3CZiYhc2Zo4MXdLvv05hQ Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.47 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5bef7fc31ab640718bddf778ee9b19f7 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerShowV247Test-1636507726 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bef7fc31ab640718bddf778ee9b19f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bef7fc31ab640718bddf778ee9b19f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bef7fc31ab640718bddf778ee9b19f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bef7fc31ab640718bddf778ee9b19f7"}]}] Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerShowV247Test-1636507726 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5bef7fc31ab640718bddf778ee9b19f7 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerShowV247Test-1636507726 Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerShowV247Test-1636507726-project Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 0f558f2ad0b146538ad11058f8b55dbe Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerShowV247Test-1636507726-project Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 80b82796-0e2a-4dc0-b837-32a0098110ff could not be found. Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '80b82796-0e2a-4dc0-b837-32a0098110ff'} Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b82796-0e2a-4dc0-b837-32a0098110ff could not be found. Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b82796-0e2a-4dc0-b837-32a0098110ff could not be found. Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:07.127427 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b82796-0e2a-4dc0-b837-32a0098110ff could not be found. Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Returning 404 to user: Instance 80b82796-0e2a-4dc0-b837-32a0098110ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df03912c-07d8-4638-bcad-dddbf5890fc5 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff" status: 404 len: 111 microversion: 2.47 time: 0.062982 Oct 31 15:37:07.132026 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2295/4448] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:07 2022] GET /compute/v2.1/servers/80b82796-0e2a-4dc0-b837-32a0098110ff => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:07.139506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:07.140076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 7e43a145-1922-4010-a9ab-d038dd3fb9c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:07.147440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:07.156309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:07.156961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:07.158496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:07.160012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:07.160689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:07.217930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 7e43a145-1922-4010-a9ab-d038dd3fb9c5] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:37:07.347617 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6503dc3a-1fcc-4576-a9d6-5b86b70e0a1e tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5" status: 204 len: 0 microversion: 2.47 time: 0.213623 Oct 31 15:37:07.348424 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2154/4449] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:37:07 2022] DELETE /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:37:07.358172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:07.359079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 7e43a145-1922-4010-a9ab-d038dd3fb9c5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:07.368965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:07.369865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:07.370563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:07.371635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:07.372098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:07.372936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:07.419222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:07.440569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:07.628393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:07.662371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:07.669037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:07.670910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af6f4b3f-c6d5-4412-9f11-38facdd89bac tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5" status: 200 len: 1362 microversion: 2.47 time: 0.318499 Oct 31 15:37:07.672159 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2296/4450] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:07 2022] GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5 => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:07.761781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:07.762842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:07.776005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:07.776586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:07.777095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:07.778053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:07.786799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:07.794730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:08.012879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:08.023467 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2fecb009-6907-46f9-840a-310b2c709b67 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1326 microversion: 2.1 time: 0.267640 Oct 31 15:37:08.025778 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2155/4451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:07 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1326 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:08.697359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:08.720904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 7e43a145-1922-4010-a9ab-d038dd3fb9c5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:08.739463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:08.740236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:08.741629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:08.744003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:08.746168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:08.747404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:08.783499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:08.856232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:08.867097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:08.869209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:08.872119 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11073d50-7afb-4d85-8a3e-49ce026a73fb tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5" status: 200 len: 1362 microversion: 2.47 time: 0.177784 Oct 31 15:37:08.873042 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2297/4452] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:08 2022] GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:09.049870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:09.052140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:09.064368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:09.064853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:09.065491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:09.066609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:09.067394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:09.067995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:09.125009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a620cfa1-a722-4515-8d31-eb88c77bf73e req-aeed97c4-f0aa-48ec-a3d6-aa585afe166b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed81a388-59b2-4601-b3e6-81b5dd3139b1", "name": "network-vif-plugged", "status": "completed", "tag": "d9028bfd-fe47-4f17-98c6-4d4612a93ae8"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:09.142508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a620cfa1-a722-4515-8d31-eb88c77bf73e req-aeed97c4-f0aa-48ec-a3d6-aa585afe166b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:09.145380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a620cfa1-a722-4515-8d31-eb88c77bf73e req-aeed97c4-f0aa-48ec-a3d6-aa585afe166b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:09.146153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a620cfa1-a722-4515-8d31-eb88c77bf73e req-aeed97c4-f0aa-48ec-a3d6-aa585afe166b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:09.172478 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a620cfa1-a722-4515-8d31-eb88c77bf73e req-aeed97c4-f0aa-48ec-a3d6-aa585afe166b service nova] Creating event network-vif-plugged:d9028bfd-fe47-4f17-98c6-4d4612a93ae8 for instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 on n-h1-858384-17 Oct 31 15:37:09.191135 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a620cfa1-a722-4515-8d31-eb88c77bf73e req-aeed97c4-f0aa-48ec-a3d6-aa585afe166b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071712 Oct 31 15:37:09.220898 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2298/4453] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:09.394814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:09.412530 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-067401f9-664b-47e7-8531-224eb4b1872b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1326 microversion: 2.1 time: 0.368410 Oct 31 15:37:09.431972 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2156/4454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:09 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1326 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:09.905771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:09.907629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 7e43a145-1922-4010-a9ab-d038dd3fb9c5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:09.926099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:09.928321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:09.928739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:09.932457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:09.933196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:09.934341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:09.977801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:09.982411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:09.983286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:09.983939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:09.984544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lazy-loading 'fault' on Instance uuid 7e43a145-1922-4010-a9ab-d038dd3fb9c5 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:37:10.063597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:10.080519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:10.082207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f558f2ad0b146538ad11058f8b55dbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bef7fc31ab640718bddf778ee9b19f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:10.083058 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e919df08-6766-480b-a9d4-33f561d0c364 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5" status: 200 len: 1367 microversion: 2.47 time: 0.187566 Oct 31 15:37:10.083773 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2299/4455] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:09 2022] GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:10.439549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:10.440497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:10.450273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:10.452592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:10.453357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:10.455293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:10.455752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:10.462635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:10.669648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:10.693047 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2afde382-791c-4bfe-a8b7-307b7fea0984 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1326 microversion: 2.1 time: 0.252879 Oct 31 15:37:10.694621 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2157/4456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:10 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1326 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:10.876381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0339790>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:10.880875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:10.885095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:10.886098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:10.894680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:10.895273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:10.895701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:10.904101 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] HTTP exception thrown: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Request method failure captured: Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/os-services/c4724074-be4d-49cc-a41a-8567e575a7ff HTTP/1.1 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 56 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-umXYuhBtUfTxiMjycPL0clfpf9gDf-Pm7yKrQRxWJNzsqEE6NEspVGp92Il2epO1VfJYrP2LGjVcksrvlK8psCT1TlORhl4tk-8d7rWWjA9nSybhMpQFRASIDQkiKgu7nbv4N-qv6RZLwj110jxbL32xVmIFQb5mUG2g0Fj67La_U Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7fc5cf125361443196741dcc0f7f07c6 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1030984879 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7fc5cf125361443196741dcc0f7f07c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7fc5cf125361443196741dcc0f7f07c6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7fc5cf125361443196741dcc0f7f07c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7fc5cf125361443196741dcc0f7f07c6"}]}] Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1030984879 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7fc5cf125361443196741dcc0f7f07c6 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1030984879 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 94170a4ae59a43998bf045e480dddc45 Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: exception: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'c4724074-be4d-49cc-a41a-8567e575a7ff', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:10.905821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.910316 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.911472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Returning 404 to user: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:10.911472 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87b84306-e3fd-4de8-b8b4-f539c3ed92e4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/c4724074-be4d-49cc-a41a-8567e575a7ff" status: 404 len: 110 microversion: 2.53 time: 0.323881 Oct 31 15:37:10.912396 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2300/4457] 10.222.0.20 () {62 vars in 1309 bytes} [Mon Oct 31 15:37:10 2022] PUT /compute/v2.1/os-services/c4724074-be4d-49cc-a41a-8567e575a7ff => generated 110 bytes in 326 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:10.923308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0f01550>, body: {"status": "disabled"} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:10.927293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:10.928500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:10.928500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:10.943561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:10.944070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:10.944509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:10.953361 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] HTTP exception thrown: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Request method failure captured: Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: request: PUT /compute/v2.1/os-services/c4724074-be4d-49cc-a41a-8567e575a7ff HTTP/1.1 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 22 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-umXYuhBtUfTxiMjycPL0clfpf9gDf-Pm7yKrQRxWJNzsqEE6NEspVGp92Il2epO1VfJYrP2LGjVcksrvlK8psCT1TlORhl4tk-8d7rWWjA9nSybhMpQFRASIDQkiKgu7nbv4N-qv6RZLwj110jxbL32xVmIFQb5mUG2g0Fj67La_U Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7fc5cf125361443196741dcc0f7f07c6 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1030984879 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7fc5cf125361443196741dcc0f7f07c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7fc5cf125361443196741dcc0f7f07c6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7fc5cf125361443196741dcc0f7f07c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7fc5cf125361443196741dcc0f7f07c6"}]}] Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1030984879 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7fc5cf125361443196741dcc0f7f07c6 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1030984879 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 94170a4ae59a43998bf045e480dddc45 Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: {"status": "disabled"} Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: exception: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'c4724074-be4d-49cc-a41a-8567e575a7ff', 'body': {'status': 'disabled'}} Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:10.956275 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Returning 404 to user: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8649ace5-b0cc-48d3-a207-40fbcc8f181c tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/c4724074-be4d-49cc-a41a-8567e575a7ff" status: 404 len: 110 microversion: 2.53 time: 0.038532 Oct 31 15:37:10.965286 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2158/4458] 10.222.0.20 () {62 vars in 1309 bytes} [Mon Oct 31 15:37:10 2022] PUT /compute/v2.1/os-services/c4724074-be4d-49cc-a41a-8567e575a7ff => generated 110 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:10.969198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Action: 'update', calling method: .version_select at 0x7f16e0b83ca0>, body: {"status": "enabled"} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:10.973986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:10.974687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:10.975856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:10.984366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:10.985026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:10.985883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:10.991623 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] HTTP exception thrown: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Request method failure captured: Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/os-services/c4724074-be4d-49cc-a41a-8567e575a7ff HTTP/1.1 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 21 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-umXYuhBtUfTxiMjycPL0clfpf9gDf-Pm7yKrQRxWJNzsqEE6NEspVGp92Il2epO1VfJYrP2LGjVcksrvlK8psCT1TlORhl4tk-8d7rWWjA9nSybhMpQFRASIDQkiKgu7nbv4N-qv6RZLwj110jxbL32xVmIFQb5mUG2g0Fj67La_U Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7fc5cf125361443196741dcc0f7f07c6 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1030984879 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7fc5cf125361443196741dcc0f7f07c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7fc5cf125361443196741dcc0f7f07c6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7fc5cf125361443196741dcc0f7f07c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7fc5cf125361443196741dcc0f7f07c6"}]}] Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1030984879 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7fc5cf125361443196741dcc0f7f07c6 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1030984879 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 94170a4ae59a43998bf045e480dddc45 Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: {"status": "enabled"} Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: exception: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'c4724074-be4d-49cc-a41a-8567e575a7ff', 'body': {'status': 'enabled'}} Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6069, in _find_service_in_cell Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6211, in service_get_by_id Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:10.993940 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. Oct 31 15:37:10.998576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:11.000649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Returning 404 to user: Service c4724074-be4d-49cc-a41a-8567e575a7ff could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:11.002191 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-06cc3ffb-438a-4296-8556-320a2a83efb4 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/c4724074-be4d-49cc-a41a-8567e575a7ff" status: 404 len: 110 microversion: 2.53 time: 0.037604 Oct 31 15:37:11.005173 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2301/4459] 10.222.0.20 () {62 vars in 1309 bytes} [Mon Oct 31 15:37:10 2022] PUT /compute/v2.1/os-services/c4724074-be4d-49cc-a41a-8567e575a7ff => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:11.025855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2841b693-9c19-42b6-9d5d-3852de3d20c2 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:11.029730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2841b693-9c19-42b6-9d5d-3852de3d20c2 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.030663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2841b693-9c19-42b6-9d5d-3852de3d20c2 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.030796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2841b693-9c19-42b6-9d5d-3852de3d20c2 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.031597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2841b693-9c19-42b6-9d5d-3852de3d20c2 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.032077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2841b693-9c19-42b6-9d5d-3852de3d20c2 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.032608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2841b693-9c19-42b6-9d5d-3852de3d20c2 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.061944 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2841b693-9c19-42b6-9d5d-3852de3d20c2 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.050380 Oct 31 15:37:11.062882 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2159/4460] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Oct 31 15:37:11 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:11.076667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b17723f3-70b2-406d-b778-bed6365e8463 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:11.080399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17723f3-70b2-406d-b778-bed6365e8463 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.080897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17723f3-70b2-406d-b778-bed6365e8463 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.081366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17723f3-70b2-406d-b778-bed6365e8463 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.082098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17723f3-70b2-406d-b778-bed6365e8463 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.082751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17723f3-70b2-406d-b778-bed6365e8463 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.083366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b17723f3-70b2-406d-b778-bed6365e8463 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.111020 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b17723f3-70b2-406d-b778-bed6365e8463 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.039076 Oct 31 15:37:11.111648 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2302/4461] 10.222.0.20 () {60 vars in 1211 bytes} [Mon Oct 31 15:37:11 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:11.116282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:11.116967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] [instance: 7e43a145-1922-4010-a9ab-d038dd3fb9c5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:11.124502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.124995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.125467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.126171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.126636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.127060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.139732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4ecc27a-6cb6-456c-a901-7d180c23c964 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:11.144023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4ecc27a-6cb6-456c-a901-7d180c23c964 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.144691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4ecc27a-6cb6-456c-a901-7d180c23c964 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.145362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4ecc27a-6cb6-456c-a901-7d180c23c964 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.146280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4ecc27a-6cb6-456c-a901-7d180c23c964 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.146742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4ecc27a-6cb6-456c-a901-7d180c23c964 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.147183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4ecc27a-6cb6-456c-a901-7d180c23c964 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.157080 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] HTTP exception thrown: Instance 7e43a145-1922-4010-a9ab-d038dd3fb9c5 could not be found. Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Request method failure captured: Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5 HTTP/1.1 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-txIQzSTFFLdSyWM_-g3-Fiedy4V3VkYNxcwGLooonxjppi06d7tCEQ1FPP98m8YvrNRbtaMDJ_5JaGB9Otr01gl5E3otg7cN0oxxL8B7Tv-gmAqyTWz40swWrG1rRp_qPQ70dh5_1EMmpegMqNWJcp8v3CZiYhc2Zo4MXdLvv05hQ Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.47 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5bef7fc31ab640718bddf778ee9b19f7 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerShowV247Test-1636507726 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bef7fc31ab640718bddf778ee9b19f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5bef7fc31ab640718bddf778ee9b19f7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5bef7fc31ab640718bddf778ee9b19f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5bef7fc31ab640718bddf778ee9b19f7"}]}] Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerShowV247Test-1636507726 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5bef7fc31ab640718bddf778ee9b19f7 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerShowV247Test-1636507726 Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerShowV247Test-1636507726-project Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 0f558f2ad0b146538ad11058f8b55dbe Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerShowV247Test-1636507726-project Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 7e43a145-1922-4010-a9ab-d038dd3fb9c5 could not be found. Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '7e43a145-1922-4010-a9ab-d038dd3fb9c5'} Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e43a145-1922-4010-a9ab-d038dd3fb9c5 could not be found. Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e43a145-1922-4010-a9ab-d038dd3fb9c5 could not be found. Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:11.158777 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:11.162713 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:11.162713 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:11.162713 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:11.162713 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:11.162713 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:11.162713 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e43a145-1922-4010-a9ab-d038dd3fb9c5 could not be found. Oct 31 15:37:11.162713 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:11.165011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] Returning 404 to user: Instance 7e43a145-1922-4010-a9ab-d038dd3fb9c5 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:11.166464 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-253e3acb-8bcf-4090-aedf-393acb679246 tempest-ServerShowV247Test-1636507726 tempest-ServerShowV247Test-1636507726-project] 10.222.0.20 "GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5" status: 404 len: 111 microversion: 2.47 time: 0.055040 Oct 31 15:37:11.170494 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2160/4462] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:11 2022] GET /compute/v2.1/servers/7e43a145-1922-4010-a9ab-d038dd3fb9c5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:11.172595 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4ecc27a-6cb6-456c-a901-7d180c23c964 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.036029 Oct 31 15:37:11.173382 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2303/4463] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Oct 31 15:37:11 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:11.188304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-460dfbd8-e13a-458d-8b6f-08050d338581 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:11.192407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460dfbd8-e13a-458d-8b6f-08050d338581 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.193061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460dfbd8-e13a-458d-8b6f-08050d338581 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.193671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460dfbd8-e13a-458d-8b6f-08050d338581 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.194683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460dfbd8-e13a-458d-8b6f-08050d338581 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.195315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460dfbd8-e13a-458d-8b6f-08050d338581 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.196502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-460dfbd8-e13a-458d-8b6f-08050d338581 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.224861 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-460dfbd8-e13a-458d-8b6f-08050d338581 tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=n-d-858384-17&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.040186 Oct 31 15:37:11.225895 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2161/4464] 10.222.0.20 () {60 vars in 1237 bytes} [Mon Oct 31 15:37:11 2022] GET /compute/v2.1/os-services?host=n-d-858384-17&binary=xxx => generated 16 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:11.237985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-06a8f1a7-d5b3-451f-ad25-1802d8b99ffd tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:11.242157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06a8f1a7-d5b3-451f-ad25-1802d8b99ffd tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.243544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06a8f1a7-d5b3-451f-ad25-1802d8b99ffd tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.244250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06a8f1a7-d5b3-451f-ad25-1802d8b99ffd tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.245177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06a8f1a7-d5b3-451f-ad25-1802d8b99ffd tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.245812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06a8f1a7-d5b3-451f-ad25-1802d8b99ffd tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.246292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-06a8f1a7-d5b3-451f-ad25-1802d8b99ffd tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.274040 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-06a8f1a7-d5b3-451f-ad25-1802d8b99ffd tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.039703 Oct 31 15:37:11.274906 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2304/4465] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Oct 31 15:37:11 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:11.291718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cfc74ca-47a3-4089-adbd-06d54040abae tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:11.295481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cfc74ca-47a3-4089-adbd-06d54040abae tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.299569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cfc74ca-47a3-4089-adbd-06d54040abae tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.300229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cfc74ca-47a3-4089-adbd-06d54040abae tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.301670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cfc74ca-47a3-4089-adbd-06d54040abae tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.302324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cfc74ca-47a3-4089-adbd-06d54040abae tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.302748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6cfc74ca-47a3-4089-adbd-06d54040abae tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.331499 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6cfc74ca-47a3-4089-adbd-06d54040abae tempest-ServicesAdminNegativeV253TestJSON-1030984879 tempest-ServicesAdminNegativeV253TestJSON-1030984879-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.047845 Oct 31 15:37:11.332409 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2162/4466] 10.222.0.20 () {60 vars in 1239 bytes} [Mon Oct 31 15:37:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:11.498137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a785113-83eb-462a-ba19-1660ef7aad3a tempest-ServicesAdminNegativeV253TestJSON-1552977128 tempest-ServicesAdminNegativeV253TestJSON-1552977128-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:11.502321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a785113-83eb-462a-ba19-1660ef7aad3a tempest-ServicesAdminNegativeV253TestJSON-1552977128 tempest-ServicesAdminNegativeV253TestJSON-1552977128-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '92d76a655a164e218bdbe81abc5f7c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2368135725bd425b9403bbb3a7cd1dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a785113-83eb-462a-ba19-1660ef7aad3a tempest-ServicesAdminNegativeV253TestJSON-1552977128 tempest-ServicesAdminNegativeV253TestJSON-1552977128-project] Request method failure captured: Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-ulxFByN5jrA9VW7vfLX7t7E3nTSOPkWpja7GmzrYBFpZsFDYWqon-d8xfwBDEJPsn_YDRq9JztiMirwOSTRq6fCtyFH1vTDTlUYU77Gj4EwqsNexfPnpxuFrU2vaBNLeE7DdMqEsSQzXNv_M1_XwqMdCOq-bubAm27_QKfnxL364E Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.53 Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 2368135725bd425b9403bbb3a7cd1dcc Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1552977128 Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2368135725bd425b9403bbb3a7cd1dcc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2368135725bd425b9403bbb3a7cd1dcc", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2368135725bd425b9403bbb3a7cd1dcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2368135725bd425b9403bbb3a7cd1dcc"}]}] Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1552977128 Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 2368135725bd425b9403bbb3a7cd1dcc Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1552977128 Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1552977128-project Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 92d76a655a164e218bdbe81abc5f7c51 Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1552977128-project Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise self.value Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 31 15:37:11.503863 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 31 15:37:11.507749 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:11.510101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a785113-83eb-462a-ba19-1660ef7aad3a tempest-ServicesAdminNegativeV253TestJSON-1552977128 tempest-ServicesAdminNegativeV253TestJSON-1552977128-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:11.511096 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a785113-83eb-462a-ba19-1660ef7aad3a tempest-ServicesAdminNegativeV253TestJSON-1552977128 tempest-ServicesAdminNegativeV253TestJSON-1552977128-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.167122 Oct 31 15:37:11.516374 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2305/4467] 10.222.0.20 () {60 vars in 1178 bytes} [Mon Oct 31 15:37:11 2022] GET /compute/v2.1/os-services => generated 112 bytes in 173 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:11.724647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:11.728204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:11.748949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.750240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.754059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.756245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:11.757377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:11.759355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:11.983170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:11.995900 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-36fd3210-bd0c-4dd0-b309-8b4137515159 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1527 microversion: 2.1 time: 0.275172 Oct 31 15:37:12.009499 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2163/4468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:11 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1527 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:12.023414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:12.026037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:12.034001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:12.035368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:12.036050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:12.037419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:12.038352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:12.040040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:12.386747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:12.396542 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6cd68a4-2e07-4526-9712-e847cd23924a tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1527 microversion: 2.1 time: 0.378497 Oct 31 15:37:12.397573 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2306/4469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:12 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1527 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:12.973852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:12.975402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:12.983287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:12.984051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:12.984734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:12.985728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:12.986426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:12.987348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:13.003439 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] HTTP exception thrown: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Request method failure captured: Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 HTTP/1.1 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-uXZUHjhMvu-fTqP0h9gmUk3Kgxvg6AHKzYjwAmHibRjISp8MlwV0jhr2EV5qvrGFeDwkFzP4h6k5yL6CJKExebZdv55bhceCe8bFvsD-dH7emdRKJB73fhRs0irD2O-K_MkhayutSP_yWq-Uw6iY1EniRrJm65pFGHoO4c6dV7Bt4 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 097a7ea82d6c421bbcd767a922782912 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1149247152 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/097a7ea82d6c421bbcd767a922782912"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_097a7ea82d6c421bbcd767a922782912", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/097a7ea82d6c421bbcd767a922782912"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/097a7ea82d6c421bbcd767a922782912"}]}] Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1149247152 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 097a7ea82d6c421bbcd767a922782912 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1149247152 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1149247152-project Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 77ea664a4e284486b27ebb3262d7fb47 Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1149247152-project Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'ed81a388-59b2-4601-b3e6-81b5dd3139b1'} Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:13.005486 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.009309 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.011392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Returning 404 to user: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:13.012505 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d399fee5-be78-408d-9926-643d80b9aa1f tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 404 len: 111 microversion: 2.1 time: 0.594115 Oct 31 15:37:13.013462 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2164/4470] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:37:12 2022] DELETE /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 111 bytes in 596 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:37:13.033605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:13.034953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:13.048741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:13.050223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:13.050661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:13.051396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:13.053374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:13.053804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:13.291782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:13.302930 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a746f77-3ef3-4be3-ab2f-f9b64d11a113 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1527 microversion: 2.1 time: 0.281610 Oct 31 15:37:13.304790 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2307/4471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:13 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1527 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:13.327517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Action: 'update', calling method: >, body: {"server": {"name": "ed81a388-59b2-4601-b3e6-81b5dd3139b1_new"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:13.331339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:13.338791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:13.344700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:13.345468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:13.345696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:13.346396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:13.346899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:13.347316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:13.381426 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] HTTP exception thrown: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Request method failure captured: Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: request: PUT /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 HTTP/1.1 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 64 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-uXZUHjhMvu-fTqP0h9gmUk3Kgxvg6AHKzYjwAmHibRjISp8MlwV0jhr2EV5qvrGFeDwkFzP4h6k5yL6CJKExebZdv55bhceCe8bFvsD-dH7emdRKJB73fhRs0irD2O-K_MkhayutSP_yWq-Uw6iY1EniRrJm65pFGHoO4c6dV7Bt4 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 097a7ea82d6c421bbcd767a922782912 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1149247152 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/097a7ea82d6c421bbcd767a922782912"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_097a7ea82d6c421bbcd767a922782912", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/097a7ea82d6c421bbcd767a922782912"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/097a7ea82d6c421bbcd767a922782912"}]}] Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1149247152 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 097a7ea82d6c421bbcd767a922782912 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1149247152 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1149247152-project Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 77ea664a4e284486b27ebb3262d7fb47 Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1149247152-project Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "ed81a388-59b2-4601-b3e6-81b5dd3139b1_new"}} Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'ed81a388-59b2-4601-b3e6-81b5dd3139b1', 'body': {'server': {'name': 'ed81a388-59b2-4601-b3e6-81b5dd3139b1_new'}}} Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:37:13.384086 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] Returning 404 to user: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28742198-371a-47e0-98b9-676be72c4d1e tempest-ServersNegativeTestMultiTenantJSON-1149247152 tempest-ServersNegativeTestMultiTenantJSON-1149247152-project] 10.222.0.20 "PUT /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 404 len: 111 microversion: 2.1 time: 0.062043 Oct 31 15:37:13.387785 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2165/4472] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 15:37:13 2022] PUT /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:13.396840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:13.397764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:13.406316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:13.407094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:13.407862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:13.408798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:13.409453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:13.410145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:13.441818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:37:13.578683 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2716045a-5ccd-4bf6-a5c3-170c6a39b251 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 204 len: 0 microversion: 2.1 time: 0.186066 Oct 31 15:37:13.579547 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2308/4473] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:37:13 2022] DELETE /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:37:13.595793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:13.595793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:13.614161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:13.619178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:13.620307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:13.625072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:13.625911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:13.626203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:13.931206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:13.952680 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2de3b4b7-49ee-4863-b483-63012c97111b tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1533 microversion: 2.1 time: 0.366135 Oct 31 15:37:13.954878 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2166/4474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:13 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1533 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:14.981632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:14.982346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:14.995707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:14.996970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:15.001852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:15.011265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:15.016615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:15.017371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:15.297305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:15.309513 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4439eb55-ad12-469b-968d-48faea254948 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1533 microversion: 2.1 time: 0.332976 Oct 31 15:37:15.312740 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2309/4475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:14 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1533 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:15.715122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c62ed391-c657-427e-a4f4-8928ff81f0f6 req-f5255ee1-b261-4db4-8e27-afa7d6a0884d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed81a388-59b2-4601-b3e6-81b5dd3139b1", "name": "network-vif-deleted", "tag": "d9028bfd-fe47-4f17-98c6-4d4612a93ae8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:15.734932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c62ed391-c657-427e-a4f4-8928ff81f0f6 req-f5255ee1-b261-4db4-8e27-afa7d6a0884d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:15.737857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c62ed391-c657-427e-a4f4-8928ff81f0f6 req-f5255ee1-b261-4db4-8e27-afa7d6a0884d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:15.739241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c62ed391-c657-427e-a4f4-8928ff81f0f6 req-f5255ee1-b261-4db4-8e27-afa7d6a0884d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:15.763301 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c62ed391-c657-427e-a4f4-8928ff81f0f6 req-f5255ee1-b261-4db4-8e27-afa7d6a0884d service nova] Creating event network-vif-deleted:d9028bfd-fe47-4f17-98c6-4d4612a93ae8 for instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 on n-h1-858384-17 Oct 31 15:37:15.780192 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c62ed391-c657-427e-a4f4-8928ff81f0f6 req-f5255ee1-b261-4db4-8e27-afa7d6a0884d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070678 Oct 31 15:37:15.791002 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2167/4476] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:37:16.341383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:16.346853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:16.361213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.361978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.368869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:16.370468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.371383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.371977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:16.416138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:16.416822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:16.417782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:16.418389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lazy-loading 'fault' on Instance uuid ed81a388-59b2-4601-b3e6-81b5dd3139b1 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:37:16.535005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6de4d3b24d24f4c922f8eee737c2966', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9007bf5774b34185b0cdc39044f016ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:16.554303 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e1bcd32-c51c-420c-8d52-d3322af985f2 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 200 len: 1316 microversion: 2.1 time: 0.210672 Oct 31 15:37:16.555215 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2310/4477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:16 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:17.593750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:17.594468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] [instance: ed81a388-59b2-4601-b3e6-81b5dd3139b1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:17.609026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:17.609577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:17.610037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:17.614925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:17.615417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:17.615854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:17.649755 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] HTTP exception thrown: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Request method failure captured: Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 HTTP/1.1 Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-uMY2RaZTcL9nVn4hDG7CoIhyuBX4fnWMOqGPl8ziFHV0htFXj6F1Sjda8L1kyueLMAGTVc32C6-bRffgvNmm-JDtSpwB8esVHrATgUN5wfI5vB1HPEQERMbHaMA-mWfnIZMFQUG6BqhWy8a5t-ecfo-OrsM2qj40jYwlMAn4gwoWc Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 9007bf5774b34185b0cdc39044f016ea Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-126396221 Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9007bf5774b34185b0cdc39044f016ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_9007bf5774b34185b0cdc39044f016ea", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/9007bf5774b34185b0cdc39044f016ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/9007bf5774b34185b0cdc39044f016ea"}]}] Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-126396221 Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 9007bf5774b34185b0cdc39044f016ea Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-126396221 Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestMultiTenantJSON-126396221-project Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: f6de4d3b24d24f4c922f8eee737c2966 Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-126396221-project Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'ed81a388-59b2-4601-b3e6-81b5dd3139b1'} Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:17.651740 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:17.656421 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:17.656421 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:17.656421 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:17.656421 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:17.656421 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:17.656421 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:17.656421 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:17.656421 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. Oct 31 15:37:17.656421 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:17.658048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] Returning 404 to user: Instance ed81a388-59b2-4601-b3e6-81b5dd3139b1 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:17.661263 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e5751ee-8afe-4019-8e8a-b65e4519faa0 tempest-ServersNegativeTestMultiTenantJSON-126396221 tempest-ServersNegativeTestMultiTenantJSON-126396221-project] 10.222.0.20 "GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1" status: 404 len: 111 microversion: 2.1 time: 0.081884 Oct 31 15:37:17.663457 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2168/4478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:17 2022] GET /compute/v2.1/servers/ed81a388-59b2-4601-b3e6-81b5dd3139b1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:28.663303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-598db43e-0a9d-42ca-890a-65b5803301de tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:28.666383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-598db43e-0a9d-42ca-890a-65b5803301de tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:28.669898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:28.676227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:28.678630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:28.715822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-598db43e-0a9d-42ca-890a-65b5803301de tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:28.716324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-598db43e-0a9d-42ca-890a-65b5803301de tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:28.716762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-598db43e-0a9d-42ca-890a-65b5803301de tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:28.724220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-598db43e-0a9d-42ca-890a-65b5803301de tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:28.724750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-598db43e-0a9d-42ca-890a-65b5803301de tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:28.731487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-598db43e-0a9d-42ca-890a-65b5803301de tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:29.017392 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-598db43e-0a9d-42ca-890a-65b5803301de tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.355733 Oct 31 15:37:29.020628 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2311/4479] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:37:28 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:37:29.030289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:29.030906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:29.033447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:29.034394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:29.035042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:29.047247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:29.050292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:29.050782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:29.052038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:29.052666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:29.053286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:29.513718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:29.522139 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52de5cfd-c18e-455e-8c8f-0537d182fd25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1671 microversion: 2.1 time: 0.496421 Oct 31 15:37:29.524791 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2169/4480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:29 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1671 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:30.553305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:30.554964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:30.573747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:30.574521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:30.575277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:30.576725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:30.577753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:30.581038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:31.149858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:31.158072 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-40d592c0-231f-4d75-8cae-739164593c32 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1676 microversion: 2.1 time: 0.610046 Oct 31 15:37:31.158675 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2312/4481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:30 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1676 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:32.199792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:32.203949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:32.222809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.225945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.229603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:32.231391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.245526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.245990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:32.704966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:32.705547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:32.706404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:32.715991 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f768cd49-c0d8-4ab0-a03b-d95422a4c9ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1676 microversion: 2.1 time: 0.530427 Oct 31 15:37:32.720600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.721385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.721952 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2170/4482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:32 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1676 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:32.722585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:32.723340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:32.723804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:32.724230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:32.999875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lazy-loading 'services' on Instance uuid 3a9c1f89-62a1-429b-9a22-45e7b9541232 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:37:33.212938 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-81780182-b0cd-4c3d-90bf-845347347b07 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/os-volume_attachments/3cbdc8ea-60da-4223-a42e-04ae45546cff" status: 202 len: 0 microversion: 2.1 time: 0.515913 Oct 31 15:37:33.213448 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2313/4483] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:37:32 2022] DELETE /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/os-volume_attachments/3cbdc8ea-60da-4223-a42e-04ae45546cff => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:37:33.755057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:33.755685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:33.768391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:33.768876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:33.779815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:33.782390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:33.784359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:33.785046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:34.664354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:34.679929 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-123dccec-bb53-47d4-ae06-a38151109946 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1676 microversion: 2.1 time: 0.933604 Oct 31 15:37:34.680769 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2171/4484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:33 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1676 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:35.704786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:35.705522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:35.720506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:35.721031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:35.728956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:35.731092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:35.732133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:35.732729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:36.437175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:36.447881 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e042b533-3a0b-4457-8d82-015bfd1d484b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1676 microversion: 2.1 time: 0.747521 Oct 31 15:37:36.453829 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2314/4485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:35 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1676 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:37.477180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:37.477814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:37.499228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:37.499747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:37.500302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:37.503044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:37.506004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:37.511561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:38.216827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:38.236593 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f755f686-9002-425e-b4f5-20ae3753c5d6 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.763010 Oct 31 15:37:38.249934 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2172/4486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:37 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:41.369265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-70465069-f8ed-4644-99b3-09d3783bc0e1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Action: 'create', calling method: .version_select at 0x7f16e0339c10>, body: {"keypair": {"name": "tempest-keypair-870513798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLa2fsfC6nLoEKv+ViXbzVh65lSrmEYgfASAsjuINoYcerM34XCAhdQJbvR1CZ3AtsGTacbbrhhjovdAwWaMW2LcoD4sKI5f3Rh+RAMg63aYMqQ562NV3F0E2OaplFBuw=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:41.426582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-70465069-f8ed-4644-99b3-09d3783bc0e1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Getting quotas for project 1c07afa65f4641e09b798511a614d9a6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:37:41.441364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-70465069-f8ed-4644-99b3-09d3783bc0e1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Getting quotas for user e1e5884af4ed42e8914691ad56cb474b and project 1c07afa65f4641e09b798511a614d9a6. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:37:41.546189 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-70465069-f8ed-4644-99b3-09d3783bc0e1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.798208 Oct 31 15:37:41.554926 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2315/4487] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:37:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:42.590205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c55de418-791f-4db1-b637-195cc9e58790 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Action: 'create', calling method: .version_select at 0x7f16e0fc05e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-102543911", "metadata": {"Type": "work"}}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c55de418-791f-4db1-b637-195cc9e58790 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Request method failure captured: Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 121 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-vF9VRjGxxc3dlJP9MAb0PYAAxWl15rUOcyMeTbS6N_9cuyhZKHdV6zTs9BhtciQkhZBJXFirI1D5uOIXjgQoXXKUdsJuCGK2fI43gzO2JzDsdqZVEd8bhKkG9xRi1YOLgHap19yqBuVRF3iw8X5Avn-KL-WppLqsmp1L3xizV4FsE Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a26408e59e7947809dbbc8efc79aad10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a26408e59e7947809dbbc8efc79aad10"}]}] Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ef9f2490c595427491db81a4c29ce267 Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-102543911", "metadata": {"Type": "work"}}} Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-102543911', 'metadata': {'Type': 'work'}}}} Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '#$%' Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:37:42.603287 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c55de418-791f-4db1-b637-195cc9e58790 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:42.607571 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c55de418-791f-4db1-b637-195cc9e58790 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.607435 Oct 31 15:37:42.618255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d443c6a5-fbef-4656-9b9b-d47b8ea61645 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Action: 'create', calling method: .version_select at 0x7f16e02ba5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1802415453", "metadata": {"Type": "work"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d443c6a5-fbef-4656-9b9b-d47b8ea61645 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Request method failure captured: Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 120 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-vF9VRjGxxc3dlJP9MAb0PYAAxWl15rUOcyMeTbS6N_9cuyhZKHdV6zTs9BhtciQkhZBJXFirI1D5uOIXjgQoXXKUdsJuCGK2fI43gzO2JzDsdqZVEd8bhKkG9xRi1YOLgHap19yqBuVRF3iw8X5Avn-KL-WppLqsmp1L3xizV4FsE Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a26408e59e7947809dbbc8efc79aad10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a26408e59e7947809dbbc8efc79aad10"}]}] Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ef9f2490c595427491db81a4c29ce267 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1802415453", "metadata": {"Type": "work"}}} Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1802415453', 'metadata': {'Type': 'work'}}}} Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi '0' Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:37:42.622546 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d443c6a5-fbef-4656-9b9b-d47b8ea61645 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:42.626735 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d443c6a5-fbef-4656-9b9b-d47b8ea61645 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011071 Oct 31 15:37:42.627516 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2173/4488] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 31 15:37:41 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 625 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:37:42.643639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5976074b-6b78-487d-9a71-21a2613a4b9d tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Action: 'create', calling method: .version_select at 0x7f16e5571670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1502367183", "metadata": {"Type": "work"}}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:42.644693 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2316/4489] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 31 15:37:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5976074b-6b78-487d-9a71-21a2613a4b9d tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Request method failure captured: Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 119 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-vF9VRjGxxc3dlJP9MAb0PYAAxWl15rUOcyMeTbS6N_9cuyhZKHdV6zTs9BhtciQkhZBJXFirI1D5uOIXjgQoXXKUdsJuCGK2fI43gzO2JzDsdqZVEd8bhKkG9xRi1YOLgHap19yqBuVRF3iw8X5Avn-KL-WppLqsmp1L3xizV4FsE Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a26408e59e7947809dbbc8efc79aad10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a26408e59e7947809dbbc8efc79aad10"}]}] Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ef9f2490c595427491db81a4c29ce267 Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1502367183", "metadata": {"Type": "work"}}} Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1502367183', 'metadata': {'Type': 'work'}}}} Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '' Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:37:42.667161 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5976074b-6b78-487d-9a71-21a2613a4b9d tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:42.673167 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5976074b-6b78-487d-9a71-21a2613a4b9d tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.028852 Oct 31 15:37:42.680592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b2579b40-29ae-4023-8a86-38c595cc3ecc tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Calling method '.version_select at 0x7f16e0323a60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:42.701979 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2174/4490] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 31 15:37:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:37:42.889937 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b2579b40-29ae-4023-8a86-38c595cc3ecc tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] HTTP exception thrown: Volume tempest-invalid-1841898448 could not be found. Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b2579b40-29ae-4023-8a86-38c595cc3ecc tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Request method failure captured: Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1841898448 HTTP/1.1 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-vF9VRjGxxc3dlJP9MAb0PYAAxWl15rUOcyMeTbS6N_9cuyhZKHdV6zTs9BhtciQkhZBJXFirI1D5uOIXjgQoXXKUdsJuCGK2fI43gzO2JzDsdqZVEd8bhKkG9xRi1YOLgHap19yqBuVRF3iw8X5Avn-KL-WppLqsmp1L3xizV4FsE Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a26408e59e7947809dbbc8efc79aad10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a26408e59e7947809dbbc8efc79aad10"}]}] Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ef9f2490c595427491db81a4c29ce267 Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: exception: Volume tempest-invalid-1841898448 could not be found. Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'tempest-invalid-1841898448'} Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1841898448 could not be found. (HTTP 404) (Request-ID: req-47ca4833-6d2f-470a-aa8e-bcffa2c569f3) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:37:42.931472 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1841898448 could not be found. Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1841898448 could not be found. Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1841898448 could not be found. Oct 31 15:37:42.935812 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:42.943414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b2579b40-29ae-4023-8a86-38c595cc3ecc tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Returning 404 to user: Volume tempest-invalid-1841898448 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:42.944734 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b2579b40-29ae-4023-8a86-38c595cc3ecc tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1841898448" status: 404 len: 99 microversion: 2.1 time: 0.268303 Oct 31 15:37:42.946644 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2317/4491] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:37:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1841898448 => generated 99 bytes in 271 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 31 15:37:42.957055 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2554b2d3-0a4c-4b1c-8365-89ca1f4dba23 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004211 Oct 31 15:37:42.961515 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2175/4492] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 31 15:37:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:37:42.969270 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f96962d4-c5b2-49c4-86de-a1ff8034a892 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005823 Oct 31 15:37:42.970822 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2318/4493] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:37:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 31 15:37:42.980742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fe796e1-e433-41d5-b2a7-3d28f218f280 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Calling method '.version_select at 0x7f16e0fc05e0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:43.072802 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-4fe796e1-e433-41d5-b2a7-3d28f218f280 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] HTTP exception thrown: Volume a2da0fa2-0efc-476f-b862-21e07b697418 could not be found. Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fe796e1-e433-41d5-b2a7-3d28f218f280 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Request method failure captured: Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-volumes/a2da0fa2-0efc-476f-b862-21e07b697418 HTTP/1.1 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-vF9VRjGxxc3dlJP9MAb0PYAAxWl15rUOcyMeTbS6N_9cuyhZKHdV6zTs9BhtciQkhZBJXFirI1D5uOIXjgQoXXKUdsJuCGK2fI43gzO2JzDsdqZVEd8bhKkG9xRi1YOLgHap19yqBuVRF3iw8X5Avn-KL-WppLqsmp1L3xizV4FsE Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a26408e59e7947809dbbc8efc79aad10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a26408e59e7947809dbbc8efc79aad10"}]}] Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ef9f2490c595427491db81a4c29ce267 Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: exception: Volume a2da0fa2-0efc-476f-b862-21e07b697418 could not be found. Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'a2da0fa2-0efc-476f-b862-21e07b697418'} Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a2da0fa2-0efc-476f-b862-21e07b697418 could not be found. (HTTP 404) (Request-ID: req-be8a71c2-ad31-4fc7-8815-7039d3910e85) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:37:43.077245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a2da0fa2-0efc-476f-b862-21e07b697418 could not be found. Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a2da0fa2-0efc-476f-b862-21e07b697418 could not be found. Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a2da0fa2-0efc-476f-b862-21e07b697418 could not be found. Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4fe796e1-e433-41d5-b2a7-3d28f218f280 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Returning 404 to user: Volume a2da0fa2-0efc-476f-b862-21e07b697418 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4fe796e1-e433-41d5-b2a7-3d28f218f280 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/a2da0fa2-0efc-476f-b862-21e07b697418" status: 404 len: 109 microversion: 2.1 time: 0.103135 Oct 31 15:37:43.083933 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2176/4494] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:37:42 2022] DELETE /compute/v2.1/os-volumes/a2da0fa2-0efc-476f-b862-21e07b697418 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:43.089000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aa6c69be-f18d-466b-a941-b3e1c6816c55 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Calling method '.version_select at 0x7f16e02f3550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:43.247985 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-aa6c69be-f18d-466b-a941-b3e1c6816c55 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] HTTP exception thrown: Volume 66321211-eb4b-4226-b1ce-2c8e766a6955 could not be found. Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aa6c69be-f18d-466b-a941-b3e1c6816c55 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Request method failure captured: Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-volumes/66321211-eb4b-4226-b1ce-2c8e766a6955 HTTP/1.1 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-vF9VRjGxxc3dlJP9MAb0PYAAxWl15rUOcyMeTbS6N_9cuyhZKHdV6zTs9BhtciQkhZBJXFirI1D5uOIXjgQoXXKUdsJuCGK2fI43gzO2JzDsdqZVEd8bhKkG9xRi1YOLgHap19yqBuVRF3iw8X5Avn-KL-WppLqsmp1L3xizV4FsE Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a26408e59e7947809dbbc8efc79aad10", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a26408e59e7947809dbbc8efc79aad10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a26408e59e7947809dbbc8efc79aad10"}]}] Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: a26408e59e7947809dbbc8efc79aad10 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-2006889738 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ef9f2490c595427491db81a4c29ce267 Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-2006889738-project Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: exception: Volume 66321211-eb4b-4226-b1ce-2c8e766a6955 could not be found. Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '66321211-eb4b-4226-b1ce-2c8e766a6955'} Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66321211-eb4b-4226-b1ce-2c8e766a6955 could not be found. (HTTP 404) (Request-ID: req-d52da46f-2f11-4d95-a4a3-9c572e33a296) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:37:43.250404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66321211-eb4b-4226-b1ce-2c8e766a6955 could not be found. Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66321211-eb4b-4226-b1ce-2c8e766a6955 could not be found. Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66321211-eb4b-4226-b1ce-2c8e766a6955 could not be found. Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aa6c69be-f18d-466b-a941-b3e1c6816c55 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] Returning 404 to user: Volume 66321211-eb4b-4226-b1ce-2c8e766a6955 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:37:43.255007 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aa6c69be-f18d-466b-a941-b3e1c6816c55 tempest-VolumesNegativeTest-2006889738 tempest-VolumesNegativeTest-2006889738-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/66321211-eb4b-4226-b1ce-2c8e766a6955" status: 404 len: 109 microversion: 2.1 time: 0.167093 Oct 31 15:37:43.258613 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2319/4495] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:37:43 2022] GET /compute/v2.1/os-volumes/66321211-eb4b-4226-b1ce-2c8e766a6955 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:37:45.700997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-404545486", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "f266baa8-7c33-400c-aeef-0d5df4183cb5"}], "security_groups": [{"name": "tempest-securitygroup--2057971177"}], "key_name": "tempest-keypair-870513798", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:45.919758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] validate_networks() for [('f266baa8-7c33-400c-aeef-0d5df4183cb5', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:37:46.869732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:37:46.870319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:37:46.870986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:37:46.872187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:37:46.872631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:37:46.899822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:46.902515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:46.903226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:46.905900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:46.907067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:46.912512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:46.983421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Getting quotas for project 1c07afa65f4641e09b798511a614d9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:37:46.998946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Getting quotas for user e1e5884af4ed42e8914691ad56cb474b and project 1c07afa65f4641e09b798511a614d9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:37:47.037965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:37:47.046145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:37:47.154669 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b36a8a4-c338-436a-8b47-ea91f1f15c0c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.456080 Oct 31 15:37:47.163397 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2177/4496] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:37:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:37:47.171846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:47.178444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4f01f44-f6ec-4c35-9089-a47f6746f371 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:47.179948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4f01f44-f6ec-4c35-9089-a47f6746f371 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:47.349384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4f01f44-f6ec-4c35-9089-a47f6746f371 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:47.362086 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4f01f44-f6ec-4c35-9089-a47f6746f371 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1240 microversion: 2.1 time: 0.191442 Oct 31 15:37:47.364814 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2320/4497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:47 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1240 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:48.390775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f9f9963-8b8d-4d6a-b365-3896e054b68f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:48.391314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f9f9963-8b8d-4d6a-b365-3896e054b68f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:48.548977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0f9f9963-8b8d-4d6a-b365-3896e054b68f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:48.558874 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f9f9963-8b8d-4d6a-b365-3896e054b68f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1240 microversion: 2.1 time: 0.172934 Oct 31 15:37:48.560147 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2178/4498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:48 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1240 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:48.935261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f145ca2-872b-4b7f-9177-21b563871462 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:48.947489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f145ca2-872b-4b7f-9177-21b563871462 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:48.947650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f145ca2-872b-4b7f-9177-21b563871462 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:48.950414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f145ca2-872b-4b7f-9177-21b563871462 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:49.023221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9f145ca2-872b-4b7f-9177-21b563871462 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Going to try to stop instance {{(pid=120588) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:37:49.130873 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f145ca2-872b-4b7f-9177-21b563871462 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/action" status: 202 len: 0 microversion: 2.1 time: 0.200650 Oct 31 15:37:49.133396 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2179/4499] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:37:48 2022] POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:37:49.142784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:49.144787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:49.157280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:49.158561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:49.159257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:49.160544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:49.161307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:49.162547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:49.468035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:49.470180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:49.486933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:49.487731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:49.489445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:49.491908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:49.493982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:49.497667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:49.518621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:49.528262 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ee1d033-be92-4a85-9a9a-2023abec5979 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1676 microversion: 2.1 time: 0.390712 Oct 31 15:37:49.533203 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2180/4500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:49 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1676 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:49.564164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:37:49.589352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:49.590347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:49.608767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:49.609539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:49.611716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:49.613994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:49.615611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:49.617652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:49.764414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:49.792223 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4623fe8b-ff8c-4139-920d-d061aaed3a9f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1292 microversion: 2.1 time: 0.207214 Oct 31 15:37:49.793964 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2181/4501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:49 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1292 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:49.834808 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-acb19baa-e169-413a-947c-d8632f48b464 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 204 len: 0 microversion: 2.32 time: 0.957841 Oct 31 15:37:49.835849 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2321/4502] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:37:48 2022] DELETE /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 0 bytes in 961 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:37:49.844875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:49.845738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:49.859272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:49.859792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:49.860234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:49.865833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:49.869071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:49.869945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:50.276592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:50.289717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:50.291703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:50.293589 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d428659c-f69e-40a2-8b67-4bc89eb5be47 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2953 microversion: 2.32 time: 0.453128 Oct 31 15:37:50.294811 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2182/4503] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:49 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2953 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:50.560350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:50.581798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:50.590187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:50.591443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:50.592190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:50.593080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:50.593727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:50.594315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:50.822438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:50.823785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:50.831523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:50.832515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:50.833157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:50.834240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:50.835003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:50.836469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:50.921387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:50.931575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:50.946293 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30cfed97-268d-4012-ba54-70cbcbc1cdee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1298 microversion: 2.1 time: 0.122619 Oct 31 15:37:50.949176 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2183/4504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:50 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:37:50.954301 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b72c9128-7f86-4cdd-be15-61076578c6ff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1676 microversion: 2.1 time: 0.387241 Oct 31 15:37:50.957055 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2322/4505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:50 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1676 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:51.328514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:51.330969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:51.344963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:51.345506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:51.345953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:51.346674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:51.347141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:51.348604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:51.722276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:51.737435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:51.739757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:51.742693 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd6c351f-e531-44fc-9b47-8623656410a9 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2953 microversion: 2.32 time: 0.423084 Oct 31 15:37:51.743996 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2184/4506] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:51 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2953 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:51.974825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:51.982955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:51.984924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:51.985391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:52.002698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:52.004204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:52.005287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:52.005782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:52.007423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:52.008097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:52.010140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:52.010756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:52.011440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:52.012621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:52.013019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:52.016399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:52.213042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:52.224409 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dc3889e-c0d6-4343-ad9a-a021a28d5a87 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1676 microversion: 2.1 time: 0.246769 Oct 31 15:37:52.227201 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2185/4507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:51 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1676 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:52.315523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:52.324565 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5807c0b6-8daa-4c19-a0e0-287094f2d19c tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1366 microversion: 2.1 time: 0.354333 Oct 31 15:37:52.325637 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2323/4508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:51 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:52.414509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3a3f6d1c-3765-4f85-9064-702a11efe3eb req-213b0ee2-b0e3-46a3-9ab0-b3600601176b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420aeaad-1dec-4179-aa64-f2785da16514", "tag": "cf4e8e15-08e1-4ddf-ba24-102fa5db34d8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:52.434075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3a3f6d1c-3765-4f85-9064-702a11efe3eb req-213b0ee2-b0e3-46a3-9ab0-b3600601176b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:52.434791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3a3f6d1c-3765-4f85-9064-702a11efe3eb req-213b0ee2-b0e3-46a3-9ab0-b3600601176b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:52.436033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3a3f6d1c-3765-4f85-9064-702a11efe3eb req-213b0ee2-b0e3-46a3-9ab0-b3600601176b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:52.452600 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3a3f6d1c-3765-4f85-9064-702a11efe3eb req-213b0ee2-b0e3-46a3-9ab0-b3600601176b service nova] Creating event network-changed:cf4e8e15-08e1-4ddf-ba24-102fa5db34d8 for instance 420aeaad-1dec-4179-aa64-f2785da16514 on n-h2-858384-17 Oct 31 15:37:52.459810 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3a3f6d1c-3765-4f85-9064-702a11efe3eb req-213b0ee2-b0e3-46a3-9ab0-b3600601176b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048661 Oct 31 15:37:52.461047 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2186/4509] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:52.771828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:52.773064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:52.781509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:52.785727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:52.787516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:52.790014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:52.790639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:52.792128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:53.138832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:53.157304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:53.160371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:53.164614 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b47c43f0-0362-4176-9fde-91f70f79f389 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2953 microversion: 2.32 time: 0.394557 Oct 31 15:37:53.169304 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2324/4510] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:52 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2953 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:53.254287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:53.255572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:53.265284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:53.265971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:53.266542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:53.267667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:53.268281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:53.268862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:53.357866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:53.360540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:53.367945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:53.368591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:53.369295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:53.370254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:53.370930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:53.371570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:53.582363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:53.598473 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a9c4741b-542b-4d0a-94a5-82fd4d9420b4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1676 microversion: 2.1 time: 0.349849 Oct 31 15:37:53.601249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:53.601834 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2187/4511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:53 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1676 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:53.610320 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c7f8ff4-a66a-4f9a-997e-30b974047533 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1366 microversion: 2.1 time: 0.262645 Oct 31 15:37:53.630897 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2325/4512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:53 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:54.196672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:54.198689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:54.218629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:54.221671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:54.223539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:54.226136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:54.226857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:54.229019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:54.626672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:54.628917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:54.644206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:54.644930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:54.647830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:54.649482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:54.652143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:54.652667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:54.730702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:54.751901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:54.756433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:54.761778 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49effd46-002d-4cc4-915f-58104e2410e8 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2932 microversion: 2.32 time: 0.569061 Oct 31 15:37:54.763342 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2188/4513] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:54 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2932 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:54.771998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:54.773020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:54.791056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:54.793380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:54.795221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:54.796215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:54.796903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:54.798419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.230325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:55.249270 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01072994-a721-43a2-ae8c-a77ae0b59ca4 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1676 microversion: 2.1 time: 0.628230 Oct 31 15:37:55.253381 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2326/4514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:54 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1676 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:55.458649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:55.472304 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-689cbc79-b86c-4eba-9445-14c6fa643712 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1366 microversion: 2.1 time: 0.706225 Oct 31 15:37:55.475116 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2189/4515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:54 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1366 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:55.798135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:55.798759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:55.811864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.812378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.812826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.819799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.820605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.821513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.837120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-71017ce8-62dd-4386-8117-c399e9b9d777 req-7be6de53-f122-4c4a-b0cc-e06f699c3024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-unplugged", "status": "completed", "tag": "a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:55.873489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-71017ce8-62dd-4386-8117-c399e9b9d777 req-7be6de53-f122-4c4a-b0cc-e06f699c3024 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:55.874557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-71017ce8-62dd-4386-8117-c399e9b9d777 req-7be6de53-f122-4c4a-b0cc-e06f699c3024 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:55.877971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-71017ce8-62dd-4386-8117-c399e9b9d777 req-7be6de53-f122-4c4a-b0cc-e06f699c3024 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:55.920940 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-71017ce8-62dd-4386-8117-c399e9b9d777 req-7be6de53-f122-4c4a-b0cc-e06f699c3024 service nova] Creating event network-vif-unplugged:a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:37:55.957508 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-71017ce8-62dd-4386-8117-c399e9b9d777 req-7be6de53-f122-4c4a-b0cc-e06f699c3024 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.499324 Oct 31 15:37:55.964080 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2327/4516] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:37:56.282772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:56.283866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:56.313647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:56.314158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:56.321720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:56.322501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:56.322989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:56.323426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:56.536574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:56.542488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:56.555174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:56.556358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:56.587972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8bc908be-26f8-49f8-87e7-59148dd02d12 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2864 microversion: 2.32 time: 0.793532 Oct 31 15:37:56.601493 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2190/4517] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:55 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2864 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:56.605906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:56.606525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:56.628405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:56.634327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:56.634852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:56.635610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:56.636803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:56.637278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:56.722280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:56.731733 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-489ee411-a3b2-4d62-aa60-6dc81113811c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1676 microversion: 2.1 time: 0.456054 Oct 31 15:37:56.733543 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2328/4518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:56 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1676 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:56.738647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-df43da34-44c6-43a8-8f6c-6fec1b3ca758 req-fb8e0545-2669-4b67-a226-c2a1523fb338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-deleted", "tag": "4aea9160-063a-4d76-83d9-228c713aee2b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:56.748900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-df43da34-44c6-43a8-8f6c-6fec1b3ca758 req-fb8e0545-2669-4b67-a226-c2a1523fb338 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:56.749860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-df43da34-44c6-43a8-8f6c-6fec1b3ca758 req-fb8e0545-2669-4b67-a226-c2a1523fb338 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:56.750610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-df43da34-44c6-43a8-8f6c-6fec1b3ca758 req-fb8e0545-2669-4b67-a226-c2a1523fb338 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:56.764536 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-df43da34-44c6-43a8-8f6c-6fec1b3ca758 req-fb8e0545-2669-4b67-a226-c2a1523fb338 service nova] Creating event network-vif-deleted:4aea9160-063a-4d76-83d9-228c713aee2b for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:37:56.770779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-df43da34-44c6-43a8-8f6c-6fec1b3ca758 req-fb8e0545-2669-4b67-a226-c2a1523fb338 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035656 Oct 31 15:37:56.771924 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2329/4519] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:56.943368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:57.489737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:57.505912 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a04df1e1-cf7c-439b-a04a-075d7873145b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1366 microversion: 2.1 time: 0.911680 Oct 31 15:37:57.507833 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2191/4520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:56 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1366 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:57.620143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:57.622078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:57.630492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:57.640777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.641253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.641691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:57.643020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.643739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.644406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:57.761516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:57.762502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:57.770858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.773081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.781865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:57.789909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:57.790514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:57.791042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:58.095386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:58.109026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:58.110492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:58.111744 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9cbc7f3d-e9cd-4aab-8d41-13b43b7c9588 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2750 microversion: 2.32 time: 0.496404 Oct 31 15:37:58.112327 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2330/4521] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:57 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2750 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:58.130717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-cd2805a9-61ce-4548-a9fc-f50ddcbcd1d7 req-5a7168bf-0f4d-4c05-873d-80241db1a222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-unplugged", "status": "completed", "tag": "ac976b0a-a5d1-4612-95b6-4eb2f35daf6d"}, {"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-unplugged", "status": "completed", "tag": "9d85ca81-1622-439d-857b-1c0c99b29b1a"}, {"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-unplugged", "status": "completed", "tag": "a2bb9ed6-823d-43a5-b740-495112886f87"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:58.167125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cd2805a9-61ce-4548-a9fc-f50ddcbcd1d7 req-5a7168bf-0f4d-4c05-873d-80241db1a222 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:58.167895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cd2805a9-61ce-4548-a9fc-f50ddcbcd1d7 req-5a7168bf-0f4d-4c05-873d-80241db1a222 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:58.168499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cd2805a9-61ce-4548-a9fc-f50ddcbcd1d7 req-5a7168bf-0f4d-4c05-873d-80241db1a222 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:58.198710 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cd2805a9-61ce-4548-a9fc-f50ddcbcd1d7 req-5a7168bf-0f4d-4c05-873d-80241db1a222 service nova] Creating event network-vif-unplugged:ac976b0a-a5d1-4612-95b6-4eb2f35daf6d for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:37:58.199527 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cd2805a9-61ce-4548-a9fc-f50ddcbcd1d7 req-5a7168bf-0f4d-4c05-873d-80241db1a222 service nova] Creating event network-vif-unplugged:9d85ca81-1622-439d-857b-1c0c99b29b1a for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:37:58.200254 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cd2805a9-61ce-4548-a9fc-f50ddcbcd1d7 req-5a7168bf-0f4d-4c05-873d-80241db1a222 service nova] Creating event network-vif-unplugged:a2bb9ed6-823d-43a5-b740-495112886f87 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:37:58.207133 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-cd2805a9-61ce-4548-a9fc-f50ddcbcd1d7 req-5a7168bf-0f4d-4c05-873d-80241db1a222 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.093543 Oct 31 15:37:58.208086 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2331/4522] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:58.535430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:58.543346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:58.554340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:58.561523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:58.562321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:58.563407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:58.564375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:58.565269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:58.569821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:58.738420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:58.749594 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6937fa52-6ab7-494d-a700-b21e9f8fcd66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1676 microversion: 2.1 time: 0.992065 Oct 31 15:37:58.751792 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2192/4523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:57 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1676 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:58.796699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-53cdf98d-7444-49bd-81e0-b7b94b59d9b3 req-eadf8027-333e-4ab2-919c-73bb2b22ed68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-deleted", "tag": "a2bb9ed6-823d-43a5-b740-495112886f87"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:37:58.813078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-53cdf98d-7444-49bd-81e0-b7b94b59d9b3 req-eadf8027-333e-4ab2-919c-73bb2b22ed68 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:58.816513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-53cdf98d-7444-49bd-81e0-b7b94b59d9b3 req-eadf8027-333e-4ab2-919c-73bb2b22ed68 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:58.817122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-53cdf98d-7444-49bd-81e0-b7b94b59d9b3 req-eadf8027-333e-4ab2-919c-73bb2b22ed68 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:58.842733 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-53cdf98d-7444-49bd-81e0-b7b94b59d9b3 req-eadf8027-333e-4ab2-919c-73bb2b22ed68 service nova] Creating event network-vif-deleted:a2bb9ed6-823d-43a5-b740-495112886f87 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:37:58.845639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:58.858007 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-475f4a4e-3e5a-4bf8-9d3f-2581c9be4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1366 microversion: 2.1 time: 0.326808 Oct 31 15:37:58.859253 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2332/4524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:58 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:37:58.863042 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-53cdf98d-7444-49bd-81e0-b7b94b59d9b3 req-eadf8027-333e-4ab2-919c-73bb2b22ed68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070062 Oct 31 15:37:58.863669 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2193/4525] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:37:59.151462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:59.152089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:59.154128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:59.166461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:59.166967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:59.167405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:59.168123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:59.168583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:59.169010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:59.374959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:59.385297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:59.387045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:37:59.388531 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1a76a93-9509-4fef-a1e7-d479d87f9366 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2589 microversion: 2.32 time: 0.242545 Oct 31 15:37:59.388963 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2333/4526] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:37:59 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2589 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:37:59.779926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:59.782995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:59.798193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:37:59.804761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:59.805374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:59.805825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:59.806696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:59.807163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:59.808249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:59.888829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:37:59.889965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:37:59.917636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:59.919372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:59.921833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:37:59.926366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:37:59.929255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:37:59.930050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.168081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:00.187510 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9fedcd16-6f88-43e4-9979-47ec7ad52fb6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1653 microversion: 2.1 time: 0.415645 Oct 31 15:38:00.188103 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2194/4527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:59 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1653 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:00.217966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc6ce3f9-1092-414c-ada8-f06a7fa606c1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:00.236683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6ce3f9-1092-414c-ada8-f06a7fa606c1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.237242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6ce3f9-1092-414c-ada8-f06a7fa606c1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.237727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc6ce3f9-1092-414c-ada8-f06a7fa606c1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.271143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:00.280382 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23f642de-2600-4372-871d-66b6956fd206 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1366 microversion: 2.1 time: 0.401619 Oct 31 15:38:00.282149 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2334/4528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:37:59 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:00.286977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-88fd7997-1175-4ef5-9ffc-297fb1e7f0b5 req-480a5c3e-7b89-4d47-be7a-e793f2106615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420aeaad-1dec-4179-aa64-f2785da16514", "name": "network-vif-plugged", "status": "completed", "tag": "cf4e8e15-08e1-4ddf-ba24-102fa5db34d8"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:00.309667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc6ce3f9-1092-414c-ada8-f06a7fa606c1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Going to try to start instance {{(pid=120588) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:38:00.315250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88fd7997-1175-4ef5-9ffc-297fb1e7f0b5 req-480a5c3e-7b89-4d47-be7a-e793f2106615 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.322534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88fd7997-1175-4ef5-9ffc-297fb1e7f0b5 req-480a5c3e-7b89-4d47-be7a-e793f2106615 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.323029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88fd7997-1175-4ef5-9ffc-297fb1e7f0b5 req-480a5c3e-7b89-4d47-be7a-e793f2106615 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.346071 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-88fd7997-1175-4ef5-9ffc-297fb1e7f0b5 req-480a5c3e-7b89-4d47-be7a-e793f2106615 service nova] Creating event network-vif-plugged:cf4e8e15-08e1-4ddf-ba24-102fa5db34d8 for instance 420aeaad-1dec-4179-aa64-f2785da16514 on n-h2-858384-17 Oct 31 15:38:00.359864 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-88fd7997-1175-4ef5-9ffc-297fb1e7f0b5 req-480a5c3e-7b89-4d47-be7a-e793f2106615 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075933 Oct 31 15:38:00.360511 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2335/4529] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:00.400715 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc6ce3f9-1092-414c-ada8-f06a7fa606c1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/action" status: 202 len: 0 microversion: 2.1 time: 0.191417 Oct 31 15:38:00.401713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2195/4530] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:38:00 2022] POST /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:38:00.416078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:00.416804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:00.436243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:00.438287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.438788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.439643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:00.442884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.447377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.448181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.449347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.463139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.465020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.467471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:00.471766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:00.471766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:00.480862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:01.125277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:01.140716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:01.145074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:01.149103 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4193d4f2-227e-4085-8961-ab00ac36da9a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2542 microversion: 2.32 time: 0.726740 Oct 31 15:38:01.150864 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2196/4531] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:00 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2542 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:01.159376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ef8e2448-fed5-4d41-b60f-151bfa54a7f4 req-aa69ef49-669f-421a-bd60-c7b15989764e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-deleted", "tag": "a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:01.195502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef8e2448-fed5-4d41-b60f-151bfa54a7f4 req-aa69ef49-669f-421a-bd60-c7b15989764e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:01.199461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef8e2448-fed5-4d41-b60f-151bfa54a7f4 req-aa69ef49-669f-421a-bd60-c7b15989764e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:01.201700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef8e2448-fed5-4d41-b60f-151bfa54a7f4 req-aa69ef49-669f-421a-bd60-c7b15989764e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:01.222997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:01.239477 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ef8e2448-fed5-4d41-b60f-151bfa54a7f4 req-aa69ef49-669f-421a-bd60-c7b15989764e service nova] Creating event network-vif-deleted:a1a3cb12-ffeb-46c2-9c3f-62f49ede2d03 for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:38:01.241297 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2de18dc-4f7c-4f41-8575-8509f4d53285 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1662 microversion: 2.1 time: 0.833347 Oct 31 15:38:01.257667 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2336/4532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:00 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1662 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:01.259287 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ef8e2448-fed5-4d41-b60f-151bfa54a7f4 req-aa69ef49-669f-421a-bd60-c7b15989764e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107157 Oct 31 15:38:01.261993 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2197/4533] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:01.313981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:01.314727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:01.337297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:01.341038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:01.348409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:01.349308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:01.355413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:01.356408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:01.974086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:01.988358 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e4c370e-4b5f-41c2-a51e-ac759bb8885b tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1366 microversion: 2.1 time: 0.683984 Oct 31 15:38:01.997565 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2337/4534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:01 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1366 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:02.189565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:02.190473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:02.207335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:02.208773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:02.210479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:02.212043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:02.214371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:02.215090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:02.270077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:02.270690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:02.280687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:02.281254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:02.281723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:02.286057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:02.287767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:02.289089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:02.338852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:02.348832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:02.363013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:02.364857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:02.367773 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-78611fc6-d489-4991-8f8a-3f493b13bc1d tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 2142 microversion: 2.32 time: 0.190549 Oct 31 15:38:02.369209 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2198/4535] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:02 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 2142 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:02.565199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:02.578030 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f13cfe5-b014-4246-8ee2-77e1ea7ef68d tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1662 microversion: 2.1 time: 0.309218 Oct 31 15:38:02.579013 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2338/4536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:02 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1662 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:03.015679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:03.016738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:03.026442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.027557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.030565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.031644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.033379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.035189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.279724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:03.291123 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1567124a-dc10-4a0a-9bb5-c974c86070f8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1555 microversion: 2.1 time: 0.280797 Oct 31 15:38:03.292416 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2339/4537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:03 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:03.299647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7675c8b8-199f-43a4-84c4-e7eb0004ab9a req-659b00dc-ea8d-411c-b9b6-4c3e7a7137d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-deleted", "tag": "9d85ca81-1622-439d-857b-1c0c99b29b1a"}, {"server_uuid": "d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0", "name": "network-vif-deleted", "tag": "ac976b0a-a5d1-4612-95b6-4eb2f35daf6d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:03.312760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7675c8b8-199f-43a4-84c4-e7eb0004ab9a req-659b00dc-ea8d-411c-b9b6-4c3e7a7137d9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.313476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7675c8b8-199f-43a4-84c4-e7eb0004ab9a req-659b00dc-ea8d-411c-b9b6-4c3e7a7137d9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.314067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7675c8b8-199f-43a4-84c4-e7eb0004ab9a req-659b00dc-ea8d-411c-b9b6-4c3e7a7137d9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.327645 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7675c8b8-199f-43a4-84c4-e7eb0004ab9a req-659b00dc-ea8d-411c-b9b6-4c3e7a7137d9 service nova] Creating event network-vif-deleted:9d85ca81-1622-439d-857b-1c0c99b29b1a for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:38:03.328595 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7675c8b8-199f-43a4-84c4-e7eb0004ab9a req-659b00dc-ea8d-411c-b9b6-4c3e7a7137d9 service nova] Creating event network-vif-deleted:ac976b0a-a5d1-4612-95b6-4eb2f35daf6d for instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 on n-h1-858384-17 Oct 31 15:38:03.330615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97943c07-7f22-410e-8119-3f7efac0b004 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'create', calling method: .version_select at 0x7f16e5571ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1238985358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUdDbfp++E0atj8cmElxTPvj4sATm8U1oh4LZpuLKeXbZdPKsySqtA4X/KQMsQEAR0t49mEaIwHjVQ+hGdbJA8d5MO6pia90UIba2mIM9saLNjCyVjbtVMy02b9IUkDRw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:03.335270 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7675c8b8-199f-43a4-84c4-e7eb0004ab9a req-659b00dc-ea8d-411c-b9b6-4c3e7a7137d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039181 Oct 31 15:38:03.335898 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2340/4538] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:03.352248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0a022c1-50a1-466e-a633-2f1481eb53a8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:03.353084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e0a022c1-50a1-466e-a633-2f1481eb53a8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:03.359527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a022c1-50a1-466e-a633-2f1481eb53a8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.360248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a022c1-50a1-466e-a633-2f1481eb53a8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.360852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a022c1-50a1-466e-a633-2f1481eb53a8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.361813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a022c1-50a1-466e-a633-2f1481eb53a8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.362433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a022c1-50a1-466e-a633-2f1481eb53a8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.363022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0a022c1-50a1-466e-a633-2f1481eb53a8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.367556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-97943c07-7f22-410e-8119-3f7efac0b004 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for project e6a2914e44014bed857d096897727c91. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:38:03.380030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-97943c07-7f22-410e-8119-3f7efac0b004 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for user e0349502a6234609ae5eb4c4a94acf95 and project e6a2914e44014bed857d096897727c91. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:38:03.436295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97943c07-7f22-410e-8119-3f7efac0b004 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.836648 Oct 31 15:38:03.443957 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2199/4539] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:38:02 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:03.469386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:03.473684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:03.488264 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0a022c1-50a1-466e-a633-2f1481eb53a8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151145 Oct 31 15:38:03.489007 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2341/4540] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:38:03 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:03.505162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.507082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.510329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.518221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.520517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.520941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.615234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:03.616535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:03.641056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.641771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.642906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.645631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:03.646185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:03.647375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:03.739511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:03.752148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:03.753677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:03.755518 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23772fd6-d765-4b14-ae41-9c34acffd325 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.316008 Oct 31 15:38:03.770315 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2200/4541] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:03 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:04.373707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:04.383569 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48708faf-adf8-4945-a5ed-c9b86f8f5914 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1666 microversion: 2.1 time: 0.778105 Oct 31 15:38:04.384795 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2342/4542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:03 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1666 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:04.784636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:04.785343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:04.822230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:04.823349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:04.825458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:04.826365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:04.826952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:04.827497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:04.913537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:04.925172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:04.927582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:04.929558 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7fc84c1-aec0-4f06-b928-6812c3f61dc7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.149800 Oct 31 15:38:04.930330 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2201/4543] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:04 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:05.957526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:05.959166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:05.970862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:05.971906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:05.973446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:06.016064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:06.017394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:06.019626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:06.176966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a93e12ed-2dcd-4b47-b5ee-d816fe382f2c req-5693d382-58ad-4dd2-99db-c419b1ae9915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420aeaad-1dec-4179-aa64-f2785da16514", "tag": "cf4e8e15-08e1-4ddf-ba24-102fa5db34d8"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:06.179527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:06.197515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:06.202347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:06.204219 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2641a731-fda8-4d4d-ac69-f6eb098c8fff tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.252134 Oct 31 15:38:06.206541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a93e12ed-2dcd-4b47-b5ee-d816fe382f2c req-5693d382-58ad-4dd2-99db-c419b1ae9915 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:06.207082 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2343/4544] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:05 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:06.208472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a93e12ed-2dcd-4b47-b5ee-d816fe382f2c req-5693d382-58ad-4dd2-99db-c419b1ae9915 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:06.209044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a93e12ed-2dcd-4b47-b5ee-d816fe382f2c req-5693d382-58ad-4dd2-99db-c419b1ae9915 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:06.244896 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a93e12ed-2dcd-4b47-b5ee-d816fe382f2c req-5693d382-58ad-4dd2-99db-c419b1ae9915 service nova] Creating event network-changed:cf4e8e15-08e1-4ddf-ba24-102fa5db34d8 for instance 420aeaad-1dec-4179-aa64-f2785da16514 on n-h2-858384-17 Oct 31 15:38:06.259885 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a93e12ed-2dcd-4b47-b5ee-d816fe382f2c req-5693d382-58ad-4dd2-99db-c419b1ae9915 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087000 Oct 31 15:38:06.260762 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2202/4545] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:38:07.232899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:07.234284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:07.247502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:07.249670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:07.257241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:07.258461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:07.259108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:07.260111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:07.449177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:07.465729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:07.467962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:07.469599 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52696648-bc5a-4870-aa00-9299efe7a567 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.240797 Oct 31 15:38:07.491108 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2344/4546] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:07 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:08.506448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:08.508632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:08.523379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:08.525260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:08.527412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:08.531820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:08.532432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:08.534724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:08.675854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:08.724621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:08.735185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:08.742414 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a1d19cf-eb74-41ab-9a72-b7c8e13ec681 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.236653 Oct 31 15:38:08.755456 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2203/4547] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:08 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:09.783310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:09.783942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:09.799339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:09.800081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:09.800708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:09.801639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:09.802256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:09.806803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:09.925512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:09.937045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:09.938436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:09.939628 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f77a294-b625-4ab8-8b8a-d0db6b3f04cf tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.160555 Oct 31 15:38:09.958103 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2345/4548] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:09 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:10.227236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:10.228067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:10.254232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:10.254739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:10.255181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:10.255910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:10.256542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:10.257013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:10.697711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:10.707198 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3882a24-6400-4bd8-a03f-38b05684afda tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.484218 Oct 31 15:38:10.708104 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2204/4549] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:10 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:10.738029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:10.739034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:10.755387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:10.760257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:10.760909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:10.761838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:10.764748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:10.765408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:10.979475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:10.980090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:10.999444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:11.005444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:11.006617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:11.007880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:11.008361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:11.008952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:11.252196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:11.268527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:11.274374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:11.278199 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e846689-3de4-4516-9fd0-ab18c8e1af6b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.302233 Oct 31 15:38:11.293817 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2205/4550] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:10 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:11.315551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:11.333050 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a770f23-6089-44a5-9cc5-72de6ee455b2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.598697 Oct 31 15:38:11.334944 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2346/4551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:10 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:11.361769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:11.362788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:11.374961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:11.377272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:11.378115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:11.380113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:11.380955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:11.383581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:11.966151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:11.976455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ae90bd3-0131-4374-b1ac-84633e81683a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.619874 Oct 31 15:38:11.983531 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2206/4552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:11 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:12.006871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:12.008286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:12.016550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:12.017481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:12.018634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:12.019593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:12.020256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:12.020975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:12.310839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:12.312076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:12.329360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:12.336110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:12.336649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:12.337459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:12.340759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:12.343900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:12.439094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:12.454447 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-237a7d4d-2193-4e0e-8b01-c63b75cdd9ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.450143 Oct 31 15:38:12.479117 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2347/4553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:12 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:12.589049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:12.603330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:12.604879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:12.606305 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16105e32-8357-4395-be82-e98f0cf2081b tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.300046 Oct 31 15:38:12.618254 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2207/4554] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:12 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:12.862029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1370946872", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fa1888d6-b08a-4260-8505-69a899fd42e4"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:13.008065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] validate_networks() for [('fa1888d6-b08a-4260-8505-69a899fd42e4', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:38:13.635101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:13.635727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:13.644780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:13.659356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:13.662812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:13.667116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:13.669190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:13.671144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:13.671720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:13.906035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:13.921904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:13.924051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:13.925778 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07337159-41e1-4e33-83a1-5988f05c9791 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.295539 Oct 31 15:38:13.944004 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2208/4555] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:13 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:38:14.961326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:14.962481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:14.981811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:14.982857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:14.984979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:14.986603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:14.989476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:14.991093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:15.077329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:15.174815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:15.204012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:15.215371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:15.221113 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ddcd9ff-e3cc-49e7-a887-9169f36687de tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.265779 Oct 31 15:38:15.221762 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2209/4556] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:14 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:15.574125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:38:15.576995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:38:15.584816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:38:15.587595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:38:15.588475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:38:15.608767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:15.617461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:15.618571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:15.619670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:15.620891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:15.621793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:15.664855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:38:15.690602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for user 33e8230d70464e5da2cced0060bb1a31 and project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:38:15.707054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:38:15.712379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:38:15.954057 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1d01ad0-8c47-4bbc-ab49-299a23a3e59b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.097908 Oct 31 15:38:15.960094 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2348/4557] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:38:15.972966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2416cd3-cf83-4259-bd48-44069e2df755 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:15.973745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2416cd3-cf83-4259-bd48-44069e2df755 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:16.216464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2416cd3-cf83-4259-bd48-44069e2df755 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:16.224243 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2416cd3-cf83-4259-bd48-44069e2df755 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1215 microversion: 2.1 time: 0.255719 Oct 31 15:38:16.236008 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2210/4558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:15 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1215 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:16.257507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:16.258047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:16.295665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:16.302103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:16.306555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:16.308713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:16.310940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:16.313264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:16.590396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:16.609236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:16.617819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:16.619061 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-553b92f2-f2bf-4b2d-b430-552c9cbba8d4 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.368546 Oct 31 15:38:16.639929 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2349/4559] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:16 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:17.266806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64bc1c59-3681-447d-89db-48e32ae3b1dd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:17.267430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64bc1c59-3681-447d-89db-48e32ae3b1dd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:17.493503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-64bc1c59-3681-447d-89db-48e32ae3b1dd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:17.506378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64bc1c59-3681-447d-89db-48e32ae3b1dd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1215 microversion: 2.1 time: 0.239163 Oct 31 15:38:17.509200 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2211/4560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:17 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:17.649842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:17.650722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:17.679329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:17.690400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:17.692760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:17.692760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:17.693104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:17.714485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:18.009895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:18.039086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:18.046326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:18.047580 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7846badd-2471-4da8-8db4-482f38f343e2 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.403681 Oct 31 15:38:18.061769 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2350/4561] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:17 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:18.535408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:18.536104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:18.554035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:18.557478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:18.558977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:18.564438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:18.565180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:18.569078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:19.079692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:19.080449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:19.106918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:19.111333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:19.113598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:19.114520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:19.125069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:19.125069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:19.252366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:19.274987 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c787881-b06c-446d-a16b-89ee8c37b4d1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1275 microversion: 2.1 time: 0.744635 Oct 31 15:38:19.276836 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2212/4562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:18 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1275 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:19.615952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:19.630444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:19.634604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:19.635828 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c0a0502d-712b-4adb-b96c-cc1805b97b50 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.560382 Oct 31 15:38:19.636859 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2351/4563] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:19 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:20.305642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:20.308174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:20.322136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:20.330934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:20.334254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:20.336217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:20.337058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:20.337965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:20.670880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:20.672080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:20.681731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:20.691268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:20.695682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:20.705348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:20.706832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:20.714302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:21.087169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:21.113985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:21.116068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:21.142828 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd18ab5a-8e24-4463-aaa6-81ca30680173 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.474397 Oct 31 15:38:21.143382 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2352/4564] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:20 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:21.173638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-749588072", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "df5755a4-7b25-4294-8974-33d3b00936e7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1238985358", "security_groups": [{"name": "tempest-secgroup-smoke-20433569"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:21.212344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:21.225009 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4614d80a-d07d-45d1-97d0-d46ddd369d1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1315 microversion: 2.1 time: 0.925920 Oct 31 15:38:21.229412 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2213/4565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:20 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:21.480974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] validate_networks() for [('df5755a4-7b25-4294-8974-33d3b00936e7', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:38:21.886361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-20029db8-62a3-4522-996e-564ff56c032b req-0dd6eb9a-139a-4f3b-a0c2-e26e1c8a93a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8f579b-16d0-4f84-a831-72307d67c783", "tag": "a1ee2140-af19-41a8-a66e-c9e3e811adea"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:21.919197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-20029db8-62a3-4522-996e-564ff56c032b req-0dd6eb9a-139a-4f3b-a0c2-e26e1c8a93a9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:21.925934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-20029db8-62a3-4522-996e-564ff56c032b req-0dd6eb9a-139a-4f3b-a0c2-e26e1c8a93a9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:21.933826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-20029db8-62a3-4522-996e-564ff56c032b req-0dd6eb9a-139a-4f3b-a0c2-e26e1c8a93a9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:21.972192 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-20029db8-62a3-4522-996e-564ff56c032b req-0dd6eb9a-139a-4f3b-a0c2-e26e1c8a93a9 service nova] Creating event network-changed:a1ee2140-af19-41a8-a66e-c9e3e811adea for instance ed8f579b-16d0-4f84-a831-72307d67c783 on n-h1-858384-17 Oct 31 15:38:21.994981 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-20029db8-62a3-4522-996e-564ff56c032b req-0dd6eb9a-139a-4f3b-a0c2-e26e1c8a93a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112494 Oct 31 15:38:21.995903 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2214/4566] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:38:22.175860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:22.176565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:22.194570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:22.195066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:22.195503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:22.207036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:22.216757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:22.217522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:22.378226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:38:22.378781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:38:22.379307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:38:22.379728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:38:22.380139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:38:22.392793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:22.399625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:22.400421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:22.401489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:22.402172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:22.402852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:22.442129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for project e6a2914e44014bed857d096897727c91. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:38:22.455404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for user e0349502a6234609ae5eb4c4a94acf95 and project e6a2914e44014bed857d096897727c91. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:38:22.462411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:22.477529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:22.480424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:22.485649 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6d76a11e-e887-4cc8-a592-b40b09bec028 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.312986 Oct 31 15:38:22.491714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:38:22.494324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:38:22.506457 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2215/4567] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:22 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:38:22.538380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:22.539078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:22.566626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:22.577029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:22.581933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:22.583164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:22.593498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:22.594272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:22.640922 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef6073c3-7d1e-4fa2-b220-9f3d691c4306 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.471110 Oct 31 15:38:22.641610 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2353/4568] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:38:21 2022] POST /compute/v2.1/servers => generated 404 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:38:22.663825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76b363ce-bfca-4975-8ec3-dea48e4c13d8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:22.674484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76b363ce-bfca-4975-8ec3-dea48e4c13d8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:22.838003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76b363ce-bfca-4975-8ec3-dea48e4c13d8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:22.853833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76b363ce-bfca-4975-8ec3-dea48e4c13d8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1266 microversion: 2.1 time: 0.193746 Oct 31 15:38:22.871499 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2354/4569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:22 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:23.232093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:23.247336 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d32edaf-5e5e-45b8-a02f-a6d11ed7f772 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1315 microversion: 2.1 time: 0.737236 Oct 31 15:38:23.269766 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2216/4570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:22 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:23.516345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:23.517039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:23.527734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:23.528237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:23.532672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:23.537672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:23.539802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:23.541508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:23.711289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:23.726291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:23.729259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:23.731439 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-efb348bb-8762-489c-998d-f69ae3ab104f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.219512 Oct 31 15:38:23.732623 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2355/4571] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:23 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:23.884151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:23.885610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:23.900757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:23.901855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:23.902553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:23.903568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:23.904256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:23.905105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:24.012731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:24.038867 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-060d5cae-63dc-4703-8869-c1a6289becc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1270 microversion: 2.1 time: 0.159970 Oct 31 15:38:24.082189 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2217/4572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:23 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:24.275834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:24.277044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:24.293648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:24.294735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:24.295418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:24.296741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:24.297559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:24.298289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:24.558004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:24.573219 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8b4e18e-83bb-499b-bfef-5123d8c03a0e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1315 microversion: 2.1 time: 0.302388 Oct 31 15:38:24.574655 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2356/4573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:24 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:24.759834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:24.760991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:24.774877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:24.776415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:24.778661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:24.779614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:24.781631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:24.783940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:25.049937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:25.069427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:25.079031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:25.082791 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0bb7611a-0a2e-48cb-b28a-3fb33c1fafbb tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.327983 Oct 31 15:38:25.089296 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2218/4574] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:24 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:25.106216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:25.107137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:25.116969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:25.117662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:25.118207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:25.119037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:25.119946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:25.120866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:25.262039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:25.270384 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aa6461c8-ef96-417e-8198-47887219c840 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1324 microversion: 2.1 time: 0.168523 Oct 31 15:38:25.272748 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2357/4575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:25 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:25.600021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:25.601959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:25.626297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:25.627719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:25.628933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:25.629921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:25.631413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:25.633063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:26.018235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:26.038693 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c193e1d6-a04d-4f70-abd6-efc784c9f36f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1315 microversion: 2.1 time: 0.442590 Oct 31 15:38:26.041836 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2219/4576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:25 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:26.128317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:26.128928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:26.145682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:26.146199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:26.153854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:26.154634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:26.155124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:26.160486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:26.236557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:26.300500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:26.301366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:26.320645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:26.322498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:26.322968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:26.323714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:26.324181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:26.324613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:26.406878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:26.418827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:26.436793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:26.438388 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a0c80f9-be3f-4fcb-a7aa-91deceecde20 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.323769 Oct 31 15:38:26.439461 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2358/4577] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:26 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:26.591776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:26.604167 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb745cd2-6345-4ed0-819b-c75cd3fc5d96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1390 microversion: 2.1 time: 0.308958 Oct 31 15:38:26.605263 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2220/4578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:26 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1390 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:27.067276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:27.068450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:27.096675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:27.097262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:27.097723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:27.103539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:27.103732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:27.104344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:27.468143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:27.468759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:27.479924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:27.480420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:27.480859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:27.481597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:27.482053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:27.482476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:27.508160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:27.621592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:27.636385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:27.638264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:27.640058 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6ba1cb33-cacc-4bbd-bde1-5f77138c2f8a tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.176020 Oct 31 15:38:27.641245 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2221/4579] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:27 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:38:27.651396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:27.652289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:27.671172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:27.672571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:27.675181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:27.677265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:27.680663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:27.681855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:27.730392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:27.740274 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0014b73-02bb-484d-a480-8992b91c7e6e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1315 microversion: 2.1 time: 0.676719 Oct 31 15:38:27.745458 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2359/4580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:27 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:27.967224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:27.978379 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-642cf5bc-8ad8-4b63-bc6c-79efdc3deee0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1390 microversion: 2.1 time: 0.335863 Oct 31 15:38:27.983943 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2222/4581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:27 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1390 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:28.294406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-66d9f250-1a91-483a-a2fa-c39d09da3352 req-5bd5ae54-30c3-4621-8aaf-cd93b7aa443b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8f579b-16d0-4f84-a831-72307d67c783", "name": "network-vif-plugged", "status": "completed", "tag": "a1ee2140-af19-41a8-a66e-c9e3e811adea"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:28.325686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-66d9f250-1a91-483a-a2fa-c39d09da3352 req-5bd5ae54-30c3-4621-8aaf-cd93b7aa443b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.330500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-66d9f250-1a91-483a-a2fa-c39d09da3352 req-5bd5ae54-30c3-4621-8aaf-cd93b7aa443b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.335147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-66d9f250-1a91-483a-a2fa-c39d09da3352 req-5bd5ae54-30c3-4621-8aaf-cd93b7aa443b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:28.370049 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-66d9f250-1a91-483a-a2fa-c39d09da3352 req-5bd5ae54-30c3-4621-8aaf-cd93b7aa443b service nova] Creating event network-vif-plugged:a1ee2140-af19-41a8-a66e-c9e3e811adea for instance ed8f579b-16d0-4f84-a831-72307d67c783 on n-h1-858384-17 Oct 31 15:38:28.385116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-66d9f250-1a91-483a-a2fa-c39d09da3352 req-5bd5ae54-30c3-4621-8aaf-cd93b7aa443b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094489 Oct 31 15:38:28.387561 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2360/4582] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:28.396985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7b3366dc-264a-4314-a6e1-ae2f7f4f5f96 req-6420eee5-005d-407d-91b2-89b907396458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391f5764-ac2b-41ae-8f1d-76f294d4b6ba", "tag": "91a3aca2-1006-42f3-af44-4ec383fe9205"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:28.418370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7b3366dc-264a-4314-a6e1-ae2f7f4f5f96 req-6420eee5-005d-407d-91b2-89b907396458 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.419103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7b3366dc-264a-4314-a6e1-ae2f7f4f5f96 req-6420eee5-005d-407d-91b2-89b907396458 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.420184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7b3366dc-264a-4314-a6e1-ae2f7f4f5f96 req-6420eee5-005d-407d-91b2-89b907396458 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:28.437640 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7b3366dc-264a-4314-a6e1-ae2f7f4f5f96 req-6420eee5-005d-407d-91b2-89b907396458 service nova] Creating event network-changed:91a3aca2-1006-42f3-af44-4ec383fe9205 for instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba on n-h2-858384-17 Oct 31 15:38:28.446756 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7b3366dc-264a-4314-a6e1-ae2f7f4f5f96 req-6420eee5-005d-407d-91b2-89b907396458 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053823 Oct 31 15:38:28.451709 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2223/4583] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:28.672862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:28.673771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:28.694984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.695661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.700709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:28.704847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.706114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.707044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:28.772398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:28.774029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:28.794974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.801314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.806206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:28.807975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:28.810150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:28.814727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:29.003594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:29.018378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:29.035584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:29.036924 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c03e356-de38-44e1-a5ce-c31dd2563160 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1603 microversion: 2.32 time: 0.368290 Oct 31 15:38:29.045700 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2361/4584] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:28 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1603 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:29.056121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:29.057168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:29.066228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:29.075992 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3b6ce68-c80a-44c4-b827-454c1aaf0abc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1315 microversion: 2.1 time: 0.309663 Oct 31 15:38:29.089156 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2224/4585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:28 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:29.089356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:29.089356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:29.089356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:29.089356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:29.089356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:29.089356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:29.284124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:29.294895 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2547469-fcc2-4b7f-8f4a-ecbbe7c6a1e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1390 microversion: 2.1 time: 0.247252 Oct 31 15:38:29.296282 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2362/4586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:29 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1390 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:30.063883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:30.065146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:30.068959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:30.076529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.077079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.077817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.078616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.079126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.079679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.112519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:30.113029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:30.117457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.118260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.118699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.119153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lazy-loading 'fault' on Instance uuid d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:38:30.126840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:30.130635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.131210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.131652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.132367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.132830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.135487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.174935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:30.185613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:30.193154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bee445dd89f544f8b866432dcc0f1ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25561007bb4e22921c780c727fd86c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:30.197680 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32c5e0ce-7ad5-439f-9a1e-05fd8fd72353 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 200 len: 1608 microversion: 2.32 time: 0.137662 Oct 31 15:38:30.198819 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2225/4587] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:30 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 1608 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:38:30.322656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:30.323267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:30.333277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.335910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.337770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.338736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.340764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.342546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.405179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:30.423090 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5a6a194f-8bf0-4b40-80b0-a477cf7c74b0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1503 microversion: 2.1 time: 0.315937 Oct 31 15:38:30.423691 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2363/4588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:30 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1503 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:30.454792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:30.455854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:30.464147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.464827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.465554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.466382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:30.466902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:30.467564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:30.566417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:30.580523 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1503f63d-23cd-41d1-9a9a-a7ca994b6729 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1390 microversion: 2.1 time: 0.261796 Oct 31 15:38:30.594228 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2226/4589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:30 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1390 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:30.839722 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Removing security group 1105de05-3e50-4e59-baf9-c72c599af399 from port a1ee2140-af19-41a8-a66e-c9e3e811adea Oct 31 15:38:31.230388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:31.231652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:31.240973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.241835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.242550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:31.243454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.244109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.244728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:31.261143 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] HTTP exception thrown: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Request method failure captured: Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 HTTP/1.1 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-o2YgDm2LLfhvE-X7h9QWYLhT06SXBkvHMpYtBZfngPmbM1BGjUWEwiUNAvS5ZAUp04hMX-yX9Pzho4JDRzuPcdplcwWqk1swIcp8NF4CtncLa63U_WwV_aMpwvceijNnd9zLATWNzq_sWuyRDpuORcJd17bohjWDodBuSuDJPQ1b0 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.32 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 4f25561007bb4e22921c780c727fd86c Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TaggedBootDevicesTest-1758366551 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f25561007bb4e22921c780c727fd86c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4f25561007bb4e22921c780c727fd86c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f25561007bb4e22921c780c727fd86c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4f25561007bb4e22921c780c727fd86c"}]}] Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TaggedBootDevicesTest-1758366551 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 4f25561007bb4e22921c780c727fd86c Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1758366551 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TaggedBootDevicesTest-1758366551-project Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: bee445dd89f544f8b866432dcc0f1ec1 Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TaggedBootDevicesTest-1758366551-project Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'd51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0'} Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:31.263151 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:31.267583 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:31.267583 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:31.267583 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:31.267583 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:31.267583 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:38:31.267583 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:38:31.267583 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:31.267583 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:31.269435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Returning 404 to user: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:38:31.270645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-66864c42-55e2-4430-834d-f6be63cfcd2f tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 404 len: 111 microversion: 2.32 time: 0.046495 Oct 31 15:38:31.271952 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2227/4590] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:31 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:38:31.281816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-700bde45-6845-4ccf-a373-42c6bf742887 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '.version_select at 0x7f16e041d0d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:31.303714 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-700bde45-6845-4ccf-a373-42c6bf742887 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806860877" status: 204 len: 0 microversion: 2.32 time: 0.026090 Oct 31 15:38:31.304076 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2228/4591] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Oct 31 15:38:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806860877 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:38:31.432703 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba63c330-3e26-48c3-ad0a-9d598d5587f9 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783/action" status: 202 len: 0 microversion: 2.1 time: 0.984153 Oct 31 15:38:31.439108 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2364/4592] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:38:30 2022] POST /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783/action => generated 0 bytes in 995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:38:31.445821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:31.446580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:31.455987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.457273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.458088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:31.459090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.459779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.460799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:31.721204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:31.743504 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7124b9e2-397f-48c1-b472-78f21e60f5f8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1461 microversion: 2.1 time: 0.298526 Oct 31 15:38:31.745210 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2229/4593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:31 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1461 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:31.762367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-23cfc8f0-cbf6-49f4-a1d6-49eef4199f6e req-bb1f6fcd-06f8-4649-a67b-356f97b40021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed8f579b-16d0-4f84-a831-72307d67c783", "tag": "a1ee2140-af19-41a8-a66e-c9e3e811adea"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:31.763105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:31.763738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:31.779330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.781722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.783351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:31.785243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.785751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.786183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:31.788548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-23cfc8f0-cbf6-49f4-a1d6-49eef4199f6e req-bb1f6fcd-06f8-4649-a67b-356f97b40021 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.791042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-23cfc8f0-cbf6-49f4-a1d6-49eef4199f6e req-bb1f6fcd-06f8-4649-a67b-356f97b40021 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.791757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-23cfc8f0-cbf6-49f4-a1d6-49eef4199f6e req-bb1f6fcd-06f8-4649-a67b-356f97b40021 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:31.828892 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-23cfc8f0-cbf6-49f4-a1d6-49eef4199f6e req-bb1f6fcd-06f8-4649-a67b-356f97b40021 service nova] Creating event network-changed:a1ee2140-af19-41a8-a66e-c9e3e811adea for instance ed8f579b-16d0-4f84-a831-72307d67c783 on n-h1-858384-17 Oct 31 15:38:31.845409 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-23cfc8f0-cbf6-49f4-a1d6-49eef4199f6e req-bb1f6fcd-06f8-4649-a67b-356f97b40021 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391710 Oct 31 15:38:31.867762 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2365/4594] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:31.876146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:31.880875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:31.900958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.901842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.902625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:31.905028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:31.905881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:31.906574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:32.139036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:32.143242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:32.157411 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-472f8815-48ff-4d0f-90ce-3d6bb24fdc6b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1390 microversion: 2.1 time: 0.407207 Oct 31 15:38:32.158841 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2230/4595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:31 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1390 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:32.287364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:32.303824 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f6efbb5f-b630-4394-96a8-7afca56eceaa tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.429498 Oct 31 15:38:32.317460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2366/4596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:31 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:32.332335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:32.332937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:32.351253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:32.352007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:32.352636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:32.353541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:32.354858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:32.355715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:32.617820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:32.626697 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-012f4097-507f-4955-b72f-d836c97f1568 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.298547 Oct 31 15:38:32.627533 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2231/4597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:32 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:32.652215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:32.652827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:32.660097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:32.664282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:32.665431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:32.666501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:32.667905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:32.668418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:32.668851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:32.855896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=14 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:32.964140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:32.972247 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc5bbc58-5168-48c7-aaf7-5f11750f7d69 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.324055 Oct 31 15:38:32.997562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:32.998179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:33.003819 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2367/4598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:32 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:33.009292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:33.010029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:33.010631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:33.011546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:33.012168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:33.012755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:33.191707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:33.192711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:33.204494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:33.209665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:33.211347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:33.213413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:33.214294 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-765a98a4-2b66-43fb-980c-04f7c4a98c75 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.220712 Oct 31 15:38:33.215949 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2232/4599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:32 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:33.218011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:33.218739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:33.219195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:33.392156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-156867184", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "fa1888d6-b08a-4260-8505-69a899fd42e4"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:33.470188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] validate_networks() for [('fa1888d6-b08a-4260-8505-69a899fd42e4', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:38:33.485171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:33.495049 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4772d576-c1b4-4f98-8b50-2d3db326f091 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1390 microversion: 2.1 time: 0.309492 Oct 31 15:38:33.496544 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2368/4600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:33 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1390 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:34.518614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:34.519229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:34.535585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:34.537438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:34.537969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:34.539207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:34.539888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:34.540747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:34.840015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:34.859600 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-766b3a59-0a98-4e26-a960-7c2abff1fe2e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1390 microversion: 2.1 time: 0.344539 Oct 31 15:38:34.879295 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2369/4601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:34 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1390 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:34.949476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:38:34.951452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:38:34.952391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:38:34.952976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:38:34.954075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:38:34.965570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:34.966068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:34.966626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:34.967686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:34.968093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:34.968525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:34.989964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:38:34.996796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Getting quotas for user 33e8230d70464e5da2cced0060bb1a31 and project f99b34e7ae9b44b5a9666b17fa41570e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:38:35.012536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:38:35.015193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:38:35.091214 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e6afc684-37b0-4974-86d0-cb3b9498a709 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703445 Oct 31 15:38:35.092965 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2233/4602] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:38:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:38:35.109581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff7e0897-a222-4fbb-99ba-05e1e7de1aca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:35.110975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff7e0897-a222-4fbb-99ba-05e1e7de1aca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:35.216350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff7e0897-a222-4fbb-99ba-05e1e7de1aca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:35.226564 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff7e0897-a222-4fbb-99ba-05e1e7de1aca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1214 microversion: 2.1 time: 0.124597 Oct 31 15:38:35.227230 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2370/4603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:35 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:35.891009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:35.891875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:35.908356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:35.909050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:35.909748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:35.936803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:35.937916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:35.939544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:36.251581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:36.252192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:36.259868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:36.269806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:36.270715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:36.271910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:36.272550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:36.273236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:36.455245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:36.474371 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be4f8645-a3f0-4070-b153-b08df5991edb tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1266 microversion: 2.1 time: 0.225986 Oct 31 15:38:36.477451 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2371/4604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:36 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:36.498325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b4252955-a350-4347-8c36-1fca325b8695 req-b2d99f5a-bbf3-4d1a-ad61-515b8fee2eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391f5764-ac2b-41ae-8f1d-76f294d4b6ba", "name": "network-vif-plugged", "status": "completed", "tag": "91a3aca2-1006-42f3-af44-4ec383fe9205"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:36.529665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b4252955-a350-4347-8c36-1fca325b8695 req-b2d99f5a-bbf3-4d1a-ad61-515b8fee2eba service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:36.531422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b4252955-a350-4347-8c36-1fca325b8695 req-b2d99f5a-bbf3-4d1a-ad61-515b8fee2eba service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:36.532746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b4252955-a350-4347-8c36-1fca325b8695 req-b2d99f5a-bbf3-4d1a-ad61-515b8fee2eba service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:36.551790 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b4252955-a350-4347-8c36-1fca325b8695 req-b2d99f5a-bbf3-4d1a-ad61-515b8fee2eba service nova] Creating event network-vif-plugged:91a3aca2-1006-42f3-af44-4ec383fe9205 for instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba on n-h2-858384-17 Oct 31 15:38:36.558216 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b4252955-a350-4347-8c36-1fca325b8695 req-b2d99f5a-bbf3-4d1a-ad61-515b8fee2eba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077182 Oct 31 15:38:36.567039 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2372/4605] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:36.753607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:36.768404 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e95160dc-f66c-4bec-950e-1e1fd6dcb42d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1390 microversion: 2.1 time: 0.880296 Oct 31 15:38:36.769078 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2234/4606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:35 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1390 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:37.503863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:37.504691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:37.519305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.527644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.529433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.530686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.532244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.533081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.608558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04d3aab9-30b0-4fe5-a7f3-c300a8c42ee8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:37.618146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04d3aab9-30b0-4fe5-a7f3-c300a8c42ee8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:37.633731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d3aab9-30b0-4fe5-a7f3-c300a8c42ee8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.634739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d3aab9-30b0-4fe5-a7f3-c300a8c42ee8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.635392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d3aab9-30b0-4fe5-a7f3-c300a8c42ee8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.636165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d3aab9-30b0-4fe5-a7f3-c300a8c42ee8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.636670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d3aab9-30b0-4fe5-a7f3-c300a8c42ee8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.637105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04d3aab9-30b0-4fe5-a7f3-c300a8c42ee8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.679697 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04d3aab9-30b0-4fe5-a7f3-c300a8c42ee8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076463 Oct 31 15:38:37.681051 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2235/4607] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:38:37 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:38:37.755509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:37.756455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:37.763482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.764039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.764492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.765231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.765698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.766126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.798205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:38:37.829318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:37.843388 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f00fb1ff-b0fd-452c-812d-4f0e9542d624 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1272 microversion: 2.1 time: 0.341488 Oct 31 15:38:37.844323 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2373/4608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:37 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:37.859884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:37.860799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:37.868959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.869867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.870873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.871768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.872223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.872962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.969711 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-813e362f-5820-484d-aea9-63b1ee6aaab3 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 204 len: 0 microversion: 2.1 time: 0.218617 Oct 31 15:38:37.970651 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2236/4609] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:38:37 2022] DELETE /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:38:37.977093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:37.977723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:37.985087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.985698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.986137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:37.987204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:37.987832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:37.988426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.006720 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] HTTP exception thrown: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Request method failure captured: Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 HTTP/1.1 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-o2YgDm2LLfhvE-X7h9QWYLhT06SXBkvHMpYtBZfngPmbM1BGjUWEwiUNAvS5ZAUp04hMX-yX9Pzho4JDRzuPcdplcwWqk1swIcp8NF4CtncLa63U_WwV_aMpwvceijNnd9zLATWNzq_sWuyRDpuORcJd17bohjWDodBuSuDJPQ1b0 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.32 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 4f25561007bb4e22921c780c727fd86c Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TaggedBootDevicesTest-1758366551 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f25561007bb4e22921c780c727fd86c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4f25561007bb4e22921c780c727fd86c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f25561007bb4e22921c780c727fd86c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4f25561007bb4e22921c780c727fd86c"}]}] Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TaggedBootDevicesTest-1758366551 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 4f25561007bb4e22921c780c727fd86c Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1758366551 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TaggedBootDevicesTest-1758366551-project Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: bee445dd89f544f8b866432dcc0f1ec1 Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TaggedBootDevicesTest-1758366551-project Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'd51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0'} Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:38:38.008769 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.013638 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.016306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Returning 404 to user: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:38:38.018873 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c55f64b2-25c4-457e-9d86-18e7ad5a61f7 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 404 len: 111 microversion: 2.32 time: 0.045345 Oct 31 15:38:38.026466 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2237/4610] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:38:37 2022] DELETE /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:38:38.035669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:38.037497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:38.045247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.045972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.046640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.048128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.048755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.049382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.181389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:38.190383 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dcbfe254-c526-4ff8-a1ed-697a65beae18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1390 microversion: 2.1 time: 0.339984 Oct 31 15:38:38.195351 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2374/4611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:37 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1390 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:38.209752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:38.210749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] [instance: d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:38.223522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.224334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.224984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.225860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.226458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.226905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.261237 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] HTTP exception thrown: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Request method failure captured: Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 HTTP/1.1 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-o2YgDm2LLfhvE-X7h9QWYLhT06SXBkvHMpYtBZfngPmbM1BGjUWEwiUNAvS5ZAUp04hMX-yX9Pzho4JDRzuPcdplcwWqk1swIcp8NF4CtncLa63U_WwV_aMpwvceijNnd9zLATWNzq_sWuyRDpuORcJd17bohjWDodBuSuDJPQ1b0 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.32 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 4f25561007bb4e22921c780c727fd86c Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TaggedBootDevicesTest-1758366551 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f25561007bb4e22921c780c727fd86c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4f25561007bb4e22921c780c727fd86c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4f25561007bb4e22921c780c727fd86c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4f25561007bb4e22921c780c727fd86c"}]}] Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TaggedBootDevicesTest-1758366551 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 4f25561007bb4e22921c780c727fd86c Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1758366551 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TaggedBootDevicesTest-1758366551-project Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: bee445dd89f544f8b866432dcc0f1ec1 Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TaggedBootDevicesTest-1758366551-project Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'd51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0'} Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.262926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] Returning 404 to user: Instance d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21b8d6a5-706d-4b66-8201-49740fc56091 tempest-TaggedBootDevicesTest-1758366551 tempest-TaggedBootDevicesTest-1758366551-project] 10.222.0.20 "GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0" status: 404 len: 111 microversion: 2.32 time: 0.068008 Oct 31 15:38:38.266959 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2375/4612] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:38:38 2022] GET /compute/v2.1/servers/d51b662a-eb5f-4a4e-8d9c-bda49ce4a7b0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:38:38.480986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:38.489511 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c2b00ae-1e55-42f8-877c-bad5672f9d72 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1672 microversion: 2.1 time: 0.461075 Oct 31 15:38:38.490207 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2238/4613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:38 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1672 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:38.596131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Calling method '.version_select at 0x7f16e02de3a0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:38.597920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.598408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.598950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.626517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.627405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.628071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.640386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.641109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.641797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.648932 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30464834-ba27-4cec-8b03-b6243365ec6d tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727 tempest-PortsAdminExtendedAttrsIpV6TestJSON-388611727-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.382700 Oct 31 15:38:38.650156 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2376/4614] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:38:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:38.868603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:38.870115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:38.885720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.886465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.889742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:38.890760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:38.892072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:38.902114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.221192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:39.222057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:39.236365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.238502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.240155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.241652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.243571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.244112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.551908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:39.559889 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4aced6e4-96a9-4f60-a48b-de5577896c30 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1314 microversion: 2.1 time: 0.695587 Oct 31 15:38:39.565351 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2239/4615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:38 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:39.588090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:39.589089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:39.604506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.605154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.610825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.614441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:39.615124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:39.616625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:39.923632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:39.935898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2c19a409-725d-4ce9-abed-a27b9f6835f8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1672 microversion: 2.1 time: 0.368691 Oct 31 15:38:39.937520 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2240/4616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:39 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1672 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:39.986289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:40.007141 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fce28ff1-50d2-4e6f-8885-913e9efcfb3e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1561 microversion: 2.1 time: 0.789384 Oct 31 15:38:40.029511 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2377/4617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:39 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1561 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:40.037837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:40.039002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:40.058632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:40.059512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:40.060226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:40.061234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:40.061929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:40.062606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:40.347150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:40.356645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a1f6daf9-b99e-478d-8a23-1dc7949a1218 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1561 microversion: 2.1 time: 0.322842 Oct 31 15:38:40.362501 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2241/4618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:40 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1561 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:40.591999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:40.592601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:40.609862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:40.610356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:40.610931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:40.612762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:40.612762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:40.619724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:40.967465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:40.968072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:40.981403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:40.981891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:40.982336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:40.989497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:40.990146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:40.990468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:41.249438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:41.259638 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a9e3c31a-f491-4b58-b5be-143b1a3b5922 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1314 microversion: 2.1 time: 0.671425 Oct 31 15:38:41.263372 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2378/4619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:40 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:41.496570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-db015893-da10-42de-af1d-83be68e22b6a req-bec11f43-eece-493d-9722-129a94aeef9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bcd62cd-e056-43e8-acc4-698383847102", "tag": "04a4cc6f-4902-4b74-84ac-1a54db96dfdd"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:41.509720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-db015893-da10-42de-af1d-83be68e22b6a req-bec11f43-eece-493d-9722-129a94aeef9f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:41.510204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-db015893-da10-42de-af1d-83be68e22b6a req-bec11f43-eece-493d-9722-129a94aeef9f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:41.510654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-db015893-da10-42de-af1d-83be68e22b6a req-bec11f43-eece-493d-9722-129a94aeef9f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:41.542852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:41.545457 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-db015893-da10-42de-af1d-83be68e22b6a req-bec11f43-eece-493d-9722-129a94aeef9f service nova] Creating event network-changed:04a4cc6f-4902-4b74-84ac-1a54db96dfdd for instance 9bcd62cd-e056-43e8-acc4-698383847102 on n-h1-858384-17 Oct 31 15:38:41.554327 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-db015893-da10-42de-af1d-83be68e22b6a req-bec11f43-eece-493d-9722-129a94aeef9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061651 Oct 31 15:38:41.554957 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2379/4620] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:38:41.710416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:41.726693 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aed7bf18-e189-432b-8e06-38ff5c2f1438 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1672 microversion: 2.1 time: 0.762923 Oct 31 15:38:41.727874 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2242/4621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:40 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1672 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:42.292419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:42.294527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:42.311438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:42.312014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:42.312521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:42.313470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:42.314002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:42.315503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:42.759980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:42.760644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:42.779286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:42.779787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:42.780286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:42.781427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:42.781898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:42.782756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:42.874442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:42.885972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-17dc06b3-a49e-4f76-b339-28d341f00df8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1604 microversion: 2.1 time: 0.132632 Oct 31 15:38:42.888216 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2243/4622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:42 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:42.933537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:42.943427 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8d614ae6-f86a-4767-8ea0-77569802d655 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1314 microversion: 2.1 time: 0.659462 Oct 31 15:38:42.968125 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2380/4623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:42 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:43.440018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-973248d0-5197-40b6-8bbd-e9a887f879b2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c12235e7-1a90-4f30-a08f-645f72ef28d3"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:43.446489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-973248d0-5197-40b6-8bbd-e9a887f879b2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:43.455819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-973248d0-5197-40b6-8bbd-e9a887f879b2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.456653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-973248d0-5197-40b6-8bbd-e9a887f879b2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.457314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-973248d0-5197-40b6-8bbd-e9a887f879b2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:43.460057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-973248d0-5197-40b6-8bbd-e9a887f879b2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.460988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-973248d0-5197-40b6-8bbd-e9a887f879b2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.463239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-973248d0-5197-40b6-8bbd-e9a887f879b2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:43.853718 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-973248d0-5197-40b6-8bbd-e9a887f879b2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "POST /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417789 Oct 31 15:38:43.854444 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2244/4624] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:38:43 2022] POST /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:43.914621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:43.916578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:43.940159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-74a4d1db-7b6c-4dd6-adfa-edc2b69c75ee req-2b13f6af-76a6-4098-a234-93dbf8e34e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a9c1f89-62a1-429b-9a22-45e7b9541232", "name": "network-vif-deleted", "tag": "1edba9ff-814f-4b53-b948-2ee6e58f5fc5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:43.956146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.959616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.962557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:43.964982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.965383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.967707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:43.981757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-74a4d1db-7b6c-4dd6-adfa-edc2b69c75ee req-2b13f6af-76a6-4098-a234-93dbf8e34e55 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:43.984194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-74a4d1db-7b6c-4dd6-adfa-edc2b69c75ee req-2b13f6af-76a6-4098-a234-93dbf8e34e55 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:43.986180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-74a4d1db-7b6c-4dd6-adfa-edc2b69c75ee req-2b13f6af-76a6-4098-a234-93dbf8e34e55 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:44.038170 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-74a4d1db-7b6c-4dd6-adfa-edc2b69c75ee req-2b13f6af-76a6-4098-a234-93dbf8e34e55 service nova] Creating event network-vif-deleted:1edba9ff-814f-4b53-b948-2ee6e58f5fc5 for instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 on n-h2-858384-17 Oct 31 15:38:44.058071 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-74a4d1db-7b6c-4dd6-adfa-edc2b69c75ee req-2b13f6af-76a6-4098-a234-93dbf8e34e55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119155 Oct 31 15:38:44.060079 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2245/4625] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:38:44.085107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:44.086373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:44.112127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:44.112960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:44.113775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:44.115655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:44.116461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:44.117170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:44.180445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:44.441339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:44.455514 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-83c928a5-5e0e-48e9-81b5-f4f98d1a0311 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 200 len: 1322 microversion: 2.1 time: 0.547407 Oct 31 15:38:44.456129 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2381/4626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:43 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:44.979575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:45.006608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:45.084466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:45.100394 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca613804-7ed0-44ad-b3a3-37047ef7b3c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1314 microversion: 2.1 time: 1.031372 Oct 31 15:38:45.102783 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2246/4627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:44 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1314 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:45.483340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:45.483961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:45.486994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:38:45.508784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:45.509624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:45.510235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:45.511219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:45.511847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:45.512783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:45.556862 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] HTTP exception thrown: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Request method failure captured: Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 HTTP/1.1 Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-sUZlcRnGl0nZzZJFYPuWavzFYIaKzUgbo43r_hpfeSKELFq3dBqUqCgfEE61Q03ukq7RPP6wsdJVbODHZcpiYQXpThcJ2kwSUACLeq2Vj_twFOtLZN0W50TeVEIiQZEJIqSwCHrJV7zcTyzIsDGjCa2iglfpC3yuE30DiLK0obD0M Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb97df11ae204a8d986977e32b44ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb97df11ae204a8d986977e32b44ada3"}]}] Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ef1e39433eb54ab6b5d2b28ddccd175b Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '3a9c1f89-62a1-429b-9a22-45e7b9541232'} Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:38:45.569309 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:45.573408 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:38:45.573408 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:38:45.573408 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:38:45.573408 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:38:45.573408 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:38:45.573408 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:38:45.573408 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:38:45.577615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Returning 404 to user: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:38:45.582080 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c443c7d-131b-4cf7-abe3-6a4af45a4dd0 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 404 len: 111 microversion: 2.1 time: 0.104753 Oct 31 15:38:45.584632 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2382/4628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:45 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:38:45.593481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-af799995-c56d-415b-80e2-999faeffe4c8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '.version_select at 0x7f16e03ce0d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:45.658420 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-af799995-c56d-415b-80e2-999faeffe4c8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327708484" status: 202 len: 0 microversion: 2.1 time: 0.069639 Oct 31 15:38:45.662628 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2247/4629] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327708484 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:38:46.128555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:46.130460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:46.141951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:46.142725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:46.146269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:46.147465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:46.148629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:46.150956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:46.839313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:46.856154 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4a42669-c8c0-4a15-bbad-1ba9d9bd9098 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1314 microversion: 2.1 time: 0.732049 Oct 31 15:38:46.861256 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2383/4630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:46 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1314 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:47.786335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-de8ee709-9945-40dc-90ca-9bff19709faf req-6e7bc068-be02-4f54-94f9-4f9d44e6743c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcd62cd-e056-43e8-acc4-698383847102", "name": "network-vif-plugged", "status": "completed", "tag": "04a4cc6f-4902-4b74-84ac-1a54db96dfdd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:47.808738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52f272ae-bff2-4991-8f10-5b29a81610a6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'create', calling method: .version_select at 0x7f16e14d7b80>, body: {"keypair": {"name": "tempest-keypair-256782169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpUvR7EZ8BkwHrdCbMrx4AcHqJqDLqsxBDzBXNYplpQRMzDxUlru3u17O1N7b/YLpOe59o1ETw1qe794aVIgj81fmHcAEBn20jOgNo79Lhlft6eCvzxK2TVNxOngluAEA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:47.831048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-de8ee709-9945-40dc-90ca-9bff19709faf req-6e7bc068-be02-4f54-94f9-4f9d44e6743c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.835371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-de8ee709-9945-40dc-90ca-9bff19709faf req-6e7bc068-be02-4f54-94f9-4f9d44e6743c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.835850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-de8ee709-9945-40dc-90ca-9bff19709faf req-6e7bc068-be02-4f54-94f9-4f9d44e6743c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.852801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-52f272ae-bff2-4991-8f10-5b29a81610a6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Getting quotas for project fb97df11ae204a8d986977e32b44ada3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:38:47.868390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-52f272ae-bff2-4991-8f10-5b29a81610a6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Getting quotas for user ef1e39433eb54ab6b5d2b28ddccd175b and project fb97df11ae204a8d986977e32b44ada3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:38:47.870813 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-de8ee709-9945-40dc-90ca-9bff19709faf req-6e7bc068-be02-4f54-94f9-4f9d44e6743c service nova] Creating event network-vif-plugged:04a4cc6f-4902-4b74-84ac-1a54db96dfdd for instance 9bcd62cd-e056-43e8-acc4-698383847102 on n-h1-858384-17 Oct 31 15:38:47.888273 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-de8ee709-9945-40dc-90ca-9bff19709faf req-6e7bc068-be02-4f54-94f9-4f9d44e6743c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107648 Oct 31 15:38:47.894390 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2248/4631] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:47.903999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:47.918176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:47.927398 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52f272ae-bff2-4991-8f10-5b29a81610a6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123079 Oct 31 15:38:47.928685 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2384/4632] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:38:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:47.937100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.943600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.951625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:47.953006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:47.954323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:47.956766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.017825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:48.018494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:48.032483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.033755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.037074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.040780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.041317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.041767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.262324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:48.272984 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aef588c7-bbf8-4d94-920e-91efaf8a6c8d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1561 microversion: 2.1 time: 0.261389 Oct 31 15:38:48.276223 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2385/4633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:48 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1561 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:48.288050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d2f418c5-639c-4722-acca-823e44dea492 req-86ea9e2a-968b-40de-9dfe-123eb057a975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391f5764-ac2b-41ae-8f1d-76f294d4b6ba", "tag": "91a3aca2-1006-42f3-af44-4ec383fe9205"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:48.309855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2f418c5-639c-4722-acca-823e44dea492 req-86ea9e2a-968b-40de-9dfe-123eb057a975 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:48.313852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2f418c5-639c-4722-acca-823e44dea492 req-86ea9e2a-968b-40de-9dfe-123eb057a975 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:48.314957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2f418c5-639c-4722-acca-823e44dea492 req-86ea9e2a-968b-40de-9dfe-123eb057a975 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:48.331598 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d2f418c5-639c-4722-acca-823e44dea492 req-86ea9e2a-968b-40de-9dfe-123eb057a975 service nova] Creating event network-changed:91a3aca2-1006-42f3-af44-4ec383fe9205 for instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba on n-h2-858384-17 Oct 31 15:38:48.338579 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d2f418c5-639c-4722-acca-823e44dea492 req-86ea9e2a-968b-40de-9dfe-123eb057a975 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060784 Oct 31 15:38:48.339890 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2386/4634] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:48.656485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:48.678605 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89a1e6cd-d85d-49e3-89e0-5452c267090c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1314 microversion: 2.1 time: 0.777508 Oct 31 15:38:48.682485 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2249/4635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:47 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:49.710072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:49.711430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:49.733673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:49.734222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:49.740948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:49.742224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:49.742877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:49.743475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:50.294405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:50.302791 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de19508d-3146-4c84-b823-90849e34343f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1314 microversion: 2.1 time: 0.598147 Oct 31 15:38:50.303398 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2387/4636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:49 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:51.328384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:51.329790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:51.344848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:51.346969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:51.349589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:51.351858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:51.352526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:51.354615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:51.729966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:51.753761 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-889338f3-2464-43ac-933e-f1361ab12e37 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1501 microversion: 2.1 time: 0.429614 Oct 31 15:38:51.755544 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2250/4637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:51 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1501 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:51.781333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-022b66e4-d6f0-4afa-9798-c5fb2b7173ce tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:51.781967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-022b66e4-d6f0-4afa-9798-c5fb2b7173ce tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:51.798075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-022b66e4-d6f0-4afa-9798-c5fb2b7173ce tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:51.802135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-022b66e4-d6f0-4afa-9798-c5fb2b7173ce tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:51.802713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-022b66e4-d6f0-4afa-9798-c5fb2b7173ce tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:51.810086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-022b66e4-d6f0-4afa-9798-c5fb2b7173ce tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:51.810727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-022b66e4-d6f0-4afa-9798-c5fb2b7173ce tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:51.811276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-022b66e4-d6f0-4afa-9798-c5fb2b7173ce tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:51.947476 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-022b66e4-d6f0-4afa-9798-c5fb2b7173ce tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102/action" status: 202 len: 0 microversion: 2.1 time: 0.171593 Oct 31 15:38:51.951360 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2388/4638] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:38:51 2022] POST /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:38:51.956852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:51.957589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:51.964060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:51.964557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:51.964994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:51.966352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:51.966816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:51.967241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:52.360777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:52.375940 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5bc6b383-6680-4ef3-91d5-58d6907ed4e8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1506 microversion: 2.1 time: 0.422878 Oct 31 15:38:52.377806 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2251/4639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:51 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:52.894093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2096529594", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2af85480-3783-4f77-9d0f-0b2295b53983"}], "security_groups": [{"name": "tempest-securitygroup--592302786"}], "key_name": "tempest-keypair-256782169", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:53.043887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] validate_networks() for [('2af85480-3783-4f77-9d0f-0b2295b53983', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:38:53.401589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:53.403352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:53.412981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:53.416408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:53.419004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:53.419998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:53.420699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:53.423662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:53.734748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:53.743997 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f4310ef6-4f33-422e-8a8d-04300e6de298 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1486 microversion: 2.1 time: 0.346529 Oct 31 15:38:53.746689 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2252/4640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:53 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1486 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:38:53.774177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:53.775483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:53.788737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:53.789601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:53.790389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:53.791407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:53.792414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:53.794329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:53.843519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lazy-loading 'flavor' on Instance uuid 9bcd62cd-e056-43e8-acc4-698383847102 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:38:54.006810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:38:54.007377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:38:54.007906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:38:54.008419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:38:54.009096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:38:54.039853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.045577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.047522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.048557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.054555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.055794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.142964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Getting quotas for project fb97df11ae204a8d986977e32b44ada3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:38:54.151798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Getting quotas for user ef1e39433eb54ab6b5d2b28ddccd175b and project fb97df11ae204a8d986977e32b44ada3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:38:54.172411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:38:54.177761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:38:54.262090 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60a2fc01-0c67-4486-84a9-0da1695ba469 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.374093 Oct 31 15:38:54.270866 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2389/4641] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:38:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:38:54.278898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-14ade532-7343-433d-b0e9-faffbfe65fef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:54.284205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-14ade532-7343-433d-b0e9-faffbfe65fef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:54.352328 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8cb31ff-bba2-4422-a04b-0cdff6a1ed28 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102/action" status: 202 len: 0 microversion: 2.1 time: 0.583958 Oct 31 15:38:54.353289 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2253/4642] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:38:53 2022] POST /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:38:54.380340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:54.384198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:54.395941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.398332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.404144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.405549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:54.407923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:54.408548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:54.429685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-14ade532-7343-433d-b0e9-faffbfe65fef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:54.440476 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-14ade532-7343-433d-b0e9-faffbfe65fef tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1237 microversion: 2.1 time: 0.165833 Oct 31 15:38:54.462884 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2390/4643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:54 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1237 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:55.033118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:55.049536 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33cab53d-0e86-40f2-9e80-bfb3122005d5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1492 microversion: 2.1 time: 0.690166 Oct 31 15:38:55.050696 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2254/4644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:54 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1492 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:55.474888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:55.488038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:55.502665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:55.503067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:55.504285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:55.505000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:55.505658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:55.506305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:55.675455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:55.694218 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cecca858-97a7-4074-a8bf-04a742259e41 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1289 microversion: 2.1 time: 0.221265 Oct 31 15:38:55.696246 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2391/4645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:55 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1289 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:56.081903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:56.083328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:56.094457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:56.095868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:56.096694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:56.097979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:56.099615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:56.101306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:56.686419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:56.699054 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e5668791-fa01-4410-9e12-b24be9e9fdfd tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1513 microversion: 2.1 time: 0.626515 Oct 31 15:38:56.711379 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2255/4646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:56 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1513 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:56.726464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:56.742672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:56.763457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:56.768569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:56.769440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:56.775728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:56.778730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:56.779688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:57.041659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:57.067867 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8e0e1ba-5fb1-4932-8cae-01d2b3d2dcff tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1295 microversion: 2.1 time: 0.347471 Oct 31 15:38:57.071866 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2392/4647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:56 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1295 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:57.739874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:57.740734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:57.753734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:57.757444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:57.759911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:57.760860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:57.764243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:57.766284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:58.094119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:58.094724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:58.112693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:58.115050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:58.115690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:58.116582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:58.117232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:58.117820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:58.295523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:58.319269 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21c72155-361b-4617-b221-1ac3e0c75038 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 0.585568 Oct 31 15:38:58.322576 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2256/4648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:57 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:58.351975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-79906ccf-848f-4df3-a2d8-36c2d5693a75 req-6bff384c-f3c4-486b-88b5-af46890d1648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcd62cd-e056-43e8-acc4-698383847102", "name": "network-vif-plugged", "status": "completed", "tag": "04a4cc6f-4902-4b74-84ac-1a54db96dfdd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:38:58.403637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-79906ccf-848f-4df3-a2d8-36c2d5693a75 req-6bff384c-f3c4-486b-88b5-af46890d1648 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:58.404286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-79906ccf-848f-4df3-a2d8-36c2d5693a75 req-6bff384c-f3c4-486b-88b5-af46890d1648 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:58.404884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-79906ccf-848f-4df3-a2d8-36c2d5693a75 req-6bff384c-f3c4-486b-88b5-af46890d1648 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:58.450762 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-79906ccf-848f-4df3-a2d8-36c2d5693a75 req-6bff384c-f3c4-486b-88b5-af46890d1648 service nova] Creating event network-vif-plugged:04a4cc6f-4902-4b74-84ac-1a54db96dfdd for instance 9bcd62cd-e056-43e8-acc4-698383847102 on n-h1-858384-17 Oct 31 15:38:58.470206 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-79906ccf-848f-4df3-a2d8-36c2d5693a75 req-6bff384c-f3c4-486b-88b5-af46890d1648 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140461 Oct 31 15:38:58.471090 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2257/4649] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:38:58.530224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:38:58.541844 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a636d22-8cfc-4d8d-a1ac-d514382c0130 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1295 microversion: 2.1 time: 0.451484 Oct 31 15:38:58.554576 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2393/4650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:58 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1295 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:38:59.351201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:59.352383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:59.368315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:59.371340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:59.371902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:59.373076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:59.373655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:59.375097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:59.583411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:38:59.583411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:38:59.607867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:59.609063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:59.609561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:38:59.611552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:38:59.612037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:38:59.614780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:00.042405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:00.052799 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-421b55b5-8efa-46c5-9a9d-4e4b78c8fd64 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1362 microversion: 2.1 time: 0.480596 Oct 31 15:39:00.060938 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2394/4651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:59 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1362 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:00.338036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:00.349318 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-184790d5-43e4-44b4-abfc-e903fda80800 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 1.005914 Oct 31 15:39:00.365935 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2258/4652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:38:59 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:00.588102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4b6c9637-c118-4e8d-ae45-680b1fe269d3"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:00.590831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:00.598944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:00.600413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:00.601241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:00.601841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:00.602557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:00.603209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:00.603637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:00.699751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-aff82e2c-197d-4a84-bad8-61f8c7fa3ba0 req-c3ec63f3-c30b-42b7-9b75-0b889eaecd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8669adee-bb93-44f4-9287-465631eb7b9a", "tag": "f0c584af-1c47-4a1d-ada1-20c6f56ceb28"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:00.732092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:00.735548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aff82e2c-197d-4a84-bad8-61f8c7fa3ba0 req-c3ec63f3-c30b-42b7-9b75-0b889eaecd9d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:00.736315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aff82e2c-197d-4a84-bad8-61f8c7fa3ba0 req-c3ec63f3-c30b-42b7-9b75-0b889eaecd9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:00.737006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aff82e2c-197d-4a84-bad8-61f8c7fa3ba0 req-c3ec63f3-c30b-42b7-9b75-0b889eaecd9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:00.770830 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-aff82e2c-197d-4a84-bad8-61f8c7fa3ba0 req-c3ec63f3-c30b-42b7-9b75-0b889eaecd9d service nova] Creating event network-changed:f0c584af-1c47-4a1d-ada1-20c6f56ceb28 for instance 8669adee-bb93-44f4-9287-465631eb7b9a on n-h2-858384-17 Oct 31 15:39:00.789732 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-aff82e2c-197d-4a84-bad8-61f8c7fa3ba0 req-c3ec63f3-c30b-42b7-9b75-0b889eaecd9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098530 Oct 31 15:39:00.792413 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2259/4653] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:00.802810 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] HTTP exception thrown: Volume 4b6c9637-c118-4e8d-ae45-680b1fe269d3 could not be found. Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Request method failure captured: Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: request: PUT /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments/c12235e7-1a90-4f30-a08f-645f72ef28d3 HTTP/1.1 Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 74 Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-vE5xffXrWs6eOR32L4GkWo3MIyYz_yF5Rtf3TCUv2X6dv9ya-kusMcak2SBIUhBYE8d4frilRo9_33hh_JePToJeqUas_2FF7zUWj_LqdXeLFBawMignS0NVtEOcJmifSflvQMh_LqKYO2RNjBZvDmR0U_c6UiE97qFeqPONg4oUE Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5ac0c87b54ad49e491d6728327adb53c Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesAdminNegativeTest-1185652044 Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ac0c87b54ad49e491d6728327adb53c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ac0c87b54ad49e491d6728327adb53c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ac0c87b54ad49e491d6728327adb53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ac0c87b54ad49e491d6728327adb53c"}]}] Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesAdminNegativeTest-1185652044 Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5ac0c87b54ad49e491d6728327adb53c Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1185652044 Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesAdminNegativeTest-1185652044-project-admin Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 9c3c6e2574eb428298950c63e269b7f8 Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesAdminNegativeTest-1185652044-project-admin Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: {"volumeAttachment": {"volumeId": "4b6c9637-c118-4e8d-ae45-680b1fe269d3"}} Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: exception: Volume 4b6c9637-c118-4e8d-ae45-680b1fe269d3 could not be found. Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': '420aeaad-1dec-4179-aa64-f2785da16514', 'id': 'c12235e7-1a90-4f30-a08f-645f72ef28d3', 'body': {'volumeAttachment': {'volumeId': '4b6c9637-c118-4e8d-ae45-680b1fe269d3'}}} Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b6c9637-c118-4e8d-ae45-680b1fe269d3 could not be found. (HTTP 404) (Request-ID: req-532c444b-9ae3-43e9-b87e-1787fa93a977) Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:39:00.805726 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b6c9637-c118-4e8d-ae45-680b1fe269d3 could not be found. Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 4b6c9637-c118-4e8d-ae45-680b1fe269d3 could not be found. Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b6c9637-c118-4e8d-ae45-680b1fe269d3 could not be found. Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Returning 400 to user: Volume 4b6c9637-c118-4e8d-ae45-680b1fe269d3 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea3f2dea-2e76-4935-8879-93c121ba5960 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments/c12235e7-1a90-4f30-a08f-645f72ef28d3" status: 400 len: 107 microversion: 2.1 time: 0.745361 Oct 31 15:39:00.810519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2395/4654] 10.222.0.20 () {60 vars in 1433 bytes} [Mon Oct 31 15:39:00 2022] PUT /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments/c12235e7-1a90-4f30-a08f-645f72ef28d3 => generated 107 bytes in 746 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:39:00.944327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:00.944997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:00.964250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:00.964751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:00.965232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:00.965946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:00.966410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:00.966840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:01.085515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:01.086127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:01.092987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:01.093603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:01.093968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:01.106411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:01.106411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:01.106411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:01.206989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lazy-loading 'services' on Instance uuid 420aeaad-1dec-4179-aa64-f2785da16514 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:39:01.355299 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2cc5aac6-13ef-4329-aaad-1fa9dbe1e1aa tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "DELETE /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments/c12235e7-1a90-4f30-a08f-645f72ef28d3" status: 202 len: 0 microversion: 2.1 time: 0.416310 Oct 31 15:39:01.356269 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2260/4655] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:39:00 2022] DELETE /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments/c12235e7-1a90-4f30-a08f-645f72ef28d3 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:39:01.383618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-afb58929-4024-47a0-b543-e0093914361f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:01.394229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-afb58929-4024-47a0-b543-e0093914361f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:01.420271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afb58929-4024-47a0-b543-e0093914361f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:01.421787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afb58929-4024-47a0-b543-e0093914361f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:01.422946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afb58929-4024-47a0-b543-e0093914361f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:01.424546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afb58929-4024-47a0-b543-e0093914361f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:01.425493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afb58929-4024-47a0-b543-e0093914361f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:01.430200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afb58929-4024-47a0-b543-e0093914361f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:01.520426 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-afb58929-4024-47a0-b543-e0093914361f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158113 Oct 31 15:39:01.521673 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2261/4656] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:01 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:01.532838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:01.533708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:01.546954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:01.551040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:01.551681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:01.552577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:01.553231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:01.557737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:01.796051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:01.811603 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eab2f54b-c1dd-4bf8-a0e2-b547b028be0c tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1362 microversion: 2.1 time: 0.730514 Oct 31 15:39:01.815294 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2396/4657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:01 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1362 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:01.831238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:01.842988 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2ca5e00-c814-4da8-a440-d4cc218636df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 0.314635 Oct 31 15:39:01.844192 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2262/4658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:01 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:02.533525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93e204e5-b83b-4f7e-ab65-06ea59ceeb41 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:02.536688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-93e204e5-b83b-4f7e-ab65-06ea59ceeb41 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:02.560306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93e204e5-b83b-4f7e-ab65-06ea59ceeb41 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:02.561554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93e204e5-b83b-4f7e-ab65-06ea59ceeb41 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:02.563441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93e204e5-b83b-4f7e-ab65-06ea59ceeb41 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:02.568967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93e204e5-b83b-4f7e-ab65-06ea59ceeb41 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:02.569696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93e204e5-b83b-4f7e-ab65-06ea59ceeb41 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:02.570296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93e204e5-b83b-4f7e-ab65-06ea59ceeb41 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:02.668815 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-93e204e5-b83b-4f7e-ab65-06ea59ceeb41 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139010 Oct 31 15:39:02.677288 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2397/4659] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:02 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:02.838670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:02.839446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:02.865926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:02.867706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:02.873019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:02.873832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:02.881910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:02.882769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:02.883271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:02.883718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:02.885906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:02.887148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:02.888834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:02.893941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:02.899739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:02.901517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:02.911673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:03.538791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:03.606395 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da394c61-7593-468a-94c7-437614ae4829 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1362 microversion: 2.1 time: 0.769278 Oct 31 15:39:03.607723 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2263/4660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:02 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1362 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:03.684531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cd1f0317-cc84-4459-92f8-29a59c68b88d tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:03.688235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cd1f0317-cc84-4459-92f8-29a59c68b88d tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:03.730077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd1f0317-cc84-4459-92f8-29a59c68b88d tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:03.730889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd1f0317-cc84-4459-92f8-29a59c68b88d tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:03.732321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd1f0317-cc84-4459-92f8-29a59c68b88d tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:03.733261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd1f0317-cc84-4459-92f8-29a59c68b88d tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:03.739175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd1f0317-cc84-4459-92f8-29a59c68b88d tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:03.741293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cd1f0317-cc84-4459-92f8-29a59c68b88d tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:03.892495 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cd1f0317-cc84-4459-92f8-29a59c68b88d tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213806 Oct 31 15:39:03.897563 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2264/4661] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:03 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:04.052592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:04.083146 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f622ab5b-64e4-471d-b1ba-fee93ab5e5f3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 1.210710 Oct 31 15:39:04.086338 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2398/4662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:02 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:04.631530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:04.632685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:04.653551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:04.656475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:04.657197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:04.658758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:04.660733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:04.662179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:04.913594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f9c87c3-2e66-402a-8ef0-3412b91393dc tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:04.917678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f9c87c3-2e66-402a-8ef0-3412b91393dc tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:04.938596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:04.943867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:04.979391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:04.984937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9c87c3-2e66-402a-8ef0-3412b91393dc tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:04.986393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9c87c3-2e66-402a-8ef0-3412b91393dc tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:04.987649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9c87c3-2e66-402a-8ef0-3412b91393dc tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:04.989249 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57875cf0-935a-49bf-ab38-8ffd038d331f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1362 microversion: 2.1 time: 0.362772 Oct 31 15:39:04.989738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9c87c3-2e66-402a-8ef0-3412b91393dc tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:04.989877 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2265/4663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:04 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:04.990648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9c87c3-2e66-402a-8ef0-3412b91393dc tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:04.991309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9c87c3-2e66-402a-8ef0-3412b91393dc tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:05.017714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d37a59e-f266-4c0d-8697-7ddbc0a16c1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:05.020800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d37a59e-f266-4c0d-8697-7ddbc0a16c1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:05.044230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d37a59e-f266-4c0d-8697-7ddbc0a16c1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:05.045592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:05.047611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d37a59e-f266-4c0d-8697-7ddbc0a16c1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:05.048364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d37a59e-f266-4c0d-8697-7ddbc0a16c1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:05.049434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d37a59e-f266-4c0d-8697-7ddbc0a16c1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:05.050352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d37a59e-f266-4c0d-8697-7ddbc0a16c1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:05.052100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d37a59e-f266-4c0d-8697-7ddbc0a16c1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:05.058974 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f9c87c3-2e66-402a-8ef0-3412b91393dc tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.151941 Oct 31 15:39:05.060298 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2399/4664] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:04 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:05.108361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:05.109820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:05.122358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:05.123263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:05.124981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:05.125955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:05.127071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:05.127772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:05.155078 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d37a59e-f266-4c0d-8697-7ddbc0a16c1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action" status: 200 len: 24572 microversion: 2.1 time: 0.145278 Oct 31 15:39:05.155746 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2266/4665] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:39:04 2022] POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action => generated 24572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:39:05.810151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:05.826142 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-70ac0171-fb5b-476e-8ddc-56d86b026d86 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 0.721713 Oct 31 15:39:05.827561 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2400/4666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:05 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:06.012697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:06.013700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:06.031826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:06.052067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:06.054877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:06.055931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:06.062127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:06.063078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:06.073543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a7c0584-d8aa-4c12-800d-f7d9c375e5ee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:06.075738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a7c0584-d8aa-4c12-800d-f7d9c375e5ee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:06.087840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7c0584-d8aa-4c12-800d-f7d9c375e5ee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:06.088329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7c0584-d8aa-4c12-800d-f7d9c375e5ee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:06.093817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7c0584-d8aa-4c12-800d-f7d9c375e5ee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:06.094798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7c0584-d8aa-4c12-800d-f7d9c375e5ee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:06.095434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7c0584-d8aa-4c12-800d-f7d9c375e5ee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:06.100383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a7c0584-d8aa-4c12-800d-f7d9c375e5ee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:06.191891 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a7c0584-d8aa-4c12-800d-f7d9c375e5ee tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123276 Oct 31 15:39:06.202320 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2401/4667] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:06 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:06.860497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:06.861463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:06.872289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:06.875131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:06.875619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:06.879223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:06.880219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:06.880859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:06.970372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:06.984844 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce382bb2-4444-4bd2-b718-aea831d695c6 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1362 microversion: 2.1 time: 0.971122 Oct 31 15:39:06.987358 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2267/4668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:06 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1362 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:07.212982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30b41b8b-c7dc-485e-a2fc-ac65f5a97990 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:07.216138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30b41b8b-c7dc-485e-a2fc-ac65f5a97990 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:07.244628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b41b8b-c7dc-485e-a2fc-ac65f5a97990 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:07.251661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b41b8b-c7dc-485e-a2fc-ac65f5a97990 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:07.252878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b41b8b-c7dc-485e-a2fc-ac65f5a97990 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:07.257184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b41b8b-c7dc-485e-a2fc-ac65f5a97990 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:07.263219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b41b8b-c7dc-485e-a2fc-ac65f5a97990 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:07.265067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b41b8b-c7dc-485e-a2fc-ac65f5a97990 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:07.391969 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30b41b8b-c7dc-485e-a2fc-ac65f5a97990 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183293 Oct 31 15:39:07.408044 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2268/4669] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:07 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:39:07.848679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:07.860506 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-37935d31-fdbf-4ca6-ad45-4cd4fcaed73c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 1.006824 Oct 31 15:39:07.866030 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2402/4670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:06 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:08.016203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:08.016825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:08.033416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:08.034478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:08.036738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:08.039866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:08.040705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:08.041360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:08.415945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-acbf9aa2-f9d8-4f6b-a556-450236db3ff3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:08.418808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-acbf9aa2-f9d8-4f6b-a556-450236db3ff3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:08.432825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acbf9aa2-f9d8-4f6b-a556-450236db3ff3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:08.439284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acbf9aa2-f9d8-4f6b-a556-450236db3ff3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:08.440364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acbf9aa2-f9d8-4f6b-a556-450236db3ff3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:08.443145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acbf9aa2-f9d8-4f6b-a556-450236db3ff3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:08.447663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acbf9aa2-f9d8-4f6b-a556-450236db3ff3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:08.448433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-acbf9aa2-f9d8-4f6b-a556-450236db3ff3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:08.525599 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-acbf9aa2-f9d8-4f6b-a556-450236db3ff3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113542 Oct 31 15:39:08.527314 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2403/4671] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:08 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:39:08.556914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:08.572189 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0aaadcf-5a84-4996-8042-3f9c8a5622cb tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1362 microversion: 2.1 time: 0.562493 Oct 31 15:39:08.572801 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2269/4672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:08 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1362 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:08.891048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:08.891926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:08.903253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:08.903759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:08.904202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:08.911773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:08.912693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:08.913390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:09.539494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c9e5c26e-c908-4a94-89d9-d077cfacc7ed tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:09.543628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c9e5c26e-c908-4a94-89d9-d077cfacc7ed tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:09.587331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e5c26e-c908-4a94-89d9-d077cfacc7ed tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:09.591253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e5c26e-c908-4a94-89d9-d077cfacc7ed tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:09.591902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e5c26e-c908-4a94-89d9-d077cfacc7ed tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:09.593820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e5c26e-c908-4a94-89d9-d077cfacc7ed tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:09.601062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e5c26e-c908-4a94-89d9-d077cfacc7ed tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:09.601809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e5c26e-c908-4a94-89d9-d077cfacc7ed tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:09.695925 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c9e5c26e-c908-4a94-89d9-d077cfacc7ed tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162413 Oct 31 15:39:09.699798 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2270/4673] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:09 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:39:09.712398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:09.717768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:09.729295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:09.735108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:09.736268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:09.738026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:09.741248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:09.743296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:09.932712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:09.945249 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e76559a-e401-4668-a376-6cd9118cb4b5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 1.058123 Oct 31 15:39:09.948162 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2404/4674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:08 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:10.208491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:10.233850 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0272dc33-7c31-4e7c-925d-8010bff0a07f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1362 microversion: 2.1 time: 0.532745 Oct 31 15:39:10.234466 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2271/4675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:09 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1362 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:10.587730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d2bd2d84-8acb-4cd7-af9d-01540b7c88f5 req-bedab554-55c4-453b-b392-dc06d86abca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8669adee-bb93-44f4-9287-465631eb7b9a", "name": "network-vif-plugged", "status": "completed", "tag": "f0c584af-1c47-4a1d-ada1-20c6f56ceb28"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:10.631295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2bd2d84-8acb-4cd7-af9d-01540b7c88f5 req-bedab554-55c4-453b-b392-dc06d86abca0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:10.632439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2bd2d84-8acb-4cd7-af9d-01540b7c88f5 req-bedab554-55c4-453b-b392-dc06d86abca0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:10.633345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2bd2d84-8acb-4cd7-af9d-01540b7c88f5 req-bedab554-55c4-453b-b392-dc06d86abca0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:10.663402 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d2bd2d84-8acb-4cd7-af9d-01540b7c88f5 req-bedab554-55c4-453b-b392-dc06d86abca0 service nova] Creating event network-vif-plugged:f0c584af-1c47-4a1d-ada1-20c6f56ceb28 for instance 8669adee-bb93-44f4-9287-465631eb7b9a on n-h2-858384-17 Oct 31 15:39:10.669723 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d2bd2d84-8acb-4cd7-af9d-01540b7c88f5 req-bedab554-55c4-453b-b392-dc06d86abca0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119222 Oct 31 15:39:10.673515 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2405/4676] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:10.717856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-acda1d79-3906-4d71-b8b7-bfd01caf4761 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:10.726428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-acda1d79-3906-4d71-b8b7-bfd01caf4761 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:10.751103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acda1d79-3906-4d71-b8b7-bfd01caf4761 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:10.753382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acda1d79-3906-4d71-b8b7-bfd01caf4761 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:10.763934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acda1d79-3906-4d71-b8b7-bfd01caf4761 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:10.765697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acda1d79-3906-4d71-b8b7-bfd01caf4761 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:10.770673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acda1d79-3906-4d71-b8b7-bfd01caf4761 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:10.779572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acda1d79-3906-4d71-b8b7-bfd01caf4761 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:10.891288 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-acda1d79-3906-4d71-b8b7-bfd01caf4761 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185267 Oct 31 15:39:10.892079 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2272/4677] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:10 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:10.978674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:10.982050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:10.999574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:11.006434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:11.008320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:11.010024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:11.012562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:11.013428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:11.263749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:11.264374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:11.276986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:11.277523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:11.277965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:11.282702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:11.290822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:11.292836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:11.749519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:11.764141 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-760d8254-ffed-4d01-8a99-778dfad03c70 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1362 microversion: 2.1 time: 0.506156 Oct 31 15:39:11.813101 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2273/4678] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:11 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:11.904751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-feb736ae-6624-4d2c-bd27-bde3ccd9b0eb tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:11.912193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-feb736ae-6624-4d2c-bd27-bde3ccd9b0eb tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:11.930812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feb736ae-6624-4d2c-bd27-bde3ccd9b0eb tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:11.931841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feb736ae-6624-4d2c-bd27-bde3ccd9b0eb tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:11.933205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feb736ae-6624-4d2c-bd27-bde3ccd9b0eb tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:11.934396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feb736ae-6624-4d2c-bd27-bde3ccd9b0eb tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:11.935097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feb736ae-6624-4d2c-bd27-bde3ccd9b0eb tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:11.935770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-feb736ae-6624-4d2c-bd27-bde3ccd9b0eb tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:11.960145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:11.982340 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b0dd499-09e6-472a-a88e-590125c3b209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 1.010183 Oct 31 15:39:11.986861 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2406/4679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:10 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:12.007765 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-feb736ae-6624-4d2c-bd27-bde3ccd9b0eb tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107281 Oct 31 15:39:12.009984 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2274/4680] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:39:11 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:39:12.384359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1522140643", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "f266baa8-7c33-400c-aeef-0d5df4183cb5"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:12.496581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] validate_networks() for [('f266baa8-7c33-400c-aeef-0d5df4183cb5', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:39:12.820622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:12.821277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:12.836118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:12.838993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:12.840422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:12.842036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:12.842841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:12.843595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:14.080592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:39:14.081074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:39:14.086084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:39:14.087570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:39:14.088358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:39:14.109179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:14.110050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:14.113658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:14.114728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:14.116586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:14.117780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:14.155004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:14.164380 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c418b73-b17b-4e44-8e49-95e670ab4dbc tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1362 microversion: 2.1 time: 1.351031 Oct 31 15:39:14.170840 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2275/4681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:12 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1362 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:14.184796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:14.185667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:14.195502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Getting quotas for project 1c07afa65f4641e09b798511a614d9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:14.203981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:14.204765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:14.206472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:14.209413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Getting quotas for user e1e5884af4ed42e8914691ad56cb474b and project 1c07afa65f4641e09b798511a614d9a6. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:14.210792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:14.211446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:14.212046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:14.249516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:39:14.252114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:39:14.366997 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d7ad3cb5-2732-4077-8bf8-0b42e49ddd5a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.987323 Oct 31 15:39:14.367664 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2407/4682] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:39:14.393472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ffa04759-ca50-4781-bf3e-639a48c7967e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:14.397117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ffa04759-ca50-4781-bf3e-639a48c7967e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:14.508288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ffa04759-ca50-4781-bf3e-639a48c7967e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:14.520731 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ffa04759-ca50-4781-bf3e-639a48c7967e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1218 microversion: 2.1 time: 0.143398 Oct 31 15:39:14.525795 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2408/4683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:14 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:14.913905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:14.939738 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2055be0f-3465-4da6-8494-c133d1a20a5a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 0.763460 Oct 31 15:39:14.944429 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2276/4684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:14 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:15.196538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:15.197795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:15.205720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:15.207103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:15.209720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:15.211043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:15.216143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:15.216937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:15.576321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06c6e450-995d-4d1a-99eb-42d34a87adab tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:15.577929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06c6e450-995d-4d1a-99eb-42d34a87adab tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:15.775904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:15.798313 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d24a28f-eb65-464d-b83f-7868d9fdeb66 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1547 microversion: 2.1 time: 0.605509 Oct 31 15:39:15.804431 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2409/4685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:15 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1547 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:15.841082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d45068ac-5cc9-4441-aa36-fbc60100d8e9 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:15.848629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d45068ac-5cc9-4441-aa36-fbc60100d8e9 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:15.866282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45068ac-5cc9-4441-aa36-fbc60100d8e9 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:15.867052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45068ac-5cc9-4441-aa36-fbc60100d8e9 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:15.868350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45068ac-5cc9-4441-aa36-fbc60100d8e9 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:15.869270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45068ac-5cc9-4441-aa36-fbc60100d8e9 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:15.869897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45068ac-5cc9-4441-aa36-fbc60100d8e9 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:15.870492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d45068ac-5cc9-4441-aa36-fbc60100d8e9 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:15.934567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-06c6e450-995d-4d1a-99eb-42d34a87adab tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:15.948790 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06c6e450-995d-4d1a-99eb-42d34a87adab tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1218 microversion: 2.1 time: 0.399880 Oct 31 15:39:15.954905 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2277/4686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:15 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1218 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:15.973387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cfe877ca-51f1-4d42-94da-7528f61fc5d5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:15.974000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cfe877ca-51f1-4d42-94da-7528f61fc5d5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:15.988334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfe877ca-51f1-4d42-94da-7528f61fc5d5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:15.989444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfe877ca-51f1-4d42-94da-7528f61fc5d5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:15.990181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfe877ca-51f1-4d42-94da-7528f61fc5d5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:15.991071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfe877ca-51f1-4d42-94da-7528f61fc5d5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:15.991708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfe877ca-51f1-4d42-94da-7528f61fc5d5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:15.992441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cfe877ca-51f1-4d42-94da-7528f61fc5d5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:16.292966 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d45068ac-5cc9-4441-aa36-fbc60100d8e9 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.456656 Oct 31 15:39:16.293913 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2410/4687] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:39:15 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-interface => generated 284 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:16.298863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:16.299477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:16.325560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:16.328521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:16.328996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:16.333420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:16.333923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:16.345334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:16.962444 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cfe877ca-51f1-4d42-94da-7528f61fc5d5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1833 microversion: 2.1 time: 0.999940 Oct 31 15:39:16.963041 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2278/4688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:15 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1833 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:16.991239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:16.992210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:17.008993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:17.016981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:17.017476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:17.018651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:17.020803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:17.027317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:17.171116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:17.197305 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c441dbe8-f381-47c6-914b-a4fafb81170a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1214 microversion: 2.1 time: 0.223038 Oct 31 15:39:17.213775 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2279/4689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:16 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1214 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:17.228865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:17.229886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:17.244270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:17.261289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:17.263448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:17.265455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:17.267312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:17.268744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:17.379245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:17.387952 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-839f9f92-3da8-4613-a33a-75f97fb304df tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 1.092833 Oct 31 15:39:17.388476 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2411/4690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:16 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:17.798987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:17.822232 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1c076bd-3f0a-4caf-a9c2-a3fad303a35e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1680 microversion: 2.1 time: 0.606860 Oct 31 15:39:17.823227 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2280/4691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:17 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1680 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:18.114581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b0e9fba-4353-4e9e-9296-d5fd4880b034 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:18.116899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b0e9fba-4353-4e9e-9296-d5fd4880b034 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:18.145099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b0e9fba-4353-4e9e-9296-d5fd4880b034 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.145791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b0e9fba-4353-4e9e-9296-d5fd4880b034 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.146253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b0e9fba-4353-4e9e-9296-d5fd4880b034 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.147007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b0e9fba-4353-4e9e-9296-d5fd4880b034 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.147478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b0e9fba-4353-4e9e-9296-d5fd4880b034 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.147909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b0e9fba-4353-4e9e-9296-d5fd4880b034 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.232489 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b0e9fba-4353-4e9e-9296-d5fd4880b034 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action" status: 200 len: 32641 microversion: 2.1 time: 0.119818 Oct 31 15:39:18.235730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:18.236360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:18.246207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2412/4692] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:39:18 2022] POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action => generated 32641 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:39:18.253884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.254417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.255005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.255736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.256202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.257280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.355380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:18.387885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:18.388587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:18.409253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.414870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.420111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.420935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.421464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.421920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.535381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ef652ba989e94c5d9f5d45f9e0385d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f201c5379a241519086c31c43d022d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:18.536156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] flavor_id is None. Assuming migration. {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 31 15:39:18.539510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:39:18.583048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:18.615494 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a53d04bc-8b1e-4041-b4ad-3d3445b92f12 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1278 microversion: 2.1 time: 0.390771 Oct 31 15:39:18.617329 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2281/4693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:18 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1278 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:18.629232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:18.642644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:18.657264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.657778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.658205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.658925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.659489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.659839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.937010 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d19e52c0-1306-465b-9248-a47986df0b78 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action" status: 202 len: 0 microversion: 2.1 time: 0.551708 Oct 31 15:39:18.938346 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2413/4694] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:39:18 2022] POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:39:18.964886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:18.965925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:18.984594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:18.989831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:18.991714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:18.994859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:19.000578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:19.001068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:19.737540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:19.755193 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34a58ae9-7939-4765-8a9a-b4b56394ba5c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 1.133914 Oct 31 15:39:19.762115 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2282/4695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:18 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:19.778539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:19.779577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:19.792947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:19.793789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:19.794575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:19.797015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:19.797732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:19.799908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:20.100319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:20.111002 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9b68f3f-f3f6-4aff-85d2-1642a9189d43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1689 microversion: 2.1 time: 1.167524 Oct 31 15:39:20.137968 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2414/4696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:18 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1689 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:20.529102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:20.541444 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9afdc4ef-2043-48e4-87ed-80723bf73cdd tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1318 microversion: 2.1 time: 0.777854 Oct 31 15:39:20.571244 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2283/4697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:19 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:20.790305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:20.796110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:20.813519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:20.814124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:20.816636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:20.817693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:20.818454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:20.820852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:21.150751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:21.151319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:21.165967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:21.166471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:21.166908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:21.167624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:21.168082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:21.168511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:21.683449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:21.699992 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6693984c-fc3e-4207-b2ab-53f79bd49209 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 0.913461 Oct 31 15:39:21.701254 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2415/4698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:20 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:21.715672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:21.717656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:21.768285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:21.772046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:21.774160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:21.775704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:21.778552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:21.780547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:22.691441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:22.711945 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc777635-2946-40da-b23e-0c7906785443 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1318 microversion: 2.1 time: 1.004899 Oct 31 15:39:22.715690 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2416/4699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:21 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1318 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:22.740493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4efe7aeb-1c59-460e-abcf-bbd1a75291b1 req-a9d1cdf2-acaa-41aa-99f6-faeda97587ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8669adee-bb93-44f4-9287-465631eb7b9a", "tag": "f0c584af-1c47-4a1d-ada1-20c6f56ceb28"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:22.800950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4efe7aeb-1c59-460e-abcf-bbd1a75291b1 req-a9d1cdf2-acaa-41aa-99f6-faeda97587ac service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:22.801479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4efe7aeb-1c59-460e-abcf-bbd1a75291b1 req-a9d1cdf2-acaa-41aa-99f6-faeda97587ac service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:22.803407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4efe7aeb-1c59-460e-abcf-bbd1a75291b1 req-a9d1cdf2-acaa-41aa-99f6-faeda97587ac service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:22.846583 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4efe7aeb-1c59-460e-abcf-bbd1a75291b1 req-a9d1cdf2-acaa-41aa-99f6-faeda97587ac service nova] Creating event network-changed:f0c584af-1c47-4a1d-ada1-20c6f56ceb28 for instance 8669adee-bb93-44f4-9287-465631eb7b9a on n-h2-858384-17 Oct 31 15:39:22.872062 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4efe7aeb-1c59-460e-abcf-bbd1a75291b1 req-a9d1cdf2-acaa-41aa-99f6-faeda97587ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154872 Oct 31 15:39:22.874948 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2417/4700] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:22.896090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:22.906454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:22.927077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:22.928025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:22.930627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:22.931595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:22.939685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:22.942297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:22.976777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:23.037543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:23.070666 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2056a470-ccd0-4e53-8449-fb0f0f8eccc5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1689 microversion: 2.1 time: 1.929175 Oct 31 15:39:23.074558 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2284/4701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:21 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1689 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:23.745533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:23.747179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:23.760555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:23.764610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:23.765443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:23.766425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:23.768362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:23.772766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:24.138760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:24.230644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:24.247016 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dfb0dabb-aa40-4ae2-8ddb-0149cca879ea tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1318 microversion: 2.1 time: 0.508556 Oct 31 15:39:24.248531 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2285/4702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:23 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:24.262152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:24.263936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:24.280165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:24.282990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:24.286426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:24.287423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:24.287941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:24.289575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:24.290231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:24.305121 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7cfd3fff-f1a5-4352-84d2-a3919973bf25 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 1.419909 Oct 31 15:39:24.321859 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2418/4703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:22 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:24.573448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0a02d69d-0c8f-4a4f-b820-8396a32f865b req-e6c3f797-4f78-40b0-838e-c2ea864891b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70786873-df81-4755-b3e7-41a13595f5cd", "tag": "3584d949-1ef8-4044-b198-ac86ed39fcc9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:24.598118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:24.600856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0a02d69d-0c8f-4a4f-b820-8396a32f865b req-e6c3f797-4f78-40b0-838e-c2ea864891b8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:24.601578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0a02d69d-0c8f-4a4f-b820-8396a32f865b req-e6c3f797-4f78-40b0-838e-c2ea864891b8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:24.602267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0a02d69d-0c8f-4a4f-b820-8396a32f865b req-e6c3f797-4f78-40b0-838e-c2ea864891b8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:24.608037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:24.615959 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0a02d69d-0c8f-4a4f-b820-8396a32f865b req-e6c3f797-4f78-40b0-838e-c2ea864891b8 service nova] Creating event network-changed:3584d949-1ef8-4044-b198-ac86ed39fcc9 for instance 70786873-df81-4755-b3e7-41a13595f5cd on n-h1-858384-17 Oct 31 15:39:24.618545 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6fb47386-07f0-41f8-aa43-6699d3f596d0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1689 microversion: 2.1 time: 0.367460 Oct 31 15:39:24.622402 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2286/4704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:24 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1689 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:24.639919 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0a02d69d-0c8f-4a4f-b820-8396a32f865b req-e6c3f797-4f78-40b0-838e-c2ea864891b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070600 Oct 31 15:39:24.646435 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2419/4705] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:25.275690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:25.276288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:25.283223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:25.283944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:25.285208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:25.286094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:25.286743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:25.287521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:25.333522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:25.335072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:25.342623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:25.343346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:25.343963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:25.344979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:25.345667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:25.346252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:25.570062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:25.579035 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8abef57c-35d6-4ff2-94e4-69b5a8eca45a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1318 microversion: 2.1 time: 0.307241 Oct 31 15:39:25.586545 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2287/4706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:25 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:25.652201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:25.652822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:25.660929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:25.661863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:25.662760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:25.663655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:25.664283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:25.664872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:25.945866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:25.980971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:25.997038 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c4e2facb-eb36-4517-a674-47c5e9fdcd7c tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1508 microversion: 2.1 time: 0.668460 Oct 31 15:39:25.998247 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2420/4707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:25 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1508 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:26.000160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:26.025986 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-114c2df9-a543-418c-ab49-27a4e4f8f1a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1689 microversion: 2.1 time: 0.377715 Oct 31 15:39:26.028227 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2288/4708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:25 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1689 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:26.614563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:26.616000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:26.623409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:26.623906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:26.624337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:26.625046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:26.625557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:26.625980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:27.022206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:27.023253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:27.040635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:27.041449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:27.043646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:27.045588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:27.049040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:27.050533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:27.207972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:27.219031 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-241651fd-811c-4cb7-8c79-0ff7bc8bf84e tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1318 microversion: 2.1 time: 0.609914 Oct 31 15:39:27.219936 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2421/4709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:26 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1318 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:27.234106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:27.234957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:27.246059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:27.246557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:27.246987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:27.247691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:27.253289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:27.256016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:27.322613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:27.335294 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d21e713-62e2-4b59-92cf-c2147425e0ca tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1505 microversion: 2.1 time: 0.318155 Oct 31 15:39:27.336131 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2289/4710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:27 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:27.654859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:27.665697 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe25adc8-45fc-4664-a242-dfab4ca0c63b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.443625 Oct 31 15:39:27.666702 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2422/4711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:27 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:28.248005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:28.248706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:28.258284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:28.259559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:28.261073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:28.262517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:28.263218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:28.264141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:28.364182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:28.365064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:28.373793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:28.386011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:28.386856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:28.387802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:28.388426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:28.389025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:28.552948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:28.571708 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-111b05e2-a3c4-45dc-98c1-827207ba8fca tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1318 microversion: 2.1 time: 0.317246 Oct 31 15:39:28.579408 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2290/4712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:28 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:28.694670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:28.695584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:28.704656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:28.709331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:28.710188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:28.711348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:28.712226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:28.712880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:29.022652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:29.036512 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-760def6a-12b0-4ae6-a3f5-8cf97ca3c1a1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1505 microversion: 2.1 time: 0.675654 Oct 31 15:39:29.040911 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2423/4713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:28 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1505 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:29.605785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:29.607862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:29.620685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:29.623617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:29.623617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:29.623617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:29.623617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:29.628382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:29.750490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:29.762388 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-052ccea9-0a97-4727-bce1-ae2cdfdb71c1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 1.075954 Oct 31 15:39:29.763601 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2291/4714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:28 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:30.063937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:30.064559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:30.078509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:30.079074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:30.080166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:30.080959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:30.084647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:30.085103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:30.123370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:30.141845 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b0f1b4e3-5a93-4c02-9676-3995f3fd4785 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1318 microversion: 2.1 time: 0.539935 Oct 31 15:39:30.142448 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2424/4715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:29 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1318 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:30.202599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1844b957-a08c-4e2a-b9a8-d90c520d51f9 req-59aec270-2efa-4f29-8575-a937d64bdfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70786873-df81-4755-b3e7-41a13595f5cd", "name": "network-vif-plugged", "status": "completed", "tag": "3584d949-1ef8-4044-b198-ac86ed39fcc9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:30.217845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1844b957-a08c-4e2a-b9a8-d90c520d51f9 req-59aec270-2efa-4f29-8575-a937d64bdfe0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:30.219110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1844b957-a08c-4e2a-b9a8-d90c520d51f9 req-59aec270-2efa-4f29-8575-a937d64bdfe0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:30.220845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1844b957-a08c-4e2a-b9a8-d90c520d51f9 req-59aec270-2efa-4f29-8575-a937d64bdfe0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:30.245508 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1844b957-a08c-4e2a-b9a8-d90c520d51f9 req-59aec270-2efa-4f29-8575-a937d64bdfe0 service nova] Creating event network-vif-plugged:3584d949-1ef8-4044-b198-ac86ed39fcc9 for instance 70786873-df81-4755-b3e7-41a13595f5cd on n-h1-858384-17 Oct 31 15:39:30.255808 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1844b957-a08c-4e2a-b9a8-d90c520d51f9 req-59aec270-2efa-4f29-8575-a937d64bdfe0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057013 Oct 31 15:39:30.261209 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2425/4716] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:39:30.452657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:30.467929 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2947782-fa4a-4fcd-b296-590c690e40f0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 200 len: 1448 microversion: 2.1 time: 0.407491 Oct 31 15:39:30.470852 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2292/4717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:30 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 1448 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:30.494329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:30.495696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:30.502485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:30.503615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:30.504693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:30.505833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:30.506862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:30.507387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:30.796319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:30.806255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:30.819526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:30.820611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:30.821876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:30.823541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:30.826394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:30.828417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:31.191069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:31.208626 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e3b9078-fd23-417f-b8c0-2f086654d4d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.718505 Oct 31 15:39:31.210807 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2426/4718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:30 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:31.226259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:31.227118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:31.240975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:31.244655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:31.249241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:31.262122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:31.262610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:31.265986 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f58a1b66-03c8-42f0-9ea0-01aa485a5d08 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.476978 Oct 31 15:39:31.267180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:31.268798 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2293/4719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:30 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:31.269246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:31.271843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:31.285728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:31.286422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:31.307219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=72 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:31.308688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:31.309283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:31.309724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:31.310437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:31.310895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:31.311317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:31.606088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:31.625796 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5e1700ba-f1db-4e5b-ad0c-d3c07e438812 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1318 microversion: 2.1 time: 0.413512 Oct 31 15:39:31.629762 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2427/4720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:31 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:31.687025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:31.697798 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-438a239b-f632-41e8-8a75-a736ebc2338a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.427195 Oct 31 15:39:31.698406 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2294/4721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:31 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:31.724106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:31.725302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:31.741186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:31.742654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:31.744621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:31.746322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:31.747621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:31.748369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:31.992370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:32.003987 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd5eb914-c55a-4ab2-a2ce-0419d69d4d29 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.282517 Oct 31 15:39:32.005930 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2428/4722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:31 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:32.050536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:32.052851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:32.063146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.064342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.064794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:32.073928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.074441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.074887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:32.301778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:32.303255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:32.315884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.317817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.318531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:32.319304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.319769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.320201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:32.607927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:32.640166 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-18992984-6ef4-499b-bd14-ad3dca966a48 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.613977 Oct 31 15:39:32.646443 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2295/4723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:32 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:32.656253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-43a3f8fa-f12e-4af8-99a2-72e4c50092eb req-7ee6404b-eecd-40a9-b9d2-233e5b2e2b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcd62cd-e056-43e8-acc4-698383847102", "name": "network-vif-unplugged", "status": "completed", "tag": "04a4cc6f-4902-4b74-84ac-1a54db96dfdd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:32.687183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-43a3f8fa-f12e-4af8-99a2-72e4c50092eb req-7ee6404b-eecd-40a9-b9d2-233e5b2e2b13 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.687910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-43a3f8fa-f12e-4af8-99a2-72e4c50092eb req-7ee6404b-eecd-40a9-b9d2-233e5b2e2b13 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.688550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-43a3f8fa-f12e-4af8-99a2-72e4c50092eb req-7ee6404b-eecd-40a9-b9d2-233e5b2e2b13 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:32.708056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.server_external_events [req-43a3f8fa-f12e-4af8-99a2-72e4c50092eb req-7ee6404b-eecd-40a9-b9d2-233e5b2e2b13 service nova] Unable to find a host for instance 9bcd62cd-e056-43e8-acc4-698383847102. Dropping event network-vif-unplugged {{(pid=120588) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 15:39:32.709609 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-43a3f8fa-f12e-4af8-99a2-72e4c50092eb req-7ee6404b-eecd-40a9-b9d2-233e5b2e2b13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.066348 Oct 31 15:39:32.710979 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2296/4724] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 15:39:32.717952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:32.718216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:32.719081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:32.728555 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a0a027c5-1a63-4cb3-b557-e9577bc42ce4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.432685 Oct 31 15:39:32.728951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.729657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.730274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:32.731648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.732277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.733151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:32.734452 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2429/4725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:32 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:32.749679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-94c5ba69-28d9-46c0-8ba5-d1a0454a3305 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:32.771754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94c5ba69-28d9-46c0-8ba5-d1a0454a3305 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.774342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94c5ba69-28d9-46c0-8ba5-d1a0454a3305 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.782102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94c5ba69-28d9-46c0-8ba5-d1a0454a3305 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:32.830573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-94c5ba69-28d9-46c0-8ba5-d1a0454a3305 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 15:39:32.914108 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-94c5ba69-28d9-46c0-8ba5-d1a0454a3305 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.175380 Oct 31 15:39:32.914990 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2430/4726] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:39:32 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:39:32.925903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:32.927126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:32.936898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.937724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.938479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:32.939514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:32.940407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:32.941817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:33.064473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:33.079213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed8d7424-2acb-4e55-a9fb-0025964d786f tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1508 microversion: 2.1 time: 0.366712 Oct 31 15:39:33.080445 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2297/4727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:32 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1508 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:33.339336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:33.385706 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca4d5881-8a33-44b8-9a36-66aa57e1d73e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.466472 Oct 31 15:39:33.388542 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2431/4728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:32 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:33.761445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:33.761992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:33.775183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:33.775478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:33.777726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:33.778671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:33.785900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:33.786623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:34.420506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:34.422904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:34.441070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:34.441927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:34.443187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:34.446070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:34.447505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:34.448434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:34.466774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:34.479054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:34.484410 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c966dc23-94ee-405b-86f6-2ea3388032ba tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.726835 Oct 31 15:39:34.491495 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2298/4729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:33 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:34.756074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:34.776585 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9619762-ff65-4b0e-9ae0-cf723e30fb5e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.359981 Oct 31 15:39:34.783346 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2432/4730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:34 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:35.514482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:35.515093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:35.531764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:35.532262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:35.532703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:35.548046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:35.550611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:35.574599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:35.802647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:35.803377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:35.831294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:35.832146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:35.837078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:35.839204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:35.839878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:35.840514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:36.051366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:36.060083 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-295c0763-bbf1-4884-a3ac-295978e6ac96 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.549285 Oct 31 15:39:36.061994 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2299/4731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:35 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:36.068110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "577dc402-1676-425d-a073-128c805f79e2"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:36.070963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:36.078285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:36.079297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:36.079948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:36.080928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:36.082873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:36.083480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:36.167466 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] HTTP exception thrown: Volume fb5b8ded-e920-4e68-9532-635d61109d72 could not be found. Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Request method failure captured: Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: request: PUT /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd/os-volume_attachments/fb5b8ded-e920-4e68-9532-635d61109d72 HTTP/1.1 Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 74 Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-vE5xffXrWs6eOR32L4GkWo3MIyYz_yF5Rtf3TCUv2X6dv9ya-kusMcak2SBIUhBYE8d4frilRo9_33hh_JePToJeqUas_2FF7zUWj_LqdXeLFBawMignS0NVtEOcJmifSflvQMh_LqKYO2RNjBZvDmR0U_c6UiE97qFeqPONg4oUE Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5ac0c87b54ad49e491d6728327adb53c Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesAdminNegativeTest-1185652044 Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ac0c87b54ad49e491d6728327adb53c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5ac0c87b54ad49e491d6728327adb53c", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5ac0c87b54ad49e491d6728327adb53c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5ac0c87b54ad49e491d6728327adb53c"}]}] Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-VolumesAdminNegativeTest-1185652044 Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5ac0c87b54ad49e491d6728327adb53c Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1185652044 Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-VolumesAdminNegativeTest-1185652044-project-admin Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 9c3c6e2574eb428298950c63e269b7f8 Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-VolumesAdminNegativeTest-1185652044-project-admin Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: {"volumeAttachment": {"volumeId": "577dc402-1676-425d-a073-128c805f79e2"}} Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: exception: Volume fb5b8ded-e920-4e68-9532-635d61109d72 could not be found. Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'server_id': '70786873-df81-4755-b3e7-41a13595f5cd', 'id': 'fb5b8ded-e920-4e68-9532-635d61109d72', 'body': {'volumeAttachment': {'volumeId': '577dc402-1676-425d-a073-128c805f79e2'}}} Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb5b8ded-e920-4e68-9532-635d61109d72 could not be found. (HTTP 404) (Request-ID: req-df5aa018-fd95-449c-893f-1e6e71d5d822) Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:39:36.169710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb5b8ded-e920-4e68-9532-635d61109d72 could not be found. Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb5b8ded-e920-4e68-9532-635d61109d72 could not be found. Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb5b8ded-e920-4e68-9532-635d61109d72 could not be found. Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:39:36.176632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] Returning 404 to user: Volume fb5b8ded-e920-4e68-9532-635d61109d72 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:39:36.180284 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92de690c-a0fe-447c-a42b-f16fd0942c84 tempest-VolumesAdminNegativeTest-1185652044 tempest-VolumesAdminNegativeTest-1185652044-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd/os-volume_attachments/fb5b8ded-e920-4e68-9532-635d61109d72" status: 404 len: 109 microversion: 2.1 time: 0.116765 Oct 31 15:39:36.181065 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2300/4732] 10.222.0.20 () {60 vars in 1433 bytes} [Mon Oct 31 15:39:36 2022] PUT /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd/os-volume_attachments/fb5b8ded-e920-4e68-9532-635d61109d72 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:39:36.284998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:36.316061 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78c967df-491b-432d-8354-cc1efa84ba3a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.516687 Oct 31 15:39:36.319851 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2433/4733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:35 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:36.571941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b78651b5-501b-4655-b23b-2e9a428f4e89 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Action: 'create', calling method: .version_select at 0x7f16e0377040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-680331523", "policies": ["affinity"]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:36.630204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b78651b5-501b-4655-b23b-2e9a428f4e89 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:36.651850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b78651b5-501b-4655-b23b-2e9a428f4e89 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:36.767375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b78651b5-501b-4655-b23b-2e9a428f4e89 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:36.782262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b78651b5-501b-4655-b23b-2e9a428f4e89 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:36.820323 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b78651b5-501b-4655-b23b-2e9a428f4e89 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.531486 Oct 31 15:39:36.821288 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2301/4734] 10.222.0.20 () {60 vars in 1174 bytes} [Mon Oct 31 15:39:36 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:36.833355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bcec00a1-8598-4279-98af-48ee001caf78 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Action: 'create', calling method: .version_select at 0x7f16e0cebd30>, body: {"server_group": {"name": "tempest-server-group-702302734", "policies": ["affinity"]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:36.872884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bcec00a1-8598-4279-98af-48ee001caf78 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:36.884947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bcec00a1-8598-4279-98af-48ee001caf78 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:36.988473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bcec00a1-8598-4279-98af-48ee001caf78 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:36.996787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bcec00a1-8598-4279-98af-48ee001caf78 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:37.017451 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bcec00a1-8598-4279-98af-48ee001caf78 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.188965 Oct 31 15:39:37.020168 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2434/4735] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 31 15:39:36 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:37.030747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6977e9b4-2e68-4340-9bea-ecc692ef854b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Action: 'create', calling method: .version_select at 0x7f16e08cf700>, body: {"server_group": {"name": "tempest-server-group-702302734", "policies": ["affinity"]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:37.065809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6977e9b4-2e68-4340-9bea-ecc692ef854b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:37.088263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:37.089464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:37.100380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:37.100993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6977e9b4-2e68-4340-9bea-ecc692ef854b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:37.107893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:37.110419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:37.115313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:37.116148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:37.117031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:37.218947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6977e9b4-2e68-4340-9bea-ecc692ef854b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:37.243784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6977e9b4-2e68-4340-9bea-ecc692ef854b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:37.295228 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6977e9b4-2e68-4340-9bea-ecc692ef854b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.268582 Oct 31 15:39:37.296925 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2302/4736] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 31 15:39:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:37.320571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb8de249-0747-4a16-8716-1bd58ef797f1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:37.422236 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb8de249-0747-4a16-8716-1bd58ef797f1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/fbcbec63-02ba-4c2a-8d35-e4881cbcce95" status: 204 len: 0 microversion: 2.1 time: 0.105338 Oct 31 15:39:37.427326 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2303/4737] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:39:37 2022] DELETE /compute/v2.1/os-server-groups/fbcbec63-02ba-4c2a-8d35-e4881cbcce95 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:39:37.435204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:37.435828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:37.468697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:37.485058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:37.485821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:37.486628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:37.487191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:37.487532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:37.833745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:37.842586 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a1427418-2b32-463d-b3d2-d690957d3b27 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.758433 Oct 31 15:39:37.857511 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2435/4738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:37 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:37.864866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87580bd8-367e-46cd-8b84-b66418c263c3 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:37.908443 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87580bd8-367e-46cd-8b84-b66418c263c3 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.049426 Oct 31 15:39:37.910860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:37.923109 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28c5b626-c961-4d07-9d14-111687facf06 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.493165 Oct 31 15:39:37.924086 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2304/4739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:37 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:37.926418 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2436/4740] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:39:37 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:38.016481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f51c3a1d-0653-4a8b-bd2c-dc97df803955 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:38.055756 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f51c3a1d-0653-4a8b-bd2c-dc97df803955 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/82929885-25f1-47f5-a9d7-d0d2095bd5ad" status: 204 len: 0 microversion: 2.1 time: 0.044309 Oct 31 15:39:38.066577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d090eef-5061-4fa1-b13b-9fae0a51e201 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:38.072622 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2437/4741] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:39:38 2022] DELETE /compute/v2.1/os-server-groups/82929885-25f1-47f5-a9d7-d0d2095bd5ad => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:39:38.091991 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d090eef-5061-4fa1-b13b-9fae0a51e201 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029930 Oct 31 15:39:38.106318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a76ca07-105c-4cb4-bc62-2caafb340cac tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Action: 'create', calling method: .version_select at 0x7f16e0ba4a60>, body: {"server_group": {"name": "tempest-server-group-2090765000", "policies": ["affinity"]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:38.114017 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2305/4742] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:39:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:38.189309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-8a76ca07-105c-4cb4-bc62-2caafb340cac tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:38.201602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-8a76ca07-105c-4cb4-bc62-2caafb340cac tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:38.258198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-8a76ca07-105c-4cb4-bc62-2caafb340cac tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:38.265714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-8a76ca07-105c-4cb4-bc62-2caafb340cac tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:38.283003 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a76ca07-105c-4cb4-bc62-2caafb340cac tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.180598 Oct 31 15:39:38.284540 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2438/4743] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 31 15:39:38 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:39:38.295512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c19db9d7-5987-4475-81a9-bdce6c7134f6 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:38.330603 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c19db9d7-5987-4475-81a9-bdce6c7134f6 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/8541cf23-2528-4176-926a-f89e4608ea6b" status: 204 len: 0 microversion: 2.1 time: 0.039003 Oct 31 15:39:38.342839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5501e4d0-5ee2-48ef-be83-c04ae61fb688 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:38.350029 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2306/4744] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:39:38 2022] DELETE /compute/v2.1/os-server-groups/8541cf23-2528-4176-926a-f89e4608ea6b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:39:38.358006 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5501e4d0-5ee2-48ef-be83-c04ae61fb688 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.019011 Oct 31 15:39:38.361345 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2439/4745] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:39:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:38.373227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60b82c3d-8c00-444d-91b3-17da2c034c4f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Action: 'create', calling method: .version_select at 0x7f16e03a8a60>, body: {"server_group": {"name": "tempest-server-group-202170255", "policies": ["anti-affinity"]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:38.403942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-60b82c3d-8c00-444d-91b3-17da2c034c4f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:38.411047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-60b82c3d-8c00-444d-91b3-17da2c034c4f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:38.446465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:38.477641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-60b82c3d-8c00-444d-91b3-17da2c034c4f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:38.485167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-60b82c3d-8c00-444d-91b3-17da2c034c4f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_groups'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:38.502349 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60b82c3d-8c00-444d-91b3-17da2c034c4f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.133846 Oct 31 15:39:38.504293 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2307/4746] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 31 15:39:38 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:38.516685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61e39a63-c165-4664-8358-6c7828c45b7b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:38.573860 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61e39a63-c165-4664-8358-6c7828c45b7b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/b9ea0e57-63b3-45ce-b570-e80a2bff0c0e" status: 204 len: 0 microversion: 2.1 time: 0.057548 Oct 31 15:39:38.574982 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2440/4747] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:39:38 2022] DELETE /compute/v2.1/os-server-groups/b9ea0e57-63b3-45ce-b570-e80a2bff0c0e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:39:38.588133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fda9fccd-2f46-4f7b-b621-780baf48a064 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:38.610930 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fda9fccd-2f46-4f7b-b621-780baf48a064 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031330 Oct 31 15:39:38.616057 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2308/4748] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:39:38 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:38.764477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-775184837", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "5574ab5d-6a40-450e-8a57-6e5b4734e6d6"}]}, "os:scheduler_hints": {"group": "b1a2fd05-0b51-487e-a1e1-8c1632b33a27"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:38.876777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:38.878418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] validate_networks() for [('5574ab5d-6a40-450e-8a57-6e5b4734e6d6', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:39:38.879184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:38.905665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:38.906892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:38.909633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:38.914385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:38.915245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:38.915777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:39.199368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:39.212457 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc2e0fa7-383c-4724-8392-a8de1ced5a35 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.346758 Oct 31 15:39:39.214863 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2309/4749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:38 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:39.229196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:39.231420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:39.245443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:39.246100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:39.247320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:39.248239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:39.248870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:39.249495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:39.723832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:39.746414 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-daa6be0b-ddcf-4d77-b5ad-f57ef9d3e0ed tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.528054 Oct 31 15:39:39.747222 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2310/4750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:39 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:40.238086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:40.239348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:40.256887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:40.258276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:40.258955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:40.263521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:40.264295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:40.265035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:40.582002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:40.591503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:39:40.591983 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-240aa81a-7587-4e50-a99e-639094dc65aa tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.358987 Oct 31 15:39:40.592089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:39:40.592573 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2311/4751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:40 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:40.605735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:39:40.606282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:39:40.606713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:39:40.632197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:40.632610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:40.633037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:40.634323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:40.634789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:40.635215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:40.685006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:40.718535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:40.723654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:40.770673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:40.771280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:40.810268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:40.810268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:40.810268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:40.810268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:40.811157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:39:40.813646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:39:40.824479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:40.824984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:40.961282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120587) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 31 15:39:40.999805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_group_members'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:41.015983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_group_members'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:41.124354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for project d1543369996041efb548cddd849a2662. Resources: {'server_group_members'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:39:41.135659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Getting quotas for user 05b65a60d95c443199b6f1fd25e5ee21 and project d1543369996041efb548cddd849a2662. Resources: {'server_group_members'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:39:41.195048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:41.208716 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b6cee834-5720-447f-b5ad-7579ab7f4efe tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.439506 Oct 31 15:39:41.209763 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2312/4752] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:40 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:41.225600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:41.227481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:41.233407 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f2b3678c-c2ea-4321-a847-ba0b4b6fdff1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.471188 Oct 31 15:39:41.245420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:41.245931 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2441/4753] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:39:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:39:41.246040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:41.246342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:41.247054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:41.247599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:41.247909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:41.260992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d131866d-9a42-4297-8536-65e308b3cbd3 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:41.264746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d131866d-9a42-4297-8536-65e308b3cbd3 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:41.320805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:39:41.445492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d131866d-9a42-4297-8536-65e308b3cbd3 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:41.465227 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d131866d-9a42-4297-8536-65e308b3cbd3 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1212 microversion: 2.1 time: 0.216043 Oct 31 15:39:41.466075 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2442/4754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:41 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1212 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:41.583163 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd935b5d-8f92-4ffc-a9b3-829c6e46acc1 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 204 len: 0 microversion: 2.1 time: 0.365124 Oct 31 15:39:41.585275 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2313/4755] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:39:41 2022] DELETE /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:39:41.593738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:41.594414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:41.609458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:41.609978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:41.610513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:41.616465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:41.616963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:41.617795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:41.622027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:41.623828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:41.634851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:41.637646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:41.638371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:41.638890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:41.639607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:41.641276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:41.641888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:42.013333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:42.042185 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6bb27c4f-8664-4912-81b6-2183406d6190 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1514 microversion: 2.1 time: 0.452716 Oct 31 15:39:42.045894 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2443/4756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:41 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1514 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:42.124063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:42.136849 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dca8257-90fc-4b48-919e-a703cbc99bbb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.519947 Oct 31 15:39:42.138320 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2314/4757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:41 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:42.239287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:42.241706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:42.254559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:42.255056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:42.258051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:42.261155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:42.262756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:42.265670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:42.494105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:42.495364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:42.505905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:42.506664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:42.507282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:42.512442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:42.515727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:42.516529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:42.654911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:42.665541 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf87ed41-79e0-4bb3-8b3d-6323fe7fa892 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1208 microversion: 2.1 time: 0.175263 Oct 31 15:39:42.666169 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2315/4758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:42 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1208 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:42.850928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:42.860739 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-421a4043-3f4c-4013-be82-0939a3aa3354 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1679 microversion: 2.1 time: 0.627230 Oct 31 15:39:42.862800 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2444/4759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:42 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1679 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:43.072000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:43.073019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:43.083819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.085501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.086675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.087894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.098337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.099164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.163784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:43.164488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:43.175628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.179337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.179818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.182949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.183474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.183919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.462106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:43.470431 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3545c7b-d822-41e7-93a8-c5a9a47d6bc3 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1514 microversion: 2.1 time: 0.403648 Oct 31 15:39:43.471887 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2316/4760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:43 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:43.547433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:43.559139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a66365a8-4c6e-415c-98b4-a8670ce329c8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1694 microversion: 2.1 time: 0.399516 Oct 31 15:39:43.559975 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2445/4761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:43 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1694 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:43.689537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:43.690801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:43.701371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.711206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.711667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.712502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.713413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.714576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.863233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:43.885934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-02ebf670-3496-499d-a766-5728731c437b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1208 microversion: 2.1 time: 0.199700 Oct 31 15:39:43.888443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:43.889314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:43.889737 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2317/4762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:43 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1208 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:43.901174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.901959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.903958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.907869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:43.908751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:43.908936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:43.984235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-473841b6-e948-4cb9-932a-d0f11a9d479e req-c0187de9-2365-4852-b475-ba6a37be5b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70786873-df81-4755-b3e7-41a13595f5cd", "name": "network-vif-deleted", "tag": "3584d949-1ef8-4044-b198-ac86ed39fcc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:44.021383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-473841b6-e948-4cb9-932a-d0f11a9d479e req-c0187de9-2365-4852-b475-ba6a37be5b97 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.021897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-473841b6-e948-4cb9-932a-d0f11a9d479e req-c0187de9-2365-4852-b475-ba6a37be5b97 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.022342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-473841b6-e948-4cb9-932a-d0f11a9d479e req-c0187de9-2365-4852-b475-ba6a37be5b97 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.037682 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-473841b6-e948-4cb9-932a-d0f11a9d479e req-c0187de9-2365-4852-b475-ba6a37be5b97 service nova] Creating event network-vif-deleted:3584d949-1ef8-4044-b198-ac86ed39fcc9 for instance 70786873-df81-4755-b3e7-41a13595f5cd on n-h1-858384-17 Oct 31 15:39:44.071120 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-473841b6-e948-4cb9-932a-d0f11a9d479e req-c0187de9-2365-4852-b475-ba6a37be5b97 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086959 Oct 31 15:39:44.073267 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2318/4763] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:44.156918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:44.169387 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7b57afa-c930-4719-b48e-c6dfe60c1231 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1656 microversion: 2.1 time: 0.286131 Oct 31 15:39:44.170625 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2446/4764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:43 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1656 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:44.196592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d55b50a2-ad8e-4d16-b4d7-28dafe286911 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:44.205887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d55b50a2-ad8e-4d16-b4d7-28dafe286911 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.206642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d55b50a2-ad8e-4d16-b4d7-28dafe286911 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.207278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d55b50a2-ad8e-4d16-b4d7-28dafe286911 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.247576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d55b50a2-ad8e-4d16-b4d7-28dafe286911 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Going to try to start instance {{(pid=120588) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 15:39:44.296630 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d55b50a2-ad8e-4d16-b4d7-28dafe286911 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.104579 Oct 31 15:39:44.297697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2319/4765] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:39:44 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:39:44.307352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:44.308140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:44.315512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.316265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.317060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.317904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.318478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.319017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.477845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:44.490565 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7cbde5e-5643-4660-a315-5262c7cc4b1a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1665 microversion: 2.1 time: 0.187156 Oct 31 15:39:44.491441 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2447/4766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:44 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1665 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:44.503229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:44.504242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:44.528962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.532937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.534883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.537083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.538510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.550911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.585508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:44.586267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:44.595236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.596625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.599370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.600256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.602833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.603405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.611516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.612732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.613582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.614202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lazy-loading 'fault' on Instance uuid 70786873-df81-4755-b3e7-41a13595f5cd {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:39:44.617588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:44.765675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:44.781956 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-290dd505-b96f-420e-88ac-b02bdcfe5677 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 200 len: 1308 microversion: 2.1 time: 0.287208 Oct 31 15:39:44.788163 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2320/4767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:44 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:44.912629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:44.913577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:44.927140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.928133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.930286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:44.931208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:44.932783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:44.933444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:45.084586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:45.098402 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76084e94-65dd-437c-b719-c9febfa0635b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1282 microversion: 2.1 time: 0.189655 Oct 31 15:39:45.099018 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2321/4768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:44 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1282 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:45.519136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:45.519747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:45.537092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:45.538288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:45.538892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:45.539765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:45.540406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:45.540843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:45.588194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:45.596734 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eb765df7-fcbc-428e-855e-38bcc095b99b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1693 microversion: 2.1 time: 1.014741 Oct 31 15:39:45.601113 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2448/4769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:44 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1693 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:45.821949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:45.824981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 70786873-df81-4755-b3e7-41a13595f5cd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:45.861253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:45.862259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:45.862934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:45.864308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:45.864893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:45.865687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:45.885378 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] HTTP exception thrown: Instance 70786873-df81-4755-b3e7-41a13595f5cd could not be found. Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Request method failure captured: Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd HTTP/1.1 Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-u2CrwWrnG67Qexo8zLtr6yKMFkXmIEK192f_mE07MACwd2fj85KVKtVuGey62OBVHNLGH2OboULb2EySI9R6p9-C-4cu7-dkq6lP9rO4-G4DtZxKU86V5XjzcZv8OS6WI1B9W-4eV3V-xncrtHhfphRz9XSrrI27znht3TQZRUIYM Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 1c07afa65f4641e09b798511a614d9a6 Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesAdminNegativeTest-151535325 Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1c07afa65f4641e09b798511a614d9a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1c07afa65f4641e09b798511a614d9a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1c07afa65f4641e09b798511a614d9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1c07afa65f4641e09b798511a614d9a6"}]}] Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesAdminNegativeTest-151535325 Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 1c07afa65f4641e09b798511a614d9a6 Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-151535325 Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesAdminNegativeTest-151535325-project Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e1e5884af4ed42e8914691ad56cb474b Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesAdminNegativeTest-151535325-project Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 70786873-df81-4755-b3e7-41a13595f5cd could not be found. Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '70786873-df81-4755-b3e7-41a13595f5cd'} Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70786873-df81-4755-b3e7-41a13595f5cd could not be found. Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70786873-df81-4755-b3e7-41a13595f5cd could not be found. Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:45.887207 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:45.891557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:45.891557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:45.891557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:45.891557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:39:45.891557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:39:45.891557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70786873-df81-4755-b3e7-41a13595f5cd could not be found. Oct 31 15:39:45.891557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:45.891557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Returning 404 to user: Instance 70786873-df81-4755-b3e7-41a13595f5cd could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:39:45.891557 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1100c84-f37e-4cb0-abc1-987dc3c064ad tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd" status: 404 len: 111 microversion: 2.1 time: 0.077088 Oct 31 15:39:45.896543 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2449/4770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:45 2022] GET /compute/v2.1/servers/70786873-df81-4755-b3e7-41a13595f5cd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:39:45.948274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:45.962373 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0c232e0d-e667-4d3f-9a57-1b1530a5dce0 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1665 microversion: 2.1 time: 0.447033 Oct 31 15:39:45.962985 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2322/4771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:45 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1665 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:46.125406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:46.126270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:46.138158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:46.138657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:46.139337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:46.140454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:46.142001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:46.143067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:46.294326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:46.305884 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe94ca90-6e8d-4a40-92af-617da23e05f9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1270 microversion: 2.1 time: 0.186669 Oct 31 15:39:46.307571 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2450/4772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:46 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1270 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:46.637061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:46.639118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:46.660077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:46.663280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:46.667491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:46.669894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:46.670630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:46.674074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:47.019630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:47.022090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:47.051325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:47.053177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:47.054572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:47.055423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:47.055896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:47.056610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:47.226687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:47.239595 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6755cb19-6678-45d4-aad6-ae5c7fe71630 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1693 microversion: 2.1 time: 0.609874 Oct 31 15:39:47.240486 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2323/4773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:46 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1693 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:47.249940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-58e1bcde-4bea-4ca4-8595-c38688b05234 req-4ad14d1f-ef0f-4e7f-8f8b-8be40917de2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391f5764-ac2b-41ae-8f1d-76f294d4b6ba", "name": "network-vif-unplugged", "status": "completed", "tag": "91a3aca2-1006-42f3-af44-4ec383fe9205"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:47.262196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-58e1bcde-4bea-4ca4-8595-c38688b05234 req-4ad14d1f-ef0f-4e7f-8f8b-8be40917de2c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:47.262931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-58e1bcde-4bea-4ca4-8595-c38688b05234 req-4ad14d1f-ef0f-4e7f-8f8b-8be40917de2c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:47.263647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-58e1bcde-4bea-4ca4-8595-c38688b05234 req-4ad14d1f-ef0f-4e7f-8f8b-8be40917de2c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:47.277475 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-58e1bcde-4bea-4ca4-8595-c38688b05234 req-4ad14d1f-ef0f-4e7f-8f8b-8be40917de2c service nova] Creating event network-vif-unplugged:91a3aca2-1006-42f3-af44-4ec383fe9205 for instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba on n-h1-858384-17 Oct 31 15:39:47.285841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-58e1bcde-4bea-4ca4-8595-c38688b05234 req-4ad14d1f-ef0f-4e7f-8f8b-8be40917de2c service nova] Instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:39:47.300682 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-58e1bcde-4bea-4ca4-8595-c38688b05234 req-4ad14d1f-ef0f-4e7f-8f8b-8be40917de2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056755 Oct 31 15:39:47.302044 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2324/4774] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:47.334416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:47.335568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:47.344304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:47.345083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:47.346716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:47.351397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:47.351899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:47.352344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:47.942801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:47.958126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:47.959256 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7666f00-477b-42ab-bac3-8df494dc984e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.623554 Oct 31 15:39:47.969162 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2325/4775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:47 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:47.969512 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8293b481-d15c-4532-ad53-2f76b7204e40 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1665 microversion: 2.1 time: 0.983006 Oct 31 15:39:47.969512 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2451/4776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:46 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1665 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:48.267408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:48.268070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:48.285369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:48.285785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:48.286227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:48.286944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:48.287399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:48.287824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:48.494363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=24 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:48.831461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:48.840362 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ffad924-85bb-44ef-b601-d494b47a4985 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1693 microversion: 2.1 time: 0.577313 Oct 31 15:39:48.841289 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2326/4777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:48 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1693 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:48.985732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:48.987505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:48.998688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:48.999570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:49.017904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.020589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.020919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.022245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:49.023776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.024170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.024806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.025436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:49.026049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:49.026944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.029621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.030270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:49.675322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:49.677629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:49.686467 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7de8d198-a332-4f1a-905a-8ba3c60611d2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.694279 Oct 31 15:39:49.691188 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2327/4778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:48 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:49.704033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-11f6c27d-0910-42be-9db7-ee476ac5d1a3 req-0e846f39-6ac6-4869-a2c1-135b49495d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391f5764-ac2b-41ae-8f1d-76f294d4b6ba", "tag": "91a3aca2-1006-42f3-af44-4ec383fe9205"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:49.709496 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2cf6ab1-6aed-4227-b945-123e62cc4984 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.725940 Oct 31 15:39:49.710294 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2452/4779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:48 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:49.723573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-11f6c27d-0910-42be-9db7-ee476ac5d1a3 req-0e846f39-6ac6-4869-a2c1-135b49495d48 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.724217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-11f6c27d-0910-42be-9db7-ee476ac5d1a3 req-0e846f39-6ac6-4869-a2c1-135b49495d48 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.724999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-11f6c27d-0910-42be-9db7-ee476ac5d1a3 req-0e846f39-6ac6-4869-a2c1-135b49495d48 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:49.732474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:49.734600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:49.745628 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-11f6c27d-0910-42be-9db7-ee476ac5d1a3 req-0e846f39-6ac6-4869-a2c1-135b49495d48 service nova] Creating event network-changed:91a3aca2-1006-42f3-af44-4ec383fe9205 for instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba on n-h1-858384-17 Oct 31 15:39:49.756224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-11f6c27d-0910-42be-9db7-ee476ac5d1a3 req-0e846f39-6ac6-4869-a2c1-135b49495d48 service nova] Instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:39:49.764216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.764731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.765206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:49.766457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.766457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.766863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:49.771480 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-11f6c27d-0910-42be-9db7-ee476ac5d1a3 req-0e846f39-6ac6-4869-a2c1-135b49495d48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078676 Oct 31 15:39:49.772501 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2328/4780] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:49.870484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:49.871441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:49.879711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.880326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.881013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:49.882115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:49.882818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:49.883545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:50.193044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:50.202563 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19bd28e4-63b5-46cd-a1ff-16ea2cf15843 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.478325 Oct 31 15:39:50.207079 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2453/4781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:49 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:50.222466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:50.235196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:50.236233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:50.244855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:50.245971 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b48b10d-b10e-452b-ba37-448228ed1731 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1693 microversion: 2.1 time: 0.381160 Oct 31 15:39:50.246303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:50.246918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:50.247638 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2329/4782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:49 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1693 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:50.248244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:50.249000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:50.249844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:50.400454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:50.400955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:50.407934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:50.419421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:50.420204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:50.422110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:50.422818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:50.423696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:50.482193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:39:50.649847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:50.654339 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1986bb05-93b2-49a6-9ef2-4898ef26fef8 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "DELETE /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 204 len: 0 microversion: 2.1 time: 0.256793 Oct 31 15:39:50.655406 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2330/4783] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:39:50 2022] DELETE /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:39:50.670797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:50.673377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:50.694091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:50.696732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:50.698201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:50.699884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:50.703304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:50.709581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:50.860143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:50.873200 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d796b179-84b9-4090-bfa9-84ebdb06dbb2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.643545 Oct 31 15:39:50.893738 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2454/4784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:50 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:50.904941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:50.905995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:50.914101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:50.915183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:50.916136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:50.925671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:50.926377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:50.927023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:51.151830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:51.162846 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c58f4e8-a70f-419b-bc7c-c33e64a45573 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1678 microversion: 2.1 time: 0.499907 Oct 31 15:39:51.165822 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2331/4785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:50 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1678 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:51.178280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:51.178280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:51.188332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:51.189258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:51.189843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:51.190814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:51.191497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:51.192133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:51.206646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:51.218195 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c8d3ca31-8c01-41c9-b568-05a87a8f7c77 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.319666 Oct 31 15:39:51.237033 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2455/4786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:50 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:51.271625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:51.272566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:51.281808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:51.282568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:51.283626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:51.284509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:51.285210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:51.285760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:51.452662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=32 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:51.543303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:51.560071 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99bb1f59-31cb-4e5c-925a-2b2332e849fe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1691 microversion: 2.1 time: 0.293429 Oct 31 15:39:51.569160 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2456/4787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:51 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1691 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:51.830605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e715fc50-f601-419d-bbad-65856e9d6bec req-f44b3b5a-1fae-4e10-a041-60fe511045a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8704cf8-685f-4d8c-b060-180b8849851b", "tag": "4e8e6639-23df-4df1-a807-ea6392d20811"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:51.859613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e715fc50-f601-419d-bbad-65856e9d6bec req-f44b3b5a-1fae-4e10-a041-60fe511045a6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:51.860400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e715fc50-f601-419d-bbad-65856e9d6bec req-f44b3b5a-1fae-4e10-a041-60fe511045a6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:51.862200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e715fc50-f601-419d-bbad-65856e9d6bec req-f44b3b5a-1fae-4e10-a041-60fe511045a6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:51.895868 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e715fc50-f601-419d-bbad-65856e9d6bec req-f44b3b5a-1fae-4e10-a041-60fe511045a6 service nova] Creating event network-changed:4e8e6639-23df-4df1-a807-ea6392d20811 for instance b8704cf8-685f-4d8c-b060-180b8849851b on n-h2-858384-17 Oct 31 15:39:51.901448 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e715fc50-f601-419d-bbad-65856e9d6bec req-f44b3b5a-1fae-4e10-a041-60fe511045a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074415 Oct 31 15:39:51.902629 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2457/4788] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:51.994980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:52.004788 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-988d7e6e-9de6-4c97-b862-c33ce926b54a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.837863 Oct 31 15:39:52.005425 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2332/4789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:51 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:52.037200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:52.040875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:52.050672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:52.052810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:52.053436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:52.054394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:52.055514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:52.056211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:52.190621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:52.191668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:52.205092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:52.206206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:52.206206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:52.206654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:52.207118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:52.207548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:52.730995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:52.741014 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bbb9e739-8891-4936-ab98-6d0f94a88ad3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.715536 Oct 31 15:39:52.745932 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2458/4790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:52 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:52.758210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:52.758210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:52.769726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:52.770227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:52.770664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:52.771380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:52.771844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:52.772270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:52.852075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:52.860250 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa109b21-7a9f-4197-ad76-4a4a6cc32a09 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1678 microversion: 2.1 time: 0.674338 Oct 31 15:39:52.860859 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2333/4791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:52 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1678 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:52.870438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:52.871051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:52.890173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:52.890667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:52.891108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:52.891820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:52.892286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:52.892759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.539671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:53.557978 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1d77e7b-ad67-48aa-beda-20eac292fe4a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1688 microversion: 2.1 time: 0.691232 Oct 31 15:39:53.558778 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2334/4792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:52 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1688 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:53.563781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:53.564574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:53.599526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.600776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.603558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.605466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.607142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.608911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.666452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:53.677318 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1da1a9ba-7492-40a0-afdc-7a07bca4fe85 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.930247 Oct 31 15:39:53.683130 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2459/4793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:52 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:53.687915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lazy-loading 'flavor' on Instance uuid 78294b47-c54e-47ff-b715-d93117bef42f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:39:53.695098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-97a3cebb-7d73-43c3-b115-387457fc7f79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:53.698190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-97a3cebb-7d73-43c3-b115-387457fc7f79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:53.710356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a3cebb-7d73-43c3-b115-387457fc7f79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.711168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a3cebb-7d73-43c3-b115-387457fc7f79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.711954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a3cebb-7d73-43c3-b115-387457fc7f79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.712911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a3cebb-7d73-43c3-b115-387457fc7f79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.714550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a3cebb-7d73-43c3-b115-387457fc7f79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.715471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97a3cebb-7d73-43c3-b115-387457fc7f79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.755445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:53.771869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:53.822688 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-97a3cebb-7d73-43c3-b115-387457fc7f79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action" status: 204 len: 0 microversion: 2.1 time: 0.137882 Oct 31 15:39:53.824265 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2460/4794] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:39:53 2022] POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:39:53.840013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:53.843083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:53.853879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.854591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.855902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.856895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.857577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.858227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.861705 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ae88b2f-5420-42a5-8ccb-261db5b16e8f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.301339 Oct 31 15:39:53.866749 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2335/4795] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:39:53 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:39:53.872554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:53.879787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:53.896498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.897290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.897896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:53.898790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:53.909938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:53.910677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:54.352581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:54.362478 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a02532d-aa58-4358-952b-7b2c24986c0f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1688 microversion: 2.1 time: 0.533309 Oct 31 15:39:54.370157 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2461/4796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:53 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1688 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:54.375298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:54.378657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:54.391675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:54.394612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:54.396300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:54.401013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:54.401577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:54.402082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:54.426796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:54.444083 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ad0dfab-4f9a-43b0-8d26-c89f0c16dd4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1677 microversion: 2.1 time: 0.575753 Oct 31 15:39:54.444691 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2336/4797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:53 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1677 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:54.775944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7df38ba7-437f-414a-930f-ace0e95df80e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:54.776633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7df38ba7-437f-414a-930f-ace0e95df80e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:54.785035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df38ba7-437f-414a-930f-ace0e95df80e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:54.801931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:54.811136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df38ba7-437f-414a-930f-ace0e95df80e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:54.813705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df38ba7-437f-414a-930f-ace0e95df80e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:54.816616 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d7c6df8e-e1a8-48b7-9410-272a673d19d2 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1678 microversion: 2.1 time: 0.445091 Oct 31 15:39:54.816903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df38ba7-437f-414a-930f-ace0e95df80e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:54.817689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df38ba7-437f-414a-930f-ace0e95df80e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:54.818318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7df38ba7-437f-414a-930f-ace0e95df80e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:54.819110 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2462/4798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:54 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1678 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:54.835843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1f83b8a4-0643-41ef-a315-a1d51fba157f req-455b2f7c-9848-414a-be96-d28ebbc36f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391f5764-ac2b-41ae-8f1d-76f294d4b6ba", "name": "network-vif-plugged", "status": "completed", "tag": "91a3aca2-1006-42f3-af44-4ec383fe9205"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:54.861997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f83b8a4-0643-41ef-a315-a1d51fba157f req-455b2f7c-9848-414a-be96-d28ebbc36f24 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:54.863139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f83b8a4-0643-41ef-a315-a1d51fba157f req-455b2f7c-9848-414a-be96-d28ebbc36f24 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:54.869278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f83b8a4-0643-41ef-a315-a1d51fba157f req-455b2f7c-9848-414a-be96-d28ebbc36f24 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:54.887938 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7df38ba7-437f-414a-930f-ace0e95df80e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/ips" status: 200 len: 144 microversion: 2.1 time: 0.421841 Oct 31 15:39:54.889022 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2337/4799] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:39:54 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/ips => generated 144 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:54.918374 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1f83b8a4-0643-41ef-a315-a1d51fba157f req-455b2f7c-9848-414a-be96-d28ebbc36f24 service nova] Creating event network-vif-plugged:91a3aca2-1006-42f3-af44-4ec383fe9205 for instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba on n-h1-858384-17 Oct 31 15:39:54.919579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:54.920205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:54.973384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:54.973692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:54.974417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:54.975933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:54.976714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:54.977955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:54.979032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-1f83b8a4-0643-41ef-a315-a1d51fba157f req-455b2f7c-9848-414a-be96-d28ebbc36f24 service nova] Instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:39:55.032034 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1f83b8a4-0643-41ef-a315-a1d51fba157f req-455b2f7c-9848-414a-be96-d28ebbc36f24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211055 Oct 31 15:39:55.032661 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2463/4800] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:55.376471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:55.387597 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09b89a68-b794-4d31-8b12-bf778ca83508 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.497101 Oct 31 15:39:55.390035 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2338/4801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:54 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:55.394367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:55.397693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:55.431828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:55.442532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:55.444975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:55.446939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:55.447635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:55.451409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:55.476252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:55.477026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:55.492653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:55.505405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:55.505405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:55.505405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:55.505405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:55.505405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.053060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:56.057710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:56.072486 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56141405-39e3-4932-b11c-6973fc89bfc5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1660 microversion: 2.1 time: 0.602601 Oct 31 15:39:56.073354 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2339/4802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:55 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1660 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:56.081507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:56.086645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:56.097544 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-311a5fd9-83bb-4ec1-857f-98c297fe731a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1688 microversion: 2.1 time: 0.713519 Oct 31 15:39:56.099692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.103480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.104605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.106288 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2464/4803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:55 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1688 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:56.108377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.112541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.113866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.123002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-04418249-2a0e-4ea3-8de4-ec75b82f945f req-dec45340-69dc-44a2-8317-b067493478d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420aeaad-1dec-4179-aa64-f2785da16514", "name": "network-vif-deleted", "tag": "cf4e8e15-08e1-4ddf-ba24-102fa5db34d8"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:56.177953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04418249-2a0e-4ea3-8de4-ec75b82f945f req-dec45340-69dc-44a2-8317-b067493478d9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.181827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04418249-2a0e-4ea3-8de4-ec75b82f945f req-dec45340-69dc-44a2-8317-b067493478d9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.182487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04418249-2a0e-4ea3-8de4-ec75b82f945f req-dec45340-69dc-44a2-8317-b067493478d9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.229666 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-04418249-2a0e-4ea3-8de4-ec75b82f945f req-dec45340-69dc-44a2-8317-b067493478d9 service nova] Creating event network-vif-deleted:cf4e8e15-08e1-4ddf-ba24-102fa5db34d8 for instance 420aeaad-1dec-4179-aa64-f2785da16514 on n-h2-858384-17 Oct 31 15:39:56.250383 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-04418249-2a0e-4ea3-8de4-ec75b82f945f req-dec45340-69dc-44a2-8317-b067493478d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139175 Oct 31 15:39:56.253721 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2465/4804] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:39:56.273053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-97bebaea-5403-4f3e-b801-baa360edbe96 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:56.275674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-97bebaea-5403-4f3e-b801-baa360edbe96 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:56.285679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97bebaea-5403-4f3e-b801-baa360edbe96 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.288854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97bebaea-5403-4f3e-b801-baa360edbe96 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.289605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97bebaea-5403-4f3e-b801-baa360edbe96 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.290538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97bebaea-5403-4f3e-b801-baa360edbe96 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.291161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97bebaea-5403-4f3e-b801-baa360edbe96 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.291847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-97bebaea-5403-4f3e-b801-baa360edbe96 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.310286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e5884af4ed42e8914691ad56cb474b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c07afa65f4641e09b798511a614d9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:56.320421 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef5bac6a-2bd5-4ece-a04c-9b173be75d56 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 200 len: 1325 microversion: 2.1 time: 0.245803 Oct 31 15:39:56.327219 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2340/4805] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:56 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 1325 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:56.414847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:56.415723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:56.426188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.429195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.429834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.430755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.434591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.435287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.468804 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-97bebaea-5403-4f3e-b801-baa360edbe96 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action" status: 202 len: 0 microversion: 2.1 time: 0.211084 Oct 31 15:39:56.472569 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2466/4806] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:39:56 2022] POST /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:39:56.485367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:56.488133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:56.502839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.508062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.508751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.515249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:56.515966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:56.519007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:56.926219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:56.939614 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a786fdbb-a344-4687-bb03-32b23f9b960a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.529167 Oct 31 15:39:56.940760 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2341/4807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:56 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:39:57.143674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:57.144372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:57.177818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:57.198314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:57.201178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:57.206246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:57.209424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:57.210516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:57.335285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:57.368982 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a04c6fc9-a4df-4868-9263-3f10b38b1500 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1666 microversion: 2.1 time: 0.892033 Oct 31 15:39:57.397028 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2467/4808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:56 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1666 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:57.415663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:57.416293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] [instance: 420aeaad-1dec-4179-aa64-f2785da16514] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:57.438663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:57.440336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:57.453501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:57.455443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:57.459864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:57.460805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:57.513480 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] HTTP exception thrown: Instance 420aeaad-1dec-4179-aa64-f2785da16514 could not be found. Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Request method failure captured: Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 HTTP/1.1 Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-u2CrwWrnG67Qexo8zLtr6yKMFkXmIEK192f_mE07MACwd2fj85KVKtVuGey62OBVHNLGH2OboULb2EySI9R6p9-C-4cu7-dkq6lP9rO4-G4DtZxKU86V5XjzcZv8OS6WI1B9W-4eV3V-xncrtHhfphRz9XSrrI27znht3TQZRUIYM Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 1c07afa65f4641e09b798511a614d9a6 Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesAdminNegativeTest-151535325 Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1c07afa65f4641e09b798511a614d9a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1c07afa65f4641e09b798511a614d9a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1c07afa65f4641e09b798511a614d9a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1c07afa65f4641e09b798511a614d9a6"}]}] Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesAdminNegativeTest-151535325 Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 1c07afa65f4641e09b798511a614d9a6 Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-151535325 Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesAdminNegativeTest-151535325-project Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e1e5884af4ed42e8914691ad56cb474b Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesAdminNegativeTest-151535325-project Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 420aeaad-1dec-4179-aa64-f2785da16514 could not be found. Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '420aeaad-1dec-4179-aa64-f2785da16514'} Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 420aeaad-1dec-4179-aa64-f2785da16514 could not be found. Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 420aeaad-1dec-4179-aa64-f2785da16514 could not be found. Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:39:57.515610 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:57.521886 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:39:57.521886 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:39:57.521886 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:39:57.521886 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:39:57.521886 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:39:57.521886 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 420aeaad-1dec-4179-aa64-f2785da16514 could not be found. Oct 31 15:39:57.521886 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:39:57.524654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Returning 404 to user: Instance 420aeaad-1dec-4179-aa64-f2785da16514 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:39:57.526086 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f99a0eb-261c-4246-930d-0ca293535e90 tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514" status: 404 len: 111 microversion: 2.1 time: 0.126962 Oct 31 15:39:57.527262 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2468/4809] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:57 2022] GET /compute/v2.1/servers/420aeaad-1dec-4179-aa64-f2785da16514 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:39:57.541540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a6eb16fa-6c43-45d0-ae01-2b8ac691be9a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] Calling method '.version_select at 0x7f16e0240af0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:57.588078 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a6eb16fa-6c43-45d0-ae01-2b8ac691be9a tempest-VolumesAdminNegativeTest-151535325 tempest-VolumesAdminNegativeTest-151535325-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-870513798" status: 202 len: 0 microversion: 2.1 time: 0.056563 Oct 31 15:39:57.589211 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2469/4810] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:39:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-870513798 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:39:57.756363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99051be9-8508-451e-82bd-f96e3020af17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "882a7381-0b51-465a-a170-b8880242b348"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:39:57.759168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99051be9-8508-451e-82bd-f96e3020af17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:57.768414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99051be9-8508-451e-82bd-f96e3020af17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:57.769311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99051be9-8508-451e-82bd-f96e3020af17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:57.770003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99051be9-8508-451e-82bd-f96e3020af17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:57.770929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99051be9-8508-451e-82bd-f96e3020af17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:57.771601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99051be9-8508-451e-82bd-f96e3020af17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:57.772241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99051be9-8508-451e-82bd-f96e3020af17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:58.385239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99051be9-8508-451e-82bd-f96e3020af17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632834 Oct 31 15:39:58.411576 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2470/4811] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:39:57 2022] POST /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:39:58.420361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:58.421417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:58.435447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:58.436801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:58.437758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:58.438944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:58.439648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:58.440468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:58.544031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:58.553895 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa63cd4c-68d5-4171-b832-f49b5a885830 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1688 microversion: 2.1 time: 1.423458 Oct 31 15:39:58.561051 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2342/4812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:57 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1688 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:58.567043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:58.569254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:58.575242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:39:58.585753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:58.586705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:58.592617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:58.593654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:58.594341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:58.595802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:58.672079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:58.684456 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c4a5e39-cc94-42fe-8339-96cc8fc02951 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.271285 Oct 31 15:39:58.685052 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2471/4813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:58 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:59.218870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:39:59.236544 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-575b5305-4869-4f34-a975-408fcb31fff5 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1666 microversion: 2.1 time: 0.673233 Oct 31 15:39:59.238099 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2343/4814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:58 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1666 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:39:59.582914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:59.583700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:59.604900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:59.607705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:59.608378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:59.610612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:59.613776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:59.615712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:59.714241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:39:59.714858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:39:59.737026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:59.739005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:59.740957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:39:59.747717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:39:59.750318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:39:59.750990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:00.174805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:00.191880 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-debc5923-7fac-40dc-8263-b1b02b58c442 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.482534 Oct 31 15:40:00.194644 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2344/4815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:59 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:00.264027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:00.264936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:00.274638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:00.286952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:00.293574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:00.295160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:00.295861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:00.298162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:00.780037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:00.795708 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6bf9b36d-c8e6-444b-9b58-2725b9752958 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1680 microversion: 2.1 time: 1.214896 Oct 31 15:40:00.797093 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2472/4816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:39:59 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1680 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:00.976180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:00.984795 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-305f294f-e9a4-4d7d-966b-afb89e389572 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1666 microversion: 2.1 time: 0.724725 Oct 31 15:40:00.989199 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2345/4817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:00 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1666 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:01.230525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:01.231150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:01.238021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:01.251262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:01.254775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:01.255466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:01.256656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:01.258529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:01.260587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:01.682643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:01.702804 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dee23b52-592b-4de4-836e-3f3bc060b12f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.487840 Oct 31 15:40:01.720887 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2473/4818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:01 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:02.013278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:02.013915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:02.029750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:02.030235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:02.030866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:02.031761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:02.033395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:02.037653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:02.548771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7f12d9d5-483b-42b0-9603-eaaa8f4e3705 req-2583dd91-ccfc-41b1-ab33-8e284e0518a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8704cf8-685f-4d8c-b060-180b8849851b", "name": "network-vif-plugged", "status": "completed", "tag": "4e8e6639-23df-4df1-a807-ea6392d20811"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:02.570823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7f12d9d5-483b-42b0-9603-eaaa8f4e3705 req-2583dd91-ccfc-41b1-ab33-8e284e0518a8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:02.581808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7f12d9d5-483b-42b0-9603-eaaa8f4e3705 req-2583dd91-ccfc-41b1-ab33-8e284e0518a8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:02.582664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7f12d9d5-483b-42b0-9603-eaaa8f4e3705 req-2583dd91-ccfc-41b1-ab33-8e284e0518a8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:02.615488 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7f12d9d5-483b-42b0-9603-eaaa8f4e3705 req-2583dd91-ccfc-41b1-ab33-8e284e0518a8 service nova] Creating event network-vif-plugged:4e8e6639-23df-4df1-a807-ea6392d20811 for instance b8704cf8-685f-4d8c-b060-180b8849851b on n-h2-858384-17 Oct 31 15:40:02.630694 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7f12d9d5-483b-42b0-9603-eaaa8f4e3705 req-2583dd91-ccfc-41b1-ab33-8e284e0518a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085427 Oct 31 15:40:02.631529 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2474/4819] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:40:02.732385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:02.733096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:02.752514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:02.752963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:02.757889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:02.758860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:02.759497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:02.760085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:03.452405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:03.470048 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4409780d-cf7b-4065-97ef-5cd90e4ad6fb tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 0.743476 Oct 31 15:40:03.471608 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2475/4820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:02 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:03.520625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:03.531609 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d38895c-c865-4f31-ab48-5bcfd7a0750f tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 1.522377 Oct 31 15:40:03.536825 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2346/4821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:02 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:03.560231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:03.581462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:03.592088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:03.592586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:03.593024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:03.593762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:03.594222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:03.594636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:03.956727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:03.971555 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7792b68-6e5a-42d1-9ffd-22ecab3aeff1 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1669 microversion: 2.1 time: 0.415052 Oct 31 15:40:03.972420 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2476/4822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:03 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1669 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:04.008620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:04.009160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:04.024762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:04.025949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:04.026410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:04.027142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:04.027614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:04.028052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:04.106874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:04.116174 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Working on deleting snapshot 63cefb3e-56bb-4e09-adf9-1947bc7644a1 from shelved instance... Oct 31 15:40:04.495349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:04.495968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:04.508378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:04.508951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:04.509465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:04.510201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:04.512888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:04.513400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:05.454425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Doing local delete in cell 0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) {{(pid=120588) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 31 15:40:05.455917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:05.456412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:05.468467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:05.469434 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 31 15:40:05.479649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] deallocate_for_instance() {{(pid=120588) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 31 15:40:06.023455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:06.028287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:06.050857 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-81161e10-b89b-4cbc-b805-fc816a86b93b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1312 microversion: 2.1 time: 1.559864 Oct 31 15:40:06.052138 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2477/4823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:04 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1312 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:07.078618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:07.079446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:07.090447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:07.091286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:07.092065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:07.093247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:07.094010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:07.094662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:07.259230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:07.270664 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73de727e-68df-428b-99df-3e39fdc209e9 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1497 microversion: 2.1 time: 0.196735 Oct 31 15:40:07.284609 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2478/4824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:07 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:07.296212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d71a89d-a4bc-4d0c-a930-3aa7b1ff532e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:07.311307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.compute.server_groups [None req-3d71a89d-a4bc-4d0c-a930-3aa7b1ff532e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Querying cell 0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) for 1 instances {{(pid=120587) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:40:07.312367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d71a89d-a4bc-4d0c-a930-3aa7b1ff532e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:07.312861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d71a89d-a4bc-4d0c-a930-3aa7b1ff532e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:07.313503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d71a89d-a4bc-4d0c-a930-3aa7b1ff532e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:07.333015 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d71a89d-a4bc-4d0c-a930-3aa7b1ff532e tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/b1a2fd05-0b51-487e-a1e1-8c1632b33a27" status: 200 len: 221 microversion: 2.1 time: 0.041155 Oct 31 15:40:07.334071 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2479/4825] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:40:07 2022] GET /compute/v2.1/os-server-groups/b1a2fd05-0b51-487e-a1e1-8c1632b33a27 => generated 221 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:40:07.345576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:07.346497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:07.352872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:07.353419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:07.353859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:07.354576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:07.355041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:07.355474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:07.383509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:07.499110 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-040835e4-b8c0-46f8-8583-1a1d8399217b tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 204 len: 0 microversion: 2.1 time: 0.157802 Oct 31 15:40:07.499848 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2480/4826] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:07 2022] DELETE /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:07.509772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:07.510595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:07.518024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:07.518884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:07.520707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:07.521733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:07.522418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:07.523459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:07.707734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:07.717703 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b002440-22df-4c62-acbe-3475c847d362 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1503 microversion: 2.1 time: 0.212343 Oct 31 15:40:07.718414 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2481/4827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:07 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1503 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:08.374395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Updating instance_info_cache with network_info: [] {{(pid=120588) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:40:08.383676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-92535763-3ecc-4106-a8cd-d1cce7dcbb56 req-104602cb-d552-44df-ba2b-a8c26632223d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcd62cd-e056-43e8-acc4-698383847102", "name": "network-vif-deleted", "tag": "04a4cc6f-4902-4b74-84ac-1a54db96dfdd"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:08.405488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-92535763-3ecc-4106-a8cd-d1cce7dcbb56 req-104602cb-d552-44df-ba2b-a8c26632223d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:08.408245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-92535763-3ecc-4106-a8cd-d1cce7dcbb56 req-104602cb-d552-44df-ba2b-a8c26632223d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:08.410843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-92535763-3ecc-4106-a8cd-d1cce7dcbb56 req-104602cb-d552-44df-ba2b-a8c26632223d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:08.442767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.compute.server_external_events [req-92535763-3ecc-4106-a8cd-d1cce7dcbb56 req-104602cb-d552-44df-ba2b-a8c26632223d service nova] Unable to find a host for instance 9bcd62cd-e056-43e8-acc4-698383847102. Dropping event network-vif-deleted {{(pid=120587) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 15:40:08.443956 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-92535763-3ecc-4106-a8cd-d1cce7dcbb56 req-104602cb-d552-44df-ba2b-a8c26632223d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.065448 Oct 31 15:40:08.445232 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2482/4828] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 15:40:08.743609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:08.744974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:08.755969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:08.757074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:08.757547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:08.758277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:08.758740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:08.759167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:08.781829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:08.863190 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5a44498-c00e-42d4-93e7-0152b19a1be8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 204 len: 0 microversion: 2.1 time: 4.859098 Oct 31 15:40:08.868211 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2347/4829] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:04 2022] DELETE /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 0 bytes in 4862 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:08.873419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:08.873972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 9bcd62cd-e056-43e8-acc4-698383847102] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:08.901195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:08.906939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:08.908325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:08.920037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:08.920479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:08.931411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:08.959066 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] HTTP exception thrown: Instance 9bcd62cd-e056-43e8-acc4-698383847102 could not be found. Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Request method failure captured: Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 HTTP/1.1 Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-pihMoS1lrMFnbEBCE6im_zb2InyUzY2oThjFX9uAdMTRl14xGqD-jMSZE26wIdrBRKGZdj0fhdoCm04cRDKzmlD6YgLdNVJOqAa1j5PfjCenA2rpmcB3IRRDEHNHdn0C9fxCVNu4gZyN1n5Rx1oeD39zVZQ2TMo2ESLLyN8flkT_I Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f99b34e7ae9b44b5a9666b17fa41570e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f99b34e7ae9b44b5a9666b17fa41570e"}]}] Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 33e8230d70464e5da2cced0060bb1a31 Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9bcd62cd-e056-43e8-acc4-698383847102 could not be found. Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9bcd62cd-e056-43e8-acc4-698383847102'} Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bcd62cd-e056-43e8-acc4-698383847102 could not be found. Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bcd62cd-e056-43e8-acc4-698383847102 could not be found. Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:08.963636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:08.967918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:08.967918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:08.967918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:08.967918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:08.967918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:08.967918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bcd62cd-e056-43e8-acc4-698383847102 could not be found. Oct 31 15:40:08.967918 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:08.969805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Returning 404 to user: Instance 9bcd62cd-e056-43e8-acc4-698383847102 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:08.972089 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-39bf0be0-3f59-4934-942a-a059aae21130 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102" status: 404 len: 111 microversion: 2.1 time: 0.102798 Oct 31 15:40:08.973145 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2348/4830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:08 2022] GET /compute/v2.1/servers/9bcd62cd-e056-43e8-acc4-698383847102 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:08.984523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:08.985563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:08.999098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:08.999715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:09.000236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:09.001006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:09.002467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:09.002966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:09.045392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:09.174425 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7193261e-3254-4bdd-aaae-f89bd873aa44 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 204 len: 0 microversion: 2.1 time: 0.196156 Oct 31 15:40:09.176150 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2349/4831] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:08 2022] DELETE /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:09.183896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:09.185982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:09.188412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:09.194371 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c78f20a0-3a78-4116-8c72-76fdd34dc857 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1503 microversion: 2.1 time: 0.454693 Oct 31 15:40:09.197327 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2483/4832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:08 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1503 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:09.205621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:09.206356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:09.206984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:09.207877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:09.208761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:09.209385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:09.495193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:09.509519 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f51de76-bc5f-43de-ae78-4139c4795625 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1467 microversion: 2.1 time: 0.328237 Oct 31 15:40:09.510238 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2350/4833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:09 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1467 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:10.227332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:10.228007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:10.239205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:10.239966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:10.240565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:10.241601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:10.242630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:10.243257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:10.366138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b65a60d95c443199b6f1fd25e5ee21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1543369996041efb548cddd849a2662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:10.375031 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea21a764-9de0-4042-b19d-6a3b2d17b875 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 200 len: 1461 microversion: 2.1 time: 0.153492 Oct 31 15:40:10.375635 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2484/4834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:10 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 1461 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:10.535990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:10.536748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:10.545767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:10.551103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:10.551660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:10.552782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:10.553761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:10.554412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:10.669056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5c6cdaaa-c8cf-45e6-bb53-f1f564594ba0 req-ed28b978-b797-4949-8e88-5d9035cb7fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8704cf8-685f-4d8c-b060-180b8849851b", "name": "network-vif-deleted", "tag": "4e8e6639-23df-4df1-a807-ea6392d20811"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:10.687722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5c6cdaaa-c8cf-45e6-bb53-f1f564594ba0 req-ed28b978-b797-4949-8e88-5d9035cb7fd1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:10.691101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5c6cdaaa-c8cf-45e6-bb53-f1f564594ba0 req-ed28b978-b797-4949-8e88-5d9035cb7fd1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:10.691746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5c6cdaaa-c8cf-45e6-bb53-f1f564594ba0 req-ed28b978-b797-4949-8e88-5d9035cb7fd1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:10.723055 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5c6cdaaa-c8cf-45e6-bb53-f1f564594ba0 req-ed28b978-b797-4949-8e88-5d9035cb7fd1 service nova] Creating event network-vif-deleted:4e8e6639-23df-4df1-a807-ea6392d20811 for instance b8704cf8-685f-4d8c-b060-180b8849851b on n-h2-858384-17 Oct 31 15:40:10.737002 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5c6cdaaa-c8cf-45e6-bb53-f1f564594ba0 req-ed28b978-b797-4949-8e88-5d9035cb7fd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070493 Oct 31 15:40:10.740710 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2485/4835] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:40:10.826143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:10.855135 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b65e4735-5e79-4c51-9750-34fa38b90910 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1467 microversion: 2.1 time: 0.321635 Oct 31 15:40:10.857439 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2351/4836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:10 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1467 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:11.404596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.408980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:11.423691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.424835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.425745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.426853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.427538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.428182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.445983 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] HTTP exception thrown: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Request method failure captured: Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b HTTP/1.1 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-w4jDRUEzf3yT9em59SsRpPGYrFDfT-beHOj46I5iYwLBp_okQ-aCfYyMZ0Low2F76tKZvNIe6eTi_Ngl3BPOJKNpT-zbeMArefnKhfmXTNkU2Anmd1wZ2tSGAyxKWKTd39MW_UOwOIIcW3mhTdTFFVUofC18fZkCQjcZ6-tizxYBs Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1543369996041efb548cddd849a2662", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1543369996041efb548cddd849a2662"}]}] Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 05b65a60d95c443199b6f1fd25e5ee21 Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b8704cf8-685f-4d8c-b060-180b8849851b'} Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.448803 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.454165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.454165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.454165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.454165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:11.454165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:11.454165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.454165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.454165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Returning 404 to user: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:11.456551 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a6d9c8ca-edd9-4bdf-bfdf-eea03224055f tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 404 len: 111 microversion: 2.1 time: 0.057694 Oct 31 15:40:11.460547 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2486/4837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:11 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:11.478823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89f8a839-60de-432c-97eb-1f4c0baa7352 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.500044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.server_groups [None req-89f8a839-60de-432c-97eb-1f4c0baa7352 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Querying cell 0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) for 1 instances {{(pid=120588) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:40:11.501799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89f8a839-60de-432c-97eb-1f4c0baa7352 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.502550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89f8a839-60de-432c-97eb-1f4c0baa7352 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.503184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89f8a839-60de-432c-97eb-1f4c0baa7352 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.533305 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89f8a839-60de-432c-97eb-1f4c0baa7352 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.057458 Oct 31 15:40:11.561294 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2352/4838] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:40:11 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:11.572391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8720f0ce-33fd-41af-9e85-96b7c564849c tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.601615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.compute.server_groups [None req-8720f0ce-33fd-41af-9e85-96b7c564849c tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Querying cell 0e0c29d5-7fdf-4375-a488-5ccb57653ff7(cell1) for 1 instances {{(pid=120587) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 31 15:40:11.603084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8720f0ce-33fd-41af-9e85-96b7c564849c tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.604035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8720f0ce-33fd-41af-9e85-96b7c564849c tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.604675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8720f0ce-33fd-41af-9e85-96b7c564849c tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.623060 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8720f0ce-33fd-41af-9e85-96b7c564849c tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/b1a2fd05-0b51-487e-a1e1-8c1632b33a27" status: 200 len: 183 microversion: 2.1 time: 0.055421 Oct 31 15:40:11.623970 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2487/4839] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:40:11 2022] GET /compute/v2.1/os-server-groups/b1a2fd05-0b51-487e-a1e1-8c1632b33a27 => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:11.636912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.637904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:11.646654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.647599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.648243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.649182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.650878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.653118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.671176 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] HTTP exception thrown: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Request method failure captured: Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b HTTP/1.1 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-w4jDRUEzf3yT9em59SsRpPGYrFDfT-beHOj46I5iYwLBp_okQ-aCfYyMZ0Low2F76tKZvNIe6eTi_Ngl3BPOJKNpT-zbeMArefnKhfmXTNkU2Anmd1wZ2tSGAyxKWKTd39MW_UOwOIIcW3mhTdTFFVUofC18fZkCQjcZ6-tizxYBs Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1543369996041efb548cddd849a2662", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1543369996041efb548cddd849a2662"}]}] Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 05b65a60d95c443199b6f1fd25e5ee21 Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'b8704cf8-685f-4d8c-b060-180b8849851b'} Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:11.676197 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.680240 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.683084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Returning 404 to user: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:11.684762 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8a5c0b9c-d693-4e52-9321-06c8f318b5d1 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 404 len: 111 microversion: 2.1 time: 0.051832 Oct 31 15:40:11.685601 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2353/4840] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:11 2022] DELETE /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:11.695735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.696438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] [instance: b8704cf8-685f-4d8c-b060-180b8849851b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:11.707311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.708087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.708235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.710374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.711252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.711672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.733486 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] HTTP exception thrown: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Request method failure captured: Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b HTTP/1.1 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-w4jDRUEzf3yT9em59SsRpPGYrFDfT-beHOj46I5iYwLBp_okQ-aCfYyMZ0Low2F76tKZvNIe6eTi_Ngl3BPOJKNpT-zbeMArefnKhfmXTNkU2Anmd1wZ2tSGAyxKWKTd39MW_UOwOIIcW3mhTdTFFVUofC18fZkCQjcZ6-tizxYBs Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1543369996041efb548cddd849a2662", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1543369996041efb548cddd849a2662"}]}] Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 05b65a60d95c443199b6f1fd25e5ee21 Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b8704cf8-685f-4d8c-b060-180b8849851b'} Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.736185 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.742676 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.742676 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.742676 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.742676 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:11.742676 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:11.742676 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. Oct 31 15:40:11.742676 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.756566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Returning 404 to user: Instance b8704cf8-685f-4d8c-b060-180b8849851b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:11.758062 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fb27c765-cc2e-40f4-92fe-ded29f0ff167 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b" status: 404 len: 111 microversion: 2.1 time: 0.067981 Oct 31 15:40:11.760601 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2488/4841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:11 2022] GET /compute/v2.1/servers/b8704cf8-685f-4d8c-b060-180b8849851b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:11.769642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b43ee272-33ce-49ca-92dc-7da0a75d52c6 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.778859 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b43ee272-33ce-49ca-92dc-7da0a75d52c6 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] HTTP exception thrown: Instance group b9ea0e57-63b3-45ce-b570-e80a2bff0c0e could not be found. Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b43ee272-33ce-49ca-92dc-7da0a75d52c6 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Request method failure captured: Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-server-groups/b9ea0e57-63b3-45ce-b570-e80a2bff0c0e HTTP/1.1 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-w4jDRUEzf3yT9em59SsRpPGYrFDfT-beHOj46I5iYwLBp_okQ-aCfYyMZ0Low2F76tKZvNIe6eTi_Ngl3BPOJKNpT-zbeMArefnKhfmXTNkU2Anmd1wZ2tSGAyxKWKTd39MW_UOwOIIcW3mhTdTFFVUofC18fZkCQjcZ6-tizxYBs Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1543369996041efb548cddd849a2662", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1543369996041efb548cddd849a2662"}]}] Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 05b65a60d95c443199b6f1fd25e5ee21 Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance group b9ea0e57-63b3-45ce-b570-e80a2bff0c0e could not be found. Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'b9ea0e57-63b3-45ce-b570-e80a2bff0c0e'} Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b9ea0e57-63b3-45ce-b570-e80a2bff0c0e could not be found. Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b9ea0e57-63b3-45ce-b570-e80a2bff0c0e could not be found. Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.785868 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.791686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.791686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.791686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:11.791686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:11.791686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b9ea0e57-63b3-45ce-b570-e80a2bff0c0e could not be found. Oct 31 15:40:11.791686 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.791686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b43ee272-33ce-49ca-92dc-7da0a75d52c6 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Returning 404 to user: Instance group b9ea0e57-63b3-45ce-b570-e80a2bff0c0e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:11.791686 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b43ee272-33ce-49ca-92dc-7da0a75d52c6 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/b9ea0e57-63b3-45ce-b570-e80a2bff0c0e" status: 404 len: 117 microversion: 2.1 time: 0.024350 Oct 31 15:40:11.791686 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2354/4842] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:40:11 2022] DELETE /compute/v2.1/os-server-groups/b9ea0e57-63b3-45ce-b570-e80a2bff0c0e => generated 117 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:11.801042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-311fa5e5-6e3c-49d7-91e1-413f13bebe2a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.809294 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-311fa5e5-6e3c-49d7-91e1-413f13bebe2a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] HTTP exception thrown: Instance group 8541cf23-2528-4176-926a-f89e4608ea6b could not be found. Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-311fa5e5-6e3c-49d7-91e1-413f13bebe2a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Request method failure captured: Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-server-groups/8541cf23-2528-4176-926a-f89e4608ea6b HTTP/1.1 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-w4jDRUEzf3yT9em59SsRpPGYrFDfT-beHOj46I5iYwLBp_okQ-aCfYyMZ0Low2F76tKZvNIe6eTi_Ngl3BPOJKNpT-zbeMArefnKhfmXTNkU2Anmd1wZ2tSGAyxKWKTd39MW_UOwOIIcW3mhTdTFFVUofC18fZkCQjcZ6-tizxYBs Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1543369996041efb548cddd849a2662", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1543369996041efb548cddd849a2662"}]}] Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 05b65a60d95c443199b6f1fd25e5ee21 Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance group 8541cf23-2528-4176-926a-f89e4608ea6b could not be found. Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8541cf23-2528-4176-926a-f89e4608ea6b'} Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8541cf23-2528-4176-926a-f89e4608ea6b could not be found. Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8541cf23-2528-4176-926a-f89e4608ea6b could not be found. Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.811177 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.816363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.816363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.816363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:11.816363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:11.816363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8541cf23-2528-4176-926a-f89e4608ea6b could not be found. Oct 31 15:40:11.816363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.818490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-311fa5e5-6e3c-49d7-91e1-413f13bebe2a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Returning 404 to user: Instance group 8541cf23-2528-4176-926a-f89e4608ea6b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:11.819388 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-311fa5e5-6e3c-49d7-91e1-413f13bebe2a tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/8541cf23-2528-4176-926a-f89e4608ea6b" status: 404 len: 117 microversion: 2.1 time: 0.022967 Oct 31 15:40:11.819973 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2489/4843] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:40:11 2022] DELETE /compute/v2.1/os-server-groups/8541cf23-2528-4176-926a-f89e4608ea6b => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:40:11.828219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c96b40d2-5e47-4119-b36c-9a9880b3fcce tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.840527 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c96b40d2-5e47-4119-b36c-9a9880b3fcce tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] HTTP exception thrown: Instance group 82929885-25f1-47f5-a9d7-d0d2095bd5ad could not be found. Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c96b40d2-5e47-4119-b36c-9a9880b3fcce tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Request method failure captured: Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/os-server-groups/82929885-25f1-47f5-a9d7-d0d2095bd5ad HTTP/1.1 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-w4jDRUEzf3yT9em59SsRpPGYrFDfT-beHOj46I5iYwLBp_okQ-aCfYyMZ0Low2F76tKZvNIe6eTi_Ngl3BPOJKNpT-zbeMArefnKhfmXTNkU2Anmd1wZ2tSGAyxKWKTd39MW_UOwOIIcW3mhTdTFFVUofC18fZkCQjcZ6-tizxYBs Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1543369996041efb548cddd849a2662", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1543369996041efb548cddd849a2662"}]}] Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 05b65a60d95c443199b6f1fd25e5ee21 Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance group 82929885-25f1-47f5-a9d7-d0d2095bd5ad could not be found. Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '82929885-25f1-47f5-a9d7-d0d2095bd5ad'} Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 82929885-25f1-47f5-a9d7-d0d2095bd5ad could not be found. Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 82929885-25f1-47f5-a9d7-d0d2095bd5ad could not be found. Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.842083 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.850077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.850077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.850077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:11.850077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:11.850077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 82929885-25f1-47f5-a9d7-d0d2095bd5ad could not be found. Oct 31 15:40:11.850077 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.850077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c96b40d2-5e47-4119-b36c-9a9880b3fcce tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Returning 404 to user: Instance group 82929885-25f1-47f5-a9d7-d0d2095bd5ad could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:11.850077 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c96b40d2-5e47-4119-b36c-9a9880b3fcce tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/82929885-25f1-47f5-a9d7-d0d2095bd5ad" status: 404 len: 117 microversion: 2.1 time: 0.019365 Oct 31 15:40:11.850077 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2355/4844] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:40:11 2022] DELETE /compute/v2.1/os-server-groups/82929885-25f1-47f5-a9d7-d0d2095bd5ad => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:11.855460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84d2683a-abbf-4401-b0b3-6d0f49dbb771 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.864922 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-84d2683a-abbf-4401-b0b3-6d0f49dbb771 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] HTTP exception thrown: Instance group fbcbec63-02ba-4c2a-8d35-e4881cbcce95 could not be found. Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84d2683a-abbf-4401-b0b3-6d0f49dbb771 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Request method failure captured: Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-server-groups/fbcbec63-02ba-4c2a-8d35-e4881cbcce95 HTTP/1.1 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-w4jDRUEzf3yT9em59SsRpPGYrFDfT-beHOj46I5iYwLBp_okQ-aCfYyMZ0Low2F76tKZvNIe6eTi_Ngl3BPOJKNpT-zbeMArefnKhfmXTNkU2Anmd1wZ2tSGAyxKWKTd39MW_UOwOIIcW3mhTdTFFVUofC18fZkCQjcZ6-tizxYBs Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d1543369996041efb548cddd849a2662", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d1543369996041efb548cddd849a2662"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d1543369996041efb548cddd849a2662"}]}] Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d1543369996041efb548cddd849a2662 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerGroupTestJSON-1870724037 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 05b65a60d95c443199b6f1fd25e5ee21 Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerGroupTestJSON-1870724037-project Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance group fbcbec63-02ba-4c2a-8d35-e4881cbcce95 could not be found. Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'fbcbec63-02ba-4c2a-8d35-e4881cbcce95'} Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fbcbec63-02ba-4c2a-8d35-e4881cbcce95 could not be found. Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fbcbec63-02ba-4c2a-8d35-e4881cbcce95 could not be found. Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.866521 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:11.870416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:11.870416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:11.870416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:11.870416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:11.870416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fbcbec63-02ba-4c2a-8d35-e4881cbcce95 could not be found. Oct 31 15:40:11.870416 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:11.870416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84d2683a-abbf-4401-b0b3-6d0f49dbb771 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Returning 404 to user: Instance group fbcbec63-02ba-4c2a-8d35-e4881cbcce95 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:11.870416 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-84d2683a-abbf-4401-b0b3-6d0f49dbb771 tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/fbcbec63-02ba-4c2a-8d35-e4881cbcce95" status: 404 len: 117 microversion: 2.1 time: 0.018443 Oct 31 15:40:11.870416 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2490/4845] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:40:11 2022] DELETE /compute/v2.1/os-server-groups/fbcbec63-02ba-4c2a-8d35-e4881cbcce95 => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:11.881334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ba2a7d8-e139-4699-a962-9df5b967cbab tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.882825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:11.883623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:11.890319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.891056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.892309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.893859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:11.894630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:11.895222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:11.923619 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ba2a7d8-e139-4699-a962-9df5b967cbab tempest-ServerGroupTestJSON-1870724037 tempest-ServerGroupTestJSON-1870724037-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/b1a2fd05-0b51-487e-a1e1-8c1632b33a27" status: 204 len: 0 microversion: 2.1 time: 0.047227 Oct 31 15:40:11.924701 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2356/4846] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 15:40:11 2022] DELETE /compute/v2.1/os-server-groups/b1a2fd05-0b51-487e-a1e1-8c1632b33a27 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:12.366606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:12.379865 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e5620fe9-46a6-4121-987d-715526cb05e3 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 200 len: 1467 microversion: 2.1 time: 0.500761 Oct 31 15:40:12.402210 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2491/4847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:11 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 1467 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:12.609752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-af6a2cf5-fbca-40bf-abba-4181f436500b req-1503a0af-92b1-4a63-843d-6cfeddfaf367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed8f579b-16d0-4f84-a831-72307d67c783", "name": "network-vif-deleted", "tag": "a1ee2140-af19-41a8-a66e-c9e3e811adea"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:12.633627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-af6a2cf5-fbca-40bf-abba-4181f436500b req-1503a0af-92b1-4a63-843d-6cfeddfaf367 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:12.636317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-af6a2cf5-fbca-40bf-abba-4181f436500b req-1503a0af-92b1-4a63-843d-6cfeddfaf367 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:12.636820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-af6a2cf5-fbca-40bf-abba-4181f436500b req-1503a0af-92b1-4a63-843d-6cfeddfaf367 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:12.652926 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-af6a2cf5-fbca-40bf-abba-4181f436500b req-1503a0af-92b1-4a63-843d-6cfeddfaf367 service nova] Creating event network-vif-deleted:a1ee2140-af19-41a8-a66e-c9e3e811adea for instance ed8f579b-16d0-4f84-a831-72307d67c783 on n-h1-858384-17 Oct 31 15:40:12.664107 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-af6a2cf5-fbca-40bf-abba-4181f436500b req-1503a0af-92b1-4a63-843d-6cfeddfaf367 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059364 Oct 31 15:40:12.664712 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2357/4848] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:13.056679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5c29d41-5e03-4df7-9f2f-56377b030904 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:13.058979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c5c29d41-5e03-4df7-9f2f-56377b030904 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:13.068108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5c29d41-5e03-4df7-9f2f-56377b030904 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.068597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5c29d41-5e03-4df7-9f2f-56377b030904 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.069349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5c29d41-5e03-4df7-9f2f-56377b030904 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:13.070637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5c29d41-5e03-4df7-9f2f-56377b030904 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.071289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5c29d41-5e03-4df7-9f2f-56377b030904 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.071711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5c29d41-5e03-4df7-9f2f-56377b030904 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:13.108053 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5c29d41-5e03-4df7-9f2f-56377b030904 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055171 Oct 31 15:40:13.109142 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2492/4849] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:13 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:13.122907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b4f5070-ae77-4980-9ca1-4fbdf38ee1c7 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:13.123921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b4f5070-ae77-4980-9ca1-4fbdf38ee1c7 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:13.130866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b4f5070-ae77-4980-9ca1-4fbdf38ee1c7 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.131833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b4f5070-ae77-4980-9ca1-4fbdf38ee1c7 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.132525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b4f5070-ae77-4980-9ca1-4fbdf38ee1c7 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:13.133316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b4f5070-ae77-4980-9ca1-4fbdf38ee1c7 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.133933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b4f5070-ae77-4980-9ca1-4fbdf38ee1c7 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.134581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b4f5070-ae77-4980-9ca1-4fbdf38ee1c7 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:13.166896 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b4f5070-ae77-4980-9ca1-4fbdf38ee1c7 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/882a7381-0b51-465a-a170-b8880242b348" status: 200 len: 194 microversion: 2.1 time: 0.049813 Oct 31 15:40:13.168944 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2358/4850] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Oct 31 15:40:13 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/882a7381-0b51-465a-a170-b8880242b348 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:40:13.410952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:13.412068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ed8f579b-16d0-4f84-a831-72307d67c783] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:13.427166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.427760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.429409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:13.432117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.432841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.434328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:13.469167 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] HTTP exception thrown: Instance ed8f579b-16d0-4f84-a831-72307d67c783 could not be found. Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Request method failure captured: Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 HTTP/1.1 Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-pihMoS1lrMFnbEBCE6im_zb2InyUzY2oThjFX9uAdMTRl14xGqD-jMSZE26wIdrBRKGZdj0fhdoCm04cRDKzmlD6YgLdNVJOqAa1j5PfjCenA2rpmcB3IRRDEHNHdn0C9fxCVNu4gZyN1n5Rx1oeD39zVZQ2TMo2ESLLyN8flkT_I Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f99b34e7ae9b44b5a9666b17fa41570e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f99b34e7ae9b44b5a9666b17fa41570e"}]}] Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 33e8230d70464e5da2cced0060bb1a31 Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance ed8f579b-16d0-4f84-a831-72307d67c783 could not be found. Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ed8f579b-16d0-4f84-a831-72307d67c783'} Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed8f579b-16d0-4f84-a831-72307d67c783 could not be found. Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed8f579b-16d0-4f84-a831-72307d67c783 could not be found. Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:13.470978 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:13.475053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:13.475053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:13.475053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:13.475053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:13.475053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:13.475053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed8f579b-16d0-4f84-a831-72307d67c783 could not be found. Oct 31 15:40:13.475053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:13.478155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Returning 404 to user: Instance ed8f579b-16d0-4f84-a831-72307d67c783 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:13.479670 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0a6682c-b066-450b-816b-399a12db10ba tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783" status: 404 len: 111 microversion: 2.1 time: 0.075846 Oct 31 15:40:13.480326 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2493/4851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:13 2022] GET /compute/v2.1/servers/ed8f579b-16d0-4f84-a831-72307d67c783 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:13.490084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:13.490566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:13.496625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.502627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.503204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:13.503965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.504463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.504844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:13.576284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:13.742317 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30a02fec-7e78-46ef-bb53-d7ef159e0cd2 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 204 len: 0 microversion: 2.1 time: 0.257091 Oct 31 15:40:13.743207 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2359/4852] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:13 2022] DELETE /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:13.751680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:13.752686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:13.763931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.764815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.765449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:13.770195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:13.771085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:13.771711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:14.262448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:14.270563 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0477b4d0-0aaf-4041-ac99-0c108a9e7795 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1507 microversion: 2.1 time: 0.523365 Oct 31 15:40:14.271152 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2494/4853] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:13 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1507 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:15.295201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:15.297256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:15.316877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:15.320146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:15.320835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:15.323037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:15.324757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:15.326088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:15.882158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:15.890120 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-edf555f9-8548-47a3-a551-03642aae7d51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1507 microversion: 2.1 time: 0.600025 Oct 31 15:40:15.890716 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2360/4854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:15 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1507 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:15.921054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e38be0f5-52ad-4fe2-8b6d-bd60de325d83 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afc34503-8e3f-4f8b-aa2e-306db49403e1"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:15.924676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e38be0f5-52ad-4fe2-8b6d-bd60de325d83 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:15.936683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e38be0f5-52ad-4fe2-8b6d-bd60de325d83 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:15.937099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e38be0f5-52ad-4fe2-8b6d-bd60de325d83 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:15.937774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e38be0f5-52ad-4fe2-8b6d-bd60de325d83 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:15.938548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e38be0f5-52ad-4fe2-8b6d-bd60de325d83 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:15.939010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e38be0f5-52ad-4fe2-8b6d-bd60de325d83 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:15.939721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e38be0f5-52ad-4fe2-8b6d-bd60de325d83 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:16.337356 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e38be0f5-52ad-4fe2-8b6d-bd60de325d83 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "POST /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419839 Oct 31 15:40:16.343436 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2495/4855] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:40:15 2022] POST /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments => generated 194 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:16.914174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:16.914924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:16.941374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:16.944295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:16.944876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:16.945786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:16.946396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:16.949665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:17.040961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-913e8ea5-5857-4f4f-a037-afa8c6a90b3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:17.045472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-913e8ea5-5857-4f4f-a037-afa8c6a90b3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:17.067767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-913e8ea5-5857-4f4f-a037-afa8c6a90b3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:17.068280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-913e8ea5-5857-4f4f-a037-afa8c6a90b3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:17.073546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-913e8ea5-5857-4f4f-a037-afa8c6a90b3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:17.074715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-913e8ea5-5857-4f4f-a037-afa8c6a90b3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:17.075207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-913e8ea5-5857-4f4f-a037-afa8c6a90b3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:17.075649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-913e8ea5-5857-4f4f-a037-afa8c6a90b3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:17.180389 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-913e8ea5-5857-4f4f-a037-afa8c6a90b3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action" status: 200 len: 24569 microversion: 2.1 time: 0.144935 Oct 31 15:40:17.181452 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2496/4856] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:40:17 2022] POST /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba/action => generated 24569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:40:17.518963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:17.529789 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-21a30e6b-8bec-478c-baa4-8400ef70698e tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1465 microversion: 2.1 time: 0.617718 Oct 31 15:40:17.533983 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2361/4857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:16 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1465 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:17.620457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fedd7a22-78f7-485b-8462-5bdb986f24f2 req-3eb4b86c-71ff-42f6-92dc-633cb54df40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b165c325-3036-4286-aa6f-a4eda48c22ca", "name": "network-vif-deleted", "tag": "0ddd42f3-ebc5-4fbb-b793-b13e396d56cc"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:17.645405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fedd7a22-78f7-485b-8462-5bdb986f24f2 req-3eb4b86c-71ff-42f6-92dc-633cb54df40e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:17.645889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fedd7a22-78f7-485b-8462-5bdb986f24f2 req-3eb4b86c-71ff-42f6-92dc-633cb54df40e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:17.649247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fedd7a22-78f7-485b-8462-5bdb986f24f2 req-3eb4b86c-71ff-42f6-92dc-633cb54df40e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:17.679009 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fedd7a22-78f7-485b-8462-5bdb986f24f2 req-3eb4b86c-71ff-42f6-92dc-633cb54df40e service nova] Creating event network-vif-deleted:0ddd42f3-ebc5-4fbb-b793-b13e396d56cc for instance b165c325-3036-4286-aa6f-a4eda48c22ca on n-h1-858384-17 Oct 31 15:40:17.695072 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fedd7a22-78f7-485b-8462-5bdb986f24f2 req-3eb4b86c-71ff-42f6-92dc-633cb54df40e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077421 Oct 31 15:40:17.696115 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2497/4858] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:18.564767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:18.566255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:18.593185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.593694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.595323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.597895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.598683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.602365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.738215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:18.741489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:18.741958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:18.745075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lazy-loading 'fault' on Instance uuid b165c325-3036-4286-aa6f-a4eda48c22ca {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:19.074829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:19.086628 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5a667e5-8313-4fb3-80ff-240693b45adc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 200 len: 1304 microversion: 2.1 time: 0.527289 Oct 31 15:40:19.087894 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2362/4859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:18 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 1304 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:20.116143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:20.118347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: b165c325-3036-4286-aa6f-a4eda48c22ca] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:20.137931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.138796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.139452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.140444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.143675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.144373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.183700 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] HTTP exception thrown: Instance b165c325-3036-4286-aa6f-a4eda48c22ca could not be found. Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Request method failure captured: Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca HTTP/1.1 Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-pihMoS1lrMFnbEBCE6im_zb2InyUzY2oThjFX9uAdMTRl14xGqD-jMSZE26wIdrBRKGZdj0fhdoCm04cRDKzmlD6YgLdNVJOqAa1j5PfjCenA2rpmcB3IRRDEHNHdn0C9fxCVNu4gZyN1n5Rx1oeD39zVZQ2TMo2ESLLyN8flkT_I Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f99b34e7ae9b44b5a9666b17fa41570e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f99b34e7ae9b44b5a9666b17fa41570e"}]}] Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 33e8230d70464e5da2cced0060bb1a31 Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance b165c325-3036-4286-aa6f-a4eda48c22ca could not be found. Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'b165c325-3036-4286-aa6f-a4eda48c22ca'} Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b165c325-3036-4286-aa6f-a4eda48c22ca could not be found. Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b165c325-3036-4286-aa6f-a4eda48c22ca could not be found. Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:20.185576 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:20.191200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:20.191200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:20.191200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:20.191200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:20.191200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:20.191200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b165c325-3036-4286-aa6f-a4eda48c22ca could not be found. Oct 31 15:40:20.191200 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:20.195463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Returning 404 to user: Instance b165c325-3036-4286-aa6f-a4eda48c22ca could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:20.196643 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8244c41d-93f7-45df-b0db-dc46cc5ea575 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca" status: 404 len: 111 microversion: 2.1 time: 0.085366 Oct 31 15:40:20.200501 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2498/4860] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:20 2022] GET /compute/v2.1/servers/b165c325-3036-4286-aa6f-a4eda48c22ca => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:20.207120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:20.207792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:20.222504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.223714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.224194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.224982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.225609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.226248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.296450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:20.304677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:20.525344 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b540143a-8932-4f72-acd8-8ab6e425ad7d tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 204 len: 0 microversion: 2.1 time: 0.319117 Oct 31 15:40:20.528962 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2363/4861] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:20 2022] DELETE /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:20.542108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:20.542818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:20.554465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.555087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.555602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.556415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:20.556939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:20.557553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:20.611296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:21.141192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:21.158900 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03a98cac-dbcc-4a5b-b2d1-73ec21fe42ad tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1496 microversion: 2.1 time: 0.623073 Oct 31 15:40:21.159683 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2499/4862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:20 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1496 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:22.187299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:22.188211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:22.218782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:22.221848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:22.222420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:22.223273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:22.227705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:22.228188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.362019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-991b19c3-5de0-4ea9-a524-2d2cea54a5eb tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:23.362550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-991b19c3-5de0-4ea9-a524-2d2cea54a5eb tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:23.377725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-991b19c3-5de0-4ea9-a524-2d2cea54a5eb tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.378238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-991b19c3-5de0-4ea9-a524-2d2cea54a5eb tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.378686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-991b19c3-5de0-4ea9-a524-2d2cea54a5eb tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.379414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-991b19c3-5de0-4ea9-a524-2d2cea54a5eb tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.385093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-991b19c3-5de0-4ea9-a524-2d2cea54a5eb tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.385822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-991b19c3-5de0-4ea9-a524-2d2cea54a5eb tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.401482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:23.416722 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd07d407-af44-4797-8f58-483a70373a4a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1496 microversion: 2.1 time: 1.236541 Oct 31 15:40:23.418179 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2364/4863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:22 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1496 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:23.647456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3954d975-50a6-4772-9d0c-e96c8e305b56 req-2ecce9b6-9b93-440a-b1ed-70e42ada6f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0b7012-4606-4145-b69e-1ec621c768a7", "name": "network-vif-deleted", "tag": "4214b8bf-52b7-43f9-9a0f-a03454093256"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:23.671551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3954d975-50a6-4772-9d0c-e96c8e305b56 req-2ecce9b6-9b93-440a-b1ed-70e42ada6f5f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:23.674270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3954d975-50a6-4772-9d0c-e96c8e305b56 req-2ecce9b6-9b93-440a-b1ed-70e42ada6f5f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:23.675168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3954d975-50a6-4772-9d0c-e96c8e305b56 req-2ecce9b6-9b93-440a-b1ed-70e42ada6f5f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:23.711850 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3954d975-50a6-4772-9d0c-e96c8e305b56 req-2ecce9b6-9b93-440a-b1ed-70e42ada6f5f service nova] Creating event network-vif-deleted:4214b8bf-52b7-43f9-9a0f-a03454093256 for instance ee0b7012-4606-4145-b69e-1ec621c768a7 on n-h1-858384-17 Oct 31 15:40:23.718315 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3954d975-50a6-4772-9d0c-e96c8e305b56 req-2ecce9b6-9b93-440a-b1ed-70e42ada6f5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076591 Oct 31 15:40:23.721517 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2365/4864] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:40:24.130599 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-991b19c3-5de0-4ea9-a524-2d2cea54a5eb tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1833 microversion: 2.1 time: 0.766062 Oct 31 15:40:24.131299 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2500/4865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:23 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1833 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:24.444973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:24.446378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:24.458672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:24.465860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:24.466625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:24.468194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:24.468867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:24.470112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:24.557154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:24.557924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:24.558532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:24.559644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lazy-loading 'fault' on Instance uuid ee0b7012-4606-4145-b69e-1ec621c768a7 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:24.958279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:24.967176 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c49e359c-8a80-4c6f-9e41-670ab5e322c7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 200 len: 1305 microversion: 2.1 time: 0.526814 Oct 31 15:40:24.971315 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2366/4866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:24 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 1305 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:25.997906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:25.999941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: ee0b7012-4606-4145-b69e-1ec621c768a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:26.014921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.017806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.018982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.021653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.023786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.030158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.055484 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] HTTP exception thrown: Instance ee0b7012-4606-4145-b69e-1ec621c768a7 could not be found. Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Request method failure captured: Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 HTTP/1.1 Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-pihMoS1lrMFnbEBCE6im_zb2InyUzY2oThjFX9uAdMTRl14xGqD-jMSZE26wIdrBRKGZdj0fhdoCm04cRDKzmlD6YgLdNVJOqAa1j5PfjCenA2rpmcB3IRRDEHNHdn0C9fxCVNu4gZyN1n5Rx1oeD39zVZQ2TMo2ESLLyN8flkT_I Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f99b34e7ae9b44b5a9666b17fa41570e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f99b34e7ae9b44b5a9666b17fa41570e"}]}] Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 33e8230d70464e5da2cced0060bb1a31 Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance ee0b7012-4606-4145-b69e-1ec621c768a7 could not be found. Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ee0b7012-4606-4145-b69e-1ec621c768a7'} Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee0b7012-4606-4145-b69e-1ec621c768a7 could not be found. Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee0b7012-4606-4145-b69e-1ec621c768a7 could not be found. Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:26.057455 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:26.063131 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:26.063131 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:26.063131 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:26.063131 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:26.063131 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:26.063131 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee0b7012-4606-4145-b69e-1ec621c768a7 could not be found. Oct 31 15:40:26.063131 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:26.069734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Returning 404 to user: Instance ee0b7012-4606-4145-b69e-1ec621c768a7 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:26.070998 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b0e0f0b7-041f-4da9-9a7f-a019b1648de7 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7" status: 404 len: 111 microversion: 2.1 time: 0.078245 Oct 31 15:40:26.072452 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2501/4867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:25 2022] GET /compute/v2.1/servers/ee0b7012-4606-4145-b69e-1ec621c768a7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:26.082148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:26.082704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:26.094351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.097819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.098283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.101179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.105502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.105943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.164835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:26.323550 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-756366f9-71c0-4711-84c5-6157de639c12 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "DELETE /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 204 len: 0 microversion: 2.1 time: 0.246231 Oct 31 15:40:26.324406 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2367/4868] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:26 2022] DELETE /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:26.332910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:26.334084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:26.343573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.344623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.352286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.354438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:26.355699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:26.357894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:26.794829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:26.820206 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22c57f84-0fdd-40c0-895a-d4ff049d4a51 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1675 microversion: 2.1 time: 0.491512 Oct 31 15:40:26.827174 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2502/4869] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:26 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1675 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:27.171175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:27.173361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:27.182173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f3615919-b705-4005-8021-53b72b6c4d08 req-872274d0-397a-4826-b5ef-4eea0d2d353f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "391f5764-ac2b-41ae-8f1d-76f294d4b6ba", "tag": "91a3aca2-1006-42f3-af44-4ec383fe9205"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:27.202788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.209772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.210448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.213890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.216935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.217689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.220008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f3615919-b705-4005-8021-53b72b6c4d08 req-872274d0-397a-4826-b5ef-4eea0d2d353f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.220514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f3615919-b705-4005-8021-53b72b6c4d08 req-872274d0-397a-4826-b5ef-4eea0d2d353f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.220944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f3615919-b705-4005-8021-53b72b6c4d08 req-872274d0-397a-4826-b5ef-4eea0d2d353f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.254425 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f3615919-b705-4005-8021-53b72b6c4d08 req-872274d0-397a-4826-b5ef-4eea0d2d353f service nova] Creating event network-changed:91a3aca2-1006-42f3-af44-4ec383fe9205 for instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba on n-h1-858384-17 Oct 31 15:40:27.272488 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f3615919-b705-4005-8021-53b72b6c4d08 req-872274d0-397a-4826-b5ef-4eea0d2d353f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091012 Oct 31 15:40:27.273707 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2503/4870] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:40:27.285512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:27.460836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=6,nova_api:DELETE=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:27.468634 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-251c518b-39c3-4697-9886-b35336d9a17b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "DELETE /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 204 len: 0 microversion: 2.1 time: 0.301515 Oct 31 15:40:27.474198 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2368/4871] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:27 2022] DELETE /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:27.484389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:27.486092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:27.502306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.503474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.504970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.506768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.509198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.510081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.840146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:27.855124 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d33118d-bc32-404c-8e8d-66d629fa51d9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1686 microversion: 2.1 time: 0.376372 Oct 31 15:40:27.856335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:27.857987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:27.866320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.867202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.867995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.868942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:27.869918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:27.870481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:27.878965 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2504/4872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:27 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1686 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:28.620790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:28.630849 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-efe20fbd-8909-41a1-ae0a-9d9fb070658a tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1675 microversion: 2.1 time: 0.779818 Oct 31 15:40:28.647473 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2369/4873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:27 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1675 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:28.885085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:28.887020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:28.912038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:28.912793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:28.913445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:28.914340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:28.914970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:28.915568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:29.662060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:29.662940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:29.673786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:29.674447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:29.676025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:29.676925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:29.678479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:29.679287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:29.712482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:29.727685 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96250a08-2ab2-4ab2-b7fa-acf7ff5584e2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1686 microversion: 2.1 time: 0.846332 Oct 31 15:40:29.734542 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2505/4874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:28 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1686 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:30.258572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:30.283927 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b67e8a5-d9c6-4e43-9166-12c047a08581 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1675 microversion: 2.1 time: 0.623576 Oct 31 15:40:30.286712 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2370/4875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:29 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1675 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:30.768024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:30.768788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:30.788822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:30.789348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:30.790007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:30.790995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:30.791622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:30.792240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:31.208377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d2e67085-f591-4282-ab55-0ff68f9c6faf req-45e51a56-625e-4f43-92f3-ad8370e318e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78294b47-c54e-47ff-b715-d93117bef42f", "name": "network-vif-deleted", "tag": "9d58db2b-a977-4b20-be35-dd136f19608f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:31.227779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d2e67085-f591-4282-ab55-0ff68f9c6faf req-45e51a56-625e-4f43-92f3-ad8370e318e0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:31.228533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d2e67085-f591-4282-ab55-0ff68f9c6faf req-45e51a56-625e-4f43-92f3-ad8370e318e0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:31.229255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d2e67085-f591-4282-ab55-0ff68f9c6faf req-45e51a56-625e-4f43-92f3-ad8370e318e0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:31.245240 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d2e67085-f591-4282-ab55-0ff68f9c6faf req-45e51a56-625e-4f43-92f3-ad8370e318e0 service nova] Creating event network-vif-deleted:9d58db2b-a977-4b20-be35-dd136f19608f for instance 78294b47-c54e-47ff-b715-d93117bef42f on n-h2-858384-17 Oct 31 15:40:31.283833 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d2e67085-f591-4282-ab55-0ff68f9c6faf req-45e51a56-625e-4f43-92f3-ad8370e318e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079901 Oct 31 15:40:31.289825 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2371/4876] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:31.323255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:31.324510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:31.342212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:31.343539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:31.345015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:31.348516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:31.355274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:31.356777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:31.431727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:31.436611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:31.436979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:31.437756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lazy-loading 'fault' on Instance uuid 78294b47-c54e-47ff-b715-d93117bef42f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:31.549524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33e8230d70464e5da2cced0060bb1a31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f99b34e7ae9b44b5a9666b17fa41570e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:31.559741 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb4e72c5-1571-4a1f-befd-982d963a94a8 tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 200 len: 1328 microversion: 2.1 time: 0.242233 Oct 31 15:40:31.581088 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2372/4877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:31 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 1328 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:40:31.744295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:31.753704 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7cae34b3-90f2-413b-86f4-401194136add tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1567 microversion: 2.1 time: 0.991298 Oct 31 15:40:31.754433 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2506/4878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:30 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1567 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:32.277399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-78846915-0587-4fbd-99ee-9927294f3794 req-bb1f6320-3504-4c0b-845c-b9fc51780dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "391f5764-ac2b-41ae-8f1d-76f294d4b6ba", "name": "network-vif-deleted", "tag": "91a3aca2-1006-42f3-af44-4ec383fe9205"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:32.318524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-78846915-0587-4fbd-99ee-9927294f3794 req-bb1f6320-3504-4c0b-845c-b9fc51780dd0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.320629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-78846915-0587-4fbd-99ee-9927294f3794 req-bb1f6320-3504-4c0b-845c-b9fc51780dd0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.321604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-78846915-0587-4fbd-99ee-9927294f3794 req-bb1f6320-3504-4c0b-845c-b9fc51780dd0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.368937 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-78846915-0587-4fbd-99ee-9927294f3794 req-bb1f6320-3504-4c0b-845c-b9fc51780dd0 service nova] Creating event network-vif-deleted:91a3aca2-1006-42f3-af44-4ec383fe9205 for instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba on n-h1-858384-17 Oct 31 15:40:32.380566 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-78846915-0587-4fbd-99ee-9927294f3794 req-bb1f6320-3504-4c0b-845c-b9fc51780dd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110235 Oct 31 15:40:32.384661 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2373/4879] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:40:32.600044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:32.610795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] [instance: 78294b47-c54e-47ff-b715-d93117bef42f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:32.618945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:32.633410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.634358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.634987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.647160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.648093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.648557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.687226 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] HTTP exception thrown: Instance 78294b47-c54e-47ff-b715-d93117bef42f could not be found. Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Request method failure captured: Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f HTTP/1.1 Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-pihMoS1lrMFnbEBCE6im_zb2InyUzY2oThjFX9uAdMTRl14xGqD-jMSZE26wIdrBRKGZdj0fhdoCm04cRDKzmlD6YgLdNVJOqAa1j5PfjCenA2rpmcB3IRRDEHNHdn0C9fxCVNu4gZyN1n5Rx1oeD39zVZQ2TMo2ESLLyN8flkT_I Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f99b34e7ae9b44b5a9666b17fa41570e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f99b34e7ae9b44b5a9666b17fa41570e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f99b34e7ae9b44b5a9666b17fa41570e"}]}] Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: f99b34e7ae9b44b5a9666b17fa41570e Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-167388906 Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 33e8230d70464e5da2cced0060bb1a31 Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-167388906-project Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 78294b47-c54e-47ff-b715-d93117bef42f could not be found. Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '78294b47-c54e-47ff-b715-d93117bef42f'} Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78294b47-c54e-47ff-b715-d93117bef42f could not be found. Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78294b47-c54e-47ff-b715-d93117bef42f could not be found. Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:32.690589 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:32.696032 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:32.696032 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:32.696032 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:32.696032 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:32.696032 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:32.696032 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78294b47-c54e-47ff-b715-d93117bef42f could not be found. Oct 31 15:40:32.696032 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:32.697547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Returning 404 to user: Instance 78294b47-c54e-47ff-b715-d93117bef42f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:32.707873 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a35ab8b-1790-46eb-8ba9-749e425f76cc tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f" status: 404 len: 111 microversion: 2.1 time: 0.126502 Oct 31 15:40:32.713805 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2507/4880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:32 2022] GET /compute/v2.1/servers/78294b47-c54e-47ff-b715-d93117bef42f => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:32.723530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d4acb2b-bb48-43bb-b66c-685a58e5d31b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] Calling method '.version_select at 0x7f16e0304c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:32.778989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:32.780060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:32.788075 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d4acb2b-bb48-43bb-b66c-685a58e5d31b tempest-ServerActionsTestJSON-167388906 tempest-ServerActionsTestJSON-167388906-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-372721830" status: 202 len: 0 microversion: 2.1 time: 0.072834 Oct 31 15:40:32.790322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.792693 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2374/4881] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-372721830 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:40:32.798517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.818177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.821289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.824323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:32.843125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:32.999207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:32.999744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.000757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.003278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lazy-loading 'fault' on Instance uuid 391f5764-ac2b-41ae-8f1d-76f294d4b6ba {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:33.142828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:33.165619 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9958d45-1179-4b21-bef9-1ec887d3aa79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 200 len: 1356 microversion: 2.1 time: 0.389977 Oct 31 15:40:33.167040 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2508/4882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:32 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 1356 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:33.548054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a6206b1-0df5-4fcf-a00e-e10f91e18ae1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:33.551240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a6206b1-0df5-4fcf-a00e-e10f91e18ae1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:33.584986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6206b1-0df5-4fcf-a00e-e10f91e18ae1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.585709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6206b1-0df5-4fcf-a00e-e10f91e18ae1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.586342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6206b1-0df5-4fcf-a00e-e10f91e18ae1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.587581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6206b1-0df5-4fcf-a00e-e10f91e18ae1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.588201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6206b1-0df5-4fcf-a00e-e10f91e18ae1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.588783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6206b1-0df5-4fcf-a00e-e10f91e18ae1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.632046 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a6206b1-0df5-4fcf-a00e-e10f91e18ae1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.089255 Oct 31 15:40:33.633207 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2375/4883] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:33 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:33.789888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-665786b8-b933-4a3c-b501-e0e74f779b25 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:33.791069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-665786b8-b933-4a3c-b501-e0e74f779b25 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:33.801076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-665786b8-b933-4a3c-b501-e0e74f779b25 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.801946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-665786b8-b933-4a3c-b501-e0e74f779b25 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.802552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-665786b8-b933-4a3c-b501-e0e74f779b25 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.803852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-665786b8-b933-4a3c-b501-e0e74f779b25 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.804522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-665786b8-b933-4a3c-b501-e0e74f779b25 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.805452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-665786b8-b933-4a3c-b501-e0e74f779b25 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.856974 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-665786b8-b933-4a3c-b501-e0e74f779b25 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/882a7381-0b51-465a-a170-b8880242b348" status: 200 len: 194 microversion: 2.1 time: 0.069985 Oct 31 15:40:33.867715 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2509/4884] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Oct 31 15:40:33 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/882a7381-0b51-465a-a170-b8880242b348 => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:33.877894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:33.880026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:33.888726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.889704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.890858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:33.892259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:33.892922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:33.894406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:34.011514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lazy-loading 'services' on Instance uuid 8669adee-bb93-44f4-9287-465631eb7b9a {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:34.104881 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea9cef37-919f-4984-8184-8a151cd0ce17 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/882a7381-0b51-465a-a170-b8880242b348" status: 202 len: 0 microversion: 2.1 time: 0.238434 Oct 31 15:40:34.106064 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2376/4885] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:40:33 2022] DELETE /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/882a7381-0b51-465a-a170-b8880242b348 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:40:34.193169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:34.193909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: 391f5764-ac2b-41ae-8f1d-76f294d4b6ba] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:34.221243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:34.222006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:34.223015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:34.223975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:34.224740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:34.225359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:34.245044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] HTTP exception thrown: Instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba could not be found. Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Request method failure captured: Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba HTTP/1.1 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-vYXw5CPfxI9qsbE5oWLVlabEwpa9M6Ef1fkrw4QAYPij6FJOM5Xg0DltLoV49P2_qcAx8GePrGwc670IZtI8hUhpzWNxVFvZtPDOo7wHEVWRZyCE_xyV_MDmU4WDjceseG9A24j1fET0QbEoX61XLGsvVw_--5yurHZAMewB53Ikw Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: e6a2914e44014bed857d096897727c91 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6a2914e44014bed857d096897727c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e6a2914e44014bed857d096897727c91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6a2914e44014bed857d096897727c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e6a2914e44014bed857d096897727c91"}]}] Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: e6a2914e44014bed857d096897727c91 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestNetworkAdvancedServerOps-2127797092-project Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e0349502a6234609ae5eb4c4a94acf95 Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2127797092-project Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba could not be found. Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '391f5764-ac2b-41ae-8f1d-76f294d4b6ba'} Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba could not be found. Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba could not be found. Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:34.246926 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:34.253994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:34.253994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:34.253994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:34.253994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:34.253994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:34.253994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:34.253994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba could not be found. Oct 31 15:40:34.253994 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:40:34.255710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Returning 404 to user: Instance 391f5764-ac2b-41ae-8f1d-76f294d4b6ba could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:34.256748 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34a2f2d8-f8ff-45e8-9b80-50c4dc976da8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba" status: 404 len: 111 microversion: 2.1 time: 0.070641 Oct 31 15:40:34.257820 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2510/4886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:34 2022] GET /compute/v2.1/servers/391f5764-ac2b-41ae-8f1d-76f294d4b6ba => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:40:43.313830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27ec01b3-7ba7-4812-ae1b-b1406f5c711a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:43.315086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27ec01b3-7ba7-4812-ae1b-b1406f5c711a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:43.325893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ec01b3-7ba7-4812-ae1b-b1406f5c711a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:43.327108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ec01b3-7ba7-4812-ae1b-b1406f5c711a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:43.329120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ec01b3-7ba7-4812-ae1b-b1406f5c711a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:43.330423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ec01b3-7ba7-4812-ae1b-b1406f5c711a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:43.331105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ec01b3-7ba7-4812-ae1b-b1406f5c711a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:43.346872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ec01b3-7ba7-4812-ae1b-b1406f5c711a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:43.358410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:43.436105 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27ec01b3-7ba7-4812-ae1b-b1406f5c711a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/afc34503-8e3f-4f8b-aa2e-306db49403e1" status: 200 len: 194 microversion: 2.1 time: 0.128898 Oct 31 15:40:43.445843 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2377/4887] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Oct 31 15:40:43 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/afc34503-8e3f-4f8b-aa2e-306db49403e1 => generated 194 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:43.449348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:43.449824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:43.464271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:43.470997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:43.479987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:43.481001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:43.481730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:43.486769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:43.727673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lazy-loading 'services' on Instance uuid 8669adee-bb93-44f4-9287-465631eb7b9a {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:40:43.853293 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f43f80e-30a9-434b-ac29-1d33ab286f1e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/afc34503-8e3f-4f8b-aa2e-306db49403e1" status: 202 len: 0 microversion: 2.1 time: 0.407529 Oct 31 15:40:43.854819 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2511/4888] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:40:43 2022] DELETE /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments/afc34503-8e3f-4f8b-aa2e-306db49403e1 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:40:43.947271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb77a57b-3bdf-4591-807c-946851fc1fa4 tempest-FloatingIPDetailsNegativeTestJSON-2045770137 tempest-FloatingIPDetailsNegativeTestJSON-2045770137-project] Calling method '.version_select at 0x7f16e03051f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:44.403624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG neutronclient.v2_0.client [None req-eb77a57b-3bdf-4591-807c-946851fc1fa4 tempest-FloatingIPDetailsNegativeTestJSON-2045770137 tempest-FloatingIPDetailsNegativeTestJSON-2045770137-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f5587e98-caa3-4d78-ace7-9cea6ab20359 could not be found", "detail": ""}} {{(pid=120588) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 31 15:40:44.405556 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-eb77a57b-3bdf-4591-807c-946851fc1fa4 tempest-FloatingIPDetailsNegativeTestJSON-2045770137 tempest-FloatingIPDetailsNegativeTestJSON-2045770137-project] HTTP exception thrown: Floating IP not found for ID f5587e98-caa3-4d78-ace7-9cea6ab20359 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb77a57b-3bdf-4591-807c-946851fc1fa4 tempest-FloatingIPDetailsNegativeTestJSON-2045770137 tempest-FloatingIPDetailsNegativeTestJSON-2045770137-project] Request method failure captured: Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-floating-ips/f5587e98-caa3-4d78-ace7-9cea6ab20359 HTTP/1.1 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-x7iUzSC5IRCsqg_YBO2P0fYZ2YiD8kO12hUmNNPA5sQfzu9UuC5Az2NnBo5HDPmnc4wxGluXJYxfhF7HV8kQ_lYEA8g_WoXxY40ZjyNCguHNKyLqkaxmadD0eH2iwnRFO4-zhPEol_V1JWH-LJJOGYUde59oGlDGuLFY453_Tnuqo Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 34d5ab8b7aba46f6b4f43d3c326776ad Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2045770137 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34d5ab8b7aba46f6b4f43d3c326776ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34d5ab8b7aba46f6b4f43d3c326776ad", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34d5ab8b7aba46f6b4f43d3c326776ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34d5ab8b7aba46f6b4f43d3c326776ad"}]}] Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2045770137 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 34d5ab8b7aba46f6b4f43d3c326776ad Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2045770137 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2045770137-project Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c492443887584176b0f1f92b9770d2f5 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2045770137-project Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: exception: Floating IP not found for ID f5587e98-caa3-4d78-ace7-9cea6ab20359 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f5587e98-caa3-4d78-ace7-9cea6ab20359'} Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 31 15:40:44.409196 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f5587e98-caa3-4d78-ace7-9cea6ab20359 could not be found Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34a597a4-52f3-4a35-bfc2-9a7e92fdcee5'] Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f5587e98-caa3-4d78-ace7-9cea6ab20359. Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f5587e98-caa3-4d78-ace7-9cea6ab20359 Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f5587e98-caa3-4d78-ace7-9cea6ab20359 Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb77a57b-3bdf-4591-807c-946851fc1fa4 tempest-FloatingIPDetailsNegativeTestJSON-2045770137 tempest-FloatingIPDetailsNegativeTestJSON-2045770137-project] Returning 404 to user: Floating IP not found for ID f5587e98-caa3-4d78-ace7-9cea6ab20359 {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb77a57b-3bdf-4591-807c-946851fc1fa4 tempest-FloatingIPDetailsNegativeTestJSON-2045770137 tempest-FloatingIPDetailsNegativeTestJSON-2045770137-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/f5587e98-caa3-4d78-ace7-9cea6ab20359" status: 404 len: 111 microversion: 2.1 time: 0.787647 Oct 31 15:40:44.413897 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2378/4889] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 15:40:43 2022] GET /compute/v2.1/os-floating-ips/f5587e98-caa3-4d78-ace7-9cea6ab20359 => generated 111 bytes in 789 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:40:45.782322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1809476036", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:45.956752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] validate_networks() for [('890cbd65-4f5d-439a-9bb3-e4fec50a5129', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:40:47.413593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:40:47.414725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:40:47.415358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:40:47.415927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:40:47.416681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:40:47.440593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:47.444054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:47.444702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:47.445709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:47.446434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:47.447044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:47.556004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Getting quotas for project 5f3ab4be623f42a8a1b6343b9f088ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:40:47.567434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Getting quotas for user 63e830c102c34d4589a7d6af54efc228 and project 5f3ab4be623f42a8a1b6343b9f088ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:40:47.601880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:40:47.604651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:40:47.748025 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19ec6fc8-8802-4d5e-9c0e-67f28eb7b22b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.192090 Oct 31 15:40:47.754344 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2512/4890] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:40:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:40:47.771787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a736956-93fd-4e9d-ad38-4f0b11893118 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:47.775096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a736956-93fd-4e9d-ad38-4f0b11893118 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:48.124989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9a736956-93fd-4e9d-ad38-4f0b11893118 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:48.137624 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a736956-93fd-4e9d-ad38-4f0b11893118 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1214 microversion: 2.1 time: 0.375718 Oct 31 15:40:48.138601 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2379/4891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:47 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1214 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:49.168364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:49.176173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:49.184291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:49.186801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:49.193437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:49.194602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:49.196056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:49.196701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:49.381289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:49.389429 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0554ca6-4f0f-49f1-bd8f-44304c1edae4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1210 microversion: 2.1 time: 0.233310 Oct 31 15:40:49.406627 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2513/4892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:49 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1210 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:50.431703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:50.432304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:50.446367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:50.447468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:50.449918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:50.450756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:50.455925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:50.456411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:51.960706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:51.970963 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdd3e44e-90f9-4235-8ecb-4aa5ed7e8bc0 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1314 microversion: 2.1 time: 1.544018 Oct 31 15:40:51.980725 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2380/4893] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:50 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1314 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:52.889696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-00267ee3-f559-4aad-b646-62676585b6f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '.version_select at 0x7f16e0cebaf0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:52.931037 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-00267ee3-f559-4aad-b646-62676585b6f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1238985358" status: 202 len: 0 microversion: 2.1 time: 0.045532 Oct 31 15:40:52.932036 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2514/4894] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Oct 31 15:40:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1238985358 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:40:52.975823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-167ad90d-8e0d-417a-a54a-f353b331502b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'create', calling method: .version_select at 0x7f16e0300ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-516838709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNSxYK9AnjeX3IQ7W0muwl2oO981UO2rvRsZLenM/0Nvbu26/dd/ARYl7UaZ4W/Jze6tGdncCqfgqPBBsVAVKn8++eL7AxgbI6zPvyPscfk7UjWPgxQz7ihiagaXFJtoA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:53.006153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:53.007057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:53.022753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:53.025179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:53.029814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:53.034341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:53.036365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:53.037652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:53.043549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:53.055682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-167ad90d-8e0d-417a-a54a-f353b331502b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for project e6a2914e44014bed857d096897727c91. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:40:53.073039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-167ad90d-8e0d-417a-a54a-f353b331502b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for user e0349502a6234609ae5eb4c4a94acf95 and project e6a2914e44014bed857d096897727c91. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:40:53.155442 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-167ad90d-8e0d-417a-a54a-f353b331502b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.183410 Oct 31 15:40:53.156869 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2381/4895] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:40:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:40:54.573975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:54.588331 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-090f2bad-c9e7-4690-9866-bc694bbe1711 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1314 microversion: 2.1 time: 1.585891 Oct 31 15:40:54.609357 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2515/4896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:53 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1314 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:55.464900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f60a3733-80c5-471b-a5cd-95bfcadd9404 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:55.466574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f60a3733-80c5-471b-a5cd-95bfcadd9404 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:55.507338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f60a3733-80c5-471b-a5cd-95bfcadd9404 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.508311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f60a3733-80c5-471b-a5cd-95bfcadd9404 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.508998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f60a3733-80c5-471b-a5cd-95bfcadd9404 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.510333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f60a3733-80c5-471b-a5cd-95bfcadd9404 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.511804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f60a3733-80c5-471b-a5cd-95bfcadd9404 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.512883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f60a3733-80c5-471b-a5cd-95bfcadd9404 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.590154 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f60a3733-80c5-471b-a5cd-95bfcadd9404 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131468 Oct 31 15:40:55.591036 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2382/4897] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:55 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:40:55.622859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:55.623506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:55.649287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.649853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.650306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.651082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.651632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.658693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.831918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2009c6db-2bd8-4880-a1c1-67ae8e2c0f77 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:55.834622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2009c6db-2bd8-4880-a1c1-67ae8e2c0f77 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:55.857403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2009c6db-2bd8-4880-a1c1-67ae8e2c0f77 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.858061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2009c6db-2bd8-4880-a1c1-67ae8e2c0f77 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.858482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2009c6db-2bd8-4880-a1c1-67ae8e2c0f77 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.868860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2009c6db-2bd8-4880-a1c1-67ae8e2c0f77 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:55.869561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2009c6db-2bd8-4880-a1c1-67ae8e2c0f77 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:55.870023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2009c6db-2bd8-4880-a1c1-67ae8e2c0f77 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:55.977721 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2009c6db-2bd8-4880-a1c1-67ae8e2c0f77 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149996 Oct 31 15:40:55.978310 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2383/4898] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:40:55 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:40:56.124537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:56.126329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:56.137779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:56.138573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:56.139190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:56.141373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:56.142060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:56.142732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:56.182565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:40:56.411603 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2b2c847-4f6c-410d-b6d0-9b27d28e63a8 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 204 len: 0 microversion: 2.1 time: 0.289578 Oct 31 15:40:56.414114 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2384/4899] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:40:56 2022] DELETE /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:40:56.429450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:56.430281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:56.444017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:56.445417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:56.448736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:56.448736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:56.448736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:56.448736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:56.715669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:56.742658 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2d20fee-1d0d-45a9-a650-afda6d4d93d8 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1314 microversion: 2.1 time: 1.123946 Oct 31 15:40:56.746943 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2516/4900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:55 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1314 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:56.757063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-14071ca0-9864-4e4b-8e2f-d9751aef2d49 req-42812f41-da26-44d3-8cce-130837dcdc98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef89ac9-7004-4119-9929-c888340e8dfe", "tag": "e7340132-3a60-4871-a9f2-edf7cef1d796"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:40:56.784340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-14071ca0-9864-4e4b-8e2f-d9751aef2d49 req-42812f41-da26-44d3-8cce-130837dcdc98 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:56.785658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-14071ca0-9864-4e4b-8e2f-d9751aef2d49 req-42812f41-da26-44d3-8cce-130837dcdc98 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:56.791752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-14071ca0-9864-4e4b-8e2f-d9751aef2d49 req-42812f41-da26-44d3-8cce-130837dcdc98 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:56.834120 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-14071ca0-9864-4e4b-8e2f-d9751aef2d49 req-42812f41-da26-44d3-8cce-130837dcdc98 service nova] Creating event network-changed:e7340132-3a60-4871-a9f2-edf7cef1d796 for instance 0ef89ac9-7004-4119-9929-c888340e8dfe on n-h1-858384-17 Oct 31 15:40:56.848264 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-14071ca0-9864-4e4b-8e2f-d9751aef2d49 req-42812f41-da26-44d3-8cce-130837dcdc98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097134 Oct 31 15:40:56.850672 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2517/4901] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:40:57.078457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:57.090435 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df642ebb-c75e-449c-a8e9-76320a62304e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1671 microversion: 2.1 time: 0.665708 Oct 31 15:40:57.103757 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2385/4902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:56 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1671 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:57.773889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:57.774670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:57.782037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:57.783383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:57.791379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:57.792742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:57.794775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:57.795733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:57.797895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:57.799416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:58.123889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:58.141480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:58.144598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:40:58.152601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:58.153111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:58.153579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:58.154379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:58.154843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:58.155362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:58.247653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:58.259851 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-544f56b3-4c74-43cb-a36e-5fccd93bc860 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1314 microversion: 2.1 time: 0.490486 Oct 31 15:40:58.261011 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2518/4903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:57 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:59.140411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:59.158658 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f092d29c-ffa8-42c7-bf62-33ad22ba95a1 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1671 microversion: 2.1 time: 1.043879 Oct 31 15:40:59.160097 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2386/4904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:58 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1671 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:40:59.286436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:40:59.288134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:40:59.306154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:59.309229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:59.310206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:59.312320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:40:59.313104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:40:59.315100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:40:59.906924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:40:59.924086 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f9847cc-6c21-4eeb-9dc7-1b0348beb013 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1314 microversion: 2.1 time: 0.643559 Oct 31 15:40:59.925723 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2519/4905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:40:59 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:00.187601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:00.192614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:00.218575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:00.220713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:00.222297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:00.224441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:00.227748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:00.229720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:00.667861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:00.680947 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c2a1622-5b52-4b09-b783-84e3996e8e9a tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1671 microversion: 2.1 time: 0.500918 Oct 31 15:41:00.681690 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2387/4906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:00 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1671 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:00.958327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:00.959340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:00.975290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:00.976026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:00.982463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:00.983689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:00.984364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:00.984973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:01.453236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:01.472724 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32c7ccb3-617a-4b47-a12b-96796c59d362 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1314 microversion: 2.1 time: 0.521991 Oct 31 15:41:01.492984 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2520/4907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:00 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:01.716236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:01.719163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:01.728925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:01.729840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:01.730519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:01.731667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:01.732539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:01.733570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:01.957703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:01.992742 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-797bd021-22a0-4bee-9332-77f1e88e6c85 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1604 microversion: 2.1 time: 0.281424 Oct 31 15:41:01.999111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2388/4908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:01 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1604 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:02.488120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-8b393077-502a-4da0-a7f8-82710df2e93b req-697b283e-7ab3-4adf-bab1-56f4ebd61989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef89ac9-7004-4119-9929-c888340e8dfe", "name": "network-vif-plugged", "status": "completed", "tag": "e7340132-3a60-4871-a9f2-edf7cef1d796"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:02.498729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:02.499711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:02.510346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:02.512535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:02.515288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:02.516305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:02.517811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:02.520651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b393077-502a-4da0-a7f8-82710df2e93b req-697b283e-7ab3-4adf-bab1-56f4ebd61989 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:02.521341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:02.525956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b393077-502a-4da0-a7f8-82710df2e93b req-697b283e-7ab3-4adf-bab1-56f4ebd61989 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:02.526780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-8b393077-502a-4da0-a7f8-82710df2e93b req-697b283e-7ab3-4adf-bab1-56f4ebd61989 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:02.562541 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-8b393077-502a-4da0-a7f8-82710df2e93b req-697b283e-7ab3-4adf-bab1-56f4ebd61989 service nova] Creating event network-vif-plugged:e7340132-3a60-4871-a9f2-edf7cef1d796 for instance 0ef89ac9-7004-4119-9929-c888340e8dfe on n-h1-858384-17 Oct 31 15:41:02.580406 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-8b393077-502a-4da0-a7f8-82710df2e93b req-697b283e-7ab3-4adf-bab1-56f4ebd61989 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097007 Oct 31 15:41:02.581733 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2521/4909] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:03.022658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:03.023372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:03.031596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:03.036949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:03.037276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:03.037735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:03.038465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:03.038931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:03.039365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:03.109097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:03.236449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1e39433eb54ab6b5d2b28ddccd175b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb97df11ae204a8d986977e32b44ada3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:03.254694 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71f5fc66-bdfa-49fa-bbec-3759e4054117 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 200 len: 1322 microversion: 2.1 time: 0.236490 Oct 31 15:41:03.255300 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2522/4910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:03 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:03.273070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-04ba12f7-eec4-46ae-b7a9-8397197b6919 req-cbbf01a1-689c-4a5b-821e-dc137cfac667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8669adee-bb93-44f4-9287-465631eb7b9a", "name": "network-vif-deleted", "tag": "f0c584af-1c47-4a1d-ada1-20c6f56ceb28"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:03.284149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04ba12f7-eec4-46ae-b7a9-8397197b6919 req-cbbf01a1-689c-4a5b-821e-dc137cfac667 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:03.284643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04ba12f7-eec4-46ae-b7a9-8397197b6919 req-cbbf01a1-689c-4a5b-821e-dc137cfac667 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:03.285078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-04ba12f7-eec4-46ae-b7a9-8397197b6919 req-cbbf01a1-689c-4a5b-821e-dc137cfac667 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:03.308916 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-04ba12f7-eec4-46ae-b7a9-8397197b6919 req-cbbf01a1-689c-4a5b-821e-dc137cfac667 service nova] Creating event network-vif-deleted:f0c584af-1c47-4a1d-ada1-20c6f56ceb28 for instance 8669adee-bb93-44f4-9287-465631eb7b9a on n-h2-858384-17 Oct 31 15:41:03.314860 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-04ba12f7-eec4-46ae-b7a9-8397197b6919 req-cbbf01a1-689c-4a5b-821e-dc137cfac667 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052725 Oct 31 15:41:03.315851 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2523/4911] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:03.507565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:03.541473 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f51a84e2-b6c7-4da9-8678-47241f5e5ac4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1314 microversion: 2.1 time: 1.045474 Oct 31 15:41:03.558103 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2389/4912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:02 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:04.278959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:04.279897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:04.296672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:04.297748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:04.298456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:04.299413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:04.300103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:04.301486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:04.322815 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] HTTP exception thrown: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Request method failure captured: Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a HTTP/1.1 Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-sUZlcRnGl0nZzZJFYPuWavzFYIaKzUgbo43r_hpfeSKELFq3dBqUqCgfEE61Q03ukq7RPP6wsdJVbODHZcpiYQXpThcJ2kwSUACLeq2Vj_twFOtLZN0W50TeVEIiQZEJIqSwCHrJV7zcTyzIsDGjCa2iglfpC3yuE30DiLK0obD0M Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb97df11ae204a8d986977e32b44ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb97df11ae204a8d986977e32b44ada3"}]}] Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ef1e39433eb54ab6b5d2b28ddccd175b Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8669adee-bb93-44f4-9287-465631eb7b9a'} Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:04.335285 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:04.340053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:04.340053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:04.340053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:04.340053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:04.340053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:04.340053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:04.340053 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:04.342271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Returning 404 to user: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:04.343978 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-efa9c308-f4c7-4e48-887a-460bfe423863 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 404 len: 111 microversion: 2.1 time: 0.070396 Oct 31 15:41:04.344848 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2524/4913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:04 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:04.353819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b56f4d5d-4893-41d7-b4dd-22923b43c245 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '.version_select at 0x7f16e02eb430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:04.400031 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b56f4d5d-4893-41d7-b4dd-22923b43c245 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-256782169" status: 202 len: 0 microversion: 2.1 time: 0.050159 Oct 31 15:41:04.404379 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2390/4914] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:41:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-256782169 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:41:04.581956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:04.582634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:04.588965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:04.589541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:04.594992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:04.595768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:04.596258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:04.596698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:06.236331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:06.248484 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c0d18c23-9624-4e2b-a94f-599575bc53ba tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1498 microversion: 2.1 time: 1.670122 Oct 31 15:41:06.259663 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2525/4915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:04 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1498 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:06.274974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:06.278061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:06.288248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:06.289832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:06.290617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:06.291593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:06.293105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:06.293819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:06.326587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lazy-loading 'flavor' on Instance uuid 0ef89ac9-7004-4119-9929-c888340e8dfe {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:41:06.523855 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c6040639-ff18-44b0-a490-f01e6d73a65e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "POST /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe/action" status: 200 len: 32 microversion: 2.1 time: 0.252599 Oct 31 15:41:06.549384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:06.550503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:06.556484 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2391/4916] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:41:06 2022] POST /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe/action => generated 32 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:41:06.564797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:06.566172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:06.567580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:06.571305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:06.575042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:06.576040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:07.324463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:07.338445 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-402ddf69-3fca-4e95-ac46-ae80dfafd382 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 0.795363 Oct 31 15:41:07.339266 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2526/4917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:06 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:08.396369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:08.402432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:08.447907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:08.448748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:08.449297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:08.465104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:08.465660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:08.469696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:09.426068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:09.434980 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e77161b4-a233-432c-87d4-9292be90ed57 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 1.071831 Oct 31 15:41:09.439874 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2392/4918] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:08 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:10.462245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:10.462916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:10.480344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:10.481184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:10.481870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:10.483039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:10.484125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:10.484812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:11.705248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:11.721050 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e32c22f9-2621-4363-9768-a7a0d8afef10 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 1.263454 Oct 31 15:41:11.722984 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2527/4919] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:10 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:12.752589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:12.753322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:12.787227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:12.790947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:12.791430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:12.792174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:12.792640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:12.793078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:13.641617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:13.644681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:13.651978 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b3d1b74d-208e-461e-8aba-0c607fa340c1 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 0.904560 Oct 31 15:41:13.665590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1802823952", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "17b6bacc-65b0-47e9-aaec-0f07b36d735e"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:13.674266 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2393/4920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:12 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:13.781097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] validate_networks() for [('17b6bacc-65b0-47e9-aaec-0f07b36d735e', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:41:14.701977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:14.703649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:14.714089 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:41:14.714691 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 15:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe (ip 10.222.0.20) !!! Oct 31 15:41:14.788466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:14.789427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:14.807183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:14.811750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:14.823142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:14.836637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:16.242646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:16.253408 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30c28707-e5fb-4c27-8eaf-8bbd80b4b5cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 1.557149 Oct 31 15:41:16.277192 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2394/4921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:14 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:16.300522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-294310800", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "57f39354-ee72-473a-afe9-ec41dd04aaa9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-516838709", "security_groups": [{"name": "tempest-secgroup-smoke-2111341595"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:16.488136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:41:16.489602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:41:16.491147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:41:16.491734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:41:16.492312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:41:16.516145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:16.517663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:16.518998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:16.521651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:16.522416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:16.524379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:16.577753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Getting quotas for project beb4873629a24e989d85e25177852e4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:41:16.593503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Getting quotas for user 52db3a22f3aa44e8b93fcf724d4eb7d2 and project beb4873629a24e989d85e25177852e4e. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:41:16.650966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:41:16.658642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:41:16.766515 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32491686-ac46-4e3b-8f6d-515ab48403d3 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.325721 Oct 31 15:41:16.767878 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2528/4922] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:41:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:41:16.784523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20c54601-ff3f-4cfd-8f89-ddb079aa923c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:16.785476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-20c54601-ff3f-4cfd-8f89-ddb079aa923c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:16.963505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-20c54601-ff3f-4cfd-8f89-ddb079aa923c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:16.979373 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-20c54601-ff3f-4cfd-8f89-ddb079aa923c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1217 microversion: 2.1 time: 0.196927 Oct 31 15:41:16.980655 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2529/4923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:16 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:17.121278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] validate_networks() for [('57f39354-ee72-473a-afe9-ec41dd04aaa9', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:41:17.285796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:17.286724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:17.299296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:17.300055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:17.301801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:17.304588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:17.307779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:17.308544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:18.034962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:18.043789 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e213abc-b311-4a5e-baa4-17dd069eedeb tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 0.763695 Oct 31 15:41:18.046298 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2530/4924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:17 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:18.057238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:18.062113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:18.076081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:18.078587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:18.085919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:18.086973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:18.087627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:18.093869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:18.456243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:18.464894 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e62f0cda-4491-4707-a7ed-f9abdb9b2b86 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1213 microversion: 2.1 time: 0.416496 Oct 31 15:41:18.481973 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2531/4925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:18 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1213 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:18.851059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:41:18.851534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:41:18.851979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:41:18.852934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:41:18.855758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:41:18.885873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:18.886571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:18.887037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:18.890030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:18.890746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:18.891495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:18.980602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for project e6a2914e44014bed857d096897727c91. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:41:18.996362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for user e0349502a6234609ae5eb4c4a94acf95 and project e6a2914e44014bed857d096897727c91. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:41:19.050833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:41:19.060046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:41:19.072207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:19.073098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:19.095401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.096176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.096802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:19.097862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.098533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.099269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:19.214241 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b79a736c-e0ef-45d3-8414-acbca8e7df7d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.918833 Oct 31 15:41:19.215189 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2395/4926] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:41:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 2921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:41:19.231083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5adc753a-20b5-4eb4-9706-5e9fda352647 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:19.232128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5adc753a-20b5-4eb4-9706-5e9fda352647 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:19.399659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5adc753a-20b5-4eb4-9706-5e9fda352647 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:19.414132 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5adc753a-20b5-4eb4-9706-5e9fda352647 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1265 microversion: 2.1 time: 0.189079 Oct 31 15:41:19.420600 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2396/4927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:19 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:19.496429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:19.508504 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10b3ef34-6b52-44da-ac95-f7f574f3f625 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 0.441602 Oct 31 15:41:19.524356 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2532/4928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:19 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:19.554814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:19.555606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:19.622210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.637104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.637641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:19.647159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.656357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.659421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:19.929494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:19.930224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:19.940680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.941536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.942244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:19.943227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:19.945533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:19.947595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:19.967308 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] HTTP exception thrown: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Request method failure captured: Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a HTTP/1.1 Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-sUZlcRnGl0nZzZJFYPuWavzFYIaKzUgbo43r_hpfeSKELFq3dBqUqCgfEE61Q03ukq7RPP6wsdJVbODHZcpiYQXpThcJ2kwSUACLeq2Vj_twFOtLZN0W50TeVEIiQZEJIqSwCHrJV7zcTyzIsDGjCa2iglfpC3yuE30DiLK0obD0M Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb97df11ae204a8d986977e32b44ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb97df11ae204a8d986977e32b44ada3"}]}] Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ef1e39433eb54ab6b5d2b28ddccd175b Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8669adee-bb93-44f4-9287-465631eb7b9a'} Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:19.969552 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:19.973867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:19.991886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Returning 404 to user: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:19.993220 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1cb4e9a-437b-4c4c-8e7b-3722b4d66d4b tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 404 len: 111 microversion: 2.1 time: 0.077613 Oct 31 15:41:19.997073 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2533/4929] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:41:19 2022] DELETE /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:20.006571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:20.008647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 8669adee-bb93-44f4-9287-465631eb7b9a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:20.041710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:20.041710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:20.042844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:20.044418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:20.045459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:20.046144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:20.092541 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] HTTP exception thrown: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Request method failure captured: Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a HTTP/1.1 Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-sUZlcRnGl0nZzZJFYPuWavzFYIaKzUgbo43r_hpfeSKELFq3dBqUqCgfEE61Q03ukq7RPP6wsdJVbODHZcpiYQXpThcJ2kwSUACLeq2Vj_twFOtLZN0W50TeVEIiQZEJIqSwCHrJV7zcTyzIsDGjCa2iglfpC3yuE30DiLK0obD0M Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb97df11ae204a8d986977e32b44ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb97df11ae204a8d986977e32b44ada3"}]}] Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ef1e39433eb54ab6b5d2b28ddccd175b Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8669adee-bb93-44f4-9287-465631eb7b9a'} Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:20.094636 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:20.099570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:20.099570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:20.099570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:20.099570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:20.099570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:20.099570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. Oct 31 15:41:20.099570 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:20.100377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Returning 404 to user: Instance 8669adee-bb93-44f4-9287-465631eb7b9a could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:20.101706 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-40f7d478-cf9c-4781-b71b-e2e733bd037f tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a" status: 404 len: 111 microversion: 2.1 time: 0.099482 Oct 31 15:41:20.103013 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2534/4930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:19 2022] GET /compute/v2.1/servers/8669adee-bb93-44f4-9287-465631eb7b9a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:41:20.448772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:20.449645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:20.462705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:20.465697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:20.471523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:20.472719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:20.480387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:20.481256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:20.721005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:20.729691 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3999c0f3-4294-4d92-9b00-0a79b622bf3d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1269 microversion: 2.1 time: 0.285473 Oct 31 15:41:20.742503 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2535/4931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:20 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1269 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:20.758277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:20.759275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:20.777448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:20.778507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:20.779284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:20.780360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:20.781074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:20.781769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:20.846937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:20.888002 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1343e6d-aafd-4d22-9702-ec3896884cec tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1275 microversion: 2.1 time: 1.380378 Oct 31 15:41:20.892776 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2397/4932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:19 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1275 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:21.454405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:21.465335 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca278ce8-1838-4534-84b5-b4403ec4f1ff tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 0.710644 Oct 31 15:41:21.473498 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2536/4933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:20 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:21.739843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1363992343", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "4264f248-82a3-4916-839d-0aff5b7846cc"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:21.767639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:21.768245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:21.804609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:21.812188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:21.817021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:21.817858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:21.818347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:21.826157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:21.909160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] validate_networks() for [('4264f248-82a3-4916-839d-0aff5b7846cc', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:41:21.914052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:22.249645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:22.260409 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eab1f97e-2f4e-4680-8747-757bd01ddfef tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1335 microversion: 2.1 time: 0.496265 Oct 31 15:41:22.280993 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2537/4934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:21 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1335 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:22.300855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:22.303918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:22.329387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:22.334037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:22.334659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:22.335430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:22.336929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:22.339556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:22.617252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:22.633549 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f2c4901-6d2d-4123-9cba-ae0fae57d9ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1275 microversion: 2.1 time: 0.347610 Oct 31 15:41:22.651244 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2538/4935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:22 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1275 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:22.651244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:22.651244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:22.676584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:22.677300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:22.677539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:22.691133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:22.693493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:22.693979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:24.138437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:24.152701 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3dd210b3-9e0b-4826-b7e4-976c6bddbb93 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 1.512479 Oct 31 15:41:24.158996 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2539/4936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:22 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:24.173974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:24.177758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:24.193351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:24.194351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:24.196060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:24.198287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:24.201459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:24.202627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:24.389352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:24.409475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c1797d7-8a18-45d7-b604-89fc8c042dc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1323 microversion: 2.1 time: 0.248242 Oct 31 15:41:24.413899 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2540/4937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:24 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1323 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:24.426633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:24.427989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:24.443621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:24.445829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:24.448355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:24.452492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:24.453289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:24.455915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:25.028817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:25.048090 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c0b464b1-17e7-4d3a-9653-020dcf19ca55 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1317 microversion: 2.1 time: 0.632729 Oct 31 15:41:25.050331 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2541/4938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:24 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:25.183938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:25.185522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:25.196856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:25.197910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:25.200497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:25.202217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:25.203276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:25.205393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:25.221985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:41:25.223136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:41:25.223798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:41:25.224370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:41:25.224995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:41:25.243941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:25.248859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:25.249821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:25.252284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:25.253043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:25.253754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:25.323950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Getting quotas for project d49a955288a744f0ab9ca6d3117a02c1. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:41:25.346412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Getting quotas for user 4ae649e1620a45b68bf41c1873d798de and project d49a955288a744f0ab9ca6d3117a02c1. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:41:25.382955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:41:25.387226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:41:25.542999 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4cb2436e-7de8-41b3-a655-4b5759ebbdf6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.945751 Oct 31 15:41:25.543667 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2398/4939] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:41:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:41:25.556320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:25.562477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:25.583488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:25.584299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:25.585068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:25.586497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:25.587567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:25.588300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:25.829491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:25.851122 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f16498a2-3f15-4113-8b4e-b7e716832f74 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 0.671748 Oct 31 15:41:25.853515 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2542/4940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:25 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:25.860256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c85a4d9d-5b6a-4b2b-8362-d38e13922a22 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:25.866561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c85a4d9d-5b6a-4b2b-8362-d38e13922a22 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:26.216440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c85a4d9d-5b6a-4b2b-8362-d38e13922a22 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:26.242568 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c85a4d9d-5b6a-4b2b-8362-d38e13922a22 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1216 microversion: 2.1 time: 0.386238 Oct 31 15:41:26.245895 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2543/4941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:25 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1216 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:26.260336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:26.268103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:26.298951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:26.301317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:26.303215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:26.308522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:26.314203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:26.314793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:26.339986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:26.367570 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96d72b87-2183-4c86-80f3-63e61f4f176b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.812669 Oct 31 15:41:26.370576 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2399/4942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:25 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:26.551127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:26.738428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:26.759887 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32ca5850-888f-466a-8d11-5fc9dd37313b tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1317 microversion: 2.1 time: 0.505424 Oct 31 15:41:26.761596 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2544/4943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:26 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1317 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:26.883016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:26.884136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:26.910481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:26.913396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:26.914108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:26.915049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:26.917180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:26.918722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:27.272946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:27.273957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:27.288618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:27.292052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:27.292636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:27.298832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:27.300006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:27.300682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:27.526800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:27.542989 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-28fc2aaa-699c-423a-8b5b-b1c7b74808d5 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1212 microversion: 2.1 time: 0.277548 Oct 31 15:41:27.548945 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2545/4944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:27 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1212 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:27.597209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:27.599294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:27.614865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:27.616677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:27.619266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:27.620597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:27.621799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:27.625894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:27.899100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:27.912191 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7964173a-0036-4bf5-afbd-9bcda5c872f7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 1.034874 Oct 31 15:41:27.929851 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2400/4945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:26 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:27.936995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:27.938179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:27.945825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:27.946699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:27.947425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:27.948684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:27.950005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:27.950695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.272816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:28.287770 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-646a783d-ea68-46ca-8b58-38cd3303e27d tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.735774 Oct 31 15:41:28.308060 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2546/4946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:27 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:28.308060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-13e1cfa3-3860-479c-8db7-821e93f3c8e3 req-f4a10cda-f035-40c4-85cd-ab00349a1e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7", "tag": "74eeb12a-515e-4461-b4d4-4ce04b9ea7d3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:28.317115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-13e1cfa3-3860-479c-8db7-821e93f3c8e3 req-f4a10cda-f035-40c4-85cd-ab00349a1e52 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.317871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-13e1cfa3-3860-479c-8db7-821e93f3c8e3 req-f4a10cda-f035-40c4-85cd-ab00349a1e52 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.318606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-13e1cfa3-3860-479c-8db7-821e93f3c8e3 req-f4a10cda-f035-40c4-85cd-ab00349a1e52 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.335447 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-13e1cfa3-3860-479c-8db7-821e93f3c8e3 req-f4a10cda-f035-40c4-85cd-ab00349a1e52 service nova] Creating event network-changed:74eeb12a-515e-4461-b4d4-4ce04b9ea7d3 for instance 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 on n-h2-858384-17 Oct 31 15:41:28.342126 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-13e1cfa3-3860-479c-8db7-821e93f3c8e3 req-f4a10cda-f035-40c4-85cd-ab00349a1e52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046796 Oct 31 15:41:28.343536 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2547/4947] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:28.350223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:28.351127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:28.359809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.360315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.363471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.365055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.367305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.368038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.394116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] HTTP exception thrown: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Request method failure captured: Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 HTTP/1.1 Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-sUZlcRnGl0nZzZJFYPuWavzFYIaKzUgbo43r_hpfeSKELFq3dBqUqCgfEE61Q03ukq7RPP6wsdJVbODHZcpiYQXpThcJ2kwSUACLeq2Vj_twFOtLZN0W50TeVEIiQZEJIqSwCHrJV7zcTyzIsDGjCa2iglfpC3yuE30DiLK0obD0M Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb97df11ae204a8d986977e32b44ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb97df11ae204a8d986977e32b44ada3"}]}] Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ef1e39433eb54ab6b5d2b28ddccd175b Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '3a9c1f89-62a1-429b-9a22-45e7b9541232'} Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:28.396482 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.401923 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.404940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Returning 404 to user: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:28.406704 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d101dc5e-9eaf-407e-8bbb-643bf3ad902e tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 404 len: 111 microversion: 2.1 time: 0.061652 Oct 31 15:41:28.407830 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2548/4948] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:41:28 2022] DELETE /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:28.428122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:28.429492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] [instance: 3a9c1f89-62a1-429b-9a22-45e7b9541232] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:28.438310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.439205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.439844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.440920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.441878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.442475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.479229 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] HTTP exception thrown: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Request method failure captured: Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 HTTP/1.1 Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-sUZlcRnGl0nZzZJFYPuWavzFYIaKzUgbo43r_hpfeSKELFq3dBqUqCgfEE61Q03ukq7RPP6wsdJVbODHZcpiYQXpThcJ2kwSUACLeq2Vj_twFOtLZN0W50TeVEIiQZEJIqSwCHrJV7zcTyzIsDGjCa2iglfpC3yuE30DiLK0obD0M Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb97df11ae204a8d986977e32b44ada3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb97df11ae204a8d986977e32b44ada3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb97df11ae204a8d986977e32b44ada3"}]}] Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fb97df11ae204a8d986977e32b44ada3 Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2104834660 Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ef1e39433eb54ab6b5d2b28ddccd175b Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeTestJSON-2104834660-project Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '3a9c1f89-62a1-429b-9a22-45e7b9541232'} Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:28.483743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.489176 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:28.489176 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:28.489176 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:28.489176 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:28.489176 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:28.489176 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. Oct 31 15:41:28.489176 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:28.492042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] Returning 404 to user: Instance 3a9c1f89-62a1-429b-9a22-45e7b9541232 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:28.493161 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b0c6c35-d938-4aff-89ba-6e36e09d2232 tempest-AttachVolumeTestJSON-2104834660 tempest-AttachVolumeTestJSON-2104834660-project] 10.222.0.20 "GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232" status: 404 len: 111 microversion: 2.1 time: 0.079887 Oct 31 15:41:28.494313 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2549/4949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:28 2022] GET /compute/v2.1/servers/3a9c1f89-62a1-429b-9a22-45e7b9541232 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:28.586696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:28.587549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:28.597674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.598359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.598972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.601047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.601757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.602358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.768066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:28.784377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52c06a6d-bf71-49a2-ab3a-bd8e7a16c9d4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1274 microversion: 2.1 time: 0.210108 Oct 31 15:41:28.802163 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2550/4950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:28 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:28.889578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:28.898919 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-245caf40-b31d-4897-8856-4138bc92a291 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1317 microversion: 2.1 time: 0.966656 Oct 31 15:41:28.899521 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2401/4951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:27 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1317 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:28.944103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:28.944861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:28.959422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.959919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.962456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:28.963214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:28.963686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:28.964129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.319448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:29.320074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:29.323278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:29.347895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.353230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.353909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.354700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.355186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.355622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.451326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:29.464514 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1cb4ace-798c-4b9f-aa2a-8b1108226f44 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 0.531436 Oct 31 15:41:29.468459 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2551/4952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:28 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:29.813210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:29.813870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:29.831952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.833587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.834067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.834804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.837942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.838387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.897707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:29.915591 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bfff6dd9-6929-4772-8017-32b3a5ef1027 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.602460 Oct 31 15:41:29.920826 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2402/4953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:29 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:29.949339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:29.950522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:29.965964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.968877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.969703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:29.970905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:29.972614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:29.973467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:30.076830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:30.088036 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd734e18-60e0-487e-8e7f-1593ae5a1218 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1274 microversion: 2.1 time: 0.279903 Oct 31 15:41:30.090818 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2552/4954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:29 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1274 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:30.273299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:30.287237 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7de10da7-a6c9-42cb-b66d-0314be6871da tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1317 microversion: 2.1 time: 0.360780 Oct 31 15:41:30.288607 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2403/4955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:29 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:30.495891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:30.496520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:30.508658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:30.509448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:30.509878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:30.515507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:30.516548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:30.517551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:30.859449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a9e90276-ccaa-4285-9c96-f0a4719d2b30 req-7aea0cb0-7424-44d0-bfa8-94e06a2f6439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:30.877427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a9e90276-ccaa-4285-9c96-f0a4719d2b30 req-7aea0cb0-7424-44d0-bfa8-94e06a2f6439 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:30.877912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a9e90276-ccaa-4285-9c96-f0a4719d2b30 req-7aea0cb0-7424-44d0-bfa8-94e06a2f6439 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:30.878344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a9e90276-ccaa-4285-9c96-f0a4719d2b30 req-7aea0cb0-7424-44d0-bfa8-94e06a2f6439 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:30.900804 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a9e90276-ccaa-4285-9c96-f0a4719d2b30 req-7aea0cb0-7424-44d0-bfa8-94e06a2f6439 service nova] Creating event network-changed:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h2-858384-17 Oct 31 15:41:30.930228 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a9e90276-ccaa-4285-9c96-f0a4719d2b30 req-7aea0cb0-7424-44d0-bfa8-94e06a2f6439 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069509 Oct 31 15:41:30.934599 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2404/4956] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:41:30.946309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:30.947022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:30.965952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:30.968917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:30.970036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:30.971609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:30.982097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:30.983421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:31.416533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:31.425202 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ccfd3246-a137-4a47-86b3-1f37453057ce tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.482992 Oct 31 15:41:31.440498 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2405/4957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:30 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:31.446360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:31.447270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:31.454884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:31.455657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:31.456283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:31.464228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:31.464986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:31.465683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:31.787213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:31.801419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:31.815955 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c95e0316-51c0-48a1-8bb7-fe729cf9fdf6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 1.325186 Oct 31 15:41:31.817038 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2553/4958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:30 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:31.821857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:31.822728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:31.838669 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70788564-7401-40db-ac3d-4f3e44e2f708 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1316 microversion: 2.1 time: 0.395112 Oct 31 15:41:31.839430 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2406/4959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:31 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:31.856014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:31.856521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:31.860225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:31.861314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:31.861921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:31.863504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:32.327196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:32.343124 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-20bafcd1-3ce4-486d-9c81-110d0afa8240 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1317 microversion: 2.1 time: 0.524887 Oct 31 15:41:32.345577 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2554/4960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:31 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:32.448256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:32.449515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:32.464715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:32.465237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:32.465687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:32.467449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:32.468325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:32.468765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:32.843800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:32.845277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:32.854022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:32.854944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:32.855644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:32.856659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:32.857922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:32.858635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:33.319329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:33.329668 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-437e64fb-3a66-4bbb-a191-d6cd54d2170e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.885436 Oct 31 15:41:33.330815 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2407/4961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:32 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:33.335652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:33.336562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:33.357008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:33.359117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:33.359789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:33.362022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:33.362193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:33.363992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:33.363992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:33.372461 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4fbfb43f-ede5-435b-8a10-002fc55b5e68 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 0.532661 Oct 31 15:41:33.373607 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2555/4962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:32 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:33.388734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:33.390203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:33.401305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:33.405214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:33.406197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:33.406915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:33.410615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:33.411357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:33.412030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:33.777513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:33.788928 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9163b5fb-bec4-48e4-9e57-49fcd867b07e tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1316 microversion: 2.1 time: 0.456776 Oct 31 15:41:33.790673 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2408/4963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:33 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:33.915315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:33.928631 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7896507e-e885-4093-9852-5f825034dcba tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1317 microversion: 2.1 time: 0.551779 Oct 31 15:41:33.931227 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2556/4964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:33 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1317 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:34.355589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:34.356423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:34.364564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:34.365471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:34.366088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:34.367229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:34.368096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:34.368746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:34.398001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:34.398596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:34.412701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:34.413199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:34.413636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:34.414361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:34.414827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:34.415237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:34.424459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:34.936996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:34.954815 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-afbc3d2e-4d8a-4251-b835-cad6d5c104dd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.602637 Oct 31 15:41:34.979377 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2409/4965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:34 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:34.988544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5e574b2d-51c8-4c5a-9529-971810ce6779 req-052e4ac0-c674-41e4-a963-a539afd9d1a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e56379-a729-4b60-b18d-a035d901e33e", "tag": "8554ffd7-8171-4a45-824b-cde317ea3cf2"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:35.001863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:35.002639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5e574b2d-51c8-4c5a-9529-971810ce6779 req-052e4ac0-c674-41e4-a963-a539afd9d1a2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:35.003302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5e574b2d-51c8-4c5a-9529-971810ce6779 req-052e4ac0-c674-41e4-a963-a539afd9d1a2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:35.003898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5e574b2d-51c8-4c5a-9529-971810ce6779 req-052e4ac0-c674-41e4-a963-a539afd9d1a2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:35.009581 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2bc8a8ff-7cd3-40e9-b98f-201539fe3a12 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1504 microversion: 2.1 time: 0.615447 Oct 31 15:41:35.021266 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5e574b2d-51c8-4c5a-9529-971810ce6779 req-052e4ac0-c674-41e4-a963-a539afd9d1a2 service nova] Creating event network-changed:8554ffd7-8171-4a45-824b-cde317ea3cf2 for instance f5e56379-a729-4b60-b18d-a035d901e33e on n-h1-858384-17 Oct 31 15:41:35.022254 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2557/4966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:34 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1504 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:35.027129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:35.027759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:35.028345 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5e574b2d-51c8-4c5a-9529-971810ce6779 req-052e4ac0-c674-41e4-a963-a539afd9d1a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044240 Oct 31 15:41:35.031149 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2410/4967] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:35.037891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:35.038854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:35.047065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:35.047573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:35.048017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:35.048731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:35.049212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:35.049642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:35.050469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:35.051227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:35.051860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:35.052773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:35.053532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:35.054153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:35.290217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:35.364721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:35.456248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:35.476437 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e9ee56d-b0fd-411f-a58e-2ac34fb74544 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1317 microversion: 2.1 time: 0.443269 Oct 31 15:41:35.479218 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2411/4968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:35 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:35.493030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f2bff253-42fb-46f8-86f4-3eea18b3c1c4 req-a21f4272-39ae-4ff7-b392-0abfb0f67fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7", "name": "network-vif-plugged", "status": "completed", "tag": "74eeb12a-515e-4461-b4d4-4ce04b9ea7d3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:35.509818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f2bff253-42fb-46f8-86f4-3eea18b3c1c4 req-a21f4272-39ae-4ff7-b392-0abfb0f67fee service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:35.513586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f2bff253-42fb-46f8-86f4-3eea18b3c1c4 req-a21f4272-39ae-4ff7-b392-0abfb0f67fee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:35.514280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f2bff253-42fb-46f8-86f4-3eea18b3c1c4 req-a21f4272-39ae-4ff7-b392-0abfb0f67fee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:35.541829 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f2bff253-42fb-46f8-86f4-3eea18b3c1c4 req-a21f4272-39ae-4ff7-b392-0abfb0f67fee service nova] Creating event network-vif-plugged:74eeb12a-515e-4461-b4d4-4ce04b9ea7d3 for instance 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 on n-h2-858384-17 Oct 31 15:41:35.551290 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f2bff253-42fb-46f8-86f4-3eea18b3c1c4 req-a21f4272-39ae-4ff7-b392-0abfb0f67fee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067685 Oct 31 15:41:35.552111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2412/4969] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:35.880063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:35.895281 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-775883df-051f-4a96-bc9a-9d674a809019 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1316 microversion: 2.1 time: 0.870971 Oct 31 15:41:35.896476 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2558/4970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:35 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1316 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:35.983581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:35.985696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:35.994898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:35.995907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:35.997273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:35.998867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:35.999560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.003660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.049383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:36.050685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:36.068884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.069419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.069863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.070633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.071056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.071511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.235486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:36.328973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:36.345448 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7558c0e-5f67-4860-a9b6-aa0bdb01de89 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.366042 Oct 31 15:41:36.346139 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2413/4971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:35 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:36.506601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:36.507487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:36.524421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.524931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.525857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.526769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.527764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.531526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.749767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:36.763950 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e884f92-a317-489a-9ea8-14e854f75595 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1484 microversion: 2.1 time: 0.716839 Oct 31 15:41:36.764958 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2559/4972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:36 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1484 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:36.919073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:36.920645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:36.928032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.928534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.928976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:36.929709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:36.934398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:36.936793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:37.220548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:37.223640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:37.233900 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-02946419-dc2f-4b32-841c-df735f0aebd9 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1317 microversion: 2.1 time: 0.731454 Oct 31 15:41:37.234823 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2414/4973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:36 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1317 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:37.244147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1656676795", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:37.314849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] validate_networks() for [('890cbd65-4f5d-439a-9bb3-e4fec50a5129', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:41:37.376321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:37.387348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e5f86dc-5377-4873-9e7f-907c2edf2c0f tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1316 microversion: 2.1 time: 0.472256 Oct 31 15:41:37.420134 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2560/4974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:36 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:37.443936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:37.468750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:37.484578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:37.489481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:37.490332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:37.493753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:37.494605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:37.496325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.020331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:41:38.020864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:41:38.021640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:41:38.022533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:41:38.023036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:41:38.039505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.040405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.041149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.042158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.043029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.043840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.069429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Getting quotas for project 5f3ab4be623f42a8a1b6343b9f088ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:41:38.076697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Getting quotas for user 63e830c102c34d4589a7d6af54efc228 and project 5f3ab4be623f42a8a1b6343b9f088ee7. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:41:38.097456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:41:38.103974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:41:38.194744 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43743c69-ceb7-4d3b-8d6e-7ce62ef4e47d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.956525 Oct 31 15:41:38.203788 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2415/4975] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:41:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:41:38.210544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d54199cf-d851-453d-bfe8-c0e0619edf5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:38.211536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d54199cf-d851-453d-bfe8-c0e0619edf5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:38.338325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d54199cf-d851-453d-bfe8-c0e0619edf5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:38.349024 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d54199cf-d851-453d-bfe8-c0e0619edf5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1214 microversion: 2.1 time: 0.143655 Oct 31 15:41:38.371886 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2416/4976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:38 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:38.371886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:38.371886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:38.379009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.381920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.382409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.383151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.383619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.384044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.623634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:38.635992 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d53f9b98-2b3a-4a62-8263-2895412dee52 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1507 microversion: 2.1 time: 0.268899 Oct 31 15:41:38.658224 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2417/4977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:38 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:38.664630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:38.665550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:38.672450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.673261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.673773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.674544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.675235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.675723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.779829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:38.792168 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e810b7c-84c6-4906-afb4-446d752737f4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 1.369164 Oct 31 15:41:38.795306 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2561/4978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:37 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:38.817769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40fed49b-800b-4273-a979-ffca958b05ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:38.820510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-40fed49b-800b-4273-a979-ffca958b05ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:38.835638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40fed49b-800b-4273-a979-ffca958b05ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.836482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40fed49b-800b-4273-a979-ffca958b05ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.838068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40fed49b-800b-4273-a979-ffca958b05ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.839018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40fed49b-800b-4273-a979-ffca958b05ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.839692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40fed49b-800b-4273-a979-ffca958b05ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.840284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40fed49b-800b-4273-a979-ffca958b05ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.877017 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-40fed49b-800b-4273-a979-ffca958b05ab tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7/ips" status: 200 len: 110 microversion: 2.1 time: 0.079381 Oct 31 15:41:38.877971 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2562/4979] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:41:38 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7/ips => generated 110 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:38.891459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4a60020-3d63-4cd0-839b-02e6ca1d8a2f tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:38.892360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4a60020-3d63-4cd0-839b-02e6ca1d8a2f tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:38.900534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a60020-3d63-4cd0-839b-02e6ca1d8a2f tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.901348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a60020-3d63-4cd0-839b-02e6ca1d8a2f tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.901981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a60020-3d63-4cd0-839b-02e6ca1d8a2f tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.902886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a60020-3d63-4cd0-839b-02e6ca1d8a2f tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.903679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a60020-3d63-4cd0-839b-02e6ca1d8a2f tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.904638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a60020-3d63-4cd0-839b-02e6ca1d8a2f tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.936895 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4a60020-3d63-4cd0-839b-02e6ca1d8a2f tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7/ips" status: 200 len: 110 microversion: 2.1 time: 0.050014 Oct 31 15:41:38.945350 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2563/4980] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:41:38 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7/ips => generated 110 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:38.952308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab5ffb28-425f-4c86-8bb1-0d4e1abae7dd tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:38.953218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ab5ffb28-425f-4c86-8bb1-0d4e1abae7dd tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:38.963620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab5ffb28-425f-4c86-8bb1-0d4e1abae7dd tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.965289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab5ffb28-425f-4c86-8bb1-0d4e1abae7dd tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.965506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab5ffb28-425f-4c86-8bb1-0d4e1abae7dd tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.968371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab5ffb28-425f-4c86-8bb1-0d4e1abae7dd tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:38.969274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab5ffb28-425f-4c86-8bb1-0d4e1abae7dd tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:38.970166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab5ffb28-425f-4c86-8bb1-0d4e1abae7dd tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:38.977755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:39.005564 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e64ce4bd-8fde-44b0-90f1-eae5ad9f121c tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1316 microversion: 2.1 time: 0.344908 Oct 31 15:41:39.022713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2418/4981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:38 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:39.031281 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab5ffb28-425f-4c86-8bb1-0d4e1abae7dd tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7/ips/tempest-ServerAddressesTestJSON-1022511584-network" status: 200 len: 95 microversion: 2.1 time: 0.083816 Oct 31 15:41:39.032242 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2564/4982] 10.222.0.20 () {58 vars in 1401 bytes} [Mon Oct 31 15:41:38 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7/ips/tempest-ServerAddressesTestJSON-1022511584-network => generated 95 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:41:39.051635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:39.052409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:39.070231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.070729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.076006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:39.077468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.079494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.080037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:39.113754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:41:39.246751 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-826b4bbe-d2d5-46da-b35b-95ea829ef05c tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 204 len: 0 microversion: 2.1 time: 0.205482 Oct 31 15:41:39.247385 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2419/4983] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:41:39 2022] DELETE /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:41:39.256402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:39.258014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:39.271903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.272525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.273283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:39.276780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.276780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.277259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:39.382459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:39.383169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:39.390355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.390999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.391646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:39.392585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.393045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.393717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:39.504726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:39.518012 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1eb70bbc-b1f2-416a-8088-371e200b928d tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1266 microversion: 2.1 time: 0.139584 Oct 31 15:41:39.519121 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2420/4984] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:39 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:39.751362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:39.768783 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a0a4e25-d08f-49da-baec-7e0e16812a21 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1513 microversion: 2.1 time: 0.516771 Oct 31 15:41:39.783301 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2565/4985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:39 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1513 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:39.821176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:39.821860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:39.841961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.844545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.846109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:39.858274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:39.861858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:39.862593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:40.036769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:40.037539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:40.050385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:40.055394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:40.056113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:40.056947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:40.057670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:40.058214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:40.101988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:40.132325 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdacf903-7c6d-4a4b-8964-0db7edc2bc18 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.317738 Oct 31 15:41:40.132918 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2421/4986] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:39 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:40.465091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:40.477955 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed5f1d2c-4f6a-42a8-8d3d-317da4ed1a2a tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1316 microversion: 2.1 time: 0.445548 Oct 31 15:41:40.478997 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2566/4987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:40 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:40.545100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:40.545801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:40.564514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:40.565036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:40.565504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:40.566332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:40.566943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:40.567858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:40.696013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:40.714157 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fb451c8c-6e0f-4983-9097-9271be9049f2 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1266 microversion: 2.1 time: 0.173717 Oct 31 15:41:40.715562 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2422/4988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:40 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:40.796884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:40.798256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:40.805449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:40.806299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:40.806986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:40.807936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:40.808625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:40.809323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.156211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:41.157242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:41.166831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:41.167321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:41.167753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.172352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:41.172884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:41.177835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.476247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:41.490764 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-975ab71c-71c1-4624-9132-5cfd8d24173e tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1513 microversion: 2.1 time: 0.694608 Oct 31 15:41:41.494941 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2567/4989] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:40 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1513 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:41.508122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0c766707-becc-413a-9976-9ab66814add0 req-8335d1b3-d920-4b1a-aa72-3d0306373d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e56379-a729-4b60-b18d-a035d901e33e", "name": "network-vif-plugged", "status": "completed", "tag": "8554ffd7-8171-4a45-824b-cde317ea3cf2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:41.532256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0c766707-becc-413a-9976-9ab66814add0 req-8335d1b3-d920-4b1a-aa72-3d0306373d89 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:41.532752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0c766707-becc-413a-9976-9ab66814add0 req-8335d1b3-d920-4b1a-aa72-3d0306373d89 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:41.533205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0c766707-becc-413a-9976-9ab66814add0 req-8335d1b3-d920-4b1a-aa72-3d0306373d89 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.552950 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0c766707-becc-413a-9976-9ab66814add0 req-8335d1b3-d920-4b1a-aa72-3d0306373d89 service nova] Creating event network-vif-plugged:8554ffd7-8171-4a45-824b-cde317ea3cf2 for instance f5e56379-a729-4b60-b18d-a035d901e33e on n-h1-858384-17 Oct 31 15:41:41.558408 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0c766707-becc-413a-9976-9ab66814add0 req-8335d1b3-d920-4b1a-aa72-3d0306373d89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059260 Oct 31 15:41:41.559045 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2568/4990] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:41.566956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:41.567952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:41.576807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:41.577655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:41.578317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.579257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:41.580853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:41.581885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.802577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:41.814902 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a6593707-45e2-4bfc-aed0-facc29b00dd7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.659627 Oct 31 15:41:41.815710 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2423/4991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:41 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:41.822520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:41.823303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:41.830063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:41.830820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:41.831604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.832482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:41.833113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:41.833821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:41.947957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:41.959358 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-511eba67-96b4-4c70-b311-0ff9e1d9c42c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1272 microversion: 2.1 time: 0.141804 Oct 31 15:41:41.976656 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2424/4992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:41 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:42.516110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:42.516699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:42.538104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:42.538623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:42.539271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:42.540390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:42.541193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:42.541672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:42.689045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:42.708158 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4394597a-565f-45b4-81a7-9c041e5c8dde tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1316 microversion: 2.1 time: 1.146946 Oct 31 15:41:42.711854 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2569/4993] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:41 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1316 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:42.844249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:42.846178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:42.854833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:42.877096 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cea4ab19-5696-44b8-a7cf-b0ecdb6f3200 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1513 microversion: 2.1 time: 0.362383 Oct 31 15:41:42.879796 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2425/4994] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:42 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1513 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:42.889938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:42.892126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:42.895748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:42.897025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:42.898457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:42.899072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:42.984467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:42.985074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:42.995167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:42.999255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:42.999877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:43.004041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:43.004749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:43.005382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:43.229971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:43.260969 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f68666a-5d5f-4128-a591-efa3365b46a1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 0.425652 Oct 31 15:41:43.276205 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2570/4995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:42 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:43.311333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ad009c52-db7c-4ac5-a5a3-427523fa3aa4 req-363e6ca6-bbd5-4152-b85b-7127b8519034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7", "name": "network-vif-deleted", "tag": "74eeb12a-515e-4461-b4d4-4ce04b9ea7d3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:43.335357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ad009c52-db7c-4ac5-a5a3-427523fa3aa4 req-363e6ca6-bbd5-4152-b85b-7127b8519034 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:43.335840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ad009c52-db7c-4ac5-a5a3-427523fa3aa4 req-363e6ca6-bbd5-4152-b85b-7127b8519034 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:43.336301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ad009c52-db7c-4ac5-a5a3-427523fa3aa4 req-363e6ca6-bbd5-4152-b85b-7127b8519034 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:43.362392 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ad009c52-db7c-4ac5-a5a3-427523fa3aa4 req-363e6ca6-bbd5-4152-b85b-7127b8519034 service nova] Creating event network-vif-deleted:74eeb12a-515e-4461-b4d4-4ce04b9ea7d3 for instance 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 on n-h2-858384-17 Oct 31 15:41:43.367944 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ad009c52-db7c-4ac5-a5a3-427523fa3aa4 req-363e6ca6-bbd5-4152-b85b-7127b8519034 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079850 Oct 31 15:41:43.369154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2571/4996] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:43.581187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-36ba846a-dcab-4aa5-b79e-fd1b510a9fc5 req-ccf708f0-377a-4db4-b798-9ee0bdcb5425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "name": "network-vif-plugged", "status": "completed", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:43.600007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-36ba846a-dcab-4aa5-b79e-fd1b510a9fc5 req-ccf708f0-377a-4db4-b798-9ee0bdcb5425 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:43.602906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-36ba846a-dcab-4aa5-b79e-fd1b510a9fc5 req-ccf708f0-377a-4db4-b798-9ee0bdcb5425 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:43.605184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-36ba846a-dcab-4aa5-b79e-fd1b510a9fc5 req-ccf708f0-377a-4db4-b798-9ee0bdcb5425 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:43.630251 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-36ba846a-dcab-4aa5-b79e-fd1b510a9fc5 req-ccf708f0-377a-4db4-b798-9ee0bdcb5425 service nova] Creating event network-vif-plugged:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h2-858384-17 Oct 31 15:41:43.638607 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-36ba846a-dcab-4aa5-b79e-fd1b510a9fc5 req-ccf708f0-377a-4db4-b798-9ee0bdcb5425 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061391 Oct 31 15:41:43.640203 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2572/4997] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:41:43.738060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:43.739621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:43.751130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:43.754737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:43.755382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:43.758348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:43.759062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:43.762362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:43.907409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:43.943803 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0e94b40-305d-4982-9a69-acf743d24785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1314 microversion: 2.1 time: 0.963440 Oct 31 15:41:43.947349 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2426/4998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:42 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1314 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:41:43.973170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:43.974038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:43.988219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:43.991496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.002768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.009521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.014356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.016101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.108581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.109746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.110194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.115179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lazy-loading 'fault' on Instance uuid 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:41:44.239125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52db3a22f3aa44e8b93fcf724d4eb7d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beb4873629a24e989d85e25177852e4e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:44.252945 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e5dad458-d044-44e2-8afa-b08345022167 tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 200 len: 1307 microversion: 2.1 time: 0.298316 Oct 31 15:41:44.281037 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2427/4999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:43 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 1307 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:44.304760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:44.305895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:44.317467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.320987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.321655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.325637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.327948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.328628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.381959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:44.392016 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-684bac54-7467-44e6-bb9b-86daea899fbf tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1504 microversion: 2.1 time: 0.660285 Oct 31 15:41:44.401942 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2573/5000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:43 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1504 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:44.428143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:44.428908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:44.439171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.441350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.446392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.447796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.448494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.449191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.512246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:41:44.724845 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e6f1b3f-26d6-4ec6-885f-0e53b6cd44a8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 204 len: 0 microversion: 2.1 time: 0.301685 Oct 31 15:41:44.725680 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2574/5001] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:41:44 2022] DELETE /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:41:44.736066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:44.739152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:44.754515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.755223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.757649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.758794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:44.759441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:44.767140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:44.784379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:45.178938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:45.187819 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f3fe6585-a319-400d-a9d0-553ff5fe94a4 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1510 microversion: 2.1 time: 0.457648 Oct 31 15:41:45.188576 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2575/5002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:44 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1510 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:45.211122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:45.211938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:45.219939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:45.220605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:45.221237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:45.222115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:45.222730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:45.223432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:45.438836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:45.446755 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f156f28b-25c3-4dc2-a3d6-54c98a83e8a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1391 microversion: 2.1 time: 1.146448 Oct 31 15:41:45.448041 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2428/5003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:44 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1391 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:45.475641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:45.476184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] [instance: 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:45.500667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:45.501260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:45.501709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:45.502500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:45.502890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:45.513333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:45.532837 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] HTTP exception thrown: Instance 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 could not be found. Oct 31 15:41:45.545058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Request method failure captured: Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 HTTP/1.1 Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-yZ5VML8Ao1lazmgDOLuMOSmAwzpKlcybA6l2IdclbdwvFmpAfDmVgGhH9TRiel04UBOPyTDgF07-JWY0nyrHkmMnZqeUeEITkFVQ_QrBpSpyyntEQKz-9YdUSst7OlWXWxy7VX6NmBTKV_VZU3nh7-zYIh2oJhpOeWwR6Eb4q-D3M Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: beb4873629a24e989d85e25177852e4e Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerAddressesTestJSON-1842347988 Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/beb4873629a24e989d85e25177852e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_beb4873629a24e989d85e25177852e4e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/beb4873629a24e989d85e25177852e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/beb4873629a24e989d85e25177852e4e"}]}] Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerAddressesTestJSON-1842347988 Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: beb4873629a24e989d85e25177852e4e Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1842347988 Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerAddressesTestJSON-1842347988-project Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 52db3a22f3aa44e8b93fcf724d4eb7d2 Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerAddressesTestJSON-1842347988-project Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 could not be found. Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7'} Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 could not be found. Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 could not be found. Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:45.547243 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 could not be found. Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] Returning 404 to user: Instance 3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d529e2eb-94b2-4873-aff8-4baa8ff7bd7d tempest-ServerAddressesTestJSON-1842347988 tempest-ServerAddressesTestJSON-1842347988-project] 10.222.0.20 "GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7" status: 404 len: 111 microversion: 2.1 time: 0.099541 Oct 31 15:41:45.556691 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2429/5004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:45 2022] GET /compute/v2.1/servers/3c8c8dd1-da20-4430-a7ed-0d3c1dcf4fb7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:45.594809 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac55e5c3-8121-4a9f-9ff2-2927e6944007 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1314 microversion: 2.1 time: 0.387922 Oct 31 15:41:45.598767 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2576/5005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:45 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:46.213847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:46.214672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:46.234590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:46.235573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:46.236025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:46.236821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:46.241503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:46.241997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:46.298176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-095e6aec-47cc-4b0b-9acb-1acf67a8760b req-93eaa2a9-db02-4ebf-8581-cd2d440f3cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a", "tag": "762ddc11-f327-4c65-95c0-fa15446b8469"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:46.345823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-095e6aec-47cc-4b0b-9acb-1acf67a8760b req-93eaa2a9-db02-4ebf-8581-cd2d440f3cff service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:46.348096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-095e6aec-47cc-4b0b-9acb-1acf67a8760b req-93eaa2a9-db02-4ebf-8581-cd2d440f3cff service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:46.349512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-095e6aec-47cc-4b0b-9acb-1acf67a8760b req-93eaa2a9-db02-4ebf-8581-cd2d440f3cff service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:46.381489 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-095e6aec-47cc-4b0b-9acb-1acf67a8760b req-93eaa2a9-db02-4ebf-8581-cd2d440f3cff service nova] Creating event network-changed:762ddc11-f327-4c65-95c0-fa15446b8469 for instance 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a on n-h2-858384-17 Oct 31 15:41:46.401599 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-095e6aec-47cc-4b0b-9acb-1acf67a8760b req-93eaa2a9-db02-4ebf-8581-cd2d440f3cff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111036 Oct 31 15:41:46.404439 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2577/5006] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:41:46.478304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:46.479132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:46.491943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:46.492588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:46.495654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:46.496580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:46.499231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:46.499810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:46.951052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:46.970121 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-405536f7-c96c-4288-bfb6-f33f814acb47 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1563 microversion: 2.1 time: 0.498487 Oct 31 15:41:46.970829 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2578/5007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:46 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1563 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:46.975625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:46.976246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:46.992360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:46.992914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:46.993351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:46.994698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:46.995176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:46.995634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:47.226710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:47.236722 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8debf36-5a33-405a-b821-0a943839ddb6 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1510 microversion: 2.1 time: 1.027973 Oct 31 15:41:47.244050 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2430/5008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:46 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1510 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:47.271988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:47.274552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:47.289277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:47.290144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:47.291085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:47.299667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:47.301784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:47.303380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:47.901449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:47.932885 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c85f74bd-ae14-44c4-898d-9b7dc1480292 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1314 microversion: 2.1 time: 0.960850 Oct 31 15:41:47.936936 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2579/5009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:46 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:47.960249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-85ff70f5-1537-44d7-8f17-ada80a23a969 req-bfd6458c-374e-4631-b810-b00eed10a62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e56379-a729-4b60-b18d-a035d901e33e", "name": "network-vif-deleted", "tag": "8554ffd7-8171-4a45-824b-cde317ea3cf2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:47.987983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-85ff70f5-1537-44d7-8f17-ada80a23a969 req-bfd6458c-374e-4631-b810-b00eed10a62f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:47.988476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-85ff70f5-1537-44d7-8f17-ada80a23a969 req-bfd6458c-374e-4631-b810-b00eed10a62f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:47.990099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-85ff70f5-1537-44d7-8f17-ada80a23a969 req-bfd6458c-374e-4631-b810-b00eed10a62f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:48.024145 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-85ff70f5-1537-44d7-8f17-ada80a23a969 req-bfd6458c-374e-4631-b810-b00eed10a62f service nova] Creating event network-vif-deleted:8554ffd7-8171-4a45-824b-cde317ea3cf2 for instance f5e56379-a729-4b60-b18d-a035d901e33e on n-h1-858384-17 Oct 31 15:41:48.038900 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-85ff70f5-1537-44d7-8f17-ada80a23a969 req-bfd6458c-374e-4631-b810-b00eed10a62f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097934 Oct 31 15:41:48.041737 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2580/5010] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:48.042369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:48.045714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:48.056100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:48.072423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e2fce0ab-b665-48dc-af2a-abe067854758 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1563 microversion: 2.1 time: 0.813100 Oct 31 15:41:48.073248 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2431/5011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:47 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1563 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:48.274457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:48.275065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:48.295150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:48.296563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:48.297215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:48.298177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:48.302526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:48.303162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:48.406045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:48.409664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:48.410200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:48.410878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lazy-loading 'fault' on Instance uuid f5e56379-a729-4b60-b18d-a035d901e33e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:41:48.494176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ae649e1620a45b68bf41c1873d798de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49a955288a744f0ab9ca6d3117a02c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:48.503474 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f95da56c-9131-4c06-9b49-98ec5c569664 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 200 len: 1306 microversion: 2.1 time: 0.235164 Oct 31 15:41:48.507520 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2581/5012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:48 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 1306 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:48.956777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:48.958031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:48.977694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:48.982004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:48.982942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:48.984149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:48.986634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:48.987362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:48.989661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:49.531593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:49.533546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:49.542795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:49.544057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:49.545255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:49.546509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:49.547203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:49.547878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:49.568289 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] HTTP exception thrown: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Request method failure captured: Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e HTTP/1.1 Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-yh55PATRbmfqIw4Gn2ETSSSoJw3XJZc9ZaWZ9vUbj_pAGmkobaFgn9_sgHQWIWxvPOE1zsAyvHFQmatQVJHso_gb4t5lD-yOsX9GfCuZZrih2yk1w5qjNv23ad2MIdQIAQG5505oc91L0B1yJt9r3VgiliYskURKrZL3rPNX-Yegk Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49a955288a744f0ab9ca6d3117a02c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49a955288a744f0ab9ca6d3117a02c1"}]}] Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ae649e1620a45b68bf41c1873d798de Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f5e56379-a729-4b60-b18d-a035d901e33e'} Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.570171 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.575659 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.575659 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.575659 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.575659 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:49.575659 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:49.575659 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.575659 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.578085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Returning 404 to user: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:49.579242 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-971594d2-8f47-4391-874c-26b99b29c7e2 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 404 len: 111 microversion: 2.1 time: 0.052805 Oct 31 15:41:49.580984 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2582/5013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:49 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:49.589760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1806066833", "metadata": {"image_type": "test"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:49.593906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:49.603013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:49.604748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:49.605755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:49.607151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:49.607876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:49.608570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:49.630869 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] HTTP exception thrown: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Request method failure captured: Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e/action HTTP/1.1 Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 112 Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-yh55PATRbmfqIw4Gn2ETSSSoJw3XJZc9ZaWZ9vUbj_pAGmkobaFgn9_sgHQWIWxvPOE1zsAyvHFQmatQVJHso_gb4t5lD-yOsX9GfCuZZrih2yk1w5qjNv23ad2MIdQIAQG5505oc91L0B1yJt9r3VgiliYskURKrZL3rPNX-Yegk Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49a955288a744f0ab9ca6d3117a02c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49a955288a744f0ab9ca6d3117a02c1"}]}] Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ae649e1620a45b68bf41c1873d798de Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1806066833", "metadata": {"image_type": "test"}}} Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f5e56379-a729-4b60-b18d-a035d901e33e', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1806066833', 'metadata': {'image_type': 'test'}}}} Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:41:49.633956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.639483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Returning 404 to user: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:49.640488 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aaca3b1c-50ae-468f-8e8a-93804fd08f20 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "POST /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e/action" status: 404 len: 111 microversion: 2.1 time: 0.055054 Oct 31 15:41:49.642029 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2583/5014] 10.222.0.20 () {60 vars in 1279 bytes} [Mon Oct 31 15:41:49 2022] POST /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:49.656869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2b5b98c-1f3d-475f-813e-7f2bba042213 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2033406744", "metadata": {"image_type": "test"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:49.665704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2b5b98c-1f3d-475f-813e-7f2bba042213 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Failed to fetch instance by id tempest-invalid-1441817907 {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:41:49.671861 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-a2b5b98c-1f3d-475f-813e-7f2bba042213 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] HTTP exception thrown: Instance tempest-invalid-1441817907 could not be found. Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2b5b98c-1f3d-475f-813e-7f2bba042213 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Request method failure captured: Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/tempest-invalid-1441817907/action HTTP/1.1 Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 112 Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-yh55PATRbmfqIw4Gn2ETSSSoJw3XJZc9ZaWZ9vUbj_pAGmkobaFgn9_sgHQWIWxvPOE1zsAyvHFQmatQVJHso_gb4t5lD-yOsX9GfCuZZrih2yk1w5qjNv23ad2MIdQIAQG5505oc91L0B1yJt9r3VgiliYskURKrZL3rPNX-Yegk Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49a955288a744f0ab9ca6d3117a02c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49a955288a744f0ab9ca6d3117a02c1"}]}] Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ae649e1620a45b68bf41c1873d798de Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2033406744", "metadata": {"image_type": "test"}}} Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance tempest-invalid-1441817907 could not be found. Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'tempest-invalid-1441817907', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2033406744', 'metadata': {'image_type': 'test'}}}} Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1441817907 could not be found. Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:49.673655 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1441817907 could not be found. Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1441817907 could not be found. Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.678956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2b5b98c-1f3d-475f-813e-7f2bba042213 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Returning 404 to user: Instance tempest-invalid-1441817907 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:49.680120 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2b5b98c-1f3d-475f-813e-7f2bba042213 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-1441817907/action" status: 404 len: 101 microversion: 2.1 time: 0.026818 Oct 31 15:41:49.692476 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2584/5015] 10.222.0.20 () {60 vars in 1249 bytes} [Mon Oct 31 15:41:49 2022] POST /compute/v2.1/servers/tempest-invalid-1441817907/action => generated 101 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:49.711241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04427b4d-bfd7-4a42-bcab-bc14ac3bbd49 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-502326160"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:49.717824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04427b4d-bfd7-4a42-bcab-bc14ac3bbd49 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:41:49.719585 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-04427b4d-bfd7-4a42-bcab-bc14ac3bbd49 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04427b4d-bfd7-4a42-bcab-bc14ac3bbd49 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Request method failure captured: Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 56 Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-yh55PATRbmfqIw4Gn2ETSSSoJw3XJZc9ZaWZ9vUbj_pAGmkobaFgn9_sgHQWIWxvPOE1zsAyvHFQmatQVJHso_gb4t5lD-yOsX9GfCuZZrih2yk1w5qjNv23ad2MIdQIAQG5505oc91L0B1yJt9r3VgiliYskURKrZL3rPNX-Yegk Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49a955288a744f0ab9ca6d3117a02c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49a955288a744f0ab9ca6d3117a02c1"}]}] Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ae649e1620a45b68bf41c1873d798de Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: {"createImage": {"name": "tempest-test-snap-502326160"}} Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-502326160'}}} Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.722327 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.728992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.728992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.728992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.728992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.728992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.728992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:49.728992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:49.728992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.728992 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.731008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04427b4d-bfd7-4a42-bcab-bc14ac3bbd49 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:49.733985 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-04427b4d-bfd7-4a42-bcab-bc14ac3bbd49 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.028355 Oct 31 15:41:49.741889 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2585/5016] 10.222.0.20 () {60 vars in 1275 bytes} [Mon Oct 31 15:41:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:49.759550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89236360-28c3-4ad5-94ca-de4584c215b8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-921174080"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:49.764902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89236360-28c3-4ad5-94ca-de4584c215b8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 31 15:41:49.765460 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-89236360-28c3-4ad5-94ca-de4584c215b8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89236360-28c3-4ad5-94ca-de4584c215b8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Request method failure captured: Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 56 Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-yh55PATRbmfqIw4Gn2ETSSSoJw3XJZc9ZaWZ9vUbj_pAGmkobaFgn9_sgHQWIWxvPOE1zsAyvHFQmatQVJHso_gb4t5lD-yOsX9GfCuZZrih2yk1w5qjNv23ad2MIdQIAQG5505oc91L0B1yJt9r3VgiliYskURKrZL3rPNX-Yegk Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49a955288a744f0ab9ca6d3117a02c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49a955288a744f0ab9ca6d3117a02c1"}]}] Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ae649e1620a45b68bf41c1873d798de Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: {"createImage": {"name": "tempest-test-snap-921174080"}} Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-921174080'}}} Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.767144 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89236360-28c3-4ad5-94ca-de4584c215b8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89236360-28c3-4ad5-94ca-de4584c215b8 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.016413 Oct 31 15:41:49.777502 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2586/5017] 10.222.0.20 () {60 vars in 1281 bytes} [Mon Oct 31 15:41:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:49.781706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:49.782289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:49.795799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:49.796307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:49.796748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:49.797563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:49.798028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:49.798455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:49.821587 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] HTTP exception thrown: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Request method failure captured: Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e HTTP/1.1 Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-yh55PATRbmfqIw4Gn2ETSSSoJw3XJZc9ZaWZ9vUbj_pAGmkobaFgn9_sgHQWIWxvPOE1zsAyvHFQmatQVJHso_gb4t5lD-yOsX9GfCuZZrih2yk1w5qjNv23ad2MIdQIAQG5505oc91L0B1yJt9r3VgiliYskURKrZL3rPNX-Yegk Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49a955288a744f0ab9ca6d3117a02c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49a955288a744f0ab9ca6d3117a02c1"}]}] Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ae649e1620a45b68bf41c1873d798de Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f5e56379-a729-4b60-b18d-a035d901e33e'} Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:49.823725 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Returning 404 to user: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:49.828889 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7387d504-2efb-467f-b2ee-dd556ff4c0e9 tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 404 len: 111 microversion: 2.1 time: 0.050644 Oct 31 15:41:49.830229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2587/5018] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:41:49 2022] DELETE /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:41:49.835797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:49.836422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] [instance: f5e56379-a729-4b60-b18d-a035d901e33e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:49.847437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:49.847751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:49.848197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:49.848924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:49.849425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:49.849838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:49.881619 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] HTTP exception thrown: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Request method failure captured: Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e HTTP/1.1 Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-yh55PATRbmfqIw4Gn2ETSSSoJw3XJZc9ZaWZ9vUbj_pAGmkobaFgn9_sgHQWIWxvPOE1zsAyvHFQmatQVJHso_gb4t5lD-yOsX9GfCuZZrih2yk1w5qjNv23ad2MIdQIAQG5505oc91L0B1yJt9r3VgiliYskURKrZL3rPNX-Yegk Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d49a955288a744f0ab9ca6d3117a02c1", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d49a955288a744f0ab9ca6d3117a02c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d49a955288a744f0ab9ca6d3117a02c1"}]}] Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d49a955288a744f0ab9ca6d3117a02c1 Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-368288755 Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 4ae649e1620a45b68bf41c1873d798de Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ImagesNegativeTestJSON-368288755-project Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f5e56379-a729-4b60-b18d-a035d901e33e'} Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:41:49.885734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.891051 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:41:49.891051 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:41:49.891051 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:41:49.891051 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:41:49.891051 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:41:49.891051 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. Oct 31 15:41:49.891051 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:41:49.891051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] Returning 404 to user: Instance f5e56379-a729-4b60-b18d-a035d901e33e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:41:49.893283 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99e91b1f-f5f8-4954-8aa8-d5d578eca2ad tempest-ImagesNegativeTestJSON-368288755 tempest-ImagesNegativeTestJSON-368288755-project] 10.222.0.20 "GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e" status: 404 len: 111 microversion: 2.1 time: 0.058760 Oct 31 15:41:49.893283 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2588/5019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:49 2022] GET /compute/v2.1/servers/f5e56379-a729-4b60-b18d-a035d901e33e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:41:50.268018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:50.284141 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ababbbf-2299-4d0a-acd6-c5c01d2ce220 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1314 microversion: 2.1 time: 1.329547 Oct 31 15:41:50.287954 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2432/5020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:48 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1314 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:51.307740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:51.308349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:51.323512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:51.324277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:51.325540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:51.326273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:51.326748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:51.327174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:51.815111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:51.834623 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1e02a50-514f-432d-806e-80baf44c904b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1314 microversion: 2.1 time: 0.530533 Oct 31 15:41:51.836260 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2589/5021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:51 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:52.867693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:52.868352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:52.884214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:52.885000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:52.885726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:52.886637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:52.888454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:52.892031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:53.367082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c41a6cc3-3b21-4cd8-bf93-be6b55016d60 req-bb80ae07-e7b9-4e99-8917-ed353f30f77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a", "name": "network-vif-plugged", "status": "completed", "tag": "762ddc11-f327-4c65-95c0-fa15446b8469"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:53.395252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c41a6cc3-3b21-4cd8-bf93-be6b55016d60 req-bb80ae07-e7b9-4e99-8917-ed353f30f77a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:53.398646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c41a6cc3-3b21-4cd8-bf93-be6b55016d60 req-bb80ae07-e7b9-4e99-8917-ed353f30f77a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:53.399842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c41a6cc3-3b21-4cd8-bf93-be6b55016d60 req-bb80ae07-e7b9-4e99-8917-ed353f30f77a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:53.422410 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c41a6cc3-3b21-4cd8-bf93-be6b55016d60 req-bb80ae07-e7b9-4e99-8917-ed353f30f77a service nova] Creating event network-vif-plugged:762ddc11-f327-4c65-95c0-fa15446b8469 for instance 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a on n-h2-858384-17 Oct 31 15:41:53.428024 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c41a6cc3-3b21-4cd8-bf93-be6b55016d60 req-bb80ae07-e7b9-4e99-8917-ed353f30f77a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064773 Oct 31 15:41:53.429191 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2590/5022] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:41:53.453798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:53.466885 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b540e03-14ee-4837-baf5-a0e76db15cda tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1314 microversion: 2.1 time: 0.606312 Oct 31 15:41:53.486013 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2433/5023] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:52 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:54.493243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:54.494158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:54.512092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:54.514121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:54.515087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:54.516004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:54.516793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:54.517660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:55.011018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:55.023745 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a35ff070-a500-4e44-a0ff-20d85c28e76e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1314 microversion: 2.1 time: 0.536174 Oct 31 15:41:55.036968 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2591/5024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:54 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:56.053635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:56.056755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:56.072668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:56.073511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:56.074147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:56.075621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:56.076632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:56.077301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:56.736493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:56.750788 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70c4ee9f-a68f-4ea1-9827-b01ec3dc417a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1498 microversion: 2.1 time: 0.703585 Oct 31 15:41:56.752581 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2434/5025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:56 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1498 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:56.780443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:56.783725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:56.806343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:56.820757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:56.823627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:56.831947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:56.832852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:56.835151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:56.933333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lazy-loading 'flavor' on Instance uuid 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:41:57.064058 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0ea0ac0-138e-4626-8e6f-0e2c50c6a23b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "POST /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a/action" status: 200 len: 32 microversion: 2.1 time: 0.286246 Oct 31 15:41:57.065835 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2592/5026] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:41:56 2022] POST /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:41:57.078086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:57.078731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:57.096290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:57.097016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:57.097530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:57.100299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:57.101058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:57.101704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:58.324751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:58.342506 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dac8fd60-6253-4320-b571-3b119f30a7e6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 1.271071 Oct 31 15:41:58.343164 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2435/5027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:57 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:58.372563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:58.373371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:58.393990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:58.394334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:58.395781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:58.397981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:58.398816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:58.399066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:58.401628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6624617e-66b8-4956-a0a1-60383aa35578 req-d87a5fba-00b0-4223-a8e2-0fd4cf103b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:41:58.440171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6624617e-66b8-4956-a0a1-60383aa35578 req-d87a5fba-00b0-4223-a8e2-0fd4cf103b08 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:58.440667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6624617e-66b8-4956-a0a1-60383aa35578 req-d87a5fba-00b0-4223-a8e2-0fd4cf103b08 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:58.441105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6624617e-66b8-4956-a0a1-60383aa35578 req-d87a5fba-00b0-4223-a8e2-0fd4cf103b08 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:58.496291 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6624617e-66b8-4956-a0a1-60383aa35578 req-d87a5fba-00b0-4223-a8e2-0fd4cf103b08 service nova] Creating event network-changed:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h2-858384-17 Oct 31 15:41:58.526831 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6624617e-66b8-4956-a0a1-60383aa35578 req-d87a5fba-00b0-4223-a8e2-0fd4cf103b08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135727 Oct 31 15:41:58.530530 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2436/5028] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:41:59.214655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:41:59.243336 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03fa3309-e1a1-4134-b27f-89806e91fb77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1563 microversion: 2.1 time: 0.858591 Oct 31 15:41:59.244365 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2593/5029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:58 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1563 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:41:59.368357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:41:59.370488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:41:59.377810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:41:59.389850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:59.391233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:59.393769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:41:59.395109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:41:59.396865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:41:59.400159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:00.642749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:00.654851 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2817b451-dd04-4964-bfe3-eefdccf8b33c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 1.291427 Oct 31 15:42:00.655707 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2437/5030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:41:59 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:01.685161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:01.686400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:01.740100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:01.747873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:01.748663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:01.750060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:01.752834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:01.765861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:02.296459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:02.316462 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b8151145-6f6b-4311-9b62-3cce1cebfe5a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.638309 Oct 31 15:42:02.317788 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2594/5031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:01 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:03.341812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:03.343771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:03.370716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:03.372152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:03.373159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:03.374134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:03.374711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:03.375221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:03.899574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:03.908627 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a6fe87c3-69cf-4fae-b2cd-4a8545d1e994 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.572062 Oct 31 15:42:03.916456 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2438/5032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:03 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:04.932979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:04.934419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:04.941561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:04.943362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:04.944133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:04.944896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:04.946075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:04.947430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:04.948145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:05.400929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:05.416480 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-84caf276-6618-461f-8a9a-951f820da619 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.488357 Oct 31 15:42:05.420972 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2595/5033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:04 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:06.444242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:06.446153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:06.463549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:06.464176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:06.466107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:06.466950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:06.468884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:06.470964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:06.797159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:06.818271 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d69a9eb-3243-449e-a5ac-75ad02820087 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.376276 Oct 31 15:42:06.818969 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2439/5034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:06 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:07.845587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:07.846194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:07.854545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:07.855423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:07.856555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:07.857475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:07.858099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:07.858792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:08.369618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b311346-ef52-414f-9666-d6c78bc90321 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e08cf9d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:08.450036 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b311346-ef52-414f-9666-d6c78bc90321 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/18a6bb53-447f-46ac-84df-29f5ba664823" status: 200 len: 661 microversion: 2.1 time: 0.083953 Oct 31 15:42:08.451008 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2440/5035] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:08 2022] GET /compute/v2.1/images/18a6bb53-447f-46ac-84df-29f5ba664823 => generated 661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:08.465430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0665c7ce-cc5d-474b-8f86-37dd29034a8b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e03d23a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:08.511001 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0665c7ce-cc5d-474b-8f86-37dd29034a8b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/18a6bb53-447f-46ac-84df-29f5ba664823" status: 200 len: 661 microversion: 2.1 time: 0.049968 Oct 31 15:42:08.513394 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2441/5036] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:08 2022] GET /compute/v2.1/images/18a6bb53-447f-46ac-84df-29f5ba664823 => generated 661 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:42:08.948433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:08.958280 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b4fb904e-98e4-4dd5-81ee-8e008bc6f3b7 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 1.116398 Oct 31 15:42:08.959700 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2596/5037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:07 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:09.984720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:09.986117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:10.005288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:10.010342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:10.012593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:10.016408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:10.021588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:10.022326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:10.492631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:10.509177 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b7dec647-c6c5-46aa-8b7a-c21e615a7dc4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.529150 Oct 31 15:42:10.511936 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2442/5038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:09 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:10.539048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7687543c-1c7b-4239-b583-9626bf370f25 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0299e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:10.618873 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7687543c-1c7b-4239-b583-9626bf370f25 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/ae399822-3385-4fe2-9f99-9f15063ad077" status: 200 len: 661 microversion: 2.1 time: 0.083972 Oct 31 15:42:10.619748 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2597/5039] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:10 2022] GET /compute/v2.1/images/ae399822-3385-4fe2-9f99-9f15063ad077 => generated 661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:10.638538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52fb7e8b-113f-448b-a4ed-fd7130426d71 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e55714c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:10.686305 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52fb7e8b-113f-448b-a4ed-fd7130426d71 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/ae399822-3385-4fe2-9f99-9f15063ad077" status: 200 len: 661 microversion: 2.1 time: 0.053543 Oct 31 15:42:10.687382 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2443/5040] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:10 2022] GET /compute/v2.1/images/ae399822-3385-4fe2-9f99-9f15063ad077 => generated 661 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:11.536096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:11.536714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:11.557222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:11.569529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:11.570749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:11.581736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:11.582356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:11.583536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:11.598737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:11.968640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d327523-4f72-4077-b5d9-b0f5b4c947c4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:11.972385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d327523-4f72-4077-b5d9-b0f5b4c947c4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:12.008754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d327523-4f72-4077-b5d9-b0f5b4c947c4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:12.014684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d327523-4f72-4077-b5d9-b0f5b4c947c4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:12.015918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d327523-4f72-4077-b5d9-b0f5b4c947c4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:12.022857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d327523-4f72-4077-b5d9-b0f5b4c947c4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:12.026017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d327523-4f72-4077-b5d9-b0f5b4c947c4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:12.027058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d327523-4f72-4077-b5d9-b0f5b4c947c4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:12.031197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:12.065373 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7bc8f058-d8ef-488c-a012-5591ee210868 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.533314 Oct 31 15:42:12.086654 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2598/5041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:11 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:12.163629 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d327523-4f72-4077-b5d9-b0f5b4c947c4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action" status: 200 len: 24562 microversion: 2.1 time: 0.201190 Oct 31 15:42:12.167078 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2444/5042] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:42:11 2022] POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action => generated 24562 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:42:12.928060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-08503ab2-7633-432f-92c6-eebe287a7035 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0f36b80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:13.021830 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-08503ab2-7633-432f-92c6-eebe287a7035 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/d2d12635-fefe-419b-b914-2ec120bbd3d5" status: 200 len: 661 microversion: 2.1 time: 0.100754 Oct 31 15:42:13.022697 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2599/5043] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:12 2022] GET /compute/v2.1/images/d2d12635-fefe-419b-b914-2ec120bbd3d5 => generated 661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:13.038541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de757eeb-a32f-4196-9c25-b1863795bdde tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e02eb1f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:13.104553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:13.105289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:13.127169 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de757eeb-a32f-4196-9c25-b1863795bdde tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/d2d12635-fefe-419b-b914-2ec120bbd3d5" status: 200 len: 661 microversion: 2.1 time: 0.093166 Oct 31 15:42:13.128046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:13.129024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:13.129760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:13.142121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:13.151487 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2445/5044] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:13 2022] GET /compute/v2.1/images/d2d12635-fefe-419b-b914-2ec120bbd3d5 => generated 661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:13.152520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:13.153203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:13.309999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-40061600", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:13.396793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:42:14.190928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:14.210067 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4bd00e9-b593-4a3e-bb92-4fbeb6090e41 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 1.119402 Oct 31 15:42:14.238876 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2600/5045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:13 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:14.245687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:42:14.246170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:42:14.246617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:42:14.247256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:42:14.247837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:42:14.287913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:14.290358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:14.290979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:14.293807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:14.295431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:14.296097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:14.358658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Getting quotas for project 1e71cf63e94c4cf893a7c15f9be3f135. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:14.372030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Getting quotas for user 0cc56b16617148c18ef65024b06443c6 and project 1e71cf63e94c4cf893a7c15f9be3f135. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:14.406252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:42:14.411190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:42:14.498652 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6ec07d7a-9c58-4da4-b0a1-0ed9226ff9d1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194958 Oct 31 15:42:14.501863 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2446/5046] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:42:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:42:14.773955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1245206304", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:14.912630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:42:15.237441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:15.238367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:15.268222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:15.269164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:15.269715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:15.270603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:15.272571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:15.273224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:15.747503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:15.760214 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c9e61dd-0bf3-4fce-9685-b74043b37451 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.527547 Oct 31 15:42:15.761111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2447/5047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:15 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:15.811293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:42:15.812184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:42:15.812668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:42:15.813769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:42:15.814297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:42:15.860575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:15.863318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:15.863916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:15.864812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:15.865942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:15.868513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:15.919148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Getting quotas for project 1e71cf63e94c4cf893a7c15f9be3f135. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:15.944578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Getting quotas for user 0cc56b16617148c18ef65024b06443c6 and project 1e71cf63e94c4cf893a7c15f9be3f135. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:15.989289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:42:15.992019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:42:16.107832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd34f25a-6e68-448c-af9d-9bf9b5c0fa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.336282 Oct 31 15:42:16.111010 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2601/5048] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:42:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:42:16.123564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-891d2bfd-b933-44bd-a88d-0569514e0b82 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:16.127334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-891d2bfd-b933-44bd-a88d-0569514e0b82 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:16.356905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-891d2bfd-b933-44bd-a88d-0569514e0b82 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:16.367563 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-891d2bfd-b933-44bd-a88d-0569514e0b82 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1218 microversion: 2.1 time: 0.251817 Oct 31 15:42:16.376190 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2602/5049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:16 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1218 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:16.652445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1448084302", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:16.775274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] validate_networks() for [('be544361-6e3a-4480-8f73-19c2ee3c737a', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:42:16.796399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:16.797113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:16.810800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:16.811305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:16.818074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:16.818998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:16.819699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:16.820142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:17.398316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:17.427339 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-63d0f5c0-e006-4f77-9a4f-6c01673d3785 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.644698 Oct 31 15:42:17.448140 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2603/5050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:16 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:17.453899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:17.454737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:17.463867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:17.465388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:17.466256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:17.467152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:17.470230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:17.474114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:17.657724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:17.679267 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eb87218f-faa5-4ffd-98ca-348083c9d798 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1214 microversion: 2.1 time: 0.228934 Oct 31 15:42:17.680655 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2604/5051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:17 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:17.845445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:42:17.846584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:42:17.848345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:42:17.849007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:42:17.849796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:42:17.864521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:17.866928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:17.867945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:17.870354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:17.871315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:17.873320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:17.904516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Getting quotas for project ff16d6e379b84aa7b8ff5ae0cf0ef43b. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:42:17.911041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Getting quotas for user 5847c76945734989adcb3566493fec79 and project ff16d6e379b84aa7b8ff5ae0cf0ef43b. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:42:17.928884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:42:17.931555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:42:18.021445 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8bca4eab-7bbe-476d-93a6-a6e4171e82d0 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.996613 Oct 31 15:42:18.022145 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2448/5052] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:42:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:42:18.034491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f528fe45-139d-4b6d-927c-60ac11654db1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:18.035697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f528fe45-139d-4b6d-927c-60ac11654db1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:18.374832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f528fe45-139d-4b6d-927c-60ac11654db1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:18.382714 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f528fe45-139d-4b6d-927c-60ac11654db1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1223 microversion: 2.1 time: 0.352369 Oct 31 15:42:18.386908 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2605/5053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:18 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1223 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:18.456053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:18.458560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:18.489389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:18.492847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:18.493483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:18.497702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:18.504178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:18.504749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:18.703774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:18.704610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:18.744845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:18.750607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:18.752781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:18.757461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:18.759620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:18.763170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:19.338751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:19.355923 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c5065f6-d0c3-4934-9a8d-afc118df293b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1276 microversion: 2.1 time: 0.655111 Oct 31 15:42:19.361901 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2606/5054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:18 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1276 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:19.425042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:19.428776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:19.453730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:19.456255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:19.456715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:19.457503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:19.460938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:19.461938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:19.573773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:19.583394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=70 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:19.592743 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-046df948-92dc-4cf8-954b-f5e19a7dc497 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 1.141611 Oct 31 15:42:19.595833 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2449/5055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:18 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:19.685726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:19.699833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b9b9771-ed87-42a3-8a28-0cb996159db6 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1227 microversion: 2.1 time: 0.285771 Oct 31 15:42:19.719535 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2607/5056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:19 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1227 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:20.386015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:20.387089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:20.400217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:20.400923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:20.407008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:20.407008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:20.407008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:20.407366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:20.623111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:20.624077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:20.642874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:20.644937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:20.647139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:20.649617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:20.656870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:20.659148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:20.916145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:20.935346 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28e2e242-af49-4781-8841-89052489f26f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1276 microversion: 2.1 time: 0.555585 Oct 31 15:42:20.939758 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2450/5057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:20 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1276 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:20.956707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:20.959953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:20.974604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:20.975545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:20.977521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:20.981957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:20.983815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:20.984349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:21.379914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:21.424927 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a54891c-34d6-4e01-bc58-c4f343692cf1 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1281 microversion: 2.1 time: 0.483229 Oct 31 15:42:21.429285 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2451/5058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:20 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1281 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:21.593074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:21.605911 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c0b1e72-eac4-4993-a9c1-59c8e8ab8e28 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.989714 Oct 31 15:42:21.606906 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2608/5059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:20 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:21.968671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:21.970032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:22.003908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:22.005539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:22.006878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:22.007663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:22.013502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:22.014086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:22.451521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:22.453220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:22.462531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:22.465197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:22.466019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:22.474288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:22.482548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:22.483437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:22.815388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:22.830084 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-145f184b-4b06-4bbe-83d1-602c4a870796 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.868054 Oct 31 15:42:22.831261 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2452/5060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:21 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:22.845089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:22.848142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:22.865532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:22.867819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:22.868467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:22.873290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:22.874024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:22.874634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:22.925680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:22.952850 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f2f555fe-4334-4dd4-a701-5fd5b8313954 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1281 microversion: 2.1 time: 0.505965 Oct 31 15:42:22.966288 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2609/5061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:22 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1281 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:23.102742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b320aa4d-63b2-43f1-8908-3bc3bb9c1da5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:23.103358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b320aa4d-63b2-43f1-8908-3bc3bb9c1da5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:23.113177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b320aa4d-63b2-43f1-8908-3bc3bb9c1da5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:23.113680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b320aa4d-63b2-43f1-8908-3bc3bb9c1da5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:23.114116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b320aa4d-63b2-43f1-8908-3bc3bb9c1da5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:23.118315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b320aa4d-63b2-43f1-8908-3bc3bb9c1da5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:23.118843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b320aa4d-63b2-43f1-8908-3bc3bb9c1da5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:23.119286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b320aa4d-63b2-43f1-8908-3bc3bb9c1da5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:23.712361 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b320aa4d-63b2-43f1-8908-3bc3bb9c1da5 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1835 microversion: 2.1 time: 0.613405 Oct 31 15:42:23.713073 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2610/5062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:23 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1835 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:23.739512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:23.740187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:23.753517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:23.754017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:23.754498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:23.755231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:23.755689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:23.756335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:23.815837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:23.825390 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7485ecdd-e6f3-422b-a638-04933fabdb2e tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.992434 Oct 31 15:42:23.826411 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2453/5063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:22 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:23.859790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:23.861378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:23.871600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:23.872561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:23.873297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:23.874532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:23.875250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:23.875931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:24.227969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:24.273991 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd77d3a1-7098-4904-8e3c-4e239ec6d66e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.418807 Oct 31 15:42:24.278335 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2454/5064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:23 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:24.292924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:24.293963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:24.314133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:24.315944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:24.316612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:24.335872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:24.336667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:24.340723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:24.481152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:24.490809 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61a63300-d92b-4ac7-a1fa-d0f68da9c515 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1682 microversion: 2.1 time: 0.755354 Oct 31 15:42:24.493491 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2611/5065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:23 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1682 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:24.804388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0605ae05-d39d-4018-9845-dfb9aa54350d req-fb3cd673-52d7-4ebc-9aea-18f1c3031bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "069cc821-7fc7-4365-91a6-d253240e6970", "tag": "3e6c790c-a9d6-4201-95e7-05ac114346d2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:24.822510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0605ae05-d39d-4018-9845-dfb9aa54350d req-fb3cd673-52d7-4ebc-9aea-18f1c3031bae service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:24.823356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0605ae05-d39d-4018-9845-dfb9aa54350d req-fb3cd673-52d7-4ebc-9aea-18f1c3031bae service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:24.824218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0605ae05-d39d-4018-9845-dfb9aa54350d req-fb3cd673-52d7-4ebc-9aea-18f1c3031bae service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:24.837842 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0605ae05-d39d-4018-9845-dfb9aa54350d req-fb3cd673-52d7-4ebc-9aea-18f1c3031bae service nova] Creating event network-changed:3e6c790c-a9d6-4201-95e7-05ac114346d2 for instance 069cc821-7fc7-4365-91a6-d253240e6970 on n-h1-858384-17 Oct 31 15:42:24.844985 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0605ae05-d39d-4018-9845-dfb9aa54350d req-fb3cd673-52d7-4ebc-9aea-18f1c3031bae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.349658 Oct 31 15:42:24.846116 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2612/5066] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:24.872632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:24.873403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:24.880238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:24.881000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:24.881662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:24.882562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:24.883194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:24.883792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:25.247148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:25.263176 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b6e868ec-7d92-4698-9039-20302dc39b00 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1323 microversion: 2.1 time: 0.981812 Oct 31 15:42:25.264648 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2455/5067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:24 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1323 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:25.272207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-120a5818-6990-4559-9a6f-0b8355988e79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:25.275542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-120a5818-6990-4559-9a6f-0b8355988e79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:25.287049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-120a5818-6990-4559-9a6f-0b8355988e79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:25.288087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-120a5818-6990-4559-9a6f-0b8355988e79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:25.288650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-120a5818-6990-4559-9a6f-0b8355988e79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:25.289527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-120a5818-6990-4559-9a6f-0b8355988e79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:25.290152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-120a5818-6990-4559-9a6f-0b8355988e79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:25.290692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-120a5818-6990-4559-9a6f-0b8355988e79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:25.638871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:25.647276 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b459dbfd-2fb6-4a05-88d7-fcb271f5ce7a tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.779485 Oct 31 15:42:25.664206 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2613/5068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:24 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:25.670923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:25.671889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:25.678967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:25.680328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:25.681084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:25.682045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:25.683239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:25.683852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:25.900727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:26.068793 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-120a5818-6990-4559-9a6f-0b8355988e79 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action" status: 200 len: 32633 microversion: 2.1 time: 0.795454 Oct 31 15:42:26.068793 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2456/5069] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:42:25 2022] POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action => generated 32633 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:42:26.273750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:26.275178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:26.292853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:26.299022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:26.300330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:26.302072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:26.303371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:26.304235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:26.422618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:26.439110 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32bebcb2-5d34-4728-a168-b2e836041764 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.772085 Oct 31 15:42:26.440836 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2614/5070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:25 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:26.447738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:26.449889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:26.457467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:26.458418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:26.459106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:26.460293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:26.461367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:26.462181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:26.495983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ef652ba989e94c5d9f5d45f9e0385d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f201c5379a241519086c31c43d022d9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:26.496908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] flavor_id is None. Assuming migration. {{(pid=120588) resize /opt/stack/nova/nova/compute/api.py:4197}} Oct 31 15:42:26.497581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120588) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 15:42:26.739405 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c40942e-be06-4dae-a85d-c1d86e4cbd79 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action" status: 202 len: 0 microversion: 2.1 time: 0.470873 Oct 31 15:42:26.742878 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2457/5071] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:42:26 2022] POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:42:26.755592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:26.757673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:26.781775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:26.782575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:26.783241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:26.784232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:26.784904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:26.786865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.050388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:27.075303 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a6d72c42-a158-4bf4-93c0-1ade63ff8a83 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.327469 Oct 31 15:42:27.080637 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2458/5072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:26 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:27.087518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:27.089880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:27.122456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:27.122971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:27.123416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.124153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:27.124615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:27.125044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.503076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:27.511753 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be6403c1-231c-4c62-8f20-aed2f863ce43 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1691 microversion: 2.1 time: 0.429695 Oct 31 15:42:27.525550 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2459/5073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:27 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1691 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:27.535201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:27.536213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:27.542919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:27.543707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:27.544152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.545053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:27.545715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:27.546324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.597266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:27.610820 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f07f4f47-a62e-4cc0-9f31-bb0c70ec8270 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1323 microversion: 2.1 time: 1.168193 Oct 31 15:42:27.612050 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2615/5074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:26 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1323 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:27.691572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-53a65fdb-fd03-4634-8577-a348c45f6263 req-35225aac-f733-461d-af95-d90fe560bff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88584df4-529c-48f1-a3b8-ee4b77a54bf7", "tag": "3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:27.719736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-53a65fdb-fd03-4634-8577-a348c45f6263 req-35225aac-f733-461d-af95-d90fe560bff2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:27.720214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-53a65fdb-fd03-4634-8577-a348c45f6263 req-35225aac-f733-461d-af95-d90fe560bff2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:27.720644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-53a65fdb-fd03-4634-8577-a348c45f6263 req-35225aac-f733-461d-af95-d90fe560bff2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:27.767094 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-53a65fdb-fd03-4634-8577-a348c45f6263 req-35225aac-f733-461d-af95-d90fe560bff2 service nova] Creating event network-changed:3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9 for instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 on n-h2-858384-17 Oct 31 15:42:27.779118 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-53a65fdb-fd03-4634-8577-a348c45f6263 req-35225aac-f733-461d-af95-d90fe560bff2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092326 Oct 31 15:42:27.780707 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2616/5075] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:42:27.885559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:27.920274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:28.034560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:28.047970 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-783bba9d-bd5e-4af3-b9d9-2af6e3be7206 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.519825 Oct 31 15:42:28.048584 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2460/5076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:27 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:28.111049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:28.112255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:28.123359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:28.125662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:28.126425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:28.127549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:28.128342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:28.129232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:28.379822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:28.540727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:28.544325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:28.567842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:28.578532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:28.579266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:28.580197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:28.581159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:28.581778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:28.718822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:28.733501 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-024817e0-0203-4d09-93dd-b8f6d44bd1a4 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1484 microversion: 2.1 time: 0.627556 Oct 31 15:42:28.739283 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2617/5077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:28 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1484 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:28.767794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:28.768452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:28.799664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:28.801165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:28.803735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:28.807742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:28.813829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:28.815841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:28.992818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:29.005751 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a1f259f1-8afd-46d7-8438-e9af1de29529 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1691 microversion: 2.1 time: 0.469587 Oct 31 15:42:29.007590 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2461/5078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:28 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1691 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:29.014474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4a2a9ed-cb46-4531-b224-8d5f4395a3e3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:29.015277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4a2a9ed-cb46-4531-b224-8d5f4395a3e3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:29.023147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4a2a9ed-cb46-4531-b224-8d5f4395a3e3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:29.023871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4a2a9ed-cb46-4531-b224-8d5f4395a3e3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:29.024622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4a2a9ed-cb46-4531-b224-8d5f4395a3e3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:29.025533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4a2a9ed-cb46-4531-b224-8d5f4395a3e3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:29.026158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4a2a9ed-cb46-4531-b224-8d5f4395a3e3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:29.027712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4a2a9ed-cb46-4531-b224-8d5f4395a3e3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:29.147562 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4a2a9ed-cb46-4531-b224-8d5f4395a3e3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "POST /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a/action" status: 202 len: 0 microversion: 2.1 time: 0.138132 Oct 31 15:42:29.148229 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2462/5079] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:42:29 2022] POST /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:42:29.162778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:29.164828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:29.183424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:29.188725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:29.189651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:29.199696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:29.200472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:29.201234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:29.360923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:29.380473 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a285af41-0917-41f7-af74-2742f286b758 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1323 microversion: 2.1 time: 0.638741 Oct 31 15:42:29.383751 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2618/5080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:28 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1323 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:29.392409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:29.394304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:29.413933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:29.413933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:29.413933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:29.413933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:29.413933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:29.413933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:29.630500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:29.647168 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc54827d-d76f-4aab-8326-20f043d7c586 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.495277 Oct 31 15:42:29.649445 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2463/5081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:29 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:29.737538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:29.740906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:29.751411 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dec3e230-94a6-4253-93d8-b7a2a3bebe70 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1492 microversion: 2.1 time: 0.365900 Oct 31 15:42:29.752598 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2619/5082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:29 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1492 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:29.831850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-cc270b7f-1341-41fc-881a-97b674685205 req-186496d4-24e3-48e7-9943-be53d1ac77ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cdfb03-c3ad-4ace-a9c7-f55fbea50e99", "tag": "820dfaba-353d-44fb-9f0f-fb61cb48a99b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:29.851218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:29.857348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cc270b7f-1341-41fc-881a-97b674685205 req-186496d4-24e3-48e7-9943-be53d1ac77ee service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:29.858078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cc270b7f-1341-41fc-881a-97b674685205 req-186496d4-24e3-48e7-9943-be53d1ac77ee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:29.859353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cc270b7f-1341-41fc-881a-97b674685205 req-186496d4-24e3-48e7-9943-be53d1ac77ee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:29.904704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:29.908910 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-cc270b7f-1341-41fc-881a-97b674685205 req-186496d4-24e3-48e7-9943-be53d1ac77ee service nova] Creating event network-changed:820dfaba-353d-44fb-9f0f-fb61cb48a99b for instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 on n-h1-858384-17 Oct 31 15:42:29.919260 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-cc270b7f-1341-41fc-881a-97b674685205 req-186496d4-24e3-48e7-9943-be53d1ac77ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092561 Oct 31 15:42:29.919944 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2464/5083] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:42:30.039083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:30.049518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:30.081121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.084275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.086777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:30.092355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.093028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.107659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:30.412072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:30.412823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:30.421196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.423172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.423172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:30.423731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.424407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.429541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:30.550095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:30.563256 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-478caf43-448c-4698-9700-e734f4982efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1691 microversion: 2.1 time: 0.531566 Oct 31 15:42:30.565263 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2620/5084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:30 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1691 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:30.677158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:30.683261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:30.697280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.704507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.706052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:30.709643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:30.710424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:30.711194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:31.249496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:31.273910 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8e75560-987a-4dee-80f4-87a39f59ba3b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1323 microversion: 2.1 time: 0.867659 Oct 31 15:42:31.274770 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2465/5085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:30 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1323 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:31.288712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:31.293299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:31.307272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:31.308114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:31.309006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:31.310119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:31.310875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:31.312269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:31.452937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:31.468789 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc923bc1-2b74-4877-b855-adb8888a91a0 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.795532 Oct 31 15:42:31.486630 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2621/5086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:30 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:31.498323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7afff2a3-b771-4637-b42b-9a918e35b1f9 req-0f001468-8ed0-4157-8cd7-f0e10600a3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069cc821-7fc7-4365-91a6-d253240e6970", "name": "network-vif-plugged", "status": "completed", "tag": "3e6c790c-a9d6-4201-95e7-05ac114346d2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:31.524520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7afff2a3-b771-4637-b42b-9a918e35b1f9 req-0f001468-8ed0-4157-8cd7-f0e10600a3cd service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:31.525461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7afff2a3-b771-4637-b42b-9a918e35b1f9 req-0f001468-8ed0-4157-8cd7-f0e10600a3cd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:31.527638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7afff2a3-b771-4637-b42b-9a918e35b1f9 req-0f001468-8ed0-4157-8cd7-f0e10600a3cd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:31.558329 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7afff2a3-b771-4637-b42b-9a918e35b1f9 req-0f001468-8ed0-4157-8cd7-f0e10600a3cd service nova] Creating event network-vif-plugged:3e6c790c-a9d6-4201-95e7-05ac114346d2 for instance 069cc821-7fc7-4365-91a6-d253240e6970 on n-h1-858384-17 Oct 31 15:42:31.569970 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7afff2a3-b771-4637-b42b-9a918e35b1f9 req-0f001468-8ed0-4157-8cd7-f0e10600a3cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087919 Oct 31 15:42:31.583404 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2622/5087] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:31.591850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:31.592811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:31.599830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:31.600565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:31.601452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:31.602395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:31.603082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:31.603962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:32.117690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:32.127770 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e1a1878-8a19-460d-93f9-805207243b33 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1691 microversion: 2.1 time: 0.542695 Oct 31 15:42:32.131360 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2623/5088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:31 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1691 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:32.304755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:32.305588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:32.318582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:32.320216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:32.320926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:32.325324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:32.327565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:32.328285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:32.508392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:32.519430 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1d74a06-a5d5-4f15-8bac-e8f64fbde152 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1323 microversion: 2.1 time: 0.221138 Oct 31 15:42:32.520045 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2624/5089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:32 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1323 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:32.525702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:32.531869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:32.540252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:32.543453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:32.544301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:32.546556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:32.553007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:32.553575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:32.554430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:32.567427 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-180bd23a-efed-47cb-a565-cc36d757a7f5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1492 microversion: 2.1 time: 1.288981 Oct 31 15:42:32.570372 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2466/5090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:31 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1492 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:32.763479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:32.777361 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11c9ad30-ba19-4bfc-bb9f-6f8f059faa0d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.255237 Oct 31 15:42:32.778748 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2625/5091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:32 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:33.158251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:33.159690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:33.177694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:33.178263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:33.178717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:33.184019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:33.184607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:33.185114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:33.545751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:33.546851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:33.573564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:33.574708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:33.575343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:33.576421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:33.577068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:33.577783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:33.856170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:33.870502 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec06d6a9-3181-483f-b3d4-2983572b2213 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1696 microversion: 2.1 time: 0.716733 Oct 31 15:42:33.874212 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2467/5092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:33 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1696 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:33.881412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:33.883086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:33.890547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:33.891323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:33.891923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:33.892825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:33.893484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:33.894157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:33.909261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:33.918036 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b98c2f1a-f955-4280-abce-a7caf22ae228 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1323 microversion: 2.1 time: 0.376498 Oct 31 15:42:33.922472 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2626/5093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:33 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1323 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:33.927583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:33.928460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:33.949769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:33.950323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:33.951162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:33.951969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:33.952434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:33.952956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:34.225261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:34.246003 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ac48e9b-5ae3-4898-a26d-167505d1d57c tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1492 microversion: 2.1 time: 0.370419 Oct 31 15:42:34.247220 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2468/5094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:33 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1492 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:34.324283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:34.341277 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-00d1a81a-a9bc-4225-8c03-232f760ea363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.411186 Oct 31 15:42:34.342480 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2627/5095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:33 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:34.900048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:34.900509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:34.920199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:34.920705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:34.921178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:34.921886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:34.922534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:34.923154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:34.946243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:34.947600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:34.958737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:34.959693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:34.960391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:34.961766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:34.963302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:34.965293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:35.215462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:35.238038 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63f35502-8755-4ce0-a8db-fe04b3abf9c5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1696 microversion: 2.1 time: 0.340813 Oct 31 15:42:35.240104 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2469/5096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:34 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1696 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:35.271400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:35.272327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:35.281276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:35.282040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:35.282914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:35.284282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:35.284822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:35.285572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:35.468442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:35.490440 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9ec5c5f2-5cb7-4acc-a911-0a6cf94cbc8e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1323 microversion: 2.1 time: 0.549944 Oct 31 15:42:35.492214 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2628/5097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:34 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1323 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:35.505450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-314e0091-6da9-488a-8833-46692061b44c req-7d265151-4a49-4dc5-aac7-47dfb601a035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cdfb03-c3ad-4ace-a9c7-f55fbea50e99", "name": "network-vif-plugged", "status": "completed", "tag": "820dfaba-353d-44fb-9f0f-fb61cb48a99b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:35.514458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:35.516875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-314e0091-6da9-488a-8833-46692061b44c req-7d265151-4a49-4dc5-aac7-47dfb601a035 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:35.518495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-314e0091-6da9-488a-8833-46692061b44c req-7d265151-4a49-4dc5-aac7-47dfb601a035 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:35.519355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-314e0091-6da9-488a-8833-46692061b44c req-7d265151-4a49-4dc5-aac7-47dfb601a035 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:35.542941 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-314e0091-6da9-488a-8833-46692061b44c req-7d265151-4a49-4dc5-aac7-47dfb601a035 service nova] Creating event network-vif-plugged:820dfaba-353d-44fb-9f0f-fb61cb48a99b for instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 on n-h1-858384-17 Oct 31 15:42:35.551531 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-314e0091-6da9-488a-8833-46692061b44c req-7d265151-4a49-4dc5-aac7-47dfb601a035 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057584 Oct 31 15:42:35.552769 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2629/5098] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:35.562404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:35.564048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:35.584388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:35.584945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:35.585599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:35.586530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:35.587432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:35.588463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:35.916184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:35.926924 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a152f6a-397c-4789-a8c0-d1bda26db12b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.372012 Oct 31 15:42:35.943026 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2630/5099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:35 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:36.075696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:36.089885 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33be1dc3-b527-45b8-96b2-25faf07df5d6 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1498 microversion: 2.1 time: 0.821403 Oct 31 15:42:36.104945 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2470/5100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:35 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1498 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:36.127910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:36.128505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:36.139602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.140094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.140532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.145491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.146355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.146984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.184015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:42:36.265171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:36.265968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:36.279627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.280154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.280605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.283288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.283772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.284204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.315800 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-152d889b-1953-4ad2-8e4e-61cd526210d5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 204 len: 0 microversion: 2.1 time: 0.191249 Oct 31 15:42:36.318435 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2631/5101] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:42:36 2022] DELETE /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:42:36.342294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:36.344438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:36.363413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.363954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.365576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.367200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.369623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.371968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.771090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:36.787014 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f3f7deb-f0f9-4611-a288-765cd0467247 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.462495 Oct 31 15:42:36.788499 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2632/5102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:36 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:36.801065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:36.802074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:36.804161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:36.819489 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c61729be-fe0e-4428-a0e5-226626935fcf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1696 microversion: 2.1 time: 0.559371 Oct 31 15:42:36.820468 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2471/5103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:36 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1696 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:36.822982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.823482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.823925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.824658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.825101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.825563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.956324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:36.956978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:36.976987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.980273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.989736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:36.991014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:36.991520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:36.992142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.244326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:37.254961 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35df5f83-0722-4e9c-98aa-06711d0e6bbc tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1323 microversion: 2.1 time: 0.463504 Oct 31 15:42:37.256088 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2633/5104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:36 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:37.580366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6b195293-ca28-456e-94ce-72cbb60dd653 req-8b31c8c6-91b1-4ef6-8179-98fadc2252c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88584df4-529c-48f1-a3b8-ee4b77a54bf7", "name": "network-vif-plugged", "status": "completed", "tag": "3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:37.591622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6b195293-ca28-456e-94ce-72cbb60dd653 req-8b31c8c6-91b1-4ef6-8179-98fadc2252c0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.592172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6b195293-ca28-456e-94ce-72cbb60dd653 req-8b31c8c6-91b1-4ef6-8179-98fadc2252c0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.592614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6b195293-ca28-456e-94ce-72cbb60dd653 req-8b31c8c6-91b1-4ef6-8179-98fadc2252c0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.620934 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6b195293-ca28-456e-94ce-72cbb60dd653 req-8b31c8c6-91b1-4ef6-8179-98fadc2252c0 service nova] Creating event network-vif-plugged:3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9 for instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 on n-h2-858384-17 Oct 31 15:42:37.630103 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6b195293-ca28-456e-94ce-72cbb60dd653 req-8b31c8c6-91b1-4ef6-8179-98fadc2252c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050129 Oct 31 15:42:37.631284 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2634/5105] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:37.827416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:37.828814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:37.851113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.852163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.852798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.855874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.856680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.857346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.905242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:37.920022 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-48ccec78-7b7a-45fc-8c25-4dffca6ac715 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.969101 Oct 31 15:42:37.936454 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2472/5106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:36 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:37.946331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:37.948294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:37.963148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.964992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.965646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:37.966979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:37.967755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:37.968417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:38.366800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:38.381103 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a363ff16-6a70-4cd5-94ed-bd1bcf658cf5 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.565011 Oct 31 15:42:38.381913 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2635/5107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:37 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:38.392720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:38.394636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:38.410873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:38.413747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:38.415122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:38.419894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:38.420773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:38.423189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:38.426550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:38.445105 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49999948-0546-4fe5-a006-53a58a0139de tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1696 microversion: 2.1 time: 0.506976 Oct 31 15:42:38.447501 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2473/5108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:37 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1696 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:38.878767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:38.882510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:38.908418 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccdc16a0-598a-4205-8da7-be333176639d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1518 microversion: 2.1 time: 0.525044 Oct 31 15:42:38.937301 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2636/5109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:38 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1518 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:38.939808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:38.942486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:38.949944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:38.950970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:38.960206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:38.960713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:38.965804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:38.966807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:38.967296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:38.968290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:38.969665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:38.970456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:38.971135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:38.972306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:38.973015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:38.973716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.028663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lazy-loading 'flavor' on Instance uuid 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:42:39.209572 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-532f64e2-99b2-46ab-91a7-d418836181ed tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action" status: 200 len: 32 microversion: 2.1 time: 0.275493 Oct 31 15:42:39.210822 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2474/5110] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:42:38 2022] POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action => generated 32 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:42:39.227455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:39.232986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:39.249985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.252607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.259370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.260666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.261362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.262006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.772948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:39.782157 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-41dd2963-6e63-4604-b074-fa154191813d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.558921 Oct 31 15:42:39.782766 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2475/5111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:39 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:39.798462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:39.808546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:39.815204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.815969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.825906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.826968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.827610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.828207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.886394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:39.895732 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-822ad55c-31e8-4a66-8086-45da12fb53a4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1318 microversion: 2.1 time: 0.956363 Oct 31 15:42:39.896011 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2637/5112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:38 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1318 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:39.926588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:39.927417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:39.940385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.941260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.941905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:39.942808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:39.943424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:39.944020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:40.216258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:40.235255 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc34f9f6-30f3-444e-aa7a-7f1b75b3f084 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1504 microversion: 2.1 time: 0.447478 Oct 31 15:42:40.236639 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2476/5113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:39 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1504 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:40.677542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:40.692652 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23f3d225-dda3-4335-9b5d-a57539ffacde tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1696 microversion: 2.1 time: 0.781110 Oct 31 15:42:40.693300 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2638/5114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:39 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1696 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:40.806632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:40.807838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:40.818129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:40.821216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:40.821882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:40.824099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:40.828018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:40.828824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:40.928597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:40.929256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:40.949485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:40.952034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:40.953602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:40.954719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:40.956699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:40.957827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:41.411566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:41.422783 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d580d8f-e64d-46ba-856b-0317cfe559c7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1468 microversion: 2.1 time: 0.504019 Oct 31 15:42:41.427724 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2639/5115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:40 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1468 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:41.450521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:41.451471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:41.457152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:41.467994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:41.468776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:41.469438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:41.472905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:41.474182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:41.476084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:41.480095 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bff8acc5-1254-4677-a8c9-53f1fd9410d2 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.674813 Oct 31 15:42:41.493776 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2477/5116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:40 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:41.524119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7e24db04-8579-428a-b551-4fcada078f4a req-0b5fe67c-2639-40ea-9256-0b64ee65cf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a", "name": "network-vif-deleted", "tag": "762ddc11-f327-4c65-95c0-fa15446b8469"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:41.560113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7e24db04-8579-428a-b551-4fcada078f4a req-0b5fe67c-2639-40ea-9256-0b64ee65cf09 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:41.560694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7e24db04-8579-428a-b551-4fcada078f4a req-0b5fe67c-2639-40ea-9256-0b64ee65cf09 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:41.562839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7e24db04-8579-428a-b551-4fcada078f4a req-0b5fe67c-2639-40ea-9256-0b64ee65cf09 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:41.618242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:41.620622 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7e24db04-8579-428a-b551-4fcada078f4a req-0b5fe67c-2639-40ea-9256-0b64ee65cf09 service nova] Creating event network-vif-deleted:762ddc11-f327-4c65-95c0-fa15446b8469 for instance 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a on n-h2-858384-17 Oct 31 15:42:41.631578 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-39b2bfe3-63bc-4a7d-ade3-6c42d9885512 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 200 len: 1462 microversion: 2.1 time: 0.202402 Oct 31 15:42:41.641171 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2640/5117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:41 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 1462 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:41.641418 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7e24db04-8579-428a-b551-4fcada078f4a req-0b5fe67c-2639-40ea-9256-0b64ee65cf09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140141 Oct 31 15:42:41.641559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:41.641559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:41.645867 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2478/5118] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:41.647948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:41.664300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:41.668197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:41.670178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:41.671183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:41.672957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:41.724466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:41.726621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:41.740794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:41.742597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:41.743902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:41.746168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:41.747676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:41.748562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.007162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:42.018239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9fdb5321-cc76-401c-9155-a3386e875420 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970" status: 200 len: 1465 microversion: 2.1 time: 0.384234 Oct 31 15:42:42.018849 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2641/5119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:41 2022] GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970 => generated 1465 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:42.049643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96ae7442-a452-4229-ae0c-4d0a644d2e48 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-215567689"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:42.052307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:42.056880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-96ae7442-a452-4229-ae0c-4d0a644d2e48 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:42.062542 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-19c54a38-41dc-4331-ba2c-2198597a3cc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1696 microversion: 2.1 time: 0.343743 Oct 31 15:42:42.063164 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2479/5120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:41 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1696 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:42.069873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ae7442-a452-4229-ae0c-4d0a644d2e48 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.070778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ae7442-a452-4229-ae0c-4d0a644d2e48 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.071220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ae7442-a452-4229-ae0c-4d0a644d2e48 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.071926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ae7442-a452-4229-ae0c-4d0a644d2e48 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.072375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ae7442-a452-4229-ae0c-4d0a644d2e48 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.073074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-96ae7442-a452-4229-ae0c-4d0a644d2e48 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.421708 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96ae7442-a452-4229-ae0c-4d0a644d2e48 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "POST /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970/action" status: 202 len: 0 microversion: 2.1 time: 0.381931 Oct 31 15:42:42.423091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2642/5121] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:42:42 2022] POST /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:42:42.435401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14bd46a6-448c-4f16-a4c2-44a9d5bb4d85 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e08cf670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:42.511973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:42.518419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:42.531298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.531781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.533197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.534393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.535445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.537958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.583067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14bd46a6-448c-4f16-a4c2-44a9d5bb4d85 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.153184 Oct 31 15:42:42.586393 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2480/5122] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:42 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:42.660836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:42.661538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:42.673725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.674237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.678792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.680081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.680777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.682347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.689042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:42.708908 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] HTTP exception thrown: Instance 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a could not be found. Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Request method failure captured: Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a HTTP/1.1 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-x9tFM0KI3t2Hg3sYXU3OecPq5GZfZypr-373aPnfojdzryUxk2DJxJLfWOOxibT394phce1feFSyN-NlK0lmYYMCqTeCmdN1TkyYKUapsuFs-atCaQP6zYsdgresnOnC5GPbmrvM3PdXSK6BgU0up1jAhjba6f9WfvOVxaj0TJ19s Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5f3ab4be623f42a8a1b6343b9f088ee7 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerRescueTestJSON-2109646661 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f3ab4be623f42a8a1b6343b9f088ee7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f3ab4be623f42a8a1b6343b9f088ee7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f3ab4be623f42a8a1b6343b9f088ee7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f3ab4be623f42a8a1b6343b9f088ee7"}]}] Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerRescueTestJSON-2109646661 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5f3ab4be623f42a8a1b6343b9f088ee7 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerRescueTestJSON-2109646661 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerRescueTestJSON-2109646661-project Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 63e830c102c34d4589a7d6af54efc228 Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerRescueTestJSON-2109646661-project Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a could not be found. Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a'} Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a could not be found. Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a could not be found. Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:42.712276 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:42:42.719897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:42.719897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:42.719897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:42.719897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:42.719897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:42.719897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a could not be found. Oct 31 15:42:42.719897 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:42:42.719897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Returning 404 to user: Instance 4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:42.722335 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61089b9c-130e-4751-9b96-bf8ef3eadbb3 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a" status: 404 len: 111 microversion: 2.1 time: 0.066269 Oct 31 15:42:42.723713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2481/5123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:42 2022] GET /compute/v2.1/servers/4e5794cd-c7a3-4290-aa5f-8c39d9a1ce4a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:42:42.733317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:42.734212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:42.744780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.745829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.747053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.748424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.749195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.750060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.795582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:42:42.949210 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-383dc1b9-8c83-472e-b7a7-16e2fcb4f1cf tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 204 len: 0 microversion: 2.1 time: 0.219762 Oct 31 15:42:42.953927 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2482/5124] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:42:42 2022] DELETE /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:42:42.964420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:42.965275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:42.972409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.973040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.973582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:42.974537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:42.975217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:42.975924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:43.013598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:43.027576 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e6a2bce-640d-428f-a3eb-2bc07147dc6d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.524120 Oct 31 15:42:43.043009 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2643/5125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:42 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:43.091472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:43.092077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:43.098265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:43.098779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:43.099204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:43.099918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:43.100380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:43.100810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:43.305423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:43.316919 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d52bc9cd-a1cf-48e6-b1c9-2131d260d2f7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1696 microversion: 2.1 time: 0.230028 Oct 31 15:42:43.335625 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2644/5126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:43 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1696 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:43.604520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-299ca790-84fa-444a-a61a-15e161857a0c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1abd790>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:43.674353 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-299ca790-84fa-444a-a61a-15e161857a0c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.076679 Oct 31 15:42:43.684046 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2645/5127] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:43 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:43.849202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:43.858741 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d88c20c-4c0e-41f8-b200-612bd7e41c05 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1490 microversion: 2.1 time: 0.903347 Oct 31 15:42:43.874373 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2483/5128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:42 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1490 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:44.053385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:44.054069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:44.065660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.066640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.067368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.068397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.070923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.071584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.344554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:44.345553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:44.350868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:44.360077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.361201 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2f56287-c746-485f-97cf-4fc8c9c1aff9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.314459 Oct 31 15:42:44.361719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.363531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.364994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.366898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.368195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.373823 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2646/5129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:44 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:44.701071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4242863-1c22-461d-8ee0-68753ae352df tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1b45f70>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:44.782027 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4242863-1c22-461d-8ee0-68753ae352df tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.094047 Oct 31 15:42:44.782752 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2647/5130] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:44 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:44.795745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:44.805744 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b63e3d6-c20b-4d75-89cc-0acaa1e210e7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1696 microversion: 2.1 time: 0.465289 Oct 31 15:42:44.806346 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2484/5131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:44 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1696 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:44.885104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:44.885886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:44.896702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.897993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.899035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:44.900607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:44.903113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:44.903797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.390073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:45.391552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:45.423686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:45.424910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:45.426367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.428296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:45.429717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:45.438680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:45.940141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:45.953930 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b611e1f2-65cd-4a89-90ac-7ba693d1d598 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1490 microversion: 2.1 time: 1.073696 Oct 31 15:42:45.969163 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2648/5132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:44 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1490 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:45.969567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-410e015d-7766-4e1b-80c0-33825f872c9a tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e17cd0d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:46.043108 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-410e015d-7766-4e1b-80c0-33825f872c9a tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.082278 Oct 31 15:42:46.044058 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2649/5133] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:45 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:46.055590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:46.060516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:46.104894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:46.105936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:46.109065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:46.112165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:46.113073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:46.113719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:46.300503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:46.319389 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2d670909-07b2-4f39-92e4-a0d779f77c7d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.934635 Oct 31 15:42:46.320664 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2485/5134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:45 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:46.982994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:46.983644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:46.995084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:46.995593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:46.996043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:46.999691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.004087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.004608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:47.193119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:47.207502 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8341d852-8c12-4553-8d41-535550644de5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1695 microversion: 2.1 time: 1.160637 Oct 31 15:42:47.208151 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2650/5135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:46 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1695 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:47.235169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6d1f823-b48c-41b8-b0bb-03fa27d2539c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e163a1f0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:47.326446 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6d1f823-b48c-41b8-b0bb-03fa27d2539c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.104064 Oct 31 15:42:47.327626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2651/5136] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:47 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:47.341046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-69042801-63aa-4c29-a296-ca682eeb29e0 req-fa57e6bf-92ad-44c8-a185-a15bfab23ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069cc821-7fc7-4365-91a6-d253240e6970", "name": "network-vif-plugged", "status": "completed", "tag": "3e6c790c-a9d6-4201-95e7-05ac114346d2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:47.365248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-69042801-63aa-4c29-a296-ca682eeb29e0 req-fa57e6bf-92ad-44c8-a185-a15bfab23ecc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.365738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-69042801-63aa-4c29-a296-ca682eeb29e0 req-fa57e6bf-92ad-44c8-a185-a15bfab23ecc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.366170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-69042801-63aa-4c29-a296-ca682eeb29e0 req-fa57e6bf-92ad-44c8-a185-a15bfab23ecc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:47.390750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-69042801-63aa-4c29-a296-ca682eeb29e0 req-fa57e6bf-92ad-44c8-a185-a15bfab23ecc service nova] Creating event network-vif-plugged:3e6c790c-a9d6-4201-95e7-05ac114346d2 for instance 069cc821-7fc7-4365-91a6-d253240e6970 on n-h1-858384-17 Oct 31 15:42:47.406156 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-69042801-63aa-4c29-a296-ca682eeb29e0 req-fa57e6bf-92ad-44c8-a185-a15bfab23ecc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071232 Oct 31 15:42:47.407045 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2652/5137] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:47.412649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-32d31cce-9d08-4728-b4c9-8dd4d94e7412 req-1d106fde-0281-4b69-9778-1d57108372a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "name": "network-vif-unplugged", "status": "completed", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:47.427300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-32d31cce-9d08-4728-b4c9-8dd4d94e7412 req-1d106fde-0281-4b69-9778-1d57108372a5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.427792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-32d31cce-9d08-4728-b4c9-8dd4d94e7412 req-1d106fde-0281-4b69-9778-1d57108372a5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.428224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-32d31cce-9d08-4728-b4c9-8dd4d94e7412 req-1d106fde-0281-4b69-9778-1d57108372a5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:47.446409 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-32d31cce-9d08-4728-b4c9-8dd4d94e7412 req-1d106fde-0281-4b69-9778-1d57108372a5 service nova] Creating event network-vif-unplugged:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h1-858384-17 Oct 31 15:42:47.455590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-32d31cce-9d08-4728-b4c9-8dd4d94e7412 req-1d106fde-0281-4b69-9778-1d57108372a5 service nova] Instance e5e640dc-7c7e-4a28-821e-41da7a74323b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:42:47.490641 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-32d31cce-9d08-4728-b4c9-8dd4d94e7412 req-1d106fde-0281-4b69-9778-1d57108372a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082025 Oct 31 15:42:47.491820 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2653/5138] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:47.492371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:47.498745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:47.499687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:47.506659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.507797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.508393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:47.508791 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d09c00c8-01e1-4500-a8f4-8b1e1ddcfe9f tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1490 microversion: 2.1 time: 0.526413 Oct 31 15:42:47.509528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.510891 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2486/5139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:46 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1490 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:47.511456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.512153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:47.783739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-73cd437c-092f-4b97-9223-ee28bc18d63e req-970678a0-9696-49eb-9e92-e80b5e647c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef89ac9-7004-4119-9929-c888340e8dfe", "name": "network-vif-deleted", "tag": "e7340132-3a60-4871-a9f2-edf7cef1d796"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:47.799449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73cd437c-092f-4b97-9223-ee28bc18d63e req-970678a0-9696-49eb-9e92-e80b5e647c61 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:47.799706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73cd437c-092f-4b97-9223-ee28bc18d63e req-970678a0-9696-49eb-9e92-e80b5e647c61 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:47.800362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-73cd437c-092f-4b97-9223-ee28bc18d63e req-970678a0-9696-49eb-9e92-e80b5e647c61 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:47.817739 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-73cd437c-092f-4b97-9223-ee28bc18d63e req-970678a0-9696-49eb-9e92-e80b5e647c61 service nova] Creating event network-vif-deleted:e7340132-3a60-4871-a9f2-edf7cef1d796 for instance 0ef89ac9-7004-4119-9929-c888340e8dfe on n-h1-858384-17 Oct 31 15:42:47.825944 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-73cd437c-092f-4b97-9223-ee28bc18d63e req-970678a0-9696-49eb-9e92-e80b5e647c61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046247 Oct 31 15:42:47.827110 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2487/5140] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:48.090189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:48.123553 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5943a02-0834-496e-b3be-ab6769dac318 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.630178 Oct 31 15:42:48.146266 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2654/5141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:47 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:48.239004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:48.239851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:48.277839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:48.284835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:48.287181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:48.294972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:48.297156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:48.297648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:48.342721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cba209b4-0de6-4068-b971-451e14178719 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0e30430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:48.464707 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cba209b4-0de6-4068-b971-451e14178719 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.127142 Oct 31 15:42:48.465338 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2655/5142] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:48 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:48.554144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:48.555315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:48.567630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:48.600169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:48.603117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:48.605945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:48.610663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:48.611594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:48.748926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:48.752799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:48.754116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:48.755283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lazy-loading 'fault' on Instance uuid 0ef89ac9-7004-4119-9929-c888340e8dfe {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:42:48.876491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e830c102c34d4589a7d6af54efc228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f3ab4be623f42a8a1b6343b9f088ee7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:48.921945 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfdfd54a-ada6-49a6-8592-fa1d8bf1475b tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 200 len: 1304 microversion: 2.1 time: 0.375558 Oct 31 15:42:48.923982 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2656/5143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:48 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 1304 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:49.017115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:49.030473 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a382d90b-7499-4a36-9c59-cfd1828002ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1695 microversion: 2.1 time: 0.798343 Oct 31 15:42:49.031080 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2488/5144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:48 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1695 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:49.157754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:49.158595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:49.168713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:49.171867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:49.172485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:49.174047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:49.179221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:49.184999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:49.480538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0bffbfc8-1154-43b8-ae0a-cd1299f0a88a tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0411790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:49.551501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:49.554775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:42:49.555785 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0bffbfc8-1154-43b8-ae0a-cd1299f0a88a tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.079527 Oct 31 15:42:49.564662 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2489/5145] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:49 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:49.568138 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-939e9b15-a50b-479c-909a-73d68012cd93 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.409085 Oct 31 15:42:49.569886 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2657/5146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:49 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:49.595297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b52df6f9-1d60-4efd-9332-108e3f3404dc req-01b009c4-bb3c-40cb-b595-595188e8d9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:49.650721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b52df6f9-1d60-4efd-9332-108e3f3404dc req-01b009c4-bb3c-40cb-b595-595188e8d9fb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:49.651264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b52df6f9-1d60-4efd-9332-108e3f3404dc req-01b009c4-bb3c-40cb-b595-595188e8d9fb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:49.655827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b52df6f9-1d60-4efd-9332-108e3f3404dc req-01b009c4-bb3c-40cb-b595-595188e8d9fb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:49.714973 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b52df6f9-1d60-4efd-9332-108e3f3404dc req-01b009c4-bb3c-40cb-b595-595188e8d9fb service nova] Creating event network-changed:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h1-858384-17 Oct 31 15:42:49.724905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-b52df6f9-1d60-4efd-9332-108e3f3404dc req-01b009c4-bb3c-40cb-b595-595188e8d9fb service nova] Instance e5e640dc-7c7e-4a28-821e-41da7a74323b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:42:49.761062 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b52df6f9-1d60-4efd-9332-108e3f3404dc req-01b009c4-bb3c-40cb-b595-595188e8d9fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192730 Oct 31 15:42:49.765927 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2490/5147] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:42:49.949194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:49.950167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] [instance: 0ef89ac9-7004-4119-9929-c888340e8dfe] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:49.957361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:49.966372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:49.967044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:49.967979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:49.968592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:49.976305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.019645 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] HTTP exception thrown: Instance 0ef89ac9-7004-4119-9929-c888340e8dfe could not be found. Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Request method failure captured: Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe HTTP/1.1 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-x9tFM0KI3t2Hg3sYXU3OecPq5GZfZypr-373aPnfojdzryUxk2DJxJLfWOOxibT394phce1feFSyN-NlK0lmYYMCqTeCmdN1TkyYKUapsuFs-atCaQP6zYsdgresnOnC5GPbmrvM3PdXSK6BgU0up1jAhjba6f9WfvOVxaj0TJ19s Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5f3ab4be623f42a8a1b6343b9f088ee7 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueTestJSON-2109646661 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f3ab4be623f42a8a1b6343b9f088ee7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f3ab4be623f42a8a1b6343b9f088ee7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f3ab4be623f42a8a1b6343b9f088ee7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f3ab4be623f42a8a1b6343b9f088ee7"}]}] Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueTestJSON-2109646661 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5f3ab4be623f42a8a1b6343b9f088ee7 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueTestJSON-2109646661 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerRescueTestJSON-2109646661-project Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 63e830c102c34d4589a7d6af54efc228 Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueTestJSON-2109646661-project Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 0ef89ac9-7004-4119-9929-c888340e8dfe could not be found. Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '0ef89ac9-7004-4119-9929-c888340e8dfe'} Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef89ac9-7004-4119-9929-c888340e8dfe could not be found. Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef89ac9-7004-4119-9929-c888340e8dfe could not be found. Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:42:50.021597 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:42:50.025088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:42:50.025088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:42:50.025088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:42:50.025088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:42:50.025088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:42:50.025088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef89ac9-7004-4119-9929-c888340e8dfe could not be found. Oct 31 15:42:50.025088 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:42:50.027174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] Returning 404 to user: Instance 0ef89ac9-7004-4119-9929-c888340e8dfe could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:42:50.028288 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a84658b-970d-416e-b6e0-3377ebf59d69 tempest-ServerRescueTestJSON-2109646661 tempest-ServerRescueTestJSON-2109646661-project] 10.222.0.20 "GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe" status: 404 len: 111 microversion: 2.1 time: 0.084194 Oct 31 15:42:50.032773 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2658/5148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:49 2022] GET /compute/v2.1/servers/0ef89ac9-7004-4119-9929-c888340e8dfe => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:42:50.061663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:50.062429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:50.087462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.088087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.088909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.093338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.094014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.095221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.580947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95f14aa5-4af5-4232-acc2-25ffa3bbf2e6 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e06d6ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:50.707078 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95f14aa5-4af5-4232-acc2-25ffa3bbf2e6 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.133130 Oct 31 15:42:50.707690 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2659/5149] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:50 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:50.723943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:50.725732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:50.735172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.735679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.736124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.736849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:50.737347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:50.737781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:50.796514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:50.811549 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71cab534-e501-4fe8-b593-2b4df1b75384 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1695 microversion: 2.1 time: 0.754879 Oct 31 15:42:50.831143 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2491/5150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:50 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1695 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:51.066562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:51.075413 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-124549f6-d5f4-48b8-8c66-a440e75f6c35 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.364003 Oct 31 15:42:51.089605 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2660/5151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:50 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:51.733749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ef06dff-5985-4e6c-bb2b-ffcdc3b54bcc tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0f59af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:51.846483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:51.851158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:51.894785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:51.895209 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9ef06dff-5985-4e6c-bb2b-ffcdc3b54bcc tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.174208 Oct 31 15:42:51.901073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:51.904889 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2492/5152] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:51 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:51.907906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:51.917567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:51.921069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:51.922077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:52.101771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:52.102459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:52.118661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:52.119608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:52.120273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:52.124282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:52.124995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:52.125620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:52.823814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:52.838991 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80b9c09a-c34a-42fc-9617-de98e9ab2dae tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1695 microversion: 2.1 time: 1.004973 Oct 31 15:42:52.840267 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2661/5153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:51 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1695 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:52.912037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-998e6a12-4c02-4dd9-adce-56e996a4f017 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1a95550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:53.030570 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-998e6a12-4c02-4dd9-adce-56e996a4f017 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.122965 Oct 31 15:42:53.041799 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2662/5154] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:52 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:53.381585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:53.411071 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-491c2ae0-7e15-461a-af71-3c2f678fde64 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 1.313866 Oct 31 15:42:53.412545 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2493/5155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:52 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:53.866812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:53.868480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:53.899418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:53.901808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:53.905468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:53.907644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:53.909959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:53.910412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:54.053636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2af7a9b9-0968-458b-b17f-c05a282a9dc9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e08adf70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:54.225815 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2af7a9b9-0968-458b-b17f-c05a282a9dc9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.173882 Oct 31 15:42:54.227119 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2494/5156] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:54 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:54.439143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:54.443005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:54.474085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:54.476629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:54.489736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:54.499387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:54.499387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:54.499387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:54.546420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:54.559236 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-abcca4da-54b6-43ac-a655-c49b45541a38 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1693 microversion: 2.1 time: 0.692359 Oct 31 15:42:54.561756 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2663/5157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:53 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1693 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:54.954224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:54.963799 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5393c5e8-dbea-45b3-bed6-a5feb92e2c31 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.528769 Oct 31 15:42:54.968805 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2495/5158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:54 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:55.250236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c6af202-fa5b-4649-bb80-582d7676cf06 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e17cda60>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:55.332279 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c6af202-fa5b-4649-bb80-582d7676cf06 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.091221 Oct 31 15:42:55.332828 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2664/5159] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:55 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:55.586017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:55.586626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:55.597675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:55.598095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:55.598536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:55.599249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:55.606278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:55.606278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:55.885747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:55.897097 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1bafcfab-446f-4bed-9816-33d6d90b7270 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1690 microversion: 2.1 time: 0.314867 Oct 31 15:42:55.908757 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2496/5160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:55 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1690 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:55.933306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09e071ba-d791-48dc-b332-ea1b224f3954 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:55.934443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09e071ba-d791-48dc-b332-ea1b224f3954 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:55.959736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09e071ba-d791-48dc-b332-ea1b224f3954 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:55.960811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09e071ba-d791-48dc-b332-ea1b224f3954 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:55.961442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09e071ba-d791-48dc-b332-ea1b224f3954 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:55.962310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09e071ba-d791-48dc-b332-ea1b224f3954 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:55.963551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09e071ba-d791-48dc-b332-ea1b224f3954 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:55.964165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09e071ba-d791-48dc-b332-ea1b224f3954 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:55.996227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:55.997102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:56.005389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:56.013904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:56.016086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:56.017007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:56.023176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:56.023823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:56.243843 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09e071ba-d791-48dc-b332-ea1b224f3954 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action" status: 202 len: 0 microversion: 2.1 time: 0.319055 Oct 31 15:42:56.245726 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2665/5161] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:42:55 2022] POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:42:56.268657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:56.269756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:56.283735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:56.284534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:56.285213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:56.287619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:56.288352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:56.288940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:56.501422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:56.510887 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7f7f15c-ebc3-4e4d-9651-da055ce62d72 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.519469 Oct 31 15:42:56.514428 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2497/5162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:55 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:56.523738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b212da3-da36-4a8c-9669-a0f5c2148d2c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e125a940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:56.620834 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b212da3-da36-4a8c-9669-a0f5c2148d2c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.103871 Oct 31 15:42:56.623154 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2498/5163] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:56 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:57.069372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:57.091221 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-77987eae-8533-4060-8e00-07d0727879af tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 0.841044 Oct 31 15:42:57.092335 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2666/5164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:56 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:57.539800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:57.540803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:57.555991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:57.559921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:57.571130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:57.578104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:57.579236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:57.580865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:57.641364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b038376b-a42c-44d9-90a5-b24b8c160c85 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0e80ca0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:57.726488 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b038376b-a42c-44d9-90a5-b24b8c160c85 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.091424 Oct 31 15:42:57.727489 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2667/5165] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:57 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:58.090984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:58.116143 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9fda9d99-876d-43f0-a222-c3a2e3e54f57 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.579095 Oct 31 15:42:58.117382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:58.118106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:58.120151 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2499/5166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:57 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:58.132643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:58.133567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:58.136155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:58.137714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:58.138460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:58.139122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:58.759709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d8a4f0f7-6272-4c1d-ac7e-1d8059627e8f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e13c9ee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:58.766344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:42:58.778831 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95408264-311b-45d2-a61e-338df5b9a169 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 0.665864 Oct 31 15:42:58.809741 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2668/5167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:58 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:42:58.869156 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d8a4f0f7-6272-4c1d-ac7e-1d8059627e8f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.127616 Oct 31 15:42:58.870228 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2500/5168] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:42:58 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:42:59.151799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:59.152986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:59.173389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:59.176941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:59.177686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:59.178752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:59.179358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:59.188975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:59.571305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4f2f462e-e19b-4a17-a6b4-305507260637 req-cff1c139-0bda-4c94-bfa5-61c552a26a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "name": "network-vif-plugged", "status": "completed", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:42:59.591187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4f2f462e-e19b-4a17-a6b4-305507260637 req-cff1c139-0bda-4c94-bfa5-61c552a26a8d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:59.591676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4f2f462e-e19b-4a17-a6b4-305507260637 req-cff1c139-0bda-4c94-bfa5-61c552a26a8d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:59.592115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4f2f462e-e19b-4a17-a6b4-305507260637 req-cff1c139-0bda-4c94-bfa5-61c552a26a8d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:59.644761 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4f2f462e-e19b-4a17-a6b4-305507260637 req-cff1c139-0bda-4c94-bfa5-61c552a26a8d service nova] Creating event network-vif-plugged:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h1-858384-17 Oct 31 15:42:59.658486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-4f2f462e-e19b-4a17-a6b4-305507260637 req-cff1c139-0bda-4c94-bfa5-61c552a26a8d service nova] Instance e5e640dc-7c7e-4a28-821e-41da7a74323b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:42:59.687695 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4f2f462e-e19b-4a17-a6b4-305507260637 req-cff1c139-0bda-4c94-bfa5-61c552a26a8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.408301 Oct 31 15:42:59.697663 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2501/5169] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:42:59.826200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:42:59.826931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:42:59.839602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:59.844264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:59.845661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:42:59.848628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:42:59.849322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:42:59.854274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:00.250925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:00.260804 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65f62e4f-aa62-42b9-a40c-93a03cd48d79 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 1.118547 Oct 31 15:43:00.266799 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2669/5170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:59 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:00.294513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aeaa9bf6-aed5-41f7-a4f0-08d63531caea tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0d319d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:00.359662 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aeaa9bf6-aed5-41f7-a4f0-08d63531caea tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.073085 Oct 31 15:43:00.360885 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2670/5171] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:00 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:00.460662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:00.476709 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40ba5fb5-4191-4479-840c-5fae381d4f42 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 0.658715 Oct 31 15:43:00.484134 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2502/5172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:42:59 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:01.312906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:01.313825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:01.333159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:01.334401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:01.335839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:01.340659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:01.342892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:01.347411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:01.380784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc4090dd-9bd0-46e5-90d2-28db1a443814 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e5571f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:01.560666 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc4090dd-9bd0-46e5-90d2-28db1a443814 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.185460 Oct 31 15:43:01.563870 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2503/5173] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:01 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:01.595566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:01.596201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:01.598338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:01.633283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:01.635774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:01.639713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:01.641873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:01.646370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:01.647158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:01.655574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:02.273752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:02.301808 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd0cd2f4-b4b8-4483-9775-b0f8211e201c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 0.736497 Oct 31 15:43:02.318717 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2504/5174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:01 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:02.576949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3405eedc-7dad-4b8d-aa9c-26e81ef10902 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1193280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:02.670356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:02.699995 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e8c728d-a13a-49b6-a54e-10941b969e75 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 1.403248 Oct 31 15:43:02.708956 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2671/5175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:01 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:02.786482 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3405eedc-7dad-4b8d-aa9c-26e81ef10902 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.213059 Oct 31 15:43:02.786482 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2505/5176] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:02 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:03.748956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:03.749698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:03.779339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:03.786407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:03.786894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:03.787656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:03.788282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:03.788887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:03.943214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:03.944418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:03.954402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:03.958432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:03.959130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:03.961514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:03.965118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:03.966114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:04.720456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:04.734392 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b7c4a760-39ac-4ee9-8bbc-6c94b855f521 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 1.001988 Oct 31 15:43:04.753473 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2506/5177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:03 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:04.761569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce715d70-090a-410e-b885-a2a31488e5c9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e5622ee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:04.829199 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce715d70-090a-410e-b885-a2a31488e5c9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.072424 Oct 31 15:43:04.830636 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2507/5178] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:04 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:04.933849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-959920789", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": "none"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:05.038456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:05.051048 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff3d3886-ecb3-4ad2-bc82-c6142a2a104c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 1.723750 Oct 31 15:43:05.073544 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2672/5179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:03 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:05.085298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:43:05.085998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:43:05.086632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:43:05.087299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:43:05.090355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:43:05.114671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:05.115834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:05.116441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:05.117359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:05.117962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:05.119306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:05.163373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Getting quotas for project cfb6cfb93cb84fe28e0b7a0c1fd1ebe8. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:43:05.172076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Getting quotas for user 8fad8d5f7b544f0a83ebc3b597ee48f2 and project cfb6cfb93cb84fe28e0b7a0c1fd1ebe8. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:43:05.196427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:43:05.200101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:43:05.289297 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc5b92f3-cfc7-43ca-a5b0-c61ff0905cc3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.457018 Oct 31 15:43:05.291187 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2508/5180] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:43:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 460 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:43:05.302305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1debf97c-7c47-44aa-ad7d-e156e04fdfcd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:05.303019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1debf97c-7c47-44aa-ad7d-e156e04fdfcd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:05.371968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7e6903bd-9c58-4ada-91ef-5e547e187d90 req-60bb07f4-8aab-4860-a68e-2f30986cdd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "name": "network-vif-unplugged", "status": "completed", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:05.387895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7e6903bd-9c58-4ada-91ef-5e547e187d90 req-60bb07f4-8aab-4860-a68e-2f30986cdd30 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:05.388997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7e6903bd-9c58-4ada-91ef-5e547e187d90 req-60bb07f4-8aab-4860-a68e-2f30986cdd30 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:05.389622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7e6903bd-9c58-4ada-91ef-5e547e187d90 req-60bb07f4-8aab-4860-a68e-2f30986cdd30 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:05.407971 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7e6903bd-9c58-4ada-91ef-5e547e187d90 req-60bb07f4-8aab-4860-a68e-2f30986cdd30 service nova] Creating event network-vif-unplugged:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h2-858384-17 Oct 31 15:43:05.416263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-7e6903bd-9c58-4ada-91ef-5e547e187d90 req-60bb07f4-8aab-4860-a68e-2f30986cdd30 service nova] Instance e5e640dc-7c7e-4a28-821e-41da7a74323b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:43:05.436687 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7e6903bd-9c58-4ada-91ef-5e547e187d90 req-60bb07f4-8aab-4860-a68e-2f30986cdd30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069454 Oct 31 15:43:05.438189 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2509/5181] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:43:05.495198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1debf97c-7c47-44aa-ad7d-e156e04fdfcd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:05.507614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1debf97c-7c47-44aa-ad7d-e156e04fdfcd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:05.511711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1debf97c-7c47-44aa-ad7d-e156e04fdfcd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:05.529274 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1debf97c-7c47-44aa-ad7d-e156e04fdfcd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1277 microversion: 2.57 time: 0.231196 Oct 31 15:43:05.534742 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2673/5182] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:05 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:05.760577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:05.761324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:05.770022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:05.770776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:05.771443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:05.772815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:05.773608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:05.774268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:05.848184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6154d90c-f365-45d2-9dba-daa231f4720f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0dd8280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:05.935148 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6154d90c-f365-45d2-9dba-daa231f4720f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.091567 Oct 31 15:43:05.936414 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2674/5183] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:05 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:06.103339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:06.104731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:06.115707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:06.136501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:06.137300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:06.138210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:06.139182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:06.139849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:06.140497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:06.159098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:06.171584 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0ff3e2e-a26f-46e0-bf62-1b81b0b745e9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.413737 Oct 31 15:43:06.173575 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2510/5184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:05 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:06.570976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:06.572445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:06.583187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:06.585858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:06.589943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:06.590749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:06.603837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:06.604395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:06.755360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:06.766196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:06.767678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:06.768501 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7cf177a-43c9-4e86-97e4-16f14aa20582 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1273 microversion: 2.57 time: 0.208421 Oct 31 15:43:06.781174 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2511/5185] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:06 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1273 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:06.799911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:06.822555 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdcfbbef-fdfa-4e8b-8874-55eea9b26aa0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 0.744095 Oct 31 15:43:06.824030 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2675/5186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:06 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:06.952322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aba850cc-833f-4273-a804-aecfb78481cc tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e11cb790>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:07.037413 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aba850cc-833f-4273-a804-aecfb78481cc tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.088944 Oct 31 15:43:07.038668 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2512/5187] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:06 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:07.210785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:07.213168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:07.230715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:07.233954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:07.234599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:07.238027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:07.238656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:07.239582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:07.496241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-224ec130-f298-4082-9c7e-10b1b863b05f req-db0856dc-9a8d-4ca5-a64d-41f63f7841be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:07.540784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-224ec130-f298-4082-9c7e-10b1b863b05f req-db0856dc-9a8d-4ca5-a64d-41f63f7841be service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:07.541724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-224ec130-f298-4082-9c7e-10b1b863b05f req-db0856dc-9a8d-4ca5-a64d-41f63f7841be service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:07.542342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-224ec130-f298-4082-9c7e-10b1b863b05f req-db0856dc-9a8d-4ca5-a64d-41f63f7841be service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:07.573968 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-224ec130-f298-4082-9c7e-10b1b863b05f req-db0856dc-9a8d-4ca5-a64d-41f63f7841be service nova] Creating event network-changed:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h2-858384-17 Oct 31 15:43:07.589735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-224ec130-f298-4082-9c7e-10b1b863b05f req-db0856dc-9a8d-4ca5-a64d-41f63f7841be service nova] Instance e5e640dc-7c7e-4a28-821e-41da7a74323b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 15:43:07.637867 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-224ec130-f298-4082-9c7e-10b1b863b05f req-db0856dc-9a8d-4ca5-a64d-41f63f7841be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146817 Oct 31 15:43:07.639345 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2513/5188] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:43:07.812310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:07.813991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:07.839238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:07.840602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:07.843736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:07.846282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:07.849500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:07.856697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:07.935597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:07.947987 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d906b26-fd53-4d16-aca3-33250656da5b tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.750488 Oct 31 15:43:07.948790 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2676/5189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:07 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:07.960492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:07.961318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:07.974431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:07.974931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:07.975371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:07.980488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:07.981352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:07.982023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:08.163759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:08.173669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:08.174112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:08.175565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:08.176713 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0a524503-ebd9-4c15-a552-99d67e6d82da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1335 microversion: 2.57 time: 0.372728 Oct 31 15:43:08.185072 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-98269151-5e20-459d-958f-74ff46030c6c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 0.228709 Oct 31 15:43:08.185712 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2677/5190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:07 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:08.186747 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2514/5191] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:07 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1335 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:08.191516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89dbc79f-6b11-4677-9180-87de739a992f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0d15ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:08.278554 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89dbc79f-6b11-4677-9180-87de739a992f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.091370 Oct 31 15:43:08.283367 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2678/5192] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:08 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:08.972008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:08.973446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:08.985597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:08.986266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:08.986873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:08.990066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:08.990711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:08.991597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:09.207264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:09.208033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:09.215509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:09.216225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:09.216827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:09.217085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:09.218061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:09.218666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:09.219235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:09.225213 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d43d2737-03e3-49e1-8e8c-522bf124f0f9 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.256977 Oct 31 15:43:09.242073 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2515/5193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:08 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:09.247639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:09.248269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:09.254794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:09.255303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:09.255747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:09.256460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:09.256925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:09.257411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:09.434311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:09.443146 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dd485d7-11b0-4bba-b94b-806353ddc0f1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 0.199783 Oct 31 15:43:09.443593 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2516/5194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:09 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:09.448683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5eec9213-fbda-466a-b67d-6fc4bc1a2578 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e5571ee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:09.504731 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5eec9213-fbda-466a-b67d-6fc4bc1a2578 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1454 microversion: 2.1 time: 0.059930 Oct 31 15:43:09.505834 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2517/5195] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:09 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:09.596339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:09.605104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:09.606566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:09.607703 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1660000a-406a-49ec-9d0a-6e821ac7ef3f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1335 microversion: 2.57 time: 0.405524 Oct 31 15:43:09.608277 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2679/5196] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:09 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1335 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:10.253029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:10.253678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:10.281425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:10.283283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:10.285305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:10.287168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:10.289386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:10.291897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:10.473407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:10.474668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:10.489912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:10.490676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:10.491352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:10.493191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:10.494504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:10.495300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:10.698585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:10.706727 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc69e8ad-1830-4dba-9bbe-325bbf14bd0d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.458786 Oct 31 15:43:10.707947 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2518/5197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:10 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:10.714050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a89d29e5-a2d4-4b5f-9fd9-891c82979c74 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e56290d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:10.773114 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a89d29e5-a2d4-4b5f-9fd9-891c82979c74 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1463 microversion: 2.1 time: 0.063735 Oct 31 15:43:10.775008 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2519/5198] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:10 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1463 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:10.781839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:10.782822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:10.792524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:10.793653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:10.808119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:10.809048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:10.814519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:10.815215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:10.873407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:10.886091 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-00b64ca5-a67a-4d9d-8c99-de9652f8bab0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 0.420162 Oct 31 15:43:10.886808 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2680/5199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:10 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:10.906969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65091cb2-c2d5-42f9-9ea0-4f0d32eb1b80 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1958670>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:10.964024 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65091cb2-c2d5-42f9-9ea0-4f0d32eb1b80 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 200 len: 1463 microversion: 2.1 time: 0.075824 Oct 31 15:43:10.985584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:10.986522 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2681/5200] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:10 2022] GET /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 1463 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:10.994809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:10.995720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:10.997227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:10.998716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:10.999941 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb5c75d6-cb88-443b-8096-acdb34e4cc38 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1356 microversion: 2.57 time: 0.223559 Oct 31 15:43:11.007415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.008063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.009260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.011051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.013109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.013304 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2520/5201] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:10 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1356 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:11.015084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.023215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:11.039918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:11.044373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:11.053230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.053938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.054554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.055429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.056245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.056850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.151255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:43:11.152176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:43:11.152851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:43:11.153561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:43:11.154669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:43:11.235460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:11.237734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:11.247773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.248563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.249174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.249629 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c0b2666-ff5e-48be-bdb8-e9bc2b450226 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970" status: 200 len: 1465 microversion: 2.1 time: 0.261672 Oct 31 15:43:11.250545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.251374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.252169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.255350 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2682/5202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:10 2022] GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970 => generated 1465 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:11.283783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93a89930-f6a4-4726-8ec0-0f92f0bfa8be tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1479306192"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:11.291174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-93a89930-f6a4-4726-8ec0-0f92f0bfa8be tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:11.299580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93a89930-f6a4-4726-8ec0-0f92f0bfa8be tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.300248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93a89930-f6a4-4726-8ec0-0f92f0bfa8be tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.301380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93a89930-f6a4-4726-8ec0-0f92f0bfa8be tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.302487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93a89930-f6a4-4726-8ec0-0f92f0bfa8be tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.303243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93a89930-f6a4-4726-8ec0-0f92f0bfa8be tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.304603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-93a89930-f6a4-4726-8ec0-0f92f0bfa8be tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.321378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de832391-5086-483f-8994-7f9342d72b30 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "POST /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1/action" status: 202 len: 1137 microversion: 2.57 time: 0.289943 Oct 31 15:43:11.323244 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2521/5203] 10.222.0.20 () {62 vars in 1320 bytes} [Mon Oct 31 15:43:11 2022] POST /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1/action => generated 1137 bytes in 300 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 31 15:43:11.358260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:11.360771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:11.370751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.372440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.373851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.375849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.377086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.377928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.655732 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-93a89930-f6a4-4726-8ec0-0f92f0bfa8be tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "POST /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7/action" status: 202 len: 0 microversion: 2.1 time: 0.379524 Oct 31 15:43:11.656980 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2683/5204] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:43:11 2022] POST /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 31 15:43:11.668824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05a2ee51-66f9-4a08-8128-11f71d587216 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e554ad30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:11.772138 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05a2ee51-66f9-4a08-8128-11f71d587216 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.108332 Oct 31 15:43:11.778035 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2684/5205] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:11 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:11.794287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:11.801312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:11.825626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.826247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.826701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:11.830710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:11.831405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:11.832403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:12.101415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:12.113775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:12.115242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:12.124625 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c5e5ea09-fc55-4a06-aeaa-b97186d472c9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.777245 Oct 31 15:43:12.125624 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2522/5206] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:11 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:12.135519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:12.136661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:12.156765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:12.158022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:12.158703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:12.159697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:12.160369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:12.161029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:12.185756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:12.197899 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e942c3d-575e-430d-b581-115f99ecd688 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.417328 Oct 31 15:43:12.210839 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2685/5207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:11 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:12.613911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:12.635343 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-433ffe3d-a485-4d0b-b2c1-8641d7b06efb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1689 microversion: 2.1 time: 0.508007 Oct 31 15:43:12.635983 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2523/5208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:12 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1689 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:12.788820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-052d163d-70c9-4a69-a72b-613e83fb5059 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0d150d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:12.876344 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-052d163d-70c9-4a69-a72b-613e83fb5059 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.092093 Oct 31 15:43:12.877427 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2686/5209] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:12 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:13.146146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-afcfc89d-0ad7-4794-8735-ab813d860352 req-4f430afa-8025-4f35-aadc-7012766429ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069cc821-7fc7-4365-91a6-d253240e6970", "name": "network-vif-unplugged", "status": "completed", "tag": "3e6c790c-a9d6-4201-95e7-05ac114346d2"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:13.157170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:13.157800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:13.170566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-afcfc89d-0ad7-4794-8735-ab813d860352 req-4f430afa-8025-4f35-aadc-7012766429ac service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:13.171049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-afcfc89d-0ad7-4794-8735-ab813d860352 req-4f430afa-8025-4f35-aadc-7012766429ac service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:13.171810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:13.173668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:13.174166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:13.176670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:13.177337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:13.177696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:13.182771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-afcfc89d-0ad7-4794-8735-ab813d860352 req-4f430afa-8025-4f35-aadc-7012766429ac service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:13.202595 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-afcfc89d-0ad7-4794-8735-ab813d860352 req-4f430afa-8025-4f35-aadc-7012766429ac service nova] Creating event network-vif-unplugged:3e6c790c-a9d6-4201-95e7-05ac114346d2 for instance 069cc821-7fc7-4365-91a6-d253240e6970 on n-h1-858384-17 Oct 31 15:43:13.209768 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-afcfc89d-0ad7-4794-8735-ab813d860352 req-4f430afa-8025-4f35-aadc-7012766429ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068135 Oct 31 15:43:13.211141 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2524/5210] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:13.226851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:13.233248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:13.247813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:13.251910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:13.253356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:13.258051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:13.259328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:13.260468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:13.388240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:13.403900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:13.405637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:13.418010 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fddab9f1-5c8d-4390-8671-b1afdc9e4473 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.255504 Oct 31 15:43:13.420327 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2687/5211] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:13 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:13.671117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:13.673431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:13.697440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:13.698646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:13.700678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:13.703847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:13.705684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:13.708807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:13.729857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:13.733372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:13.747397 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d168a31b-833c-44ed-a7bc-1a83539edebd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1524 microversion: 2.1 time: 0.524977 Oct 31 15:43:13.749524 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2525/5212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:13 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1524 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:13.892504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba3ef778-5bd1-4f15-8333-c7f433a30ec9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e10078b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:13.987223 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba3ef778-5bd1-4f15-8333-c7f433a30ec9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.099241 Oct 31 15:43:13.989367 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2526/5213] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:13 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:14.069295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:14.080772 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-57fd784f-4abb-405f-a730-4b07049d3f7b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1682 microversion: 2.1 time: 0.418232 Oct 31 15:43:14.097994 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2688/5214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:13 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1682 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:14.450656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:14.451290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:14.466531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:14.467537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:14.468121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:14.468973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:14.469616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:14.471682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:14.629917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:14.639576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:14.641335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:14.642761 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2b278f4b-c246-4e4a-b994-2d837230cdd4 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.198223 Oct 31 15:43:14.643798 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2527/5215] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:14 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:14.776791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:14.777697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:14.792662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:14.793604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:14.794492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:14.796749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:14.797480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:14.798221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:15.008364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0836008-6bd7-4d73-95a9-79eaf55d4fd9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e18bc040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:15.077895 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0836008-6bd7-4d73-95a9-79eaf55d4fd9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.076117 Oct 31 15:43:15.079199 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2528/5216] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:14 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:15.165537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:15.178979 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eb7b474d-12ae-45b9-bfc1-567298d9cfe7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1504 microversion: 2.1 time: 0.412378 Oct 31 15:43:15.196497 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2689/5217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:14 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:15.209445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b728646-1dea-4f5b-b935-40758209939c tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Action: 'create', calling method: .version_select at 0x7f16e125a3a0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-244537531", "description": "tempest-description-1068468294"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:15.222051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:15.223984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:15.600662 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b728646-1dea-4f5b-b935-40758209939c tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.397768 Oct 31 15:43:15.621249 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2529/5218] 10.222.0.20 () {60 vars in 1180 bytes} [Mon Oct 31 15:43:15 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:15.622665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-244537531"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:15.623456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:15.636865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:15.640831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:15.641949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:15.642838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:15.644384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:15.647110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:15.647819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:15.670857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:15.671469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:15.683635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:15.684143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:15.684582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:15.685332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:15.685799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:15.686227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:15.812117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:15.830827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:15.832523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:15.835899 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d2e4e73d-f469-4736-884e-8d811c134733 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.169063 Oct 31 15:43:15.836496 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2530/5219] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:15 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:15.983080 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Adding security group bff7275d-6b64-432e-bc08-c623fb18a148 to port 820dfaba-353d-44fb-9f0f-fb61cb48a99b Oct 31 15:43:16.093800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b31476b-cd04-45d6-8fd2-d916f7276573 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e18bce50>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:16.179579 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2b31476b-cd04-45d6-8fd2-d916f7276573 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.089386 Oct 31 15:43:16.181100 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2531/5220] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:16 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:16.532554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ef9ec8fe-732c-46b6-819f-bf58f2f2dba1 req-b11f30d1-33fe-4c8d-955a-deec7a3843f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "name": "network-vif-plugged", "status": "completed", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:16.586087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef9ec8fe-732c-46b6-819f-bf58f2f2dba1 req-b11f30d1-33fe-4c8d-955a-deec7a3843f2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:16.586998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef9ec8fe-732c-46b6-819f-bf58f2f2dba1 req-b11f30d1-33fe-4c8d-955a-deec7a3843f2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:16.589798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ef9ec8fe-732c-46b6-819f-bf58f2f2dba1 req-b11f30d1-33fe-4c8d-955a-deec7a3843f2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:16.619780 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ef9ec8fe-732c-46b6-819f-bf58f2f2dba1 req-b11f30d1-33fe-4c8d-955a-deec7a3843f2 service nova] Creating event network-vif-plugged:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h2-858384-17 Oct 31 15:43:16.635418 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ef9ec8fe-732c-46b6-819f-bf58f2f2dba1 req-b11f30d1-33fe-4c8d-955a-deec7a3843f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107407 Oct 31 15:43:16.636732 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2532/5221] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:16.865092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:16.869274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:16.886697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:16.888093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:16.888856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:16.889894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:16.891206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:16.891873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:16.947261 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db3a5a29-2336-4937-86e3-64d1a48317e3 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action" status: 202 len: 0 microversion: 2.1 time: 1.332969 Oct 31 15:43:16.954058 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2690/5222] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:43:15 2022] POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action => generated 0 bytes in 1341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:43:16.961409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-244537531"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:16.967021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:16.988661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:16.990636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:16.993717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:16.994842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:16.996553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:16.998074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:17.139947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:17.157972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:17.160157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:17.162346 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8376d7f1-386f-44d2-bcd9-4ab6c4470dd2 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.301795 Oct 31 15:43:17.164409 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2533/5223] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:16 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:17.171016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6c14140e-423d-4732-8bbb-7bdd5e76269c req-0ce2aabd-5b86-42ee-a7f2-9024e27233c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cdfb03-c3ad-4ace-a9c7-f55fbea50e99", "tag": "820dfaba-353d-44fb-9f0f-fb61cb48a99b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:17.195417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6c14140e-423d-4732-8bbb-7bdd5e76269c req-0ce2aabd-5b86-42ee-a7f2-9024e27233c5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:17.198277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6c14140e-423d-4732-8bbb-7bdd5e76269c req-0ce2aabd-5b86-42ee-a7f2-9024e27233c5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:17.199493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6c14140e-423d-4732-8bbb-7bdd5e76269c req-0ce2aabd-5b86-42ee-a7f2-9024e27233c5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:17.229117 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6c14140e-423d-4732-8bbb-7bdd5e76269c req-0ce2aabd-5b86-42ee-a7f2-9024e27233c5 service nova] Creating event network-changed:820dfaba-353d-44fb-9f0f-fb61cb48a99b for instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 on n-h1-858384-17 Oct 31 15:43:17.236399 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6c14140e-423d-4732-8bbb-7bdd5e76269c req-0ce2aabd-5b86-42ee-a7f2-9024e27233c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068921 Oct 31 15:43:17.237804 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2534/5224] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:17.246331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11487cba-0387-43a1-bd56-0403214e92f2 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e10078b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:17.325369 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11487cba-0387-43a1-bd56-0403214e92f2 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.086060 Oct 31 15:43:17.326212 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2535/5225] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:17 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:18.045265 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Removing security group bff7275d-6b64-432e-bc08-c623fb18a148 from port 820dfaba-353d-44fb-9f0f-fb61cb48a99b Oct 31 15:43:18.197629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:18.199331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:18.219787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:18.224728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:18.225642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:18.230701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:18.231464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:18.232131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:18.804136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:18.818171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:18.829745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:18.831227 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-927b00fe-1d8c-40c1-b188-4f9bf2e84749 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.640878 Oct 31 15:43:18.834289 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2536/5226] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:18 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:18.841928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e11bb11-6fab-4b16-a47d-8a9cfe243568 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e18bc0d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:18.967490 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e11bb11-6fab-4b16-a47d-8a9cfe243568 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.129277 Oct 31 15:43:18.968964 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2537/5227] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:18 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:19.482517 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3128eb7-e048-4e9f-9e10-c8e6ffa13d2d tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action" status: 202 len: 0 microversion: 2.1 time: 2.526141 Oct 31 15:43:19.483119 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2691/5228] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:43:16 2022] POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action => generated 0 bytes in 2527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:43:19.496784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-323da2ea-f197-4609-876e-55675fddb780 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Action: 'create', calling method: .version_select at 0x7f16e125a940>, body: {"pool": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:19.513413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-abc3b1f6-49e9-4573-ada0-8baac59ea6a5 req-24a19e2c-aab0-4ebf-a686-9184d1145303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cdfb03-c3ad-4ace-a9c7-f55fbea50e99", "tag": "820dfaba-353d-44fb-9f0f-fb61cb48a99b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:19.541539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-abc3b1f6-49e9-4573-ada0-8baac59ea6a5 req-24a19e2c-aab0-4ebf-a686-9184d1145303 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:19.544972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-abc3b1f6-49e9-4573-ada0-8baac59ea6a5 req-24a19e2c-aab0-4ebf-a686-9184d1145303 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:19.548359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-abc3b1f6-49e9-4573-ada0-8baac59ea6a5 req-24a19e2c-aab0-4ebf-a686-9184d1145303 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:19.605488 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-abc3b1f6-49e9-4573-ada0-8baac59ea6a5 req-24a19e2c-aab0-4ebf-a686-9184d1145303 service nova] Creating event network-changed:820dfaba-353d-44fb-9f0f-fb61cb48a99b for instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 on n-h1-858384-17 Oct 31 15:43:19.622155 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-abc3b1f6-49e9-4573-ada0-8baac59ea6a5 req-24a19e2c-aab0-4ebf-a686-9184d1145303 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113262 Oct 31 15:43:19.623370 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2692/5229] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:19.865853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:19.866730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:19.893940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:19.897721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:19.898609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:19.900605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:19.906381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:19.907126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:20.168441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:20.180671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:20.184761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:20.186940 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ec26aa2-c986-41b6-a821-5a597bfe0cdb tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.327210 Oct 31 15:43:20.202030 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2693/5230] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:19 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:20.215418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b319213-d44e-4a09-9314-0d5cea2cbb32 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0e30310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:20.300148 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b319213-d44e-4a09-9314-0d5cea2cbb32 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.095836 Oct 31 15:43:20.307089 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2694/5231] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:20 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:20.317180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d28a162c-6487-4b31-8390-3b9320a5b382 req-d4273e43-6c35-464f-9174-b92d2dd33fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88584df4-529c-48f1-a3b8-ee4b77a54bf7", "name": "network-vif-plugged", "status": "completed", "tag": "3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:20.341095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d28a162c-6487-4b31-8390-3b9320a5b382 req-d4273e43-6c35-464f-9174-b92d2dd33fef service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:20.346524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d28a162c-6487-4b31-8390-3b9320a5b382 req-d4273e43-6c35-464f-9174-b92d2dd33fef service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:20.347043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d28a162c-6487-4b31-8390-3b9320a5b382 req-d4273e43-6c35-464f-9174-b92d2dd33fef service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:20.366603 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d28a162c-6487-4b31-8390-3b9320a5b382 req-d4273e43-6c35-464f-9174-b92d2dd33fef service nova] Creating event network-vif-plugged:3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9 for instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 on n-h2-858384-17 Oct 31 15:43:20.382636 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d28a162c-6487-4b31-8390-3b9320a5b382 req-d4273e43-6c35-464f-9174-b92d2dd33fef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073172 Oct 31 15:43:20.385111 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2695/5232] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:21.221368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:21.223568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:21.250450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:21.252129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:21.255895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:21.259048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:21.263086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:21.263652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:21.459606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:21.473534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:21.489042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:21.494822 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6b21e75c-c157-4ef6-9251-4a4d3fff44c7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.277314 Oct 31 15:43:21.509645 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2696/5233] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:21 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:21.522960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd265cdf-0fb9-4aba-a6c8-575d1e7c9a35 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0d858b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:21.576031 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd265cdf-0fb9-4aba-a6c8-575d1e7c9a35 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.064294 Oct 31 15:43:21.587679 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2697/5234] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:21 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:22.496654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Calling method '.version_select at 0x7f16e06fbaf0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:22.499574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:22.500226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:22.500831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:22.538623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:22.540050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:22.540641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:22.565043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:22.565740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:22.570287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:22.596518 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09ee5e13-eee0-495b-be77-4cf00dcd70db tempest-PortsAdminExtendedAttrsTestJSON-1086646172 tempest-PortsAdminExtendedAttrsTestJSON-1086646172-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.390313 Oct 31 15:43:22.618426 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2698/5235] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:43:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:43:22.628753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:22.631799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:22.645861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:22.650535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:22.651197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:22.654596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:22.655282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:22.655896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:22.826717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:22.844663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:22.859405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:22.876216 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53454eb1-6675-4833-bae9-380fcbccea7a tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.256220 Oct 31 15:43:22.881739 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2699/5236] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:22 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:22.908784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a92210b3-2b30-4620-80b6-b8431340d038 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e06fb310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:23.018481 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a92210b3-2b30-4620-80b6-b8431340d038 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.133307 Oct 31 15:43:23.027672 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2700/5237] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:22 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:23.912787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:23.913587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:23.928257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:23.933952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:23.936787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:23.938006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:23.941105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:23.946333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:24.156971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:24.180918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:24.188554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:24.195294 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd5f8480-5cd6-416d-991a-bb7abe62eee7 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.286233 Oct 31 15:43:24.200005 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2701/5238] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:23 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:24.215359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-43b65d09-19c4-40aa-a786-4cbf76392352 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e06fb310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:24.322010 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-43b65d09-19c4-40aa-a786-4cbf76392352 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.119709 Oct 31 15:43:24.324188 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2702/5239] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:24 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:24.872606 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-323da2ea-f197-4609-876e-55675fddb780 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.382268 Oct 31 15:43:24.873731 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2538/5240] 10.222.0.20 () {60 vars in 1170 bytes} [Mon Oct 31 15:43:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:24.888328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.130"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:24.891076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:24.897598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:24.898313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:24.899054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:24.899769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:24.900385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:24.900983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:24.939943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "refresh_cache-26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:43:24.941182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquired lock "refresh_cache-26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:43:25.230342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:25.231612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:25.238675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.239171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.239634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.240347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:25.240799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:25.241266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:25.341693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:25.350263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:25.355017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:25.356517 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ee2b685-1d6e-442e-bd40-ebaf2d599436 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.134104 Oct 31 15:43:25.357935 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2539/5241] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:25 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:25.362979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cce81386-5dcd-4a3b-8525-a59cb64fb5c1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0f3a0d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:25.419795 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cce81386-5dcd-4a3b-8525-a59cb64fb5c1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.060611 Oct 31 15:43:25.421102 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2540/5242] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:25 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:26.383858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:26.384581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:26.396327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:26.397695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:26.398364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:26.399362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:26.400303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:26.401115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:26.445363 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:43:26.446255 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 15:43:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 (ip 10.222.0.20) !!! Oct 31 15:43:26.531383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:26.546314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:26.547914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:26.551880 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-119e93c6-d150-44f5-b1c2-5708a039700c tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.173368 Oct 31 15:43:26.553779 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2541/5243] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:26 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:26.569715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-421c6ffb-ccd2-4f48-bf2a-ae46b7026c36 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1007ee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:26.698325 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-421c6ffb-ccd2-4f48-bf2a-ae46b7026c36 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.143332 Oct 31 15:43:26.708185 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2542/5244] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:26 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:27.585012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:27.585694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:27.603393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:27.603838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:27.604314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:27.605041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:27.605532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:27.609855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:27.710785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:27.724045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:27.729380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:27.734724 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d84448de-673a-48af-8c86-3d92fce88fe9 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.154601 Oct 31 15:43:27.735563 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2543/5245] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:27 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:27.757298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11c91b30-bf34-4ad9-bdd5-4b3cb22077db tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1007820>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:27.846926 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11c91b30-bf34-4ad9-bdd5-4b3cb22077db tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.109457 Oct 31 15:43:27.847629 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2544/5246] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:27 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:28.408812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Building network info cache for instance {{(pid=120587) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:43:28.443703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f7bdad52-247d-4102-b39a-9b8eb98192a0 req-80dd4ab2-fbbc-4277-a6dc-f23cb1d1dbc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cdfb03-c3ad-4ace-a9c7-f55fbea50e99", "tag": "820dfaba-353d-44fb-9f0f-fb61cb48a99b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:28.481875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f7bdad52-247d-4102-b39a-9b8eb98192a0 req-80dd4ab2-fbbc-4277-a6dc-f23cb1d1dbc3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:28.482538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f7bdad52-247d-4102-b39a-9b8eb98192a0 req-80dd4ab2-fbbc-4277-a6dc-f23cb1d1dbc3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:28.483088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f7bdad52-247d-4102-b39a-9b8eb98192a0 req-80dd4ab2-fbbc-4277-a6dc-f23cb1d1dbc3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:28.502480 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f7bdad52-247d-4102-b39a-9b8eb98192a0 req-80dd4ab2-fbbc-4277-a6dc-f23cb1d1dbc3 service nova] Creating event network-changed:820dfaba-353d-44fb-9f0f-fb61cb48a99b for instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 on n-h1-858384-17 Oct 31 15:43:28.520445 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f7bdad52-247d-4102-b39a-9b8eb98192a0 req-80dd4ab2-fbbc-4277-a6dc-f23cb1d1dbc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080573 Oct 31 15:43:28.522089 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2545/5247] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:28.765037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:28.766617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:28.776269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:28.777151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:28.778365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:28.779674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:28.780352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:28.781078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:28.883846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:28.896158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:28.906465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:28.910008 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c31b8c23-573a-4402-91fa-eee49254c3cc tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.147728 Oct 31 15:43:28.910847 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2546/5248] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:28 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:28.925360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e533be02-97b6-4e1f-a6a9-69f5c53c157a tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0fb0af0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:29.026822 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e533be02-97b6-4e1f-a6a9-69f5c53c157a tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.114103 Oct 31 15:43:29.038678 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2547/5249] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:28 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:29.948474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:29.949119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:29.972854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:29.973387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:29.973840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:29.974567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:29.975036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:29.975472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:30.146686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Updating instance_info_cache with network_info: [{"id": "820dfaba-353d-44fb-9f0f-fb61cb48a99b", "address": "fa:16:3e:59:ba:fe", "network": {"id": "be544361-6e3a-4480-8f73-19c2ee3c737a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1938217046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ff16d6e379b84aa7b8ff5ae0cf0ef43b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap820dfaba-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120587) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:43:30.160250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:30.169019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Releasing lock "refresh_cache-26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" {{(pid=120587) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:43:30.170886 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c5407f9-92ee-4ead-a37f-fc018cfe9a85 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action" status: 202 len: 0 microversion: 2.1 time: 5.288673 Oct 31 15:43:30.172072 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2703/5250] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:43:24 2022] POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action => generated 0 bytes in 5291 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:43:30.179308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfa3571a-68ab-4530-a0aa-ac8dae6e2750 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1777700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:30.185737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:30.187429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:30.188656 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-197c4e84-307b-4bba-a39c-ce744c0d33f3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.246787 Oct 31 15:43:30.195430 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2548/5251] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:29 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:30.218124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.130"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:30.269718 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfa3571a-68ab-4530-a0aa-ac8dae6e2750 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.096178 Oct 31 15:43:30.270363 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2704/5252] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:30 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:31.026593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:31.033546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:31.034233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:31.034763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:31.035459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:31.038877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:31.039553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:31.230139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:31.230844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:31.243790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:31.245557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:31.246371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:31.248561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:31.249812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:31.250572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:31.364414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:31.367524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:31.375445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:31.376918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:31.378126 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02f6d8f6-39c3-413d-b97c-8184bd08f29b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.158552 Oct 31 15:43:31.378709 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2705/5253] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:31 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:31.406659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab72faa1-7864-4460-b99f-bb77c7465990 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e55a1af0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:31.486618 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab72faa1-7864-4460-b99f-bb77c7465990 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.090469 Oct 31 15:43:31.490700 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2706/5254] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:31 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:31.818276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "refresh_cache-26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 31 15:43:31.819492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquired lock "refresh_cache-26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 31 15:43:32.418832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:32.420392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:32.445827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:32.446428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:32.448885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:32.449845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:32.450326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:32.450765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:32.552295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:32.564431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:32.566090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:32.567703 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f420cf4e-20d5-4adf-b2e9-14adee7aae6e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.161088 Oct 31 15:43:32.568822 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2707/5255] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:32 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:32.575836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdf4748e-8875-4560-97f7-7ad23afef8f7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e55a1430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:32.678250 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdf4748e-8875-4560-97f7-7ad23afef8f7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.107046 Oct 31 15:43:32.679219 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2708/5256] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:32 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:33.602898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:33.603547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:33.620442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:33.620942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:33.621479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:33.622203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:33.622666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:33.623088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:33.895074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:33.912998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:33.915468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:33.931100 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5b09cb3-7ac7-476e-ae22-9e812585c3a6 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.327122 Oct 31 15:43:33.932047 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2709/5257] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:33 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:33.942253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-13d2dd67-a5a4-4b26-b0a0-e88b90eb51e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0d158b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:34.043507 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-13d2dd67-a5a4-4b26-b0a0-e88b90eb51e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.107546 Oct 31 15:43:34.049007 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2710/5258] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:33 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:34.790581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Building network info cache for instance {{(pid=120588) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 31 15:43:34.848689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-785accfa-5264-46e9-8cd0-9c2e8a04e298 req-7c95d76c-1a4f-4020-b5a0-ed133f6f6229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cdfb03-c3ad-4ace-a9c7-f55fbea50e99", "tag": "820dfaba-353d-44fb-9f0f-fb61cb48a99b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:34.876061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-785accfa-5264-46e9-8cd0-9c2e8a04e298 req-7c95d76c-1a4f-4020-b5a0-ed133f6f6229 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:34.876570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-785accfa-5264-46e9-8cd0-9c2e8a04e298 req-7c95d76c-1a4f-4020-b5a0-ed133f6f6229 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:34.880330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-785accfa-5264-46e9-8cd0-9c2e8a04e298 req-7c95d76c-1a4f-4020-b5a0-ed133f6f6229 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:34.919331 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-785accfa-5264-46e9-8cd0-9c2e8a04e298 req-7c95d76c-1a4f-4020-b5a0-ed133f6f6229 service nova] Creating event network-changed:820dfaba-353d-44fb-9f0f-fb61cb48a99b for instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 on n-h1-858384-17 Oct 31 15:43:34.928011 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-785accfa-5264-46e9-8cd0-9c2e8a04e298 req-7c95d76c-1a4f-4020-b5a0-ed133f6f6229 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083102 Oct 31 15:43:34.929034 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2711/5259] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:43:34.978167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:34.979231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:35.003020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:35.003662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:35.004173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:35.005200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:35.005905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:35.006410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:35.204300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:35.213570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:35.215015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:35.216206 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8be18d6c-9aa2-4286-a4df-b47b4f791aa3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.257812 Oct 31 15:43:35.216789 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2712/5260] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:34 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:35.243626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b37339c9-ad93-426e-b782-cf4d088aa125 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e14cbb80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:35.303030 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b37339c9-ad93-426e-b782-cf4d088aa125 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.074694 Oct 31 15:43:35.305648 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2713/5261] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:35 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:36.245903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:36.246535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:36.262420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=54 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:36.277728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:36.278233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:36.278672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:36.279481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:36.280025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:36.280451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:36.552418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:36.572003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:36.573560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:36.574740 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8bbeb91a-8875-4cc4-8dc8-459ef864156b tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.332872 Oct 31 15:43:36.593585 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2714/5262] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:36 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:36.599062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-08c8ab0e-970d-4798-ae25-6d324d6f9b13 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e14cb940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:36.627705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Updating instance_info_cache with network_info: [{"id": "820dfaba-353d-44fb-9f0f-fb61cb48a99b", "address": "fa:16:3e:59:ba:fe", "network": {"id": "be544361-6e3a-4480-8f73-19c2ee3c737a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1938217046-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ff16d6e379b84aa7b8ff5ae0cf0ef43b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap820dfaba-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120588) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 31 15:43:36.651132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Releasing lock "refresh_cache-26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" {{(pid=120588) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 31 15:43:36.652524 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5cc9384-4f17-452d-8a9a-aee63e693f87 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action" status: 202 len: 0 microversion: 2.1 time: 6.455639 Oct 31 15:43:36.653426 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2549/5263] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:43:30 2022] POST /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99/action => generated 0 bytes in 6457 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 31 15:43:36.661877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed252314-2d04-47c6-aeca-1bf15a048b95 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '.version_select at 0x7f16e168a160>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:36.685405 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-08c8ab0e-970d-4798-ae25-6d324d6f9b13 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1455 microversion: 2.1 time: 0.090288 Oct 31 15:43:36.695553 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2715/5264] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:36 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:37.603421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:37.606771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:37.625710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:37.626235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:37.628960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:37.629805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:37.634960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:37.635625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:38.047377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:38.060666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:38.062356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:38.063908 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fb6360c9-7a52-4e68-8b33-a793517ca5b5 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.466001 Oct 31 15:43:38.080325 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2716/5265] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:37 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:38.089662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c677bf9-37b4-4dee-a255-e36f15fa45bf tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e14cb160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:38.153740 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c677bf9-37b4-4dee-a255-e36f15fa45bf tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1464 microversion: 2.1 time: 0.072136 Oct 31 15:43:38.154980 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2717/5266] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:38 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1464 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:38.173337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1fc0d67-ca66-4aff-bd04-613670813b70 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0cd4f70>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:38.233662 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1fc0d67-ca66-4aff-bd04-613670813b70 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 200 len: 1464 microversion: 2.1 time: 0.067168 Oct 31 15:43:38.234520 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2718/5267] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:38 2022] GET /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 1464 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:38.251069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:38.252158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:38.261747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:38.262412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:38.262969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:38.264238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:38.264700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:38.265151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:38.579995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:38.592886 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-865a99b5-01a9-458f-bf5d-3c471c97696f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1468 microversion: 2.1 time: 0.347786 Oct 31 15:43:38.593537 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2719/5268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:38 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1468 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:38.602234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a3207fd-f8f1-493c-bd47-8d3d59ac14c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:38.604711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8a3207fd-f8f1-493c-bd47-8d3d59ac14c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:38.612706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a3207fd-f8f1-493c-bd47-8d3d59ac14c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:38.613472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a3207fd-f8f1-493c-bd47-8d3d59ac14c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:38.614081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a3207fd-f8f1-493c-bd47-8d3d59ac14c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:38.618117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a3207fd-f8f1-493c-bd47-8d3d59ac14c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:38.618768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a3207fd-f8f1-493c-bd47-8d3d59ac14c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:38.619356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a3207fd-f8f1-493c-bd47-8d3d59ac14c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:38.706679 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a3207fd-f8f1-493c-bd47-8d3d59ac14c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action" status: 200 len: 63160 microversion: 2.1 time: 0.108125 Oct 31 15:43:38.708154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2720/5269] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:43:38 2022] POST /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b/action => generated 63160 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:43:38.714167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc1b89ab-0d50-4275-8ac0-23ed16fec538 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2013582581"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:38.716618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc1b89ab-0d50-4275-8ac0-23ed16fec538 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:38.729290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc1b89ab-0d50-4275-8ac0-23ed16fec538 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:38.730019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc1b89ab-0d50-4275-8ac0-23ed16fec538 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:38.730648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc1b89ab-0d50-4275-8ac0-23ed16fec538 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:38.731547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc1b89ab-0d50-4275-8ac0-23ed16fec538 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:38.732168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc1b89ab-0d50-4275-8ac0-23ed16fec538 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:38.732847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc1b89ab-0d50-4275-8ac0-23ed16fec538 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:39.046658 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc1b89ab-0d50-4275-8ac0-23ed16fec538 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "POST /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970/action" status: 202 len: 0 microversion: 2.1 time: 0.337031 Oct 31 15:43:39.047698 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2721/5270] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:43:38 2022] POST /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 15:43:39.067532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dbd3edc2-50ff-40b4-a928-fc1eaa156d00 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1513790>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:39.132623 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dbd3edc2-50ff-40b4-a928-fc1eaa156d00 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.074832 Oct 31 15:43:39.137847 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2722/5271] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:39 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:39.151375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:39.152018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:39.160299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:39.160791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:39.161255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:39.161980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:39.162724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:39.163479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:39.246739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:39.260579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:39.262094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:39.263330 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee57cfb1-0246-4fc1-af12-9fdd0aad42da tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.124212 Oct 31 15:43:39.267000 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2723/5272] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:39 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:39.604753 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed252314-2d04-47c6-aeca-1bf15a048b95 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/bc659ced-349d-4dff-bbbd-96447a66bbe5" status: 202 len: 0 microversion: 2.1 time: 2.946870 Oct 31 15:43:39.606741 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2550/5273] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:43:36 2022] DELETE /compute/v2.1/os-floating-ips/bc659ced-349d-4dff-bbbd-96447a66bbe5 => generated 0 bytes in 2950 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:43:39.618458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e18999dc-2694-4ddb-a9c3-46ff705d82ee tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '.version_select at 0x7f16e0e30e50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:40.036197 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e18999dc-2694-4ddb-a9c3-46ff705d82ee tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/bff7275d-6b64-432e-bc08-c623fb18a148" status: 202 len: 0 microversion: 2.1 time: 0.422062 Oct 31 15:43:40.037397 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2724/5274] 10.222.0.20 () {58 vars in 1272 bytes} [Mon Oct 31 15:43:39 2022] DELETE /compute/v2.1/os-security-groups/bff7275d-6b64-432e-bc08-c623fb18a148 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:43:40.047543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:40.048383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:40.055204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:40.056990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:40.057786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:40.058291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:40.059082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:40.059759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:40.060286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:40.093346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:43:40.151204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7dcc3c94-e886-4704-a2e8-92ea9f3ad72f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0e5a700>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:40.206415 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7dcc3c94-e886-4704-a2e8-92ea9f3ad72f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.061347 Oct 31 15:43:40.207921 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2725/5275] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:40 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:40.241204 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ae1c12a-648a-4b2a-81a0-ec508cb2b999 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "DELETE /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 204 len: 0 microversion: 2.1 time: 0.199225 Oct 31 15:43:40.242760 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2551/5276] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:43:40 2022] DELETE /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:43:40.251821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:40.252623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:40.261064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:40.261844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:40.262505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:40.263442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:40.264463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:40.265184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:40.297320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:40.298343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:40.308937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:40.309804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:40.310418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:40.311348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:40.311992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:40.312963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:40.392656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:40.408507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:40.410329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:40.411528 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-696172b6-e696-49aa-b53c-3fb965b68739 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.121513 Oct 31 15:43:40.412625 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2552/5277] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:40 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:40.573291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:40.582607 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee9049e1-33d5-4081-bf77-f14c9ab7145e tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1510 microversion: 2.1 time: 0.335879 Oct 31 15:43:40.583429 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2726/5278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:40 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1510 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:41.228425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cf066f1-5753-42b6-ab69-86c7831fde76 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0fdd940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:41.309719 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7cf066f1-5753-42b6-ab69-86c7831fde76 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.089551 Oct 31 15:43:41.310819 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2553/5279] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:41 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:41.449017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:41.453751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:41.471347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:41.472553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:41.478176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:41.479074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:41.480203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:41.480646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:41.530236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ba67303d-c608-41ae-8f7a-397fe4faac88 req-969b11b9-7cd9-40a6-8690-d94af976c87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88584df4-529c-48f1-a3b8-ee4b77a54bf7", "name": "network-vif-unplugged", "status": "completed", "tag": "3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:41.553979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ba67303d-c608-41ae-8f7a-397fe4faac88 req-969b11b9-7cd9-40a6-8690-d94af976c87d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:41.555199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ba67303d-c608-41ae-8f7a-397fe4faac88 req-969b11b9-7cd9-40a6-8690-d94af976c87d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:41.556762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ba67303d-c608-41ae-8f7a-397fe4faac88 req-969b11b9-7cd9-40a6-8690-d94af976c87d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:41.582592 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ba67303d-c608-41ae-8f7a-397fe4faac88 req-969b11b9-7cd9-40a6-8690-d94af976c87d service nova] Creating event network-vif-unplugged:3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9 for instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 on n-h2-858384-17 Oct 31 15:43:41.591455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ba67303d-c608-41ae-8f7a-397fe4faac88 req-969b11b9-7cd9-40a6-8690-d94af976c87d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063897 Oct 31 15:43:41.592792 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2554/5280] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:43:41.614505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:41.615489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:41.626489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:41.627673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:41.628180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:41.629011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:41.631263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:41.631872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:41.670353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:41.758110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:41.776245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:41.778783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:41.780251 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd1a6dc0-5d83-4402-a796-8fe790e8b075 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.338644 Oct 31 15:43:41.781546 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2727/5281] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:41 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:42.030823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:42.069612 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-41151e30-391c-4cdb-98ec-af76fb2a4650 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1510 microversion: 2.1 time: 0.457042 Oct 31 15:43:42.079348 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2555/5282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:41 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1510 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:42.328546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8fb48ff4-ced9-44eb-a461-ec3f75e7bb62 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0d319d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:42.418217 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8fb48ff4-ced9-44eb-a461-ec3f75e7bb62 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.093853 Oct 31 15:43:42.428806 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2728/5283] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:42 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:42.811457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:42.813624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:42.825603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:42.826600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:42.827304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:42.828137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:42.828953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:42.830072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:43.099368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:43.109439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:43.116724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:43.118491 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-731d0d4e-4960-4e74-99dd-83515115156e tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1365 microversion: 2.57 time: 0.315489 Oct 31 15:43:43.124811 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2556/5284] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:42 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:43.141662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:43.142501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:43.155843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:43.156553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:43.157217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:43.158125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:43.158766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:43.159422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:43.203832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:43.204703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:43.205357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:43.206017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lazy-loading 'fault' on Instance uuid 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:43:43.312582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5847c76945734989adcb3566493fec79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff16d6e379b84aa7b8ff5ae0cf0ef43b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:43.327942 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9390baa6-1086-4d2d-b1f7-0e7e0927feb7 tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 200 len: 1313 microversion: 2.1 time: 0.201666 Oct 31 15:43:43.330668 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2557/5285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:43 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:43.402988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ce7de598-ae7e-440a-8e5c-a135f857b047 req-88ebcd15-d856-4d79-971c-e381823af406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cdfb03-c3ad-4ace-a9c7-f55fbea50e99", "name": "network-vif-deleted", "tag": "820dfaba-353d-44fb-9f0f-fb61cb48a99b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:43.424099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ce7de598-ae7e-440a-8e5c-a135f857b047 req-88ebcd15-d856-4d79-971c-e381823af406 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:43.424681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ce7de598-ae7e-440a-8e5c-a135f857b047 req-88ebcd15-d856-4d79-971c-e381823af406 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:43.425199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ce7de598-ae7e-440a-8e5c-a135f857b047 req-88ebcd15-d856-4d79-971c-e381823af406 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:43.436958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d3a45bc-12cb-4d8d-a51d-f7f979ef7066 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0ff6d30>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:43.437154 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ce7de598-ae7e-440a-8e5c-a135f857b047 req-88ebcd15-d856-4d79-971c-e381823af406 service nova] Creating event network-vif-deleted:820dfaba-353d-44fb-9f0f-fb61cb48a99b for instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 on n-h1-858384-17 Oct 31 15:43:43.442499 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ce7de598-ae7e-440a-8e5c-a135f857b047 req-88ebcd15-d856-4d79-971c-e381823af406 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.453160 Oct 31 15:43:43.443408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2729/5286] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:43:43.499279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6d3a45bc-12cb-4d8d-a51d-f7f979ef7066 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.067952 Oct 31 15:43:43.501555 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2558/5287] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:43 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:43.644313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7e11357a-7492-4e65-862b-f945182070df req-fd6da212-4d42-4d38-b4cb-aa0382b2ca65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069cc821-7fc7-4365-91a6-d253240e6970", "name": "network-vif-plugged", "status": "completed", "tag": "3e6c790c-a9d6-4201-95e7-05ac114346d2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:43.664703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7e11357a-7492-4e65-862b-f945182070df req-fd6da212-4d42-4d38-b4cb-aa0382b2ca65 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:43.669932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7e11357a-7492-4e65-862b-f945182070df req-fd6da212-4d42-4d38-b4cb-aa0382b2ca65 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:43.670908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7e11357a-7492-4e65-862b-f945182070df req-fd6da212-4d42-4d38-b4cb-aa0382b2ca65 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:43.724744 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7e11357a-7492-4e65-862b-f945182070df req-fd6da212-4d42-4d38-b4cb-aa0382b2ca65 service nova] Creating event network-vif-plugged:3e6c790c-a9d6-4201-95e7-05ac114346d2 for instance 069cc821-7fc7-4365-91a6-d253240e6970 on n-h1-858384-17 Oct 31 15:43:43.736909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7e11357a-7492-4e65-862b-f945182070df req-fd6da212-4d42-4d38-b4cb-aa0382b2ca65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097234 Oct 31 15:43:43.740513 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2730/5288] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:44.156209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:44.156968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:44.166120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:44.166767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:44.167299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:44.168247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:44.168775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:44.169302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:44.248933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:44.258777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:44.261458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:44.262693 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87623fee-0f12-4dc3-9829-13345cb0ff95 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1371 microversion: 2.57 time: 0.111321 Oct 31 15:43:44.276551 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2559/5289] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:44 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:44.361908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:44.362644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] [instance: 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:44.374901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:44.377824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:44.378795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:44.381974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:44.386675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:44.388975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:44.414927 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] HTTP exception thrown: Instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 could not be found. Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Request method failure captured: Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 HTTP/1.1 Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-zXKPV19JBOPHoGcGmZwApzqL6K-MY8ZHn1Cc3024IlEKeAbDpJ4B9pVebM5RSxuSVZU1S9yK4cqGThDB6vErzkM_KMiFRy0YSuKWpGJOJfURhaooCha2Hr-Lf86GV7wSxhFwGMnbyYaTKS--I_8Ol90vwtWDlXaY5Wt2HNA9g4yJo Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: ff16d6e379b84aa7b8ff5ae0cf0ef43b Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-825115950 Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff16d6e379b84aa7b8ff5ae0cf0ef43b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ff16d6e379b84aa7b8ff5ae0cf0ef43b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ff16d6e379b84aa7b8ff5ae0cf0ef43b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ff16d6e379b84aa7b8ff5ae0cf0ef43b"}]}] Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-825115950 Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: ff16d6e379b84aa7b8ff5ae0cf0ef43b Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-825115950 Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerRescueTestJSONUnderV235-825115950-project Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 5847c76945734989adcb3566493fec79 Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-825115950-project Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 could not be found. Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '26cdfb03-c3ad-4ace-a9c7-f55fbea50e99'} Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 could not be found. Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 could not be found. Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:44.416775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 could not be found. Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] Returning 404 to user: Instance 26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:43:44.420213 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a44a419-b760-4d73-b5c6-464c7bcaf5bd tempest-ServerRescueTestJSONUnderV235-825115950 tempest-ServerRescueTestJSONUnderV235-825115950-project] 10.222.0.20 "GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99" status: 404 len: 111 microversion: 2.1 time: 0.063926 Oct 31 15:43:44.423240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2731/5290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:44 2022] GET /compute/v2.1/servers/26cdfb03-c3ad-4ace-a9c7-f55fbea50e99 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:43:44.515676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e177926-6a7d-4947-9c42-1f4104755d78 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e55b3940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:44.606818 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e177926-6a7d-4947-9c42-1f4104755d78 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.094813 Oct 31 15:43:44.612409 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2560/5291] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:44 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:45.296613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:45.297331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:45.313515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:45.315181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:45.316985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:45.318971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:45.320681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:45.324088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:45.363337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be42c9ed-da53-4b96-9b4b-6f6d194cc9db tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:45.364240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be42c9ed-da53-4b96-9b4b-6f6d194cc9db tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:45.386071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be42c9ed-da53-4b96-9b4b-6f6d194cc9db tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:45.386968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be42c9ed-da53-4b96-9b4b-6f6d194cc9db tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:45.438929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be42c9ed-da53-4b96-9b4b-6f6d194cc9db tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:45.441093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be42c9ed-da53-4b96-9b4b-6f6d194cc9db tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:45.444136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be42c9ed-da53-4b96-9b4b-6f6d194cc9db tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:45.446170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be42c9ed-da53-4b96-9b4b-6f6d194cc9db tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:45.610395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:45.620872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:45.624902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:45.635901 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d371f513-5164-478c-92ca-02e5a691fd79 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1371 microversion: 2.57 time: 0.345031 Oct 31 15:43:45.636820 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2561/5292] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:45 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1371 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:45.657017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bdf243ce-7204-47dc-a6e3-e9a4d177cf8b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e55b3160>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:45.758431 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bdf243ce-7204-47dc-a6e3-e9a4d177cf8b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.117510 Oct 31 15:43:45.761786 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2562/5293] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:45 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:45.787337 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be42c9ed-da53-4b96-9b4b-6f6d194cc9db tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1835 microversion: 2.1 time: 0.728310 Oct 31 15:43:45.802135 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2732/5294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:45 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1835 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:46.673909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:46.674632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:46.691606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:46.705219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:46.708387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:46.709452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:46.713265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:46.717210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:46.786626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89d9ae0f-3fba-46ce-b0d3-e9a947d55915 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e55895e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:46.880531 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89d9ae0f-3fba-46ce-b0d3-e9a947d55915 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.100859 Oct 31 15:43:46.881753 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2733/5295] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:46 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:46.919426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:46.935383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:46.937379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:46.939619 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4ce40b78-0d07-422b-95fc-5682ce80e520 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1356 microversion: 2.57 time: 0.271035 Oct 31 15:43:46.940553 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2563/5296] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:46 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1356 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:43:46.975592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:46.977084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:46.989835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:46.990701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:46.992234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:46.995540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:46.997692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:46.998354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:47.055107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:43:47.128340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:43:47.192794 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a004b210-72c9-471d-a418-af86f1c9fabd tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 204 len: 0 microversion: 2.57 time: 0.220567 Oct 31 15:43:47.200067 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2734/5297] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:43:46 2022] DELETE /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:43:47.206953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:47.207928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:47.218535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:47.222393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:47.223417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:47.229199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:47.230134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:47.230795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:47.411994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:47.424455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:47.426173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:47.427551 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1610fe2a-d20f-45fd-b60b-3864226557e3 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1362 microversion: 2.57 time: 0.226733 Oct 31 15:43:47.428579 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2564/5298] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:47 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:47.899224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-37810f70-20f1-4ebe-a883-9e2062dd6260 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0bf3040>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:47.994790 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-37810f70-20f1-4ebe-a883-9e2062dd6260 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.100734 Oct 31 15:43:48.003923 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2735/5299] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:47 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:48.454677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:48.456451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:48.476275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:48.476941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:48.477445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:48.478351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:48.478969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:48.479553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:48.683442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:48.697581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:48.701798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:48.707527 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-057b0dfa-523e-46d8-8cf9-9904747178db tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1362 microversion: 2.57 time: 0.256639 Oct 31 15:43:48.721964 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2565/5300] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:48 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:49.011926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a511a0fc-40b1-4e82-88fd-3c1503a66011 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0e80940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:49.088334 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a511a0fc-40b1-4e82-88fd-3c1503a66011 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.080791 Oct 31 15:43:49.089224 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2736/5301] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:49 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:49.305305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:49.306244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:49.317424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:49.321018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:49.326464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:49.336698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:49.337902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:49.338615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:49.342328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-27fbefdb-1516-4934-b7d1-0de1c76f7d66 req-d98669a4-a772-4949-84c2-00e43f03a6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:49.359281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-27fbefdb-1516-4934-b7d1-0de1c76f7d66 req-d98669a4-a772-4949-84c2-00e43f03a6f6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:49.361312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-27fbefdb-1516-4934-b7d1-0de1c76f7d66 req-d98669a4-a772-4949-84c2-00e43f03a6f6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:49.367900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-27fbefdb-1516-4934-b7d1-0de1c76f7d66 req-d98669a4-a772-4949-84c2-00e43f03a6f6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:49.385263 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-27fbefdb-1516-4934-b7d1-0de1c76f7d66 req-d98669a4-a772-4949-84c2-00e43f03a6f6 service nova] Creating event network-changed:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h2-858384-17 Oct 31 15:43:49.393617 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-27fbefdb-1516-4934-b7d1-0de1c76f7d66 req-d98669a4-a772-4949-84c2-00e43f03a6f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061844 Oct 31 15:43:49.395887 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2737/5302] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:43:49.407558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:43:49.651689 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b90b5e18-a308-4686-8766-369b55a855ec tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 204 len: 0 microversion: 2.1 time: 0.349326 Oct 31 15:43:49.652577 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2566/5303] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:43:49 2022] DELETE /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:43:49.663783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:49.664520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:49.671886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:49.672371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:49.673012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:49.673920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:49.674572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:49.675165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:49.740603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:49.743895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:49.762949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:49.763486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:49.765588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:49.767909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:49.770019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:49.770798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:49.839356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:49.840152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:49.840905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:49.841744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lazy-loading 'fault' on Instance uuid 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:43:49.938610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:49.951949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:49.956232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:49.961071 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed70c670-dac7-48e3-ad3a-f1da0a480896 tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1367 microversion: 2.57 time: 0.225587 Oct 31 15:43:49.962526 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2567/5304] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:49 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:50.104769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b6510b9-4e09-479b-aae4-dc4b7cc5d300 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e56228b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:50.123867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:50.142405 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69ea862c-c367-4974-a810-1f246092fdd3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1688 microversion: 2.1 time: 0.482728 Oct 31 15:43:50.154346 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2738/5305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:49 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1688 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:50.187916 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b6510b9-4e09-479b-aae4-dc4b7cc5d300 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.078804 Oct 31 15:43:50.187916 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2568/5306] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:50 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:50.989099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:50.989707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:51.001541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:51.002123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:51.009566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:51.010489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:51.011044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:51.011563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:51.102870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:51.105170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:51.106686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:51.107654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lazy-loading 'fault' on Instance uuid 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:43:51.171749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:51.172363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:51.190755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:51.191508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:51.192123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:51.192949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:51.193728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:51.199529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:51.338088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:51.360034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:51.361783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8fad8d5f7b544f0a83ebc3b597ee48f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfb6cfb93cb84fe28e0b7a0c1fd1ebe8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:51.363513 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1b8a5dd-c5fc-42aa-83e8-8a6a68d2af5f tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 200 len: 1367 microversion: 2.57 time: 0.379315 Oct 31 15:43:51.364788 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2739/5307] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:50 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:43:51.380641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1dd1a92-038d-4d7f-92fb-53edfbdec3e6 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0b71d30>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:51.473061 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1dd1a92-038d-4d7f-92fb-53edfbdec3e6 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.106154 Oct 31 15:43:51.474061 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2740/5308] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:51 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:51.640652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:51.655219 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f1c37342-c408-401c-9f7a-ffa52d7bd6ff tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1688 microversion: 2.1 time: 0.483396 Oct 31 15:43:51.658596 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2569/5309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:51 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1688 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:52.390600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:52.391281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] [instance: 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:52.407333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:52.409842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:52.410624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:52.414823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:52.416631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:52.418056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:52.461000 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] HTTP exception thrown: Instance 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 could not be found. Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Request method failure captured: Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 HTTP/1.1 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-0Hw6ILy7e_5XTN2KLsC6DGvTbF-Uj8U52WuMAtlBvHq3-fpe2ck8_iCYT4JN9llZj2i7vTZWYGYjn9VCQUVusqhzlE_nqJ34werwgoR-BOhXzPS1oBdcIXDEn0i3L0l0RIR1mjVVvn5m03n3yy_Eczpcf4JWVFUGuTklL5srDV-5A Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.57 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: cfb6cfb93cb84fe28e0b7a0c1fd1ebe8 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerShowV257Test-1040618735 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cfb6cfb93cb84fe28e0b7a0c1fd1ebe8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_cfb6cfb93cb84fe28e0b7a0c1fd1ebe8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/cfb6cfb93cb84fe28e0b7a0c1fd1ebe8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/cfb6cfb93cb84fe28e0b7a0c1fd1ebe8"}]}] Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerShowV257Test-1040618735 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: cfb6cfb93cb84fe28e0b7a0c1fd1ebe8 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerShowV257Test-1040618735 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerShowV257Test-1040618735-project Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 8fad8d5f7b544f0a83ebc3b597ee48f2 Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerShowV257Test-1040618735-project Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 could not be found. Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '9edf7b0d-cc39-4b39-a1e6-f03efd6796a1'} Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 could not be found. Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 could not be found. Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:52.466016 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:52.469674 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:52.469674 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:52.469674 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:52.469674 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:43:52.469674 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:43:52.469674 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 could not be found. Oct 31 15:43:52.469674 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:43:52.473013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] Returning 404 to user: Instance 9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:43:52.474363 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-052bc1a0-418e-434a-aaed-3866c8771c5d tempest-ServerShowV257Test-1040618735 tempest-ServerShowV257Test-1040618735-project] 10.222.0.20 "GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1" status: 404 len: 111 microversion: 2.57 time: 0.088528 Oct 31 15:43:52.480287 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2741/5310] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:43:52 2022] GET /compute/v2.1/servers/9edf7b0d-cc39-4b39-a1e6-f03efd6796a1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:43:52.489756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f080f0d5-a91d-4b39-8f92-0a35088a2edc tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0fc2ee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:52.558731 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f080f0d5-a91d-4b39-8f92-0a35088a2edc tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.074409 Oct 31 15:43:52.560098 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2570/5311] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:52 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:43:52.691271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:52.692314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:52.713534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:52.714181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:52.714699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:52.715500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:52.716035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:52.716531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:53.413510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:53.443191 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad962e59-b735-4a09-a606-4b5a9a4f6fa6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1569 microversion: 2.1 time: 0.761847 Oct 31 15:43:53.456387 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2742/5312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:52 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1569 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:53.581827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1cb8096f-ce71-4789-ba3f-072d4f579d46 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0300ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:53.690908 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1cb8096f-ce71-4789-ba3f-072d4f579d46 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.112576 Oct 31 15:43:53.711084 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2571/5313] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:53 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:53.768684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e1ce0308-b891-41e6-8e40-af6a6a6fd943 req-f37f7d19-a0f3-4a46-bb98-89c76fb90289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e640dc-7c7e-4a28-821e-41da7a74323b", "name": "network-vif-deleted", "tag": "ed4d6c65-1c13-454b-810e-cc7aa5b3d32b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:43:53.829780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e1ce0308-b891-41e6-8e40-af6a6a6fd943 req-f37f7d19-a0f3-4a46-bb98-89c76fb90289 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:53.832159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e1ce0308-b891-41e6-8e40-af6a6a6fd943 req-f37f7d19-a0f3-4a46-bb98-89c76fb90289 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:53.838179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e1ce0308-b891-41e6-8e40-af6a6a6fd943 req-f37f7d19-a0f3-4a46-bb98-89c76fb90289 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:53.865795 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e1ce0308-b891-41e6-8e40-af6a6a6fd943 req-f37f7d19-a0f3-4a46-bb98-89c76fb90289 service nova] Creating event network-vif-deleted:ed4d6c65-1c13-454b-810e-cc7aa5b3d32b for instance e5e640dc-7c7e-4a28-821e-41da7a74323b on n-h2-858384-17 Oct 31 15:43:53.880166 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e1ce0308-b891-41e6-8e40-af6a6a6fd943 req-f37f7d19-a0f3-4a46-bb98-89c76fb90289 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115210 Oct 31 15:43:53.885966 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2743/5314] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:43:54.479510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:54.483922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:54.505943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:54.507937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:54.512796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:54.514115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:54.515063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:54.519391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:54.622554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:54.623734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:54.624325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:54.624971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lazy-loading 'fault' on Instance uuid e5e640dc-7c7e-4a28-821e-41da7a74323b {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:43:54.715287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86c30875-645e-43d7-a5ea-4650da38e9dd tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0b44c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:54.808433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:43:54.812763 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-86c30875-645e-43d7-a5ea-4650da38e9dd tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.102686 Oct 31 15:43:54.814978 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2744/5315] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:54 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:54.819644 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dca1c903-5f37-4cde-8e0b-9c4188b710eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 200 len: 1355 microversion: 2.1 time: 0.347115 Oct 31 15:43:54.835881 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2572/5316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:54 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 1355 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:55.831049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1ca25c39-d646-4dfc-a8e5-45d1a573957c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0d1b310>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:55.853504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:55.854854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: e5e640dc-7c7e-4a28-821e-41da7a74323b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:43:55.876156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:55.876656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:55.885594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:55.886381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:43:55.886865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:43:55.887299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:43:55.919866 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1ca25c39-d646-4dfc-a8e5-45d1a573957c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.092195 Oct 31 15:43:55.930331 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2745/5317] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:55 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:55.959218 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] HTTP exception thrown: Instance e5e640dc-7c7e-4a28-821e-41da7a74323b could not be found. Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Request method failure captured: Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b HTTP/1.1 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-vYXw5CPfxI9qsbE5oWLVlabEwpa9M6Ef1fkrw4QAYPij6FJOM5Xg0DltLoV49P2_qcAx8GePrGwc670IZtI8hUhpzWNxVFvZtPDOo7wHEVWRZyCE_xyV_MDmU4WDjceseG9A24j1fET0QbEoX61XLGsvVw_--5yurHZAMewB53Ikw Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: e6a2914e44014bed857d096897727c91 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6a2914e44014bed857d096897727c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e6a2914e44014bed857d096897727c91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6a2914e44014bed857d096897727c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e6a2914e44014bed857d096897727c91"}]}] Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: e6a2914e44014bed857d096897727c91 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestNetworkAdvancedServerOps-2127797092-project Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e0349502a6234609ae5eb4c4a94acf95 Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2127797092-project Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance e5e640dc-7c7e-4a28-821e-41da7a74323b could not be found. Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'e5e640dc-7c7e-4a28-821e-41da7a74323b'} Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e640dc-7c7e-4a28-821e-41da7a74323b could not be found. Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e640dc-7c7e-4a28-821e-41da7a74323b could not be found. Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:43:55.962029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:43:55.965916 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:43:55.965916 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:43:55.965916 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:43:55.965916 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:43:55.965916 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:43:55.965916 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:43:55.965916 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e640dc-7c7e-4a28-821e-41da7a74323b could not be found. Oct 31 15:43:55.965916 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:43:55.978028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Returning 404 to user: Instance e5e640dc-7c7e-4a28-821e-41da7a74323b could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:43:55.982305 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7cfe99e4-b762-47bf-a042-6d99ad70a5a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b" status: 404 len: 111 microversion: 2.1 time: 0.137115 Oct 31 15:43:55.982860 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2573/5318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:43:55 2022] GET /compute/v2.1/servers/e5e640dc-7c7e-4a28-821e-41da7a74323b => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:43:56.937557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1c768a2b-d4fe-4f58-b1b2-a65e5c90a5a2 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1e9daf0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:57.009716 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1c768a2b-d4fe-4f58-b1b2-a65e5c90a5a2 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.076910 Oct 31 15:43:57.022876 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2746/5319] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:56 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:58.028641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b9cc5bcf-ab19-41ac-ad38-132d5dd2cc8c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0f01280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:58.134318 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b9cc5bcf-ab19-41ac-ad38-132d5dd2cc8c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.107237 Oct 31 15:43:58.138217 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2574/5320] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:58 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:43:59.153216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11f1ff99-de7f-478c-977d-f3d078e39c73 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e55a1430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:43:59.236937 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11f1ff99-de7f-478c-977d-f3d078e39c73 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.087351 Oct 31 15:43:59.239302 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2747/5321] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:43:59 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:00.255826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-902c9692-a180-4a10-818f-83dd5147d0b5 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0f014c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:00.330990 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-902c9692-a180-4a10-818f-83dd5147d0b5 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.080107 Oct 31 15:44:00.332438 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2575/5322] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:00 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:01.348140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b5d6dc0-0122-4535-80c9-38e340ce4747 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0dd8160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:01.435690 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b5d6dc0-0122-4535-80c9-38e340ce4747 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.091639 Oct 31 15:44:01.437425 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2748/5323] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:01 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:02.457236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e5dc8d0f-02d9-4c29-8565-fe8ca99d1937 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0fdd160>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:02.534387 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e5dc8d0f-02d9-4c29-8565-fe8ca99d1937 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.083815 Oct 31 15:44:02.535269 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2576/5324] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:02 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:03.551703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5ce74a7-c9c6-49d6-ba18-5a19b64a897e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0d1b3a0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:03.666798 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5ce74a7-c9c6-49d6-ba18-5a19b64a897e tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.118892 Oct 31 15:44:03.670063 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2749/5325] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:03 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:04.701408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-033c0d9f-3f6d-454d-a67b-9f15983c3ac3 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0ea4a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:04.814796 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-033c0d9f-3f6d-454d-a67b-9f15983c3ac3 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.132540 Oct 31 15:44:04.815466 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2577/5326] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:04 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:05.832522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7153c3f-fb6c-4fc6-a482-31328bf8f020 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0cbf0d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:05.846076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:05.851150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:05.936597 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7153c3f-fb6c-4fc6-a482-31328bf8f020 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.109106 Oct 31 15:44:05.937581 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2750/5327] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:05 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:06.952314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:06.954705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:06.961564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40463683-4441-4567-a8da-ca92d447f0b1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e5571f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:07.040905 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40463683-4441-4567-a8da-ca92d447f0b1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.090449 Oct 31 15:44:07.050703 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2578/5328] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:06 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:08.063070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09c107fa-e266-4d81-906f-ccf1af705961 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e55a1ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:08.187411 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09c107fa-e266-4d81-906f-ccf1af705961 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.131796 Oct 31 15:44:08.210549 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2751/5329] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:08 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:09.204223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b05dede6-efba-4063-872b-ef3b84c13c95 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0f01040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:09.281832 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b05dede6-efba-4063-872b-ef3b84c13c95 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1455 microversion: 2.1 time: 0.081276 Oct 31 15:44:09.291545 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2579/5330] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:09 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:10.301310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba12546f-e1e2-42a2-a6ed-31beb86a2919 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0b444c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:10.389657 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba12546f-e1e2-42a2-a6ed-31beb86a2919 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1464 microversion: 2.1 time: 0.094776 Oct 31 15:44:10.391289 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2752/5331] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:10 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1464 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:10.410048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a19af39f-58fc-4608-86e5-343f0bdef794 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e168a040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:10.518494 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a19af39f-58fc-4608-86e5-343f0bdef794 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 200 len: 1464 microversion: 2.1 time: 0.111750 Oct 31 15:44:10.536570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:10.537967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:10.542548 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2580/5332] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:10 2022] GET /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:10.548615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:10.549117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:10.549573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:10.550280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:10.550894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:10.551475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:11.078353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:11.086851 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c4231dc-02ca-45ed-86e8-672600f494ba tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970" status: 200 len: 1465 microversion: 2.1 time: 0.554293 Oct 31 15:44:11.087770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2753/5333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:10 2022] GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970 => generated 1465 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:11.114714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd8abe65-1719-496d-bc8c-6a68c6f3ff25 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0fdd4c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:11.259670 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd8abe65-1719-496d-bc8c-6a68c6f3ff25 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-10-31T15%3A42%3A11Z" status: 200 len: 1902 microversion: 2.1 time: 0.150598 Oct 31 15:44:11.260909 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2581/5334] 10.222.0.20 () {58 vars in 1199 bytes} [Mon Oct 31 15:44:11 2022] GET /compute/v2.1/images?changes-since=2022-10-31T15%3A42%3A11Z => generated 1902 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:11.278775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f7774f7-60d7-4fd1-ac0f-30ddc1f6c80d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0b444c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:11.379260 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f7774f7-60d7-4fd1-ac0f-30ddc1f6c80d tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-534160666" status: 200 len: 484 microversion: 2.1 time: 0.105076 Oct 31 15:44:11.380883 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2754/5335] 10.222.0.20 () {58 vars in 1229 bytes} [Mon Oct 31 15:44:11 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-534160666 => generated 484 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:11.394723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6924be7-5c78-407e-9ea3-1f3f08ec418c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0ea4b80>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:11.517355 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f6924be7-5c78-407e-9ea3-1f3f08ec418c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images?server=069cc821-7fc7-4365-91a6-d253240e6970" status: 200 len: 957 microversion: 2.1 time: 0.127266 Oct 31 15:44:11.528739 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2582/5336] 10.222.0.20 () {58 vars in 1209 bytes} [Mon Oct 31 15:44:11 2022] GET /compute/v2.1/images?server=069cc821-7fc7-4365-91a6-d253240e6970 => generated 957 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:11.532687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe06d66a-efab-40c0-b221-d9403e5db11f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0b71430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:11.576617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d40b880-fe36-49bd-8483-c6248fd2acd9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '.version_select at 0x7f16e16761f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:11.613386 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe06d66a-efab-40c0-b221-d9403e5db11f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 485 microversion: 2.1 time: 0.084635 Oct 31 15:44:11.614883 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2755/5337] 10.222.0.20 () {58 vars in 1317 bytes} [Mon Oct 31 15:44:11 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 485 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:11.629732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-605a16d5-edaa-4262-bc59-a985c0a765f5 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e15610d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:11.638150 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d40b880-fe36-49bd-8483-c6248fd2acd9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-516838709" status: 202 len: 0 microversion: 2.1 time: 0.071206 Oct 31 15:44:11.642990 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2583/5338] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 31 15:44:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-516838709 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:44:11.703557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-966f005b-bc37-4f0f-9a34-22ab5cdfb8b7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'create', calling method: .version_select at 0x7f16e0e55f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-7667330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNflarG8NBzTghlzPgO3WS+MvlgeePTsHp0LbAfdWN4ZVoaQ02uNdj20x+cxs7moUYqEDaTB6ZsrVJf7FBOEOLxdAdEe8hF6M6EMqsmrCK9nG/OAXHEUITHQf/zay7MzQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:11.726058 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-605a16d5-edaa-4262-bc59-a985c0a765f5 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 485 microversion: 2.1 time: 0.101717 Oct 31 15:44:11.726657 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2756/5339] 10.222.0.20 () {58 vars in 1303 bytes} [Mon Oct 31 15:44:11 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 485 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:11.731776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-966f005b-bc37-4f0f-9a34-22ab5cdfb8b7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for project e6a2914e44014bed857d096897727c91. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:44:11.737177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-966f005b-bc37-4f0f-9a34-22ab5cdfb8b7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for user e0349502a6234609ae5eb4c4a94acf95 and project e6a2914e44014bed857d096897727c91. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:44:11.746612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a3dc8c4-6d93-4d10-9423-63e70400a5a7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e03395e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:11.783972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-966f005b-bc37-4f0f-9a34-22ab5cdfb8b7 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.099499 Oct 31 15:44:11.785021 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2584/5340] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:44:11 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:11.902245 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5a3dc8c4-6d93-4d10-9423-63e70400a5a7 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.161649 Oct 31 15:44:11.913690 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2757/5341] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:44:11 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:11.918647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c693bad-f56b-49d4-91e5-58e3a01fd6de tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e574e1f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:12.002898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c693bad-f56b-49d4-91e5-58e3a01fd6de tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.087978 Oct 31 15:44:12.013500 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2585/5342] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:44:11 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:12.018551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc3a1e96-b891-44fb-ab5c-e06f732e15f1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1561790>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:12.075238 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc3a1e96-b891-44fb-ab5c-e06f732e15f1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.060018 Oct 31 15:44:12.076181 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2758/5343] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:44:12 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:12.092072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c10ef9b0-f958-476b-bb40-d921293223f5 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0ff6040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:12.212540 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c10ef9b0-f958-476b-bb40-d921293223f5 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-10-31T15%3A42%3A07Z" status: 200 len: 6332 microversion: 2.1 time: 0.124541 Oct 31 15:44:12.228339 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2586/5344] 10.222.0.20 () {58 vars in 1220 bytes} [Mon Oct 31 15:44:12 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-31T15%3A42%3A07Z => generated 6332 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:12.235984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22dd1aae-68f6-4ffb-a798-8e5c8e997a03 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0339430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:12.292119 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22dd1aae-68f6-4ffb-a798-8e5c8e997a03 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-534160666" status: 200 len: 664 microversion: 2.1 time: 0.061797 Oct 31 15:44:12.304567 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2759/5345] 10.222.0.20 () {58 vars in 1250 bytes} [Mon Oct 31 15:44:12 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-534160666 => generated 664 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:12.310704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8aa7b621-e9e1-4cf3-9790-864271e8ab4b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e16761f0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:12.413690 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8aa7b621-e9e1-4cf3-9790-864271e8ab4b tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1467 microversion: 2.1 time: 0.106926 Oct 31 15:44:12.425504 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2587/5346] 10.222.0.20 () {58 vars in 1338 bytes} [Mon Oct 31 15:44:12 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1467 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:12.432097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ce26549-e726-4fe1-bb47-3020dd797786 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e03601f0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:12.501149 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ce26549-e726-4fe1-bb47-3020dd797786 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1467 microversion: 2.1 time: 0.074105 Oct 31 15:44:12.513184 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2760/5347] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Oct 31 15:44:12 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1467 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:12.520946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-78c4befc-8263-4a8b-87d5-e7657e4ec25f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0ef8f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:12.826691 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-78c4befc-8263-4a8b-87d5-e7657e4ec25f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.310394 Oct 31 15:44:12.843727 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2588/5348] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 31 15:44:12 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:12.852854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5295386-c375-4481-9422-b9f31c2c31c9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1561820>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:12.947607 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5295386-c375-4481-9422-b9f31c2c31c9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.099324 Oct 31 15:44:12.948466 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2761/5349] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 31 15:44:12 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:12.969054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb808139-5d75-4a46-96b5-afc0d533ce9f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e574ef70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:13.075125 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb808139-5d75-4a46-96b5-afc0d533ce9f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/524d630e-d0c9-4d4c-9057-837f830c46f6" status: 200 len: 784 microversion: 2.1 time: 0.110294 Oct 31 15:44:13.079303 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2589/5350] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:12 2022] GET /compute/v2.1/images/524d630e-d0c9-4d4c-9057-837f830c46f6 => generated 784 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:13.098300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b85f6aa9-2e8f-4073-a87f-837d24073bdc tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0e30c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:13.179952 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b85f6aa9-2e8f-4073-a87f-837d24073bdc tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.085367 Oct 31 15:44:13.180588 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2762/5351] 10.222.0.20 () {58 vars in 1158 bytes} [Mon Oct 31 15:44:13 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:13.200586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-67ad8e8e-b928-429a-a416-f64172aa12b9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e574e040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:13.936515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e3e656ac-547a-4f67-bbec-b081e5bdc939 req-9b598c20-8f03-45fd-bee2-ad9d867af458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069cc821-7fc7-4365-91a6-d253240e6970", "name": "network-vif-unplugged", "status": "completed", "tag": "3e6c790c-a9d6-4201-95e7-05ac114346d2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:13.975508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e3e656ac-547a-4f67-bbec-b081e5bdc939 req-9b598c20-8f03-45fd-bee2-ad9d867af458 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:13.979398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e3e656ac-547a-4f67-bbec-b081e5bdc939 req-9b598c20-8f03-45fd-bee2-ad9d867af458 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:13.981555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e3e656ac-547a-4f67-bbec-b081e5bdc939 req-9b598c20-8f03-45fd-bee2-ad9d867af458 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:14.011614 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e3e656ac-547a-4f67-bbec-b081e5bdc939 req-9b598c20-8f03-45fd-bee2-ad9d867af458 service nova] Creating event network-vif-unplugged:3e6c790c-a9d6-4201-95e7-05ac114346d2 for instance 069cc821-7fc7-4365-91a6-d253240e6970 on n-h1-858384-17 Oct 31 15:44:14.023822 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e3e656ac-547a-4f67-bbec-b081e5bdc939 req-9b598c20-8f03-45fd-bee2-ad9d867af458 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091527 Oct 31 15:44:14.025182 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2763/5352] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:14.134445 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-67ad8e8e-b928-429a-a416-f64172aa12b9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "DELETE /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e" status: 204 len: 0 microversion: 2.1 time: 0.938911 Oct 31 15:44:14.143592 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2590/5353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:13 2022] DELETE /compute/v2.1/images/09d72de2-7330-4dbd-b91f-3cd3ea284f9e => generated 0 bytes in 941 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:14.146188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-93eb198c-9728-4bcc-92f7-129dd3a26593 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e1561790>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:14.939173 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-93eb198c-9728-4bcc-92f7-129dd3a26593 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "DELETE /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b" status: 204 len: 0 microversion: 2.1 time: 0.797983 Oct 31 15:44:14.939851 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2764/5354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:14 2022] DELETE /compute/v2.1/images/907d8a93-85bc-4ef8-be23-75958fbd190b => generated 0 bytes in 800 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:14.948655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c52be8c9-ca94-4885-86c8-66138a789a90 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e16764c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:15.631019 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c52be8c9-ca94-4885-86c8-66138a789a90 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "DELETE /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4" status: 204 len: 0 microversion: 2.1 time: 0.685574 Oct 31 15:44:15.632900 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2591/5355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:14 2022] DELETE /compute/v2.1/images/f2d2c9cc-172b-4361-9ae6-dbd05b0439e4 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:15.644473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:15.645578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:15.659222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:15.660143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:15.660860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:15.662523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:15.663614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:15.664256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:15.706881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:44:15.870352 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8103de0e-7d9f-4e0e-b2cf-d28ea4ea0523 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 204 len: 0 microversion: 2.1 time: 0.230988 Oct 31 15:44:15.872154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2765/5356] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:15 2022] DELETE /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:15.885394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:15.886348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:15.910100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:15.910928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:15.911958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:15.913490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:15.920096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:15.920852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:16.703400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:16.725661 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6317fac1-e6e2-4da0-b7c7-5e40de4f995f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1474 microversion: 2.1 time: 0.848829 Oct 31 15:44:16.731279 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2592/5357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:15 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1474 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:17.755023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:17.756568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:17.776127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:17.776953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:17.777621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:17.780185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:17.780868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:17.782760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:18.610970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:18.624910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f093790-e324-401c-a01e-e4f3ac669761 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1474 microversion: 2.1 time: 0.869654 Oct 31 15:44:18.625633 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2766/5358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:17 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1474 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:19.655682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:19.659192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:19.674023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:19.675729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:19.678455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:19.682785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:19.683875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:19.684716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:20.565000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:20.586012 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-62271163-4762-4857-a951-b226e9b8268c tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1474 microversion: 2.1 time: 0.937688 Oct 31 15:44:20.586995 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2593/5359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:19 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1474 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:20.743223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c6dacfda-35e2-4511-a273-0d7c17f8d477 req-84c5f3c9-877c-42cd-b50e-9d48696e91b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88584df4-529c-48f1-a3b8-ee4b77a54bf7", "name": "network-vif-deleted", "tag": "3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:20.777833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c6dacfda-35e2-4511-a273-0d7c17f8d477 req-84c5f3c9-877c-42cd-b50e-9d48696e91b2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:20.778516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c6dacfda-35e2-4511-a273-0d7c17f8d477 req-84c5f3c9-877c-42cd-b50e-9d48696e91b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:20.779050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c6dacfda-35e2-4511-a273-0d7c17f8d477 req-84c5f3c9-877c-42cd-b50e-9d48696e91b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:20.823822 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c6dacfda-35e2-4511-a273-0d7c17f8d477 req-84c5f3c9-877c-42cd-b50e-9d48696e91b2 service nova] Creating event network-vif-deleted:3597c0b4-71bf-4ccc-a1b5-d45f75d01ab9 for instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 on n-h2-858384-17 Oct 31 15:44:20.834126 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c6dacfda-35e2-4511-a273-0d7c17f8d477 req-84c5f3c9-877c-42cd-b50e-9d48696e91b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095349 Oct 31 15:44:20.841240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2767/5360] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:21.246525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3bab4275-686f-45a6-a0dc-74f8adf69b3f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'create', calling method: .version_select at 0x7f16e17039d0>, body: {"keypair": {"name": "tempest-keypair-2077340121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKd0Un6pWTIIvFkZ5ixia5MnI+XSclYKF+6GDbCAV1lfo8t036SzZlChWQlHsfEbK+LQITeT/kqcazgVACteb/tO5QYpfvwBVU6aPyjPa6k77EzJmkJzb4NMehkeLp/Dwg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:21.321462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3bab4275-686f-45a6-a0dc-74f8adf69b3f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Getting quotas for project 3b3bb1592c2c45c181e470ce3756c812. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:44:21.344824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-3bab4275-686f-45a6-a0dc-74f8adf69b3f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Getting quotas for user 5c07cff9c6ae4abf994127f2f38737cb and project 3b3bb1592c2c45c181e470ce3756c812. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:44:21.422476 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3bab4275-686f-45a6-a0dc-74f8adf69b3f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.394416 Oct 31 15:44:21.423620 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2594/5361] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 31 15:44:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 399 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:44:21.612775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:21.613766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:21.623902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:21.628944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:21.629580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:21.631265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:21.633032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:21.635724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:21.729042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:21.731910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:21.735195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:21.735893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lazy-loading 'fault' on Instance uuid 88584df4-529c-48f1-a3b8-ee4b77a54bf7 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:44:21.912698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:21.954055 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8148a81d-9b5b-4bec-9ed7-207cca1ce2e8 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 200 len: 1308 microversion: 2.1 time: 0.346516 Oct 31 15:44:21.960582 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2768/5362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:21 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 1308 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:22.990830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:22.991480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 88584df4-529c-48f1-a3b8-ee4b77a54bf7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:23.022160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.023553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.024066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:23.024857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.025529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.026199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:23.113344 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] HTTP exception thrown: Instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 could not be found. Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Request method failure captured: Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 HTTP/1.1 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-zOcIEEOQ0tCD3FR5Uq6jzTqXgi735SV45I4QboR0-wZbS0Fyr8mqN53mFVXF3IDGeIHKKLdRNuhwkbqJl88EbIYca6JJBU8z4S6fLPuQ5VCWf2xwGaTXFR0TUsQuB3sODkYb69EeRaUNchtJQNmTqCZwSeBEtNety8xZ7oJb42xlk Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 1e71cf63e94c4cf893a7c15f9be3f135 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ListImageFiltersTestJSON-2104621267 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e71cf63e94c4cf893a7c15f9be3f135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e71cf63e94c4cf893a7c15f9be3f135", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e71cf63e94c4cf893a7c15f9be3f135"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e71cf63e94c4cf893a7c15f9be3f135"}]}] Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ListImageFiltersTestJSON-2104621267 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 1e71cf63e94c4cf893a7c15f9be3f135 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2104621267 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ListImageFiltersTestJSON-2104621267-project Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 0cc56b16617148c18ef65024b06443c6 Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ListImageFiltersTestJSON-2104621267-project Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 could not be found. Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '88584df4-529c-48f1-a3b8-ee4b77a54bf7'} Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 could not be found. Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 could not be found. Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:23.115754 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:23.120206 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:23.120206 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:23.120206 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:23.120206 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:23.120206 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:23.120206 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 could not be found. Oct 31 15:44:23.120206 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:23.120822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Returning 404 to user: Instance 88584df4-529c-48f1-a3b8-ee4b77a54bf7 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:23.122055 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-53440219-f7fe-471a-bd7b-89bab7cbcae4 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7" status: 404 len: 111 microversion: 2.1 time: 0.139625 Oct 31 15:44:23.123108 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2595/5363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:22 2022] GET /compute/v2.1/servers/88584df4-529c-48f1-a3b8-ee4b77a54bf7 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:23.132128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:23.133360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:23.145924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.146895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.147700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:23.149348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.150102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.150747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:23.214518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:44:23.436115 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8034fd8-eff6-40ef-a594-c2484a033be1 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "DELETE /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970" status: 204 len: 0 microversion: 2.1 time: 0.308475 Oct 31 15:44:23.437615 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2769/5364] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:44:23 2022] DELETE /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:23.448717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:23.449788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:23.458542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.459622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.460250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:23.461982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:23.462679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:23.464161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:24.422684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:24.447372 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-286726f1-84a4-4c5e-a34d-f1f88f826fef tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970" status: 200 len: 1471 microversion: 2.1 time: 1.004063 Oct 31 15:44:24.463688 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2596/5365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:23 2022] GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970 => generated 1471 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:24.602172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa73f8d8-6216-4ccc-bcaa-a2ca2e75a74a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: .version_select at 0x7f16e1561820>, body: {"keypair": {"name": "tempest-keypair-498283281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXCBcvRlpVCNXhLGst6sPuSdG1uX3ca5Gg/JQNBQT+F0XHwWgj4T9cMVxY5VKQ2bOglcDqOmWVniO5BPp+YPitxu9bEWa1glTVYb8GGyAsPCKVrUp/3glzD6dTv3GPMZg=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:24.649027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fa73f8d8-6216-4ccc-bcaa-a2ca2e75a74a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for project bb201c74554c43f0a526161cf24206f3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:44:24.655750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fa73f8d8-6216-4ccc-bcaa-a2ca2e75a74a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for user a5bfcc2112ea47dcb758487de253311f and project bb201c74554c43f0a526161cf24206f3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:44:24.710294 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa73f8d8-6216-4ccc-bcaa-a2ca2e75a74a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.225742 Oct 31 15:44:24.711573 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2770/5366] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:44:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:25.476864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:25.478092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:25.492934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:25.493665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:25.494275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:25.495160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:25.495737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:25.496097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:26.450661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:26.481766 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e074dda-c827-4d01-a5a0-e0b10a1a2363 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970" status: 200 len: 1471 microversion: 2.1 time: 1.006210 Oct 31 15:44:26.486479 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2597/5367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:25 2022] GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970 => generated 1471 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:27.516543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:27.517484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:27.543978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:27.545294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:27.546171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:27.547325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:27.548347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:27.548984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:27.761470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc56b16617148c18ef65024b06443c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e71cf63e94c4cf893a7c15f9be3f135', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:27.779847 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7afff7fd-1371-462f-9201-0ea29ab90113 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970" status: 200 len: 1429 microversion: 2.1 time: 0.265711 Oct 31 15:44:27.781581 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2771/5368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:27 2022] GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970 => generated 1429 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:27.841361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-507d81a5-f8d1-45a3-8eb6-0678635e0895 req-0b9b31fe-04c9-44ee-a22c-243ce2db5bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069cc821-7fc7-4365-91a6-d253240e6970", "name": "network-vif-deleted", "tag": "3e6c790c-a9d6-4201-95e7-05ac114346d2"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:27.871357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-507d81a5-f8d1-45a3-8eb6-0678635e0895 req-0b9b31fe-04c9-44ee-a22c-243ce2db5bf9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:27.871919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-507d81a5-f8d1-45a3-8eb6-0678635e0895 req-0b9b31fe-04c9-44ee-a22c-243ce2db5bf9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:27.872374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-507d81a5-f8d1-45a3-8eb6-0678635e0895 req-0b9b31fe-04c9-44ee-a22c-243ce2db5bf9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:27.911224 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-507d81a5-f8d1-45a3-8eb6-0678635e0895 req-0b9b31fe-04c9-44ee-a22c-243ce2db5bf9 service nova] Creating event network-vif-deleted:3e6c790c-a9d6-4201-95e7-05ac114346d2 for instance 069cc821-7fc7-4365-91a6-d253240e6970 on n-h1-858384-17 Oct 31 15:44:27.920012 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-507d81a5-f8d1-45a3-8eb6-0678635e0895 req-0b9b31fe-04c9-44ee-a22c-243ce2db5bf9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082899 Oct 31 15:44:27.921324 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2598/5369] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:27.998650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-281094531", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10e79de8-877b-4b91-8dd5-b765b9465821"}], "security_groups": [{"name": "tempest-securitygroup--2030541986"}], "key_name": "tempest-keypair-2077340121", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:28.228205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] validate_networks() for [('10e79de8-877b-4b91-8dd5-b765b9465821', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:44:28.812647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:28.813620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] [instance: 069cc821-7fc7-4365-91a6-d253240e6970] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:28.842322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:28.846191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:28.848593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:28.851256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:28.852024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:28.852650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:28.877979 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] HTTP exception thrown: Instance 069cc821-7fc7-4365-91a6-d253240e6970 could not be found. Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Request method failure captured: Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970 HTTP/1.1 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-zOcIEEOQ0tCD3FR5Uq6jzTqXgi735SV45I4QboR0-wZbS0Fyr8mqN53mFVXF3IDGeIHKKLdRNuhwkbqJl88EbIYca6JJBU8z4S6fLPuQ5VCWf2xwGaTXFR0TUsQuB3sODkYb69EeRaUNchtJQNmTqCZwSeBEtNety8xZ7oJb42xlk Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 1e71cf63e94c4cf893a7c15f9be3f135 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ListImageFiltersTestJSON-2104621267 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e71cf63e94c4cf893a7c15f9be3f135"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1e71cf63e94c4cf893a7c15f9be3f135", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1e71cf63e94c4cf893a7c15f9be3f135"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1e71cf63e94c4cf893a7c15f9be3f135"}]}] Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ListImageFiltersTestJSON-2104621267 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 1e71cf63e94c4cf893a7c15f9be3f135 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-2104621267 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ListImageFiltersTestJSON-2104621267-project Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 0cc56b16617148c18ef65024b06443c6 Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ListImageFiltersTestJSON-2104621267-project Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 069cc821-7fc7-4365-91a6-d253240e6970 could not be found. Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '069cc821-7fc7-4365-91a6-d253240e6970'} Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 069cc821-7fc7-4365-91a6-d253240e6970 could not be found. Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 069cc821-7fc7-4365-91a6-d253240e6970 could not be found. Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:28.888758 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:28.892333 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:28.892333 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:28.892333 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:28.892333 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:28.892333 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:28.892333 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 069cc821-7fc7-4365-91a6-d253240e6970 could not be found. Oct 31 15:44:28.892333 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:28.895508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Returning 404 to user: Instance 069cc821-7fc7-4365-91a6-d253240e6970 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:28.898281 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bfc7076a-d60d-4fab-a3e2-20153e299c89 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970" status: 404 len: 111 microversion: 2.1 time: 0.091725 Oct 31 15:44:28.902828 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2599/5370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:28 2022] GET /compute/v2.1/servers/069cc821-7fc7-4365-91a6-d253240e6970 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:44:28.911055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26063237-fcb0-47c1-a3fc-7eca073a282f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e5622040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:29.327528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:44:29.328090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:44:29.328609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:44:29.329160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:44:29.329904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:44:29.349089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:29.352371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:29.355551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:29.362004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:29.363708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:29.365553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:29.402458 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26063237-fcb0-47c1-a3fc-7eca073a282f tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "DELETE /compute/v2.1/images/d2d12635-fefe-419b-b914-2ec120bbd3d5" status: 204 len: 0 microversion: 2.1 time: 0.498202 Oct 31 15:44:29.403045 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2600/5371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:28 2022] DELETE /compute/v2.1/images/d2d12635-fefe-419b-b914-2ec120bbd3d5 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:44:29.410640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Getting quotas for project 3b3bb1592c2c45c181e470ce3756c812. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:44:29.411986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea7bb509-f98b-403e-81df-78ec58ab90fa tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e05723a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:29.419787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Getting quotas for user 5c07cff9c6ae4abf994127f2f38737cb and project 3b3bb1592c2c45c181e470ce3756c812. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:44:29.440056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:44:29.444177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:44:29.526148 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d994e4a6-e827-4228-9424-be989e151fe9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.533625 Oct 31 15:44:29.528218 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2772/5372] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:44:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:44:29.540390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f04b9ac-8ad3-403f-bc3f-a4d603abb555 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:29.563641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f04b9ac-8ad3-403f-bc3f-a4d603abb555 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:29.873442 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea7bb509-f98b-403e-81df-78ec58ab90fa tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "DELETE /compute/v2.1/images/ae399822-3385-4fe2-9f99-9f15063ad077" status: 204 len: 0 microversion: 2.1 time: 0.465987 Oct 31 15:44:29.876890 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2601/5373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:29 2022] DELETE /compute/v2.1/images/ae399822-3385-4fe2-9f99-9f15063ad077 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:29.882439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-72a2c680-02ee-4650-9d82-47b8ddcbb4e9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] Calling method '.version_select at 0x7f16e0e554c0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:29.963026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f04b9ac-8ad3-403f-bc3f-a4d603abb555 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:29.972263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f04b9ac-8ad3-403f-bc3f-a4d603abb555 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:29.974287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f04b9ac-8ad3-403f-bc3f-a4d603abb555 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:29.977903 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f04b9ac-8ad3-403f-bc3f-a4d603abb555 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1281 microversion: 2.20 time: 0.441747 Oct 31 15:44:30.011024 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2773/5374] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:29 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1281 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:44:30.292981 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-72a2c680-02ee-4650-9d82-47b8ddcbb4e9 tempest-ListImageFiltersTestJSON-2104621267 tempest-ListImageFiltersTestJSON-2104621267-project] 10.222.0.20 "DELETE /compute/v2.1/images/18a6bb53-447f-46ac-84df-29f5ba664823" status: 204 len: 0 microversion: 2.1 time: 0.414598 Oct 31 15:44:30.293903 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2602/5375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:29 2022] DELETE /compute/v2.1/images/18a6bb53-447f-46ac-84df-29f5ba664823 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:44:31.018013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:31.018616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:31.030022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:31.031391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:31.032015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:31.033444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:31.035239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:31.035872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:31.150239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:31.159293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:31.161106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:31.163560 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c6e3381-b08d-41e8-abb1-48fa3c697b9d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1333 microversion: 2.20 time: 0.153529 Oct 31 15:44:31.177668 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2774/5376] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:31 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1333 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:32.190814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:32.191424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:32.195903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:32.209090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:32.209614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:32.215609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:32.216639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:32.217301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:32.217882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:32.861405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:32.877765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:32.879571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:32.882039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e300e04e-7c3f-461f-96eb-a6a4816bc698 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1339 microversion: 2.20 time: 0.695177 Oct 31 15:44:32.894090 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2603/5377] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:32 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1339 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:33.227256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1768107620", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f438d2d0-1357-4e21-b1cc-6088b00737d1"}], "security_groups": [{"name": "tempest-securitygroup--254161760"}], "key_name": "tempest-keypair-498283281", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:33.796141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] validate_networks() for [('f438d2d0-1357-4e21-b1cc-6088b00737d1', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:44:34.016726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d16c95c-ad31-4fc3-8cee-2039cac2776f tempest-ListImageFiltersNegativeTestJSON-1244671639 tempest-ListImageFiltersNegativeTestJSON-1244671639-project] Calling method '.version_select at 0x7f16e5571f70>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:34.044823 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-6d16c95c-ad31-4fc3-8cee-2039cac2776f tempest-ListImageFiltersNegativeTestJSON-1244671639 tempest-ListImageFiltersNegativeTestJSON-1244671639-project] HTTP exception thrown: Image not found. Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d16c95c-ad31-4fc3-8cee-2039cac2776f tempest-ListImageFiltersNegativeTestJSON-1244671639 tempest-ListImageFiltersNegativeTestJSON-1244671639-project] Request method failure captured: Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/images/f5f95eeb-f96d-42ef-9deb-6a707d4efda4 HTTP/1.1 Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1h8JSaKNeOSHNyqmmK1HAGygpuvPSCY-KVxObR6lHvoQ9YbyVawrHQz_OVZpooO1Eqs35nkl4WK8Raz753hKMJUbR8q_SXBubdwHGGh1ctcch3-k_Lms4hTGDgSohq6-cW4puxCq8pXpC2m2eL8Pqw5Bx1eTcJmhGXETzmK-ZARFw Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5527374f86a8416aa50db1fb35358b4e Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1244671639 Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5527374f86a8416aa50db1fb35358b4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5527374f86a8416aa50db1fb35358b4e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5527374f86a8416aa50db1fb35358b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5527374f86a8416aa50db1fb35358b4e"}]}] Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1244671639 Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5527374f86a8416aa50db1fb35358b4e Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1244671639 Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ListImageFiltersNegativeTestJSON-1244671639-project Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 713ceac7ee9d482fbdff4e70f35d5b8b Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1244671639-project Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: exception: Image not found. Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f5f95eeb-f96d-42ef-9deb-6a707d4efda4'} Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f5f95eeb-f96d-42ef-9deb-6a707d4efda4 Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 31 15:44:34.047029 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f5f95eeb-f96d-42ef-9deb-6a707d4efda4 could not be found. Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 31 15:44:34.051543 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:44:34.054632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d16c95c-ad31-4fc3-8cee-2039cac2776f tempest-ListImageFiltersNegativeTestJSON-1244671639 tempest-ListImageFiltersNegativeTestJSON-1244671639-project] Returning 404 to user: Image not found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:44:34.057152 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6d16c95c-ad31-4fc3-8cee-2039cac2776f tempest-ListImageFiltersNegativeTestJSON-1244671639 tempest-ListImageFiltersNegativeTestJSON-1244671639-project] 10.222.0.20 "GET /compute/v2.1/images/f5f95eeb-f96d-42ef-9deb-6a707d4efda4" status: 404 len: 62 microversion: 2.1 time: 0.292097 Oct 31 15:44:34.057152 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2604/5378] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 31 15:44:33 2022] GET /compute/v2.1/images/f5f95eeb-f96d-42ef-9deb-6a707d4efda4 => generated 62 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 31 15:44:34.065089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:34.066750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:34.075587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:34.076171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:34.076834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:34.077773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:34.078631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:34.079421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:34.735738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:34.757061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:34.758614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:34.760420 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e03ee58-167b-44e3-a7bb-d23ee912224c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1407 microversion: 2.20 time: 0.703384 Oct 31 15:44:34.761409 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2605/5379] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:34 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1407 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:34.894854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:44:34.896485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:44:34.897250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:44:34.897879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:44:34.898474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:44:34.919291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:34.921204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:34.922226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:34.925005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:34.925666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:34.928428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:34.976367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for project bb201c74554c43f0a526161cf24206f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:44:34.989633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for user a5bfcc2112ea47dcb758487de253311f and project bb201c74554c43f0a526161cf24206f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:44:35.007277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:44:35.009870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:44:35.090485 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dada51a7-c30a-48b8-b812-1ea6d72909c8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.867720 Oct 31 15:44:35.098364 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2775/5380] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:44:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:44:35.104480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-951f5a37-9dd5-4cbe-8cfc-06f496c7fcdb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:35.105098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-951f5a37-9dd5-4cbe-8cfc-06f496c7fcdb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:35.290899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-951f5a37-9dd5-4cbe-8cfc-06f496c7fcdb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:35.301486 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-951f5a37-9dd5-4cbe-8cfc-06f496c7fcdb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1241 microversion: 2.1 time: 0.202457 Oct 31 15:44:35.319509 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2606/5381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:35 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1241 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:35.798547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:35.799233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:35.813203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:35.813704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:35.821832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:35.822802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:35.823285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:35.823716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:35.886375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:36.284455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:36.300624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:36.302955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:36.304177 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53667fac-6961-4c5b-8df6-74fd6352c8fe tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1407 microversion: 2.20 time: 0.519179 Oct 31 15:44:36.317921 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2776/5382] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:35 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:36.336335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f4f3f883-8cc3-4c19-a42e-4121d80ea139 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:36.337870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f4f3f883-8cc3-4c19-a42e-4121d80ea139 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:37.072299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f4f3f883-8cc3-4c19-a42e-4121d80ea139 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:37.089857 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f4f3f883-8cc3-4c19-a42e-4121d80ea139 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1241 microversion: 2.1 time: 0.760473 Oct 31 15:44:37.091327 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2607/5383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:36 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1241 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:37.368387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:37.382031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:37.393173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:37.418250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:37.420462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:37.421371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:37.425659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:37.426704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:37.427474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:38.115445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:38.116030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:38.118696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:38.137368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:38.138308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:38.138777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:38.139534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:38.139994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:38.140472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:38.196980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=43 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:38.358576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:38.394935 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a778a79b-5ec8-4d7f-b83e-d2b68030cf93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1311 microversion: 2.1 time: 0.283355 Oct 31 15:44:38.416528 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2608/5384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:38 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1311 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:38.426087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-64ac7e73-f1d4-48af-885f-3e88ea58e1d0 req-24c3d335-6f2e-4228-ad3c-36fe51286426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9547ba84-a354-46e2-b2a5-4f3d4d71159d", "tag": "163e80be-44ff-4862-ae47-6ccd8f6a3afa"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:38.436973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-64ac7e73-f1d4-48af-885f-3e88ea58e1d0 req-24c3d335-6f2e-4228-ad3c-36fe51286426 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:38.437547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-64ac7e73-f1d4-48af-885f-3e88ea58e1d0 req-24c3d335-6f2e-4228-ad3c-36fe51286426 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:38.437976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-64ac7e73-f1d4-48af-885f-3e88ea58e1d0 req-24c3d335-6f2e-4228-ad3c-36fe51286426 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:38.458795 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-64ac7e73-f1d4-48af-885f-3e88ea58e1d0 req-24c3d335-6f2e-4228-ad3c-36fe51286426 service nova] Creating event network-changed:163e80be-44ff-4862-ae47-6ccd8f6a3afa for instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d on n-h2-858384-17 Oct 31 15:44:38.468266 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-64ac7e73-f1d4-48af-885f-3e88ea58e1d0 req-24c3d335-6f2e-4228-ad3c-36fe51286426 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047678 Oct 31 15:44:38.469958 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2609/5385] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:38.635405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:38.647291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:38.649390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:38.650630 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5f0635c-4662-43ed-9392-225ddb1099cc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1407 microversion: 2.20 time: 1.318621 Oct 31 15:44:38.665712 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2777/5386] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:37 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1407 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:39.424077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:39.424782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:39.431528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:39.432021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:39.432649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:39.433554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:39.434183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:39.434761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:39.602822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:39.612189 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec7422a4-7a1c-4a88-acff-d57d9fecd0b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1299 microversion: 2.1 time: 0.192775 Oct 31 15:44:39.614990 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2610/5387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:39 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:39.680655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:39.681892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:39.694055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:39.694553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:39.695174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:39.696053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:39.696578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:39.697710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:40.041609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1543794807", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "c3c6e6cc-85ae-4518-af81-19638043b0da"}], "key_name": "tempest-TestNetworkAdvancedServerOps-7667330", "security_groups": [{"name": "tempest-secgroup-smoke-987700045"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:40.418883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:40.435118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:40.438783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:40.446235 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aff075ba-7143-432e-a6e1-dd9b78edc478 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1407 microversion: 2.20 time: 0.770504 Oct 31 15:44:40.448600 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2778/5388] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:39 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1407 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:40.635887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:40.636505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:40.644546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:40.645043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:40.645542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:40.646264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:40.646856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:40.647144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:40.826575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] validate_networks() for [('c3c6e6cc-85ae-4518-af81-19638043b0da', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:44:41.094780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:41.108547 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bddad1fa-89ba-4bca-8a6d-45f68f9f8531 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1366 microversion: 2.1 time: 0.475900 Oct 31 15:44:41.137627 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2779/5389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:40 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:41.477989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:41.478602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:41.496344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:41.496846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:41.497328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:41.498052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:41.498514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:41.498942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:42.360163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:42.378458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:42.381487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:42.382686 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-38c61a78-3a7f-4f5b-8fbe-c887e9dd6492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1407 microversion: 2.20 time: 0.910618 Oct 31 15:44:42.383278 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2780/5390] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:41 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1407 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:44:42.397825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:42.406725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:42.429805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:42.430271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:42.430668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:42.431381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:42.431832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:42.432614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:42.732949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:44:42.733496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:44:42.734231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:44:42.734646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:44:42.735216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:44:42.756906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:42.757218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:42.760440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:42.761691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:42.763462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:42.768280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:42.810859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for project e6a2914e44014bed857d096897727c91. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:44:42.826044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for user e0349502a6234609ae5eb4c4a94acf95 and project e6a2914e44014bed857d096897727c91. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:44:42.872111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:44:42.881896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:44:43.006817 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04fe8931-0590-46db-b348-1e76fe34e4e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.966993 Oct 31 15:44:43.021641 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2611/5391] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:44:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:44:43.026752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-81c169c9-aad3-43a0-a129-046d6c912322 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:43.027365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-81c169c9-aad3-43a0-a129-046d6c912322 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:43.211474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-81c169c9-aad3-43a0-a129-046d6c912322 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:43.221198 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-81c169c9-aad3-43a0-a129-046d6c912322 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1264 microversion: 2.1 time: 0.198238 Oct 31 15:44:43.221819 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2612/5392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:43 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:43.391461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:43.405005 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-064ba1f1-05eb-4795-ad00-1a5a1e615537 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1366 microversion: 2.1 time: 1.011388 Oct 31 15:44:43.409166 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2781/5393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:42 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1366 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:43.419785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:43.420409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:43.438919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:43.439938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:43.440401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:43.445109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:43.447545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:43.449672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.061634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:44.077032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:44.078834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:44.081698 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae4792eb-6328-4686-a5f7-490becebe87f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1407 microversion: 2.20 time: 0.671000 Oct 31 15:44:44.082885 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2613/5394] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:43 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1407 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:44.247607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:44.248503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:44.261277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.262358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.263510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.264453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.266124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.267059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.435919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:44.436463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:44.448145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.448624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.449068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.449828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.450293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.457911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.543894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:44.566146 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a0ed425-2218-4a89-970f-f74b08d0e87b tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1316 microversion: 2.1 time: 0.322886 Oct 31 15:44:44.570517 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2782/5395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:44 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1316 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:44.835279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4575cd8f-cf22-4fc8-9541-a7e7d71ff4aa req-65af989a-969c-4916-8a62-b50959703f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9993bf49-4859-4a8a-b916-c4883a14059c", "tag": "cf2bce7c-44ae-4462-8fe1-64047df8f3ea"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:44.875981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4575cd8f-cf22-4fc8-9541-a7e7d71ff4aa req-65af989a-969c-4916-8a62-b50959703f83 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:44.877103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4575cd8f-cf22-4fc8-9541-a7e7d71ff4aa req-65af989a-969c-4916-8a62-b50959703f83 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:44.877778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4575cd8f-cf22-4fc8-9541-a7e7d71ff4aa req-65af989a-969c-4916-8a62-b50959703f83 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:44.914156 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4575cd8f-cf22-4fc8-9541-a7e7d71ff4aa req-65af989a-969c-4916-8a62-b50959703f83 service nova] Creating event network-changed:cf2bce7c-44ae-4462-8fe1-64047df8f3ea for instance 9993bf49-4859-4a8a-b916-c4883a14059c on n-h1-858384-17 Oct 31 15:44:44.933930 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4575cd8f-cf22-4fc8-9541-a7e7d71ff4aa req-65af989a-969c-4916-8a62-b50959703f83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107059 Oct 31 15:44:44.937956 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2783/5396] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:45.108093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:45.111188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=18 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:45.118233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.119157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.141613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.142393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.146365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.147794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.148675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.150068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.320284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:45.329097 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b3dfcadf-3af6-4bfb-ab2d-a6bbcfe491fd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1366 microversion: 2.1 time: 0.897187 Oct 31 15:44:45.334308 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2614/5397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:44 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1366 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:45.596779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:45.597461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:45.609790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.610591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.611349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.614842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:45.615310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:45.615933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:45.825894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:45.844385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:45.846264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:45.847635 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd8d3f13-6d75-4e68-a034-1b02cabdd6e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1407 microversion: 2.20 time: 0.742774 Oct 31 15:44:45.853554 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2784/5398] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:45 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1407 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:45.870521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:45.883279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8587ef44-01cc-4ae9-afd3-de5fd4e35d07 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1322 microversion: 2.1 time: 0.291569 Oct 31 15:44:45.884149 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2615/5399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:45 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:46.356763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:46.357811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:46.371910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:46.372793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:46.377509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:46.378750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:46.380069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:46.380748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:46.879245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:46.882086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:46.893866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:46.895939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:46.906321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:46.907143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:46.919768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:46.919768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:46.982451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:46.996385 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a9b689c9-9d63-48ef-a3d5-d750ca042fbe tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1366 microversion: 2.1 time: 0.643579 Oct 31 15:44:47.007773 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2785/5400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:46 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1366 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:47.012863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:47.018092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:47.031641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:47.032164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:47.032597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:47.038104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:47.038858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:47.039483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:47.338324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:47.352160 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5f83f93-ec1a-4853-9bb8-793d3ecb04cc tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1322 microversion: 2.1 time: 0.342507 Oct 31 15:44:47.369583 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2786/5401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:47 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:47.406668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1f2e9e7a-a69f-4cb8-b223-d8d7161264fd req-5155c3d5-2646-4bea-8d23-3e83f3c8ecc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9547ba84-a354-46e2-b2a5-4f3d4d71159d", "name": "network-vif-plugged", "status": "completed", "tag": "163e80be-44ff-4862-ae47-6ccd8f6a3afa"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:47.428240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:47.431654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f2e9e7a-a69f-4cb8-b223-d8d7161264fd req-5155c3d5-2646-4bea-8d23-3e83f3c8ecc3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:47.432215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f2e9e7a-a69f-4cb8-b223-d8d7161264fd req-5155c3d5-2646-4bea-8d23-3e83f3c8ecc3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:47.432649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f2e9e7a-a69f-4cb8-b223-d8d7161264fd req-5155c3d5-2646-4bea-8d23-3e83f3c8ecc3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:47.446881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:47.452587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:47.454612 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f2d9d4e9-da47-4b5a-a83a-7aa3c13c72ce tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1407 microversion: 2.20 time: 0.581060 Oct 31 15:44:47.458919 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2616/5402] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:46 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:47.460439 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1f2e9e7a-a69f-4cb8-b223-d8d7161264fd req-5155c3d5-2646-4bea-8d23-3e83f3c8ecc3 service nova] Creating event network-vif-plugged:163e80be-44ff-4862-ae47-6ccd8f6a3afa for instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d on n-h2-858384-17 Oct 31 15:44:47.477462 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1f2e9e7a-a69f-4cb8-b223-d8d7161264fd req-5155c3d5-2646-4bea-8d23-3e83f3c8ecc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074283 Oct 31 15:44:47.479112 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2787/5403] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:48.034373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:48.036107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:48.065982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.067180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.069899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:48.073116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.075856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.076500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:48.380656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:48.382019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:48.391097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.391603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.392042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:48.407423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.407919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.408373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:48.599188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:48.620665 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-48f34709-6d98-4988-b244-54a4a9a8721c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1366 microversion: 2.1 time: 0.590386 Oct 31 15:44:48.623199 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2617/5404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:48 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1366 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:48.650441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:48.652659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:48.666707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.667211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.667654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:48.697647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:48.698202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:48.698663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:49.542892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:49.561881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:49.562511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:49.571122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:49.576876 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-170ef81a-6e93-415d-8a26-06cef7bb5854 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1407 microversion: 2.20 time: 0.951449 Oct 31 15:44:49.577858 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2618/5405] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:48 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1407 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:49.607817 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3ec317c9-ce44-41cd-b577-d229e41105d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1389 microversion: 2.1 time: 1.232826 Oct 31 15:44:49.609346 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2788/5406] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:48 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1389 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:49.649325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:49.650281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:49.665529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:49.666108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:49.667857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:49.668837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:49.670936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:49.672041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:50.492485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:50.508292 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fff43b48-f0d3-43ff-8b98-48102a23490d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1366 microversion: 2.1 time: 0.864385 Oct 31 15:44:50.509555 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2619/5407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:49 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1366 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:50.606979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:50.607744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:50.619221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:50.620144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:50.620973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:50.623043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:50.623688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:50.624579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:50.636669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:50.637335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:50.648543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:50.649056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:50.656729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:50.656729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:50.656729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:50.656729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:51.533890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:51.546682 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d9ea3b2-0e1d-4c41-939b-9f5f10d3f577 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1389 microversion: 2.1 time: 0.913952 Oct 31 15:44:51.548298 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2620/5408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:50 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1389 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:51.555638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:51.556561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:51.567307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:51.568365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:51.569003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:51.570037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:51.571492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:51.572188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:51.763577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:51.776370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:51.778988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:51.782249 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b02effde-d08a-4853-86bc-24196e1b7915 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1599 microversion: 2.20 time: 1.180421 Oct 31 15:44:51.783408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2789/5409] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:44:50 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1599 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:44:51.809102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f22cf17-4466-4d43-9520-2315f2d026b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:51.809868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f22cf17-4466-4d43-9520-2315f2d026b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:51.816297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f22cf17-4466-4d43-9520-2315f2d026b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:51.818272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f22cf17-4466-4d43-9520-2315f2d026b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:51.818901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f22cf17-4466-4d43-9520-2315f2d026b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:51.819784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f22cf17-4466-4d43-9520-2315f2d026b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:51.825607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f22cf17-4466-4d43-9520-2315f2d026b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:51.826282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f22cf17-4466-4d43-9520-2315f2d026b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:51.922323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:51.935691 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ed26d00-956c-4201-97ae-c2f7fbdfb504 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1366 microversion: 2.1 time: 0.385027 Oct 31 15:44:51.936322 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2621/5410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:51 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:51.965726 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f22cf17-4466-4d43-9520-2315f2d026b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.160332 Oct 31 15:44:51.975323 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2790/5411] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 31 15:44:51 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:44:52.576130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:52.576918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:52.598298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:52.599331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:52.599800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:52.600983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:52.601607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:52.602041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:52.779028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:52.968717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:52.970019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:52.995572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:52.996204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:52.996657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:52.997610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:52.998225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:52.999000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:53.215951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:53.526860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:53.541275 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6feaa76f-fafe-4ffa-94df-06c7db0c45b0 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1366 microversion: 2.1 time: 0.584943 Oct 31 15:44:53.553165 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2791/5412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:52 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1366 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:53.553382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a9e787ae-c47c-4f84-81e0-a6701a177a73 req-078340ef-9424-450c-930c-eec22f6daee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60fc5ff-f019-45f7-9532-7ad4f10048db", "tag": "8de97a21-18ae-41b0-b670-f2daa3921493"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:53.563572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a9e787ae-c47c-4f84-81e0-a6701a177a73 req-078340ef-9424-450c-930c-eec22f6daee1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:53.565627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a9e787ae-c47c-4f84-81e0-a6701a177a73 req-078340ef-9424-450c-930c-eec22f6daee1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:53.566205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a9e787ae-c47c-4f84-81e0-a6701a177a73 req-078340ef-9424-450c-930c-eec22f6daee1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:53.589958 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a9e787ae-c47c-4f84-81e0-a6701a177a73 req-078340ef-9424-450c-930c-eec22f6daee1 service nova] Creating event network-changed:8de97a21-18ae-41b0-b670-f2daa3921493 for instance f60fc5ff-f019-45f7-9532-7ad4f10048db on n-h2-858384-17 Oct 31 15:44:53.596622 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a9e787ae-c47c-4f84-81e0-a6701a177a73 req-078340ef-9424-450c-930c-eec22f6daee1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047134 Oct 31 15:44:53.598246 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2792/5413] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:53.732805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:53.748237 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a4179ff-fcd1-42e9-b6d4-0c2769e29b14 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1389 microversion: 2.1 time: 1.175897 Oct 31 15:44:53.749393 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2622/5414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:52 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1389 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:53.935462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-2b706e78-277d-4aba-af2e-a464f4795436 req-cf9d3168-1931-4761-ab5b-c41a756fc5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9993bf49-4859-4a8a-b916-c4883a14059c", "name": "network-vif-plugged", "status": "completed", "tag": "cf2bce7c-44ae-4462-8fe1-64047df8f3ea"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:53.947914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2b706e78-277d-4aba-af2e-a464f4795436 req-cf9d3168-1931-4761-ab5b-c41a756fc5ee service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:53.948765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2b706e78-277d-4aba-af2e-a464f4795436 req-cf9d3168-1931-4761-ab5b-c41a756fc5ee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:53.949574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-2b706e78-277d-4aba-af2e-a464f4795436 req-cf9d3168-1931-4761-ab5b-c41a756fc5ee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:53.967585 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-2b706e78-277d-4aba-af2e-a464f4795436 req-cf9d3168-1931-4761-ab5b-c41a756fc5ee service nova] Creating event network-vif-plugged:cf2bce7c-44ae-4462-8fe1-64047df8f3ea for instance 9993bf49-4859-4a8a-b916-c4883a14059c on n-h1-858384-17 Oct 31 15:44:53.974832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-2b706e78-277d-4aba-af2e-a464f4795436 req-cf9d3168-1931-4761-ab5b-c41a756fc5ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044280 Oct 31 15:44:53.976718 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2793/5415] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:54.568861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:54.570168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:54.587099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:54.590318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:54.590766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:54.591497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:54.593192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:54.593778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:54.772738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:54.773631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:54.782427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:54.787528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:54.788240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:54.789078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:54.789732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:54.790396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:55.223245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:55.233619 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c42f2f98-783e-45f1-853f-ba0cb75f3c3e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1366 microversion: 2.1 time: 0.670124 Oct 31 15:44:55.237802 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2623/5416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:54 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1366 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:55.579940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:55.612903 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-befe9695-8623-421f-bebf-db12a12d1488 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1389 microversion: 2.1 time: 0.843015 Oct 31 15:44:55.620924 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2794/5417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:54 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1389 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:56.227958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-be17fe70-3611-477d-822d-85b51d8f8124 req-8189e1b6-3b36-40ba-92ed-5f303423138a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9547ba84-a354-46e2-b2a5-4f3d4d71159d", "tag": "163e80be-44ff-4862-ae47-6ccd8f6a3afa"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:56.259869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:56.260757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:56.268910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-be17fe70-3611-477d-822d-85b51d8f8124 req-8189e1b6-3b36-40ba-92ed-5f303423138a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.269887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-be17fe70-3611-477d-822d-85b51d8f8124 req-8189e1b6-3b36-40ba-92ed-5f303423138a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.270520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.271015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.271452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.271865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-be17fe70-3611-477d-822d-85b51d8f8124 req-8189e1b6-3b36-40ba-92ed-5f303423138a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.272158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.272615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.273034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.306653 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-be17fe70-3611-477d-822d-85b51d8f8124 req-8189e1b6-3b36-40ba-92ed-5f303423138a service nova] Creating event network-changed:163e80be-44ff-4862-ae47-6ccd8f6a3afa for instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d on n-h2-858384-17 Oct 31 15:44:56.315274 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-be17fe70-3611-477d-822d-85b51d8f8124 req-8189e1b6-3b36-40ba-92ed-5f303423138a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107328 Oct 31 15:44:56.318600 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2624/5418] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:44:56.648501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:56.649449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:56.656549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.657047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.657509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.658220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.658646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.659127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.805754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:56.808622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:44:56.818942 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55fd7463-f8cc-40c3-8498-ebf33613854b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1556 microversion: 2.1 time: 0.562467 Oct 31 15:44:56.820500 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2795/5419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:56 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1556 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:56.848265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c99e0a40-b21d-4517-8834-8e46df270f16 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:56.849508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c99e0a40-b21d-4517-8834-8e46df270f16 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:56.856159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c99e0a40-b21d-4517-8834-8e46df270f16 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.861187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c99e0a40-b21d-4517-8834-8e46df270f16 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.864651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c99e0a40-b21d-4517-8834-8e46df270f16 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:56.867667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c99e0a40-b21d-4517-8834-8e46df270f16 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:56.869686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c99e0a40-b21d-4517-8834-8e46df270f16 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:56.871272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c99e0a40-b21d-4517-8834-8e46df270f16 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:57.159190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:57.176346 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2477c794-ff55-4b91-925f-98d87f6b2f40 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1389 microversion: 2.1 time: 0.535280 Oct 31 15:44:57.205451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2625/5420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:56 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1389 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:44:57.414198 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c99e0a40-b21d-4517-8834-8e46df270f16 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.570755 Oct 31 15:44:57.414879 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2796/5421] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:44:56 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-interface => generated 284 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:57.662905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7844f1f-48ce-4f82-8a63-636d074df62d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Action: 'create', calling method: .version_select at 0x7f16e0e8c310>, body: {"keypair": {"name": "tempest-keypair-1547373323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBBN7PDKxj1mCCRhTrkocnvo3tiOen6cRjvNio0T4XgPgGGTj/VGI9V9KMUp8+xJuRRetoDHwnibOV35Hj4trNb3lHQs3evHIzQRV8sh9NjRd4rBZ5C5p+fzJbwiCY+ZA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:44:57.701099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e7844f1f-48ce-4f82-8a63-636d074df62d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Getting quotas for project 61ea6a909ace44749ebae7b1dff990ba. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:44:57.713686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e7844f1f-48ce-4f82-8a63-636d074df62d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Getting quotas for user 8d9c0276eba84fe691a3028b7b4a02a4 and project 61ea6a909ace44749ebae7b1dff990ba. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:44:57.764902 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7844f1f-48ce-4f82-8a63-636d074df62d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.363200 Oct 31 15:44:57.765936 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2626/5422] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:44:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:44:58.204498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:58.205018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:58.218214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:58.218722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:58.219164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:58.219898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:58.220364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:58.220796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:58.451621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:58.469996 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1067ee49-8342-4561-85d0-a3bba0037477 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1389 microversion: 2.1 time: 0.269365 Oct 31 15:44:58.471005 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2797/5423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:58 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1389 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:44:59.499351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:44:59.500090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:44:59.522172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:59.522963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:59.523883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:59.524836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:44:59.525543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:44:59.526194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:44:59.904207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:44:59.934961 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aecff012-9a2d-4a7c-b6f1-410a1207d7a0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1389 microversion: 2.1 time: 0.439621 Oct 31 15:44:59.936930 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2627/5424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:44:59 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1389 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:00.910925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fb289c00-25ba-49ee-8ba3-c5736bd90e2d req-d8272525-9c0b-4d57-81ba-22307edccb9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9993bf49-4859-4a8a-b916-c4883a14059c", "tag": "cf2bce7c-44ae-4462-8fe1-64047df8f3ea"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:00.933565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fb289c00-25ba-49ee-8ba3-c5736bd90e2d req-d8272525-9c0b-4d57-81ba-22307edccb9d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:00.934512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fb289c00-25ba-49ee-8ba3-c5736bd90e2d req-d8272525-9c0b-4d57-81ba-22307edccb9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:00.935189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fb289c00-25ba-49ee-8ba3-c5736bd90e2d req-d8272525-9c0b-4d57-81ba-22307edccb9d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:00.953872 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fb289c00-25ba-49ee-8ba3-c5736bd90e2d req-d8272525-9c0b-4d57-81ba-22307edccb9d service nova] Creating event network-changed:cf2bce7c-44ae-4462-8fe1-64047df8f3ea for instance 9993bf49-4859-4a8a-b916-c4883a14059c on n-h1-858384-17 Oct 31 15:45:00.967232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:00.968446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:00.969191 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fb289c00-25ba-49ee-8ba3-c5736bd90e2d req-d8272525-9c0b-4d57-81ba-22307edccb9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061832 Oct 31 15:45:00.970369 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2798/5425] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:00.978081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:00.979081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:00.979904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:00.980812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:00.981556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:00.982531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:01.325310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:01.328488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:01.342293 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5527679-9b01-4c7f-ae17-a08014938d83 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1389 microversion: 2.1 time: 0.380501 Oct 31 15:45:01.352139 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2628/5426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:00 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1389 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:02.065346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3ad48924-930b-40ae-a06f-32d739a2c54a req-389966a1-52d6-40e3-8fa9-06d9dec02fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60fc5ff-f019-45f7-9532-7ad4f10048db", "name": "network-vif-plugged", "status": "completed", "tag": "8de97a21-18ae-41b0-b670-f2daa3921493"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:02.091322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3ad48924-930b-40ae-a06f-32d739a2c54a req-389966a1-52d6-40e3-8fa9-06d9dec02fba service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:02.091817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3ad48924-930b-40ae-a06f-32d739a2c54a req-389966a1-52d6-40e3-8fa9-06d9dec02fba service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:02.097064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3ad48924-930b-40ae-a06f-32d739a2c54a req-389966a1-52d6-40e3-8fa9-06d9dec02fba service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:02.130006 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3ad48924-930b-40ae-a06f-32d739a2c54a req-389966a1-52d6-40e3-8fa9-06d9dec02fba service nova] Creating event network-vif-plugged:8de97a21-18ae-41b0-b670-f2daa3921493 for instance f60fc5ff-f019-45f7-9532-7ad4f10048db on n-h2-858384-17 Oct 31 15:45:02.135980 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3ad48924-930b-40ae-a06f-32d739a2c54a req-389966a1-52d6-40e3-8fa9-06d9dec02fba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077662 Oct 31 15:45:02.136853 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2799/5427] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:02.389692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:02.391039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:02.416690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:02.417220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:02.418301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:02.419022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:02.419484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:02.419907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:02.795035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:02.807197 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5bae24f0-0210-4204-94a2-0c862d8ff4c0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1389 microversion: 2.1 time: 0.431063 Oct 31 15:45:02.808417 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2629/5428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:02 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1389 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:03.835989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:03.837616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:03.855110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:03.855889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:03.857921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:03.858880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:03.860959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:03.861611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:04.137426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-657523529", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0ce6d1d9-965c-4c01-83dd-0687f33185f9"}], "security_groups": [{"name": "tempest-securitygroup--914512920"}], "key_name": "tempest-keypair-1547373323", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:04.239235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:04.262852 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87360f70-427f-431a-98d2-80f1f7c44f53 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1561 microversion: 2.1 time: 0.432607 Oct 31 15:45:04.265172 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2800/5429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:03 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1561 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:04.288953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:04.289850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:04.296640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:04.297455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:04.298412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:04.299342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:04.299960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:04.300825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:04.384805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] validate_networks() for [('0ce6d1d9-965c-4c01-83dd-0687f33185f9', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:45:04.760941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:04.772699 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e94da5f8-2a49-48fb-adb5-c7a046205d9e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1561 microversion: 2.1 time: 0.488006 Oct 31 15:45:04.775701 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2801/5430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:04 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1561 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:05.963812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Getting quotas for project 61ea6a909ace44749ebae7b1dff990ba. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:05.970147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Getting quotas for user 8d9c0276eba84fe691a3028b7b4a02a4 and project 61ea6a909ace44749ebae7b1dff990ba. Resources: dict_keys(['metadata_items']) {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:05.983453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:45:05.983872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:45:05.984341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:45:05.984743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:45:05.985171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:45:05.994023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:05.994744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:05.995359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:05.996104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:05.996559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:05.997164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:06.016018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Getting quotas for project 61ea6a909ace44749ebae7b1dff990ba. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:06.022827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Getting quotas for user 8d9c0276eba84fe691a3028b7b4a02a4 and project 61ea6a909ace44749ebae7b1dff990ba. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:06.037020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:45:06.039473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:45:06.097830 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9cb11cbc-36e1-4a37-aa88-53c5b9d62987 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.966614 Oct 31 15:45:06.098884 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2630/5431] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:45:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:45:06.111825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0aa3311-ec2c-43d5-95f9-f753b3c790bc tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:06.114591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b0aa3311-ec2c-43d5-95f9-f753b3c790bc tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:06.193745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b0aa3311-ec2c-43d5-95f9-f753b3c790bc tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:06.201798 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b0aa3311-ec2c-43d5-95f9-f753b3c790bc tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1269 microversion: 2.1 time: 0.095475 Oct 31 15:45:06.219100 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2802/5432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:06 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:07.230233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:07.230857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:07.251401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:07.251910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:07.252349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:07.254041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:07.254321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:07.254763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:07.496866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:07.521256 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e3c70799-3c49-4a97-a952-4afb763e8247 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1321 microversion: 2.1 time: 0.296675 Oct 31 15:45:07.523764 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2631/5433] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:07 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:08.399602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:08.400356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:08.416056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=54 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:08.417781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:08.418944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:08.419561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:08.422662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-302f7d08-8520-46ec-9d95-9454f6b3e5c9 req-de5cdf22-a7e3-4f64-a177-29638e616360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60fc5ff-f019-45f7-9532-7ad4f10048db", "tag": "8de97a21-18ae-41b0-b670-f2daa3921493"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:08.423182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:08.429520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:08.429982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:08.439411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:08.445317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-302f7d08-8520-46ec-9d95-9454f6b3e5c9 req-de5cdf22-a7e3-4f64-a177-29638e616360 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:08.449827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-302f7d08-8520-46ec-9d95-9454f6b3e5c9 req-de5cdf22-a7e3-4f64-a177-29638e616360 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:08.450503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-302f7d08-8520-46ec-9d95-9454f6b3e5c9 req-de5cdf22-a7e3-4f64-a177-29638e616360 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:08.471183 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-302f7d08-8520-46ec-9d95-9454f6b3e5c9 req-de5cdf22-a7e3-4f64-a177-29638e616360 service nova] Creating event network-changed:8de97a21-18ae-41b0-b670-f2daa3921493 for instance f60fc5ff-f019-45f7-9532-7ad4f10048db on n-h2-858384-17 Oct 31 15:45:08.492396 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-302f7d08-8520-46ec-9d95-9454f6b3e5c9 req-de5cdf22-a7e3-4f64-a177-29638e616360 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073216 Oct 31 15:45:08.493649 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2632/5434] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:08.552422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:08.553204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:08.573082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:08.573843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:08.574438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:08.575313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:08.575937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:08.576512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:08.775953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:08.785339 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d553dbb0-3523-4f44-af93-1adec22ea508 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1327 microversion: 2.1 time: 0.237558 Oct 31 15:45:08.798340 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2633/5435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:08 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1327 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:08.855724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:08.881687 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d6a4ecb8-6e46-4f97-bccc-7a04b2006865 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1561 microversion: 2.1 time: 0.486280 Oct 31 15:45:08.904815 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2803/5436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:08 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1561 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:09.823852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:09.824697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:09.849212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:09.849730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:09.850180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:09.854559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:09.855307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:09.856354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:10.392423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:10.401823 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9281a2df-a6f5-4eaa-8594-71d3c4f52f45 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1394 microversion: 2.1 time: 0.585556 Oct 31 15:45:10.402717 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2634/5437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:09 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1394 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:10.742720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e9115c94-8153-437d-a95b-b9adcb0f0169 req-824f85d3-a867-4938-88ec-7cfd363fab09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f31f49-8600-4322-ad3e-a09431fbd250", "tag": "60c43b16-9f2c-4f34-bd11-03060bdf333b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:10.798286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e9115c94-8153-437d-a95b-b9adcb0f0169 req-824f85d3-a867-4938-88ec-7cfd363fab09 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:10.801919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e9115c94-8153-437d-a95b-b9adcb0f0169 req-824f85d3-a867-4938-88ec-7cfd363fab09 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:10.802724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e9115c94-8153-437d-a95b-b9adcb0f0169 req-824f85d3-a867-4938-88ec-7cfd363fab09 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:10.826226 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e9115c94-8153-437d-a95b-b9adcb0f0169 req-824f85d3-a867-4938-88ec-7cfd363fab09 service nova] Creating event network-changed:60c43b16-9f2c-4f34-bd11-03060bdf333b for instance 75f31f49-8600-4322-ad3e-a09431fbd250 on n-h1-858384-17 Oct 31 15:45:10.841659 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e9115c94-8153-437d-a95b-b9adcb0f0169 req-824f85d3-a867-4938-88ec-7cfd363fab09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107381 Oct 31 15:45:10.844104 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2804/5438] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:11.432624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:11.434006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:11.441438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:11.442273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:11.442713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:11.443408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:11.444010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:11.444600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:11.829999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:11.860781 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70c33ead-b79f-4cb5-9aa3-68441ec7a091 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1394 microversion: 2.1 time: 0.434281 Oct 31 15:45:11.861947 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2635/5439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:11 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1394 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:12.888750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:12.889487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:12.897417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:12.898165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:12.898883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:12.899717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:12.900321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:12.900890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:13.669685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:13.680670 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6213ff1b-31d6-402d-93de-c1b9672575df tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1394 microversion: 2.1 time: 0.794011 Oct 31 15:45:13.681345 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2805/5440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:12 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1394 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:14.704936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:14.706518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:14.734960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:14.739766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:14.740661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:14.742810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:14.744234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:14.746714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:15.137471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:15.146079 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be46877a-b353-4348-827b-3a60f2f49f33 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1394 microversion: 2.1 time: 0.444944 Oct 31 15:45:15.156336 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2636/5441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:14 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1394 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:16.171599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:16.172207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:16.186117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:16.186607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:16.187078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:16.187784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:16.188236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:16.201638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:16.202377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:16.640423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:16.651892 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-00cb4ff0-7d6f-43f4-a569-94a7069aab1d tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1394 microversion: 2.1 time: 0.483270 Oct 31 15:45:16.652260 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2806/5442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:16 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1394 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:17.661667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6b328230-ac23-497f-bab4-857343a246c2 req-9028f8b8-c928-496e-b0d0-dc04ef075c25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f31f49-8600-4322-ad3e-a09431fbd250", "name": "network-vif-plugged", "status": "completed", "tag": "60c43b16-9f2c-4f34-bd11-03060bdf333b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:17.667915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:17.668515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:17.677151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:17.678366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:17.684216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6b328230-ac23-497f-bab4-857343a246c2 req-9028f8b8-c928-496e-b0d0-dc04ef075c25 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:17.686039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6b328230-ac23-497f-bab4-857343a246c2 req-9028f8b8-c928-496e-b0d0-dc04ef075c25 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:17.686739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6b328230-ac23-497f-bab4-857343a246c2 req-9028f8b8-c928-496e-b0d0-dc04ef075c25 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:17.697640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:17.698135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:17.698580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:17.699299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:17.699755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:17.700178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:17.714509 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6b328230-ac23-497f-bab4-857343a246c2 req-9028f8b8-c928-496e-b0d0-dc04ef075c25 service nova] Creating event network-vif-plugged:60c43b16-9f2c-4f34-bd11-03060bdf333b for instance 75f31f49-8600-4322-ad3e-a09431fbd250 on n-h1-858384-17 Oct 31 15:45:17.725919 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6b328230-ac23-497f-bab4-857343a246c2 req-9028f8b8-c928-496e-b0d0-dc04ef075c25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068325 Oct 31 15:45:17.728279 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2637/5443] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:18.162348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:18.170779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b620240-1034-4359-9703-f201dcc90336 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1394 microversion: 2.1 time: 0.498513 Oct 31 15:45:18.178607 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2807/5444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:17 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1394 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:19.204684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:19.205535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:19.219584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:19.221715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:19.223926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:19.226576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:19.228330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:19.229506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:19.570483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:19.582469 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f9e4733-0881-49fe-a8f8-0e49e12f4352 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1394 microversion: 2.1 time: 0.382896 Oct 31 15:45:19.594911 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2638/5445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:19 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1394 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:20.613613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:20.615137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:20.628195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:20.629038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:20.631454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:20.633715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:20.634590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:20.638997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:20.961266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:20.972210 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6095c82-45e8-47ca-95b0-875ce8a74425 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1574 microversion: 2.1 time: 0.363201 Oct 31 15:45:20.982292 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2808/5446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:20 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1574 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:21.005245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-90eafbb0-0adb-446f-81c1-64ea5766e190 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:21.005763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-90eafbb0-0adb-446f-81c1-64ea5766e190 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:21.015238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90eafbb0-0adb-446f-81c1-64ea5766e190 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:21.015746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90eafbb0-0adb-446f-81c1-64ea5766e190 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:21.016190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90eafbb0-0adb-446f-81c1-64ea5766e190 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:21.016906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90eafbb0-0adb-446f-81c1-64ea5766e190 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:21.020417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90eafbb0-0adb-446f-81c1-64ea5766e190 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:21.021026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90eafbb0-0adb-446f-81c1-64ea5766e190 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:21.221240 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-90eafbb0-0adb-446f-81c1-64ea5766e190 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220086 Oct 31 15:45:21.222910 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2639/5447] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:45:20 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250/os-interface => generated 284 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:23.040624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:23.042949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:23.061529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:23.063131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:23.067776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:23.068812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:23.070399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:23.071019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:23.193914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-dc21a5c3-38cf-4b05-9b15-9d0f0054a51a req-6abc622e-b8d6-4b31-8be4-be9064c91450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f31f49-8600-4322-ad3e-a09431fbd250", "tag": "60c43b16-9f2c-4f34-bd11-03060bdf333b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:23.215171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dc21a5c3-38cf-4b05-9b15-9d0f0054a51a req-6abc622e-b8d6-4b31-8be4-be9064c91450 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:23.215667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dc21a5c3-38cf-4b05-9b15-9d0f0054a51a req-6abc622e-b8d6-4b31-8be4-be9064c91450 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:23.216110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dc21a5c3-38cf-4b05-9b15-9d0f0054a51a req-6abc622e-b8d6-4b31-8be4-be9064c91450 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:23.240492 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-dc21a5c3-38cf-4b05-9b15-9d0f0054a51a req-6abc622e-b8d6-4b31-8be4-be9064c91450 service nova] Creating event network-changed:60c43b16-9f2c-4f34-bd11-03060bdf333b for instance 75f31f49-8600-4322-ad3e-a09431fbd250 on n-h1-858384-17 Oct 31 15:45:23.247070 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-dc21a5c3-38cf-4b05-9b15-9d0f0054a51a req-6abc622e-b8d6-4b31-8be4-be9064c91450 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062261 Oct 31 15:45:23.248261 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2640/5448] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:45:23.520569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:23.529089 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f34d8b6e-c108-418d-a38d-d79b764163ed tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1574 microversion: 2.1 time: 0.492225 Oct 31 15:45:23.551503 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2809/5449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:23 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1574 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:28.282241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-65a0462f-7391-4ae3-99e2-2f9a1ae3fc93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:28.283018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-65a0462f-7391-4ae3-99e2-2f9a1ae3fc93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:28.289278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65a0462f-7391-4ae3-99e2-2f9a1ae3fc93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:28.289776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65a0462f-7391-4ae3-99e2-2f9a1ae3fc93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:28.290565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65a0462f-7391-4ae3-99e2-2f9a1ae3fc93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:28.290920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65a0462f-7391-4ae3-99e2-2f9a1ae3fc93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:28.291384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65a0462f-7391-4ae3-99e2-2f9a1ae3fc93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:28.291805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65a0462f-7391-4ae3-99e2-2f9a1ae3fc93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:28.323462 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-65a0462f-7391-4ae3-99e2-2f9a1ae3fc93 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/ips" status: 200 len: 150 microversion: 2.1 time: 0.046583 Oct 31 15:45:28.324216 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2641/5450] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:45:28 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:29.019697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67a94fd5-8c3c-4fd0-aa04-62d492cb7e7e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:29.020374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67a94fd5-8c3c-4fd0-aa04-62d492cb7e7e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:29.028243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67a94fd5-8c3c-4fd0-aa04-62d492cb7e7e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:29.029024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67a94fd5-8c3c-4fd0-aa04-62d492cb7e7e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:29.029701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67a94fd5-8c3c-4fd0-aa04-62d492cb7e7e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:29.031093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67a94fd5-8c3c-4fd0-aa04-62d492cb7e7e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:29.031762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67a94fd5-8c3c-4fd0-aa04-62d492cb7e7e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:29.032522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67a94fd5-8c3c-4fd0-aa04-62d492cb7e7e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:29.060758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=66 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:29.067372 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67a94fd5-8c3c-4fd0-aa04-62d492cb7e7e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/ips" status: 200 len: 151 microversion: 2.20 time: 0.053466 Oct 31 15:45:29.068498 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2810/5451] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Oct 31 15:45:29 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/ips => generated 151 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:45:29.649956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a8e9bd2e-f00b-4068-ab2b-5577d5922fea tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:29.653476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a8e9bd2e-f00b-4068-ab2b-5577d5922fea tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:29.667382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8e9bd2e-f00b-4068-ab2b-5577d5922fea tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:29.668522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8e9bd2e-f00b-4068-ab2b-5577d5922fea tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:29.669388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8e9bd2e-f00b-4068-ab2b-5577d5922fea tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:29.670373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8e9bd2e-f00b-4068-ab2b-5577d5922fea tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:29.671005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8e9bd2e-f00b-4068-ab2b-5577d5922fea tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:29.671863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8e9bd2e-f00b-4068-ab2b-5577d5922fea tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:29.746752 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a8e9bd2e-f00b-4068-ab2b-5577d5922fea tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db/action" status: 200 len: 24570 microversion: 2.1 time: 0.102292 Oct 31 15:45:29.747839 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2642/5452] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:45:29 2022] POST /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db/action => generated 24570 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:45:30.998215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc2ed70b-9332-453d-a683-1c06349bceee tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9492625c-e6e9-4f55-b343-6dd09397df7c"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:31.001236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc2ed70b-9332-453d-a683-1c06349bceee tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:31.022166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2ed70b-9332-453d-a683-1c06349bceee tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:31.022671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2ed70b-9332-453d-a683-1c06349bceee tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:31.023113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2ed70b-9332-453d-a683-1c06349bceee tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:31.023831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2ed70b-9332-453d-a683-1c06349bceee tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:31.024284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2ed70b-9332-453d-a683-1c06349bceee tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:31.024963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2ed70b-9332-453d-a683-1c06349bceee tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:31.448762 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc2ed70b-9332-453d-a683-1c06349bceee tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.456177 Oct 31 15:45:31.449798 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2811/5453] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:45:30 2022] POST /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:32.232624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:32.233461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:32.251426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:32.252522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:32.253113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:32.256665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:32.258132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:32.258742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:32.308469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lazy-loading 'flavor' on Instance uuid 9547ba84-a354-46e2-b2a5-4f3d4d71159d {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:45:32.433633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:32.812982 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a2b8a64-724c-458d-8063-ecbce001210c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/action" status: 202 len: 0 microversion: 2.20 time: 0.584034 Oct 31 15:45:32.813685 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2643/5454] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:45:32 2022] POST /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:45:32.827270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:32.828041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:32.844935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:32.847575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:32.848406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:32.851416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:32.852341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:32.853027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:33.241186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:33.251229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:33.255676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:33.256928 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6b92c802-dba6-489d-a03d-412d893fbb88 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.437996 Oct 31 15:45:33.268352 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2812/5455] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:32 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:34.293220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:34.295101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:34.310080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:34.310976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:34.311636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:34.312578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:34.313986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:34.316926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:34.816995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:34.828259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:34.832159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:34.836512 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f2576564-ef81-49ec-b657-65d8800e6ae2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.547219 Oct 31 15:45:34.854655 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2644/5456] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:34 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:35.880989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:35.883300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:35.897843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:35.898633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:35.901820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:35.902758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:35.907508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:35.908709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:36.385983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:36.403871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:36.406986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:36.410058 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55107b9f-3091-4a14-b486-0e71cc4cddd0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.546757 Oct 31 15:45:36.411448 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2813/5457] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:35 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:37.436429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:37.437803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:37.454795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:37.456356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:37.457037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:37.460818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:37.461553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:37.467038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:37.795444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:37.811034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:37.812794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:37.814636 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a95b58e9-5c26-4ad5-932a-60177639b5a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.382440 Oct 31 15:45:37.816920 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2645/5458] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:37 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:38.845892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:38.846856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:38.860178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=22 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:38.881112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:38.883117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:38.883588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:38.891295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:38.901167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:38.911131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:39.318597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:39.328187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:39.332224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:39.335955 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-07af022c-1407-440e-af2e-2f68405273a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.494542 Oct 31 15:45:39.363319 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2814/5459] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:38 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:40.371544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:40.372830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:40.376117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=28 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:40.383570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:40.384312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:40.384938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:40.386038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:40.386714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:40.387377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:40.568502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:40.578639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:40.580499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:40.582020 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70985003-c836-48b3-bd30-fe3d3b5a6d2f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.215097 Oct 31 15:45:40.583220 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2646/5460] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:40 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:40.844557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:40.845202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:40.855801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:40.856568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:40.857343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:40.858278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:40.858941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:40.859870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.328551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:41.339357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af5904c7-f02c-4714-91e6-6b870b976d77 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1679 microversion: 2.1 time: 0.499443 Oct 31 15:45:41.353543 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2815/5461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:40 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1679 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:41.461452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c13d680-0d89-439d-bcdd-c73a46ae4417 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:41.463862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c13d680-0d89-439d-bcdd-c73a46ae4417 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:41.476904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c13d680-0d89-439d-bcdd-c73a46ae4417 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.477399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c13d680-0d89-439d-bcdd-c73a46ae4417 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.478240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c13d680-0d89-439d-bcdd-c73a46ae4417 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.478952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c13d680-0d89-439d-bcdd-c73a46ae4417 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.479863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c13d680-0d89-439d-bcdd-c73a46ae4417 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.480447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c13d680-0d89-439d-bcdd-c73a46ae4417 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.555923 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c13d680-0d89-439d-bcdd-c73a46ae4417 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db/action" status: 200 len: 32630 microversion: 2.1 time: 0.096943 Oct 31 15:45:41.566773 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2647/5462] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:45:41 2022] POST /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db/action => generated 32630 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:45:41.607858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:41.617061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:41.627190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.628711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.629593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.632281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.633034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.633657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.746925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ee46d96-6137-43b0-bdfd-930f4fa7a656 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:41.747977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ee46d96-6137-43b0-bdfd-930f4fa7a656 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:41.764896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ee46d96-6137-43b0-bdfd-930f4fa7a656 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.766214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ee46d96-6137-43b0-bdfd-930f4fa7a656 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.767079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ee46d96-6137-43b0-bdfd-930f4fa7a656 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:41.771533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ee46d96-6137-43b0-bdfd-930f4fa7a656 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:41.772631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ee46d96-6137-43b0-bdfd-930f4fa7a656 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:41.773393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ee46d96-6137-43b0-bdfd-930f4fa7a656 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:42.018498 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ee46d96-6137-43b0-bdfd-930f4fa7a656 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1832 microversion: 2.1 time: 0.276411 Oct 31 15:45:42.019902 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2648/5463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:41 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1832 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:42.047311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:42.052043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:42.054936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:42.062939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:42.063744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:42.064421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:42.065385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:42.066761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:42.067600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:42.068255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:42.068494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:42.069818 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f68f6202-51ed-4447-b4f1-d9288ad026b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.465938 Oct 31 15:45:42.071018 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2816/5464] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:41 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:42.112171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lazy-loading 'flavor' on Instance uuid f60fc5ff-f019-45f7-9532-7ad4f10048db {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:45:42.127293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Going to try to live migrate instance to another host {{(pid=120588) live_migrate /opt/stack/nova/nova/compute/api.py:5483}} Oct 31 15:45:43.098759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:43.099374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:43.109699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:43.110450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:43.111110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:43.112056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:43.112677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:43.113294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:43.327040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:43.337171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:43.338949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:43.340163 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f675eb3-d89f-4a91-9302-26c5ccad2492 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.246397 Oct 31 15:45:43.340750 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2817/5465] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:43 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:44.374217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:44.379114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:44.394439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:44.395972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:44.396418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:44.400144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:44.400991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:44.403090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:44.803750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:44.813477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:44.821841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:44.823619 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-81418c2f-91d7-407a-bc10-fe2697097121 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1744 microversion: 2.20 time: 0.460010 Oct 31 15:45:44.838305 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2818/5466] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:44 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1744 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:45.856013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:45.856866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:45.871846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:45.872341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:45.872774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:45.873516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:45.873977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:45.874402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:46.260335 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ca9c517-9fb8-4ad8-b4b7-577fd627d2a7 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db/action" status: 202 len: 0 microversion: 2.1 time: 4.212478 Oct 31 15:45:46.264155 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2649/5467] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:45:42 2022] POST /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db/action => generated 0 bytes in 4218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:45:46.276791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-000707d4-cd83-43d0-8e5c-269b9f3c39aa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: .version_select at 0x7f16e56ad4c0>, body: {"keypair": {"name": "tempest-keypair-792222358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArdLiar5llG+ioHT8hkDrqm94Adf0CmBFvOBSD7HilaaXXxA6wLywPla30toCyRHHglo/1twc5d6ORU/a5d5AZFhD2zTbHYOiKz++I8+NIqk+XDw09I9lpnIFTVV3nyQQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:46.340090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-000707d4-cd83-43d0-8e5c-269b9f3c39aa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for project bb201c74554c43f0a526161cf24206f3. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:46.352011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-000707d4-cd83-43d0-8e5c-269b9f3c39aa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for user a5bfcc2112ea47dcb758487de253311f and project bb201c74554c43f0a526161cf24206f3. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:46.379297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:46.390690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:46.392958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:46.400489 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-10ea02e5-edd3-4c4f-9a60-df831021e060 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.548410 Oct 31 15:45:46.401095 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2819/5468] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:45 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:46.430969 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-000707d4-cd83-43d0-8e5c-269b9f3c39aa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165234 Oct 31 15:45:46.433084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:46.434544 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2650/5469] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:45:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:46.435956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:46.463284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:46.465994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:46.469565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:46.470661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:46.471331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:46.474618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:47.433468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:47.435092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:47.446374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:47.447295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:47.447876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:47.448818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:47.449377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:47.449907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:47.715329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:47.734762 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e5e5440c-74a2-4fa1-95fa-b145cda4d055 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1689 microversion: 2.1 time: 1.319995 Oct 31 15:45:47.739965 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2820/5470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:46 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1689 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:47.775421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:47.786071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:47.792019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:47.799370 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c325f6b-26f5-4d1b-a26e-6427d88f25f7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.372165 Oct 31 15:45:47.800088 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2651/5471] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:47 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:48.129408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-84d191aa-c4b1-425f-b970-ea41fc128096 req-9d7b7e38-d1e5-4196-babb-27541d3c3efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9547ba84-a354-46e2-b2a5-4f3d4d71159d", "name": "network-vif-plugged", "status": "completed", "tag": "163e80be-44ff-4862-ae47-6ccd8f6a3afa"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:48.153497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-84d191aa-c4b1-425f-b970-ea41fc128096 req-9d7b7e38-d1e5-4196-babb-27541d3c3efa service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:48.155870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-84d191aa-c4b1-425f-b970-ea41fc128096 req-9d7b7e38-d1e5-4196-babb-27541d3c3efa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:48.157150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-84d191aa-c4b1-425f-b970-ea41fc128096 req-9d7b7e38-d1e5-4196-babb-27541d3c3efa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:48.201350 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-84d191aa-c4b1-425f-b970-ea41fc128096 req-9d7b7e38-d1e5-4196-babb-27541d3c3efa service nova] Creating event network-vif-plugged:163e80be-44ff-4862-ae47-6ccd8f6a3afa for instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d on n-h2-858384-17 Oct 31 15:45:48.216385 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-84d191aa-c4b1-425f-b970-ea41fc128096 req-9d7b7e38-d1e5-4196-babb-27541d3c3efa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096148 Oct 31 15:45:48.220716 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2821/5472] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:48.771067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:48.772500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:48.790868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:48.791791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:48.792389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:48.795248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:48.796384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:48.796986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:48.830840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:48.832578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:48.875127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:48.877895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:48.879382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:48.882186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:48.883629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:48.885683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:49.461110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:49.472668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:49.478031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:49.479387 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29cd9397-1827-4367-ad5a-37f7dadca24b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.655957 Oct 31 15:45:49.484433 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2822/5473] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:48 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:49.509368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:49.537453 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f5b122a-b1f6-4f14-9b55-8dff766afd36 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1689 microversion: 2.1 time: 0.759288 Oct 31 15:45:49.542548 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2652/5474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:48 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1689 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:50.137832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c4ad270d-ac39-4da0-9abc-c9925d70a019 req-cc8eab9c-a5ba-496a-8aef-cb1a7e72545f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60fc5ff-f019-45f7-9532-7ad4f10048db", "name": "network-vif-unplugged", "status": "completed", "tag": "8de97a21-18ae-41b0-b670-f2daa3921493"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:50.155123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c4ad270d-ac39-4da0-9abc-c9925d70a019 req-cc8eab9c-a5ba-496a-8aef-cb1a7e72545f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:50.155657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c4ad270d-ac39-4da0-9abc-c9925d70a019 req-cc8eab9c-a5ba-496a-8aef-cb1a7e72545f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:50.156094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c4ad270d-ac39-4da0-9abc-c9925d70a019 req-cc8eab9c-a5ba-496a-8aef-cb1a7e72545f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:50.192544 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c4ad270d-ac39-4da0-9abc-c9925d70a019 req-cc8eab9c-a5ba-496a-8aef-cb1a7e72545f service nova] Creating event network-vif-unplugged:8de97a21-18ae-41b0-b670-f2daa3921493 for instance f60fc5ff-f019-45f7-9532-7ad4f10048db on n-h2-858384-17 Oct 31 15:45:50.198751 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c4ad270d-ac39-4da0-9abc-c9925d70a019 req-cc8eab9c-a5ba-496a-8aef-cb1a7e72545f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064583 Oct 31 15:45:50.205583 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2823/5475] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:50.515541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:50.516150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:50.534426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:50.535129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:50.535758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:50.538050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:50.540236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:50.540819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:50.578103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:50.579084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:50.602983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:50.605259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:50.605783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:50.607816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:50.609381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:50.611765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:50.892288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:50.917096 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a8ebceec-f8a5-469e-ae0a-a1df072da0c9 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1689 microversion: 2.1 time: 0.343573 Oct 31 15:45:50.934407 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2824/5476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:50 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1689 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:51.396502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:51.420923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:51.422778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:51.429403 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1af40159-8d8e-4728-9981-1c7db4acf15f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.916938 Oct 31 15:45:51.430397 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2653/5477] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:50 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:51.947563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:51.948993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:51.974366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:51.976061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:51.979605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:51.980665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:51.984015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:51.984725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:52.284586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-de264c85-aba9-42df-8839-8989356616dc req-a54a702c-c136-4834-a26a-ce28799bb7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60fc5ff-f019-45f7-9532-7ad4f10048db", "tag": "8de97a21-18ae-41b0-b670-f2daa3921493"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:52.308766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-de264c85-aba9-42df-8839-8989356616dc req-a54a702c-c136-4834-a26a-ce28799bb7fa service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:52.309689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-de264c85-aba9-42df-8839-8989356616dc req-a54a702c-c136-4834-a26a-ce28799bb7fa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:52.310378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-de264c85-aba9-42df-8839-8989356616dc req-a54a702c-c136-4834-a26a-ce28799bb7fa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:52.328694 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-de264c85-aba9-42df-8839-8989356616dc req-a54a702c-c136-4834-a26a-ce28799bb7fa service nova] Creating event network-changed:8de97a21-18ae-41b0-b670-f2daa3921493 for instance f60fc5ff-f019-45f7-9532-7ad4f10048db on n-h2-858384-17 Oct 31 15:45:52.336468 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-de264c85-aba9-42df-8839-8989356616dc req-a54a702c-c136-4834-a26a-ce28799bb7fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055694 Oct 31 15:45:52.337902 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2654/5478] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:52.457181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:52.458340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:52.472224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:52.473785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:52.478153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:52.479256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:52.479523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:52.480222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:52.481056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:52.493514 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b640ad65-66a0-4b83-846a-8e38f7836773 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1689 microversion: 2.1 time: 0.553174 Oct 31 15:45:52.494438 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2825/5479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:51 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1689 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:52.753195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-223208765", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f438d2d0-1357-4e21-b1cc-6088b00737d1"}], "security_groups": [{"name": "tempest-securitygroup--1093222869"}], "key_name": "tempest-keypair-792222358", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:45:53.284200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:53.299051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:53.308015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:53.309678 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b06f5a5-bf05-4410-b146-ca993a842e60 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.857415 Oct 31 15:45:53.312741 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2655/5480] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:52 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:53.420107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] validate_networks() for [('f438d2d0-1357-4e21-b1cc-6088b00737d1', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:45:53.520792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:53.521767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:53.546991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:53.548799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:53.549546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:53.550526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:53.553922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:53.554986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:53.956978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:53.973496 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e94f6e4-20ef-4034-98dc-0001e24c0daf tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1689 microversion: 2.1 time: 0.455645 Oct 31 15:45:53.976628 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2656/5481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:53 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1689 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:54.342687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:54.343356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:54.353264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:54.353769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:54.354221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:54.354949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:54.355413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:54.355858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:54.724942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:54.742986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:54.749811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:54.752297 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-31d0f5e3-f64a-4628-bccf-5a7735f53917 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.413407 Oct 31 15:45:54.767328 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2657/5482] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:54 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:54.999770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:55.000390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:55.013452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.013952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.014392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.022904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.023482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.023938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.582450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:55.596258 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae1d8bbe-d5c6-4524-b44c-7e934d9ad271 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1689 microversion: 2.1 time: 0.600336 Oct 31 15:45:55.596869 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2658/5483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:54 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1689 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:55.622201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:45:55.622720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:45:55.623106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:45:55.623523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:45:55.623932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:45:55.647303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.648093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.648241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.648971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.652207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.652207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.699078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for project bb201c74554c43f0a526161cf24206f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:45:55.705438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for user a5bfcc2112ea47dcb758487de253311f and project bb201c74554c43f0a526161cf24206f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:45:55.720954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:45:55.723747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:45:55.781588 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc4ce5d8-c83a-49bb-b222-a8250b505c63 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.034108 Oct 31 15:45:55.783284 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2826/5484] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:45:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 3036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:45:55.786781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:55.787677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:55.796733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.797510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.798543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.799699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:55.800322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:55.801000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:55.803002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78f43326-ec93-4ccd-81ae-dc4cc607da6f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:55.806184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78f43326-ec93-4ccd-81ae-dc4cc607da6f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:55.903597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78f43326-ec93-4ccd-81ae-dc4cc607da6f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:55.914694 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78f43326-ec93-4ccd-81ae-dc4cc607da6f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1240 microversion: 2.1 time: 0.121427 Oct 31 15:45:55.917514 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2827/5485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:55 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:56.362465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:56.409160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:56.432125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:56.435510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:56.437611 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-080001c0-c71f-4e3c-a9e7-b419b595a9b4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.661243 Oct 31 15:45:56.439007 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2659/5486] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:55 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:45:56.625521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:56.628038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:56.639841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:56.640802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:56.642953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:56.645157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:56.646891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:56.647687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:56.949343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:56.951989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:56.980834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:56.982732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:56.983481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:56.985295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:56.986563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.005151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.099587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:57.221360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:57.254067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b78c84b-b9e7-495b-9f42-58a7771fd3f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1292 microversion: 2.1 time: 0.316974 Oct 31 15:45:57.277212 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2660/5487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:56 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1292 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:57.302360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:57.316543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:57.318221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Searching by: {'deleted': False, 'project_id': '61ea6a909ace44749ebae7b1dff990ba'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:45:57.332766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:57.336095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.339143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.340216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:57.341618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.343510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.414646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:45:57.449314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:57.452568 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3cd50030-b401-4d84-affe-1a0e4b9e787a tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.173358 Oct 31 15:45:57.455023 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2661/5488] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:45:57 2022] GET /compute/v2.1/servers => generated 333 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:57.472140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:45:57.491180 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1a4fb99-1c08-46b8-b2f6-215dadf69a45 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1689 microversion: 2.1 time: 0.870809 Oct 31 15:45:57.495562 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2828/5489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:56 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1689 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:45:57.512982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:57.519747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:57.520450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:57.521440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:57.522725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Searching by: {'deleted': False, 'project_id': '61ea6a909ace44749ebae7b1dff990ba'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:45:57.530647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:57.532178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.532886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:57.533218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.534407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:57.534526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.535558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.536262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.536447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.539670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:57.541427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.543178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:57.610405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:45:57.709793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:57.732482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:57.733711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:57.735109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.050156 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22bfce73-f448-4c05-94dc-6285884c62a4 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.552916 Oct 31 15:45:58.050770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2829/5490] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:45:57 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:58.085647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16189c1f-c2a2-425d-bf4b-ac0868704838 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:58.103193 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16189c1f-c2a2-425d-bf4b-ac0868704838 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026171 Oct 31 15:45:58.105199 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2830/5491] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Oct 31 15:45:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:45:58.246366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:58.260934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:58.262627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:58.269628 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d26a8a79-ed09-4fe4-bc36-49b96f437a92 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.798441 Oct 31 15:45:58.271761 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2662/5492] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:57 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:58.293995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:58.294872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:58.306720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.310555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.311664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.312573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.315436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.318503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.418983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:58.420182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:58.432062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.432557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.432994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.436536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.437041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.437508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.496699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:45:58.724182 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f1e4a675-48bb-40ba-b4bf-ed45a1b089f9 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 204 len: 0 microversion: 2.1 time: 0.309328 Oct 31 15:45:58.724792 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2663/5493] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:45:58 2022] DELETE /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:45:58.729987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:58.730758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:58.742154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.747988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.749161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.750087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.750800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.751448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.905560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:58.920724 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a32e9b88-9dd3-4329-bc44-9c575b20ee60 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1298 microversion: 2.1 time: 0.631838 Oct 31 15:45:58.921414 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2831/5494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:58 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1298 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:58.947626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:58.949690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:58.959785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.960615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.983005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:58.986431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:58.996454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:58.998051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:59.483347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:59.493090 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fba28a62-6f82-4722-be1c-98a10bcc5ba5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1698 microversion: 2.1 time: 0.569695 Oct 31 15:45:59.497958 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2832/5495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:58 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1698 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:59.507629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:59.517560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:59.524180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:59.524775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:59.525372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:59.526328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:59.526958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:59.534353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:59.924528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:59.940313 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23117816-d0d1-4e32-8a4e-adf73af9dcc8 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1689 microversion: 2.1 time: 1.208062 Oct 31 15:45:59.954824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:59.956340 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2664/5496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:58 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1689 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:45:59.966235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:59.966480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:45:59.967329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:45:59.967858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:45:59.969194 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-170a433a-c51d-4fcc-b472-73e98c671477 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.469848 Oct 31 15:45:59.970722 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2833/5497] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:45:59 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:45:59.976578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:59.977559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:59.978212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:45:59.979204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:45:59.980445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:45:59.981074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:00.112031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:00.145977 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-10de4b70-2d1d-4673-9779-f41ce0de8279 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1298 microversion: 2.1 time: 0.181825 Oct 31 15:46:00.145977 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2665/5498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:45:59 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:00.535552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:00.536460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:00.543228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:00.543975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:00.544600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:00.545508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:00.546128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:00.546740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:00.970710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:00.972020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:00.979376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:00.987823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:00.988540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:00.989578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:00.990269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:00.990947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:01.119591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:01.133884 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-14bae566-7034-4d20-bafb-7b145df99def tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1698 microversion: 2.1 time: 0.607429 Oct 31 15:46:01.135087 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2834/5499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:00 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1698 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:01.139925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:01.154185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:01.161942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:01.162523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:01.163070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:01.163877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:01.164449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:01.171814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:01.364211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:01.374863 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ad62087f-988d-435d-81ff-a6a072f103df tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1689 microversion: 2.1 time: 0.407895 Oct 31 15:46:01.377751 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2666/5500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:00 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1689 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:01.392708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:01.394406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:01.410306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:01.411135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:01.411962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:01.412887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:01.413729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:01.414422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:01.722828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:01.731776 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6daf30dc-8884-48fb-81a0-1e7571ce23f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1366 microversion: 2.1 time: 0.352746 Oct 31 15:46:01.732380 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2667/5501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:01 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:02.071199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:02.103085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:02.107128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:02.108662 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30ef94bf-26a5-44d3-9138-176d99625ad0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.972414 Oct 31 15:46:02.122226 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2835/5502] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:01 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:02.165737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:02.167313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:02.175813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:02.176788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:02.177443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:02.178952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:02.179626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:02.180202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:02.408085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:02.409050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:02.427461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:02.430191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:02.430832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:02.432059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:02.432698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:02.434142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:02.607677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:02.624557 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3205247-265b-4df7-b56a-3dcce99bdd52 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1698 microversion: 2.1 time: 0.456687 Oct 31 15:46:02.628073 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2668/5503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:02 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1698 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:02.759109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:02.760185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:02.794504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:02.796763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:02.798262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:02.803670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:02.809985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:02.810648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:02.997341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.014832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd69c417-7465-4217-8c04-5227c2166bc3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1679 microversion: 2.1 time: 0.613960 Oct 31 15:46:03.029761 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2836/5504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:02 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1679 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:03.052418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e18f76f8-5d99-4db3-8e7c-62eb0734cb04 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:03.053325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e18f76f8-5d99-4db3-8e7c-62eb0734cb04 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:03.066956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e18f76f8-5d99-4db3-8e7c-62eb0734cb04 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.070616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e18f76f8-5d99-4db3-8e7c-62eb0734cb04 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.071117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e18f76f8-5d99-4db3-8e7c-62eb0734cb04 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.074203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e18f76f8-5d99-4db3-8e7c-62eb0734cb04 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.076698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e18f76f8-5d99-4db3-8e7c-62eb0734cb04 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.077889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e18f76f8-5d99-4db3-8e7c-62eb0734cb04 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.315710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.326949 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-591c0462-3f1f-411f-b732-7243e533487b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1366 microversion: 2.1 time: 0.574730 Oct 31 15:46:03.327566 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2669/5505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:02 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1366 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:03.338600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:03.341903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:03.354020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.356541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.359154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.360346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.362074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.362501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.729756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.745850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.747594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.749042 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-39924460-0a2a-4d0b-9e43-981e83802b48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.414877 Oct 31 15:46:03.752177 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2670/5506] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:03 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:03.758672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:03.761591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:03.779002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.780815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.781473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.798309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:03.799072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:03.800190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:03.981263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:03.998574 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-68c015b7-2944-4e30-85c5-a3d0d35d87c5 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1631 microversion: 2.1 time: 0.245040 Oct 31 15:46:04.000340 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2671/5507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:03 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1631 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:04.082456 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e18f76f8-5d99-4db3-8e7c-62eb0734cb04 tempest-TestNetworkAdvancedServerOps-863331559 tempest-TestNetworkAdvancedServerOps-863331559-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1832 microversion: 2.1 time: 1.030903 Oct 31 15:46:04.084289 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2837/5508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:03 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1832 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:04.119102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:04.119627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:04.136277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.136777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.142410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.144140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.146972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.147428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.351650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:04.352274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:04.368024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.368531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.368970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.369712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.370343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.370952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.894795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:04.913850 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-318dec03-448d-4325-98bd-7a2525c6a136 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1679 microversion: 2.1 time: 0.793480 Oct 31 15:46:04.929152 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2672/5509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:04 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1679 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:04.929152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f925fb1a-83bb-4b28-9c6b-149c04b99335 req-46fb2898-9636-4e2a-bf09-086f5eb3640a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91348e48-50bd-4039-b86b-fa84f253bfe8", "tag": "48f3fb0b-db4c-4a51-ba27-cab2fdc6ff4b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:04.949305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f925fb1a-83bb-4b28-9c6b-149c04b99335 req-46fb2898-9636-4e2a-bf09-086f5eb3640a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:04.949798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f925fb1a-83bb-4b28-9c6b-149c04b99335 req-46fb2898-9636-4e2a-bf09-086f5eb3640a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:04.950236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f925fb1a-83bb-4b28-9c6b-149c04b99335 req-46fb2898-9636-4e2a-bf09-086f5eb3640a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:04.966615 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f925fb1a-83bb-4b28-9c6b-149c04b99335 req-46fb2898-9636-4e2a-bf09-086f5eb3640a service nova] Creating event network-changed:48f3fb0b-db4c-4a51-ba27-cab2fdc6ff4b for instance 91348e48-50bd-4039-b86b-fa84f253bfe8 on n-h2-858384-17 Oct 31 15:46:04.983409 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f925fb1a-83bb-4b28-9c6b-149c04b99335 req-46fb2898-9636-4e2a-bf09-086f5eb3640a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067601 Oct 31 15:46:04.984041 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2673/5510] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:04.994000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:04.994699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:05.012188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:05.018372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:05.019023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:05.019955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:05.020711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:05.021331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:05.469953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:05.480004 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab17edef-5ef9-4a57-88c0-ce1fd00f944e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1366 microversion: 2.1 time: 1.132823 Oct 31 15:46:05.491617 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2838/5511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:04 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1366 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:05.505774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:05.506698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:05.519087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:05.519896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:05.520797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:05.521741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:05.522522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:05.523144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:05.531548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:05.552490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:05.557926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:05.569638 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0159a8d7-881d-4399-84c2-275bad71301c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.574065 Oct 31 15:46:05.574142 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2674/5512] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:04 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:05.592889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0b5901e-ebed-4a71-9a3e-c8594561d32a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:05.605791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0b5901e-ebed-4a71-9a3e-c8594561d32a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:05.624577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b5901e-ebed-4a71-9a3e-c8594561d32a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:05.625100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b5901e-ebed-4a71-9a3e-c8594561d32a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:05.627440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b5901e-ebed-4a71-9a3e-c8594561d32a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:05.628318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b5901e-ebed-4a71-9a3e-c8594561d32a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:05.628823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b5901e-ebed-4a71-9a3e-c8594561d32a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:05.629292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0b5901e-ebed-4a71-9a3e-c8594561d32a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:05.754781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d9c0276eba84fe691a3028b7b4a02a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61ea6a909ace44749ebae7b1dff990ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:05.764117 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0b5901e-ebed-4a71-9a3e-c8594561d32a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db/action" status: 200 len: 38670 microversion: 2.1 time: 0.180077 Oct 31 15:46:05.764748 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1842f60f-297c-42ac-a5fd-b19583f0e794 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 200 len: 1354 microversion: 2.1 time: 0.271658 Oct 31 15:46:05.765671 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2675/5513] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:46:05 2022] POST /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db/action => generated 38670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:46:05.780140 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2839/5514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:05 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 1354 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:06.517302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:06.518675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:06.544559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:06.545188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:06.545845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:06.546755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:06.547437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:06.548087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:06.561242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:06.595954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:06.596563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:06.613362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:06.615020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:06.615481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:06.616230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:06.616686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:06.617113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:06.983575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:06.991714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:07.004769 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f47297a5-b3e6-486f-b132-f4c215f56ae9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1366 microversion: 2.1 time: 0.494735 Oct 31 15:46:07.005151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:07.007119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:07.007341 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2676/5515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:06 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:07.009043 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be944112-cf4b-4d4a-acf4-47276a0fe013 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 0.418554 Oct 31 15:46:07.010207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2840/5516] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:06 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:07.015484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:07.022039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] [instance: 75f31f49-8600-4322-ad3e-a09431fbd250] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:07.029337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:07.031018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:07.032444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:07.034129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:07.034832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:07.035517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:07.061832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d07cda9f-1ac6-45ae-8f82-5c117084d74d req-9509ca3a-4187-4613-aa76-1f6f13031d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f31f49-8600-4322-ad3e-a09431fbd250", "name": "network-vif-deleted", "tag": "60c43b16-9f2c-4f34-bd11-03060bdf333b"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:07.076510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d07cda9f-1ac6-45ae-8f82-5c117084d74d req-9509ca3a-4187-4613-aa76-1f6f13031d5b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:07.077253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d07cda9f-1ac6-45ae-8f82-5c117084d74d req-9509ca3a-4187-4613-aa76-1f6f13031d5b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:07.077953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d07cda9f-1ac6-45ae-8f82-5c117084d74d req-9509ca3a-4187-4613-aa76-1f6f13031d5b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:07.086687 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] HTTP exception thrown: Instance 75f31f49-8600-4322-ad3e-a09431fbd250 could not be found. Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Request method failure captured: Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 HTTP/1.1 Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-15KwOUha7RANJ_Jouirn2LJZd9NFvvmcgip_70qN0SwV_H893BJSqNc4SOqjmjxOQ-5Lrd3noTbKdOdpNc_RprgrFvg00lnBrNbiiVpX4PuhAL6wOlN3ZBlzAuZ9mzDg6el0C4QVtA9LQltYqA8a7OnjJ0DiiwIQN08UFVstOK6Cg Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 61ea6a909ace44749ebae7b1dff990ba Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersTestJSON-151717064 Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61ea6a909ace44749ebae7b1dff990ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_61ea6a909ace44749ebae7b1dff990ba", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/61ea6a909ace44749ebae7b1dff990ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/61ea6a909ace44749ebae7b1dff990ba"}]}] Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersTestJSON-151717064 Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 61ea6a909ace44749ebae7b1dff990ba Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersTestJSON-151717064 Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersTestJSON-151717064-project Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 8d9c0276eba84fe691a3028b7b4a02a4 Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersTestJSON-151717064-project Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 75f31f49-8600-4322-ad3e-a09431fbd250 could not be found. Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '75f31f49-8600-4322-ad3e-a09431fbd250'} Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75f31f49-8600-4322-ad3e-a09431fbd250 could not be found. Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75f31f49-8600-4322-ad3e-a09431fbd250 could not be found. Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:07.088804 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:07.096268 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:07.096268 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:07.096268 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:07.096268 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:07.096268 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75f31f49-8600-4322-ad3e-a09431fbd250 could not be found. Oct 31 15:46:07.096268 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:07.096268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Returning 404 to user: Instance 75f31f49-8600-4322-ad3e-a09431fbd250 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:07.096268 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03d2740b-1dff-4225-80e4-a24a34c71ca7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250" status: 404 len: 111 microversion: 2.1 time: 0.083348 Oct 31 15:46:07.096268 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2677/5517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:07 2022] GET /compute/v2.1/servers/75f31f49-8600-4322-ad3e-a09431fbd250 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:07.104928 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d07cda9f-1ac6-45ae-8f82-5c117084d74d req-9509ca3a-4187-4613-aa76-1f6f13031d5b service nova] Creating event network-vif-deleted:60c43b16-9f2c-4f34-bd11-03060bdf333b for instance 75f31f49-8600-4322-ad3e-a09431fbd250 on n-h1-858384-17 Oct 31 15:46:07.112880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23c7980b-0617-4544-95b5-fe37ed13e9c7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] Calling method '.version_select at 0x7f16e17039d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:07.114351 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d07cda9f-1ac6-45ae-8f82-5c117084d74d req-9509ca3a-4187-4613-aa76-1f6f13031d5b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057802 Oct 31 15:46:07.116492 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2841/5518] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:46:07.151400 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23c7980b-0617-4544-95b5-fe37ed13e9c7 tempest-ServersTestJSON-151717064 tempest-ServersTestJSON-151717064-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547373323" status: 202 len: 0 microversion: 2.1 time: 0.048046 Oct 31 15:46:07.156255 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2678/5519] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 15:46:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547373323 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:46:08.052372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:08.054352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:08.056886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:08.060982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:08.064562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:08.069828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:08.072408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:08.097754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.098802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.103305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.103975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:08.105542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.106737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.107939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.108367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:08.109028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:08.115502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:08.116311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:08.116903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:08.448317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:08.458063 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e9623eb5-f94e-4234-ad30-3076a131992d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1366 microversion: 2.1 time: 0.418607 Oct 31 15:46:08.459555 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2842/5520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:08 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:09.087485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:09.107565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:09.109052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:09.110631 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-43ad66ed-4489-44ec-96cd-43a81f4d565d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1739 microversion: 2.20 time: 1.073532 Oct 31 15:46:09.111736 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2679/5521] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:08 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1739 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:09.330733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:09.332003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:09.347366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9f2ed899-cb95-4940-9590-04b22da0e2d6 req-c72b18c6-c47e-418c-9a20-0979806ea1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60fc5ff-f019-45f7-9532-7ad4f10048db", "tag": "8de97a21-18ae-41b0-b670-f2daa3921493"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:09.349365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:09.353883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:09.356209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:09.358858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:09.362522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:09.363285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:09.364758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:09.365157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9f2ed899-cb95-4940-9590-04b22da0e2d6 req-c72b18c6-c47e-418c-9a20-0979806ea1d0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:09.365641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9f2ed899-cb95-4940-9590-04b22da0e2d6 req-c72b18c6-c47e-418c-9a20-0979806ea1d0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:09.366259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9f2ed899-cb95-4940-9590-04b22da0e2d6 req-c72b18c6-c47e-418c-9a20-0979806ea1d0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:09.412990 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9f2ed899-cb95-4940-9590-04b22da0e2d6 req-c72b18c6-c47e-418c-9a20-0979806ea1d0 service nova] Creating event network-changed:8de97a21-18ae-41b0-b670-f2daa3921493 for instance f60fc5ff-f019-45f7-9532-7ad4f10048db on n-h1-858384-17 Oct 31 15:46:09.415316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:46:09.435425 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9f2ed899-cb95-4940-9590-04b22da0e2d6 req-c72b18c6-c47e-418c-9a20-0979806ea1d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091738 Oct 31 15:46:09.441194 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2680/5522] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:09.484700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:09.486619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:09.500904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:09.502404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:09.502993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:09.506259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:09.507759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:09.508355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:09.674724 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6e50d51-ac91-4b8a-8b0d-d5382aab9b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 204 len: 0 microversion: 2.1 time: 0.349789 Oct 31 15:46:09.675402 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2843/5523] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:46:09 2022] DELETE /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:46:09.697875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:09.698811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:09.722937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:09.724785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:09.725437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:09.726328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:09.729235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:09.729877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:09.995826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.007949 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-20d6c3d1-0206-42ba-bf3a-0508b3c173fa tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1366 microversion: 2.1 time: 0.528279 Oct 31 15:46:10.012147 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2681/5524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:09 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1366 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:10.146106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:10.146776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:10.160337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:10.165590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:10.166299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:10.167254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:10.168227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:10.168909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:10.527194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.539096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:10.545297 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-14c52cc7-e807-4fb1-9840-9ae5f2ede029 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1685 microversion: 2.1 time: 0.862688 Oct 31 15:46:10.546504 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2844/5525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:09 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1685 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:10.603967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.615751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.619091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:10.623511 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a9eb398f-45e2-49a3-9308-51804b6ba879 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1721 microversion: 2.20 time: 0.481400 Oct 31 15:46:10.625741 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2682/5526] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:10 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1721 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:11.041513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:11.042856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:11.061922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.062903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.064204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:11.067221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.068493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.069849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:11.467716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1d739ae4-d468-4f9a-9c35-8211ca1ecfc6 req-03bb596d-cfc9-490a-8031-e0e9a5795602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60fc5ff-f019-45f7-9532-7ad4f10048db", "name": "network-vif-deleted", "tag": "8de97a21-18ae-41b0-b670-f2daa3921493"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:11.485458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:11.492495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1d739ae4-d468-4f9a-9c35-8211ca1ecfc6 req-03bb596d-cfc9-490a-8031-e0e9a5795602 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.493299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1d739ae4-d468-4f9a-9c35-8211ca1ecfc6 req-03bb596d-cfc9-490a-8031-e0e9a5795602 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.495784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1d739ae4-d468-4f9a-9c35-8211ca1ecfc6 req-03bb596d-cfc9-490a-8031-e0e9a5795602 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:11.535153 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1d739ae4-d468-4f9a-9c35-8211ca1ecfc6 req-03bb596d-cfc9-490a-8031-e0e9a5795602 service nova] Creating event network-vif-deleted:8de97a21-18ae-41b0-b670-f2daa3921493 for instance f60fc5ff-f019-45f7-9532-7ad4f10048db on n-h1-858384-17 Oct 31 15:46:11.551232 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1d739ae4-d468-4f9a-9c35-8211ca1ecfc6 req-03bb596d-cfc9-490a-8031-e0e9a5795602 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085507 Oct 31 15:46:11.553981 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2683/5527] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:46:11.584000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:11.584773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:11.601696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.603214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.605449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:11.608818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.609645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.612602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:11.698149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.699043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.700199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:11.704238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lazy-loading 'fault' on Instance uuid f60fc5ff-f019-45f7-9532-7ad4f10048db {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:46:11.817578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:11.846657 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c1422f4-5361-414d-9eda-d586a44a69be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 200 len: 1354 microversion: 2.1 time: 0.271015 Oct 31 15:46:11.850556 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2684/5528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:11 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 1354 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:11.860636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:11.865616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:11.877456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.881455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.882190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:11.883260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:11.883949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:11.884621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:12.216304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:12.229963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:12.233910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:12.235982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:12.237217 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86228106-53bb-47ae-b3b6-ea9a95d80bb2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1721 microversion: 2.20 time: 0.385464 Oct 31 15:46:12.237952 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2685/5529] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:11 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1721 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:12.251738 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9a657eb-b9be-48ce-b5ea-b121990904e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1366 microversion: 2.1 time: 1.215486 Oct 31 15:46:12.252277 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2845/5530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:11 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1366 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:12.253994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-451395b7-5cc0-403a-97ec-df9235151e61 req-f9debcea-1098-46f3-81a4-b474e18638f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91348e48-50bd-4039-b86b-fa84f253bfe8", "name": "network-vif-plugged", "status": "completed", "tag": "48f3fb0b-db4c-4a51-ba27-cab2fdc6ff4b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:12.271529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-451395b7-5cc0-403a-97ec-df9235151e61 req-f9debcea-1098-46f3-81a4-b474e18638f6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:12.283504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-451395b7-5cc0-403a-97ec-df9235151e61 req-f9debcea-1098-46f3-81a4-b474e18638f6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:12.284154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-451395b7-5cc0-403a-97ec-df9235151e61 req-f9debcea-1098-46f3-81a4-b474e18638f6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:12.296648 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-451395b7-5cc0-403a-97ec-df9235151e61 req-f9debcea-1098-46f3-81a4-b474e18638f6 service nova] Creating event network-vif-plugged:48f3fb0b-db4c-4a51-ba27-cab2fdc6ff4b for instance 91348e48-50bd-4039-b86b-fa84f253bfe8 on n-h2-858384-17 Oct 31 15:46:12.303494 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-451395b7-5cc0-403a-97ec-df9235151e61 req-f9debcea-1098-46f3-81a4-b474e18638f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064335 Oct 31 15:46:12.304356 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2686/5531] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:12.880604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:12.881300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: f60fc5ff-f019-45f7-9532-7ad4f10048db] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:12.889012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:12.889871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:12.890551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:12.891734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:12.892455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:12.893445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:12.911052 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] HTTP exception thrown: Instance f60fc5ff-f019-45f7-9532-7ad4f10048db could not be found. Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Request method failure captured: Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db HTTP/1.1 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-vYXw5CPfxI9qsbE5oWLVlabEwpa9M6Ef1fkrw4QAYPij6FJOM5Xg0DltLoV49P2_qcAx8GePrGwc670IZtI8hUhpzWNxVFvZtPDOo7wHEVWRZyCE_xyV_MDmU4WDjceseG9A24j1fET0QbEoX61XLGsvVw_--5yurHZAMewB53Ikw Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: e6a2914e44014bed857d096897727c91 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6a2914e44014bed857d096897727c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e6a2914e44014bed857d096897727c91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6a2914e44014bed857d096897727c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e6a2914e44014bed857d096897727c91"}]}] Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: e6a2914e44014bed857d096897727c91 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestNetworkAdvancedServerOps-2127797092-project Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e0349502a6234609ae5eb4c4a94acf95 Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2127797092-project Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f60fc5ff-f019-45f7-9532-7ad4f10048db could not be found. Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f60fc5ff-f019-45f7-9532-7ad4f10048db'} Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60fc5ff-f019-45f7-9532-7ad4f10048db could not be found. Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60fc5ff-f019-45f7-9532-7ad4f10048db could not be found. Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:46:12.914743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60fc5ff-f019-45f7-9532-7ad4f10048db could not be found. Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Returning 404 to user: Instance f60fc5ff-f019-45f7-9532-7ad4f10048db could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:12.918989 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-368eeaf1-1dc5-4378-8cf5-37910b95aebb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db" status: 404 len: 111 microversion: 2.1 time: 0.041266 Oct 31 15:46:12.925322 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2846/5532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:12 2022] GET /compute/v2.1/servers/f60fc5ff-f019-45f7-9532-7ad4f10048db => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:46:13.268165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:13.269661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:13.277705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:13.278527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:13.279198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:13.280210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:13.280946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:13.282033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:13.283782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:13.284471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:13.294941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:13.297637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:13.298010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:13.298771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:13.299250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:13.304407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:13.619837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:13.633455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:13.635560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:13.638032 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b244171-291d-4b4b-934c-121ce8844ffb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1664 microversion: 2.20 time: 0.375228 Oct 31 15:46:13.639550 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2687/5533] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:13 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1664 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:13.666416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2c8701f-5ada-43da-bdd5-07c54d03a8bc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfc8fa33-c79b-4013-b76e-9a575b069868"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:13.669291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2c8701f-5ada-43da-bdd5-07c54d03a8bc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:13.676994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c8701f-5ada-43da-bdd5-07c54d03a8bc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:13.677943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c8701f-5ada-43da-bdd5-07c54d03a8bc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:13.678607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c8701f-5ada-43da-bdd5-07c54d03a8bc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:13.679578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c8701f-5ada-43da-bdd5-07c54d03a8bc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:13.680264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c8701f-5ada-43da-bdd5-07c54d03a8bc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:13.680912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c8701f-5ada-43da-bdd5-07c54d03a8bc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.154350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:14.174132 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec95f345-79f8-4b87-9afd-ab2c1c753a45 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1366 microversion: 2.1 time: 0.895750 Oct 31 15:46:14.177737 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2847/5534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:13 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1366 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:14.178124 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2c8701f-5ada-43da-bdd5-07c54d03a8bc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.516101 Oct 31 15:46:14.185726 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2688/5535] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Oct 31 15:46:13 2022] POST /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 188 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:46:14.336384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:14.338141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:14.347008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:14.347798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:14.348491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.349498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:14.350193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:14.351111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.440487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-52d39894-c1d4-4a0b-947a-25d06397b0e3 req-d47c437d-6746-46d6-93ff-66872bef7862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9547ba84-a354-46e2-b2a5-4f3d4d71159d", "name": "network-vif-unplugged", "status": "completed", "tag": "163e80be-44ff-4862-ae47-6ccd8f6a3afa"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:14.455989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120587) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:46:14.483906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-52d39894-c1d4-4a0b-947a-25d06397b0e3 req-d47c437d-6746-46d6-93ff-66872bef7862 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:14.485016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-52d39894-c1d4-4a0b-947a-25d06397b0e3 req-d47c437d-6746-46d6-93ff-66872bef7862 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:14.490696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-52d39894-c1d4-4a0b-947a-25d06397b0e3 req-d47c437d-6746-46d6-93ff-66872bef7862 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.525950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.server_external_events [req-52d39894-c1d4-4a0b-947a-25d06397b0e3 req-d47c437d-6746-46d6-93ff-66872bef7862 service nova] Unable to find a host for instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d. Dropping event network-vif-unplugged {{(pid=120588) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 15:46:14.529980 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-52d39894-c1d4-4a0b-947a-25d06397b0e3 req-d47c437d-6746-46d6-93ff-66872bef7862 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.107883 Oct 31 15:46:14.532484 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2689/5536] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 112 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 31 15:46:14.613544 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6eb02ce2-c38d-49d7-9857-344b91d4b1b2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/action" status: 202 len: 0 microversion: 2.20 time: 0.281770 Oct 31 15:46:14.615002 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2848/5537] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:46:14 2022] POST /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:46:14.628890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:14.629528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:14.636469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:14.637329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:14.638003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:14.639192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:14.639860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:14.640576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:15.205772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:15.206405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:15.234446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:15.235646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:15.236101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:15.236842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:15.237340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:15.237771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:15.457634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:15.475266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:15.477226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:15.478701 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2904139c-62cf-4cf3-a3a9-27bc727e4af8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1750 microversion: 2.20 time: 0.857152 Oct 31 15:46:15.480196 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2690/5538] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:14 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1750 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:16.023811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:16.042620 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7171a68c-edca-41d1-b7f7-545275af3abf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1557 microversion: 2.1 time: 0.844192 Oct 31 15:46:16.044402 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2849/5539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:15 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1557 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:16.072282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eaae6b26-458a-4a05-ab2d-928e0d4c8b52 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:16.072783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eaae6b26-458a-4a05-ab2d-928e0d4c8b52 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:16.083651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaae6b26-458a-4a05-ab2d-928e0d4c8b52 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:16.084155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaae6b26-458a-4a05-ab2d-928e0d4c8b52 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:16.084596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaae6b26-458a-4a05-ab2d-928e0d4c8b52 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:16.097858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaae6b26-458a-4a05-ab2d-928e0d4c8b52 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:16.098383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaae6b26-458a-4a05-ab2d-928e0d4c8b52 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:16.098932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eaae6b26-458a-4a05-ab2d-928e0d4c8b52 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:16.511482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:16.512346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:16.526465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:16.527201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:16.528082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:16.529024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:16.530762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:16.532167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:16.561408 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eaae6b26-458a-4a05-ab2d-928e0d4c8b52 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.493064 Oct 31 15:46:16.562423 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2691/5540] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:46:16 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8/os-interface => generated 285 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:17.195164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:17.243481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:17.252164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:17.255316 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-15802087-d789-4c5b-a0ab-3035a84db1e8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1752 microversion: 2.20 time: 0.746690 Oct 31 15:46:17.255937 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2850/5541] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:16 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1752 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:18.291221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:18.292744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:18.320547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.321633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.322315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:18.323295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:18.328843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:18.329687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:19.138431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:19.155110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:19.160180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:19.168340 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a946784-297e-48fd-9611-13855812e4ae tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1752 microversion: 2.20 time: 0.883747 Oct 31 15:46:19.174134 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2692/5542] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:18 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1752 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:20.200444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:20.201438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:20.218960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.219848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.220306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.221030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.221519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.221947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.620463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-395a50ff-fa33-41fc-bf6d-e207a3eed2da req-e65378fd-9a9e-4794-a6c3-e9e36c6c928f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91348e48-50bd-4039-b86b-fa84f253bfe8", "tag": "48f3fb0b-db4c-4a51-ba27-cab2fdc6ff4b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:20.632635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-395a50ff-fa33-41fc-bf6d-e207a3eed2da req-e65378fd-9a9e-4794-a6c3-e9e36c6c928f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:20.633081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-395a50ff-fa33-41fc-bf6d-e207a3eed2da req-e65378fd-9a9e-4794-a6c3-e9e36c6c928f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:20.633562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-395a50ff-fa33-41fc-bf6d-e207a3eed2da req-e65378fd-9a9e-4794-a6c3-e9e36c6c928f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:20.646268 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-395a50ff-fa33-41fc-bf6d-e207a3eed2da req-e65378fd-9a9e-4794-a6c3-e9e36c6c928f service nova] Creating event network-changed:48f3fb0b-db4c-4a51-ba27-cab2fdc6ff4b for instance 91348e48-50bd-4039-b86b-fa84f253bfe8 on n-h2-858384-17 Oct 31 15:46:20.652272 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-395a50ff-fa33-41fc-bf6d-e207a3eed2da req-e65378fd-9a9e-4794-a6c3-e9e36c6c928f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035200 Oct 31 15:46:20.658104 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2693/5543] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:46:21.881154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:21.902223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:21.904114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:21.915670 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea5fafa8-999d-4d1c-a75c-60a6a63ac281 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1752 microversion: 2.20 time: 1.719288 Oct 31 15:46:21.916484 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2851/5544] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:20 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1752 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:22.947992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:22.948834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:22.965428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:22.967308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:22.967765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:22.973796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:22.974540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:22.979172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:23.552956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:23.595008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:23.601325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:23.605228 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-44dc1fdf-6542-4922-9126-d8d02f511a51 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1752 microversion: 2.20 time: 0.662251 Oct 31 15:46:23.608451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2694/5545] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:22 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1752 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:24.641244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:24.641994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:24.650177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:24.650912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:24.651447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:24.652768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:24.653478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:24.654147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:24.980283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:24.996448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:25.002135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:25.005689 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f61c4774-6274-44bb-9379-903422b5a826 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1752 microversion: 2.20 time: 0.368726 Oct 31 15:46:25.012103 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2852/5546] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:24 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1752 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:26.052530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:26.053554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:26.068303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:26.069858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:26.071614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:26.073736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:26.074419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:26.075594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:26.118573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:26.321089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8209651f-9fce-40f0-811d-fbe9ba5a5d82 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '.version_select at 0x7f16e0220dc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:26.366507 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8209651f-9fce-40f0-811d-fbe9ba5a5d82 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-7667330" status: 202 len: 0 microversion: 2.1 time: 0.051330 Oct 31 15:46:26.367428 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2853/5547] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:46:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-7667330 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:46:26.397253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b998179-3785-4c9e-803a-a430ea399872 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'create', calling method: .version_select at 0x7f16e01e7d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-327270528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImkbPGvexO2eC0oT4wCPnTAT9rVykFx6tp3JCDebfj1RjDnJdvtNxOXNnQVzo21+XpVhv6HUdzLM/t8LYYK0Y/Drh1oCX3VG41M6dEgFUWZsO778OAf1doNK5bdZX9XKw=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:26.411631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:26.426598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6b998179-3785-4c9e-803a-a430ea399872 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for project e6a2914e44014bed857d096897727c91. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:46:26.433772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-6b998179-3785-4c9e-803a-a430ea399872 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for user e0349502a6234609ae5eb4c4a94acf95 and project e6a2914e44014bed857d096897727c91. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:46:26.464951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:26.471556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:26.478961 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a8fb1b94-97d8-424a-adae-3a6903ade480 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1752 microversion: 2.20 time: 0.433396 Oct 31 15:46:26.485566 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2695/5548] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:26 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1752 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:26.487779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6b998179-3785-4c9e-803a-a430ea399872 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.094131 Oct 31 15:46:26.513239 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2854/5549] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:46:26 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:46:27.522408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:27.523972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:27.543108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:27.544092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:27.544750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:27.545731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:27.546786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:27.547890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:28.301691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:28.318678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:28.321057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:28.322982 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5808a995-1744-41d1-b92c-0c8cb4b6e9f6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.812841 Oct 31 15:46:28.338276 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2696/5550] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:27 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:29.229928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-bb41ebc4-0aa1-4a96-ae7f-69e980f8f78a req-34b6bb72-1ed9-4d9f-9cd8-bf10a7d71cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9547ba84-a354-46e2-b2a5-4f3d4d71159d", "tag": "163e80be-44ff-4862-ae47-6ccd8f6a3afa"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:29.258021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bb41ebc4-0aa1-4a96-ae7f-69e980f8f78a req-34b6bb72-1ed9-4d9f-9cd8-bf10a7d71cde service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:29.259623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bb41ebc4-0aa1-4a96-ae7f-69e980f8f78a req-34b6bb72-1ed9-4d9f-9cd8-bf10a7d71cde service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:29.260771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bb41ebc4-0aa1-4a96-ae7f-69e980f8f78a req-34b6bb72-1ed9-4d9f-9cd8-bf10a7d71cde service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:29.295101 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-bb41ebc4-0aa1-4a96-ae7f-69e980f8f78a req-34b6bb72-1ed9-4d9f-9cd8-bf10a7d71cde service nova] Creating event network-changed:163e80be-44ff-4862-ae47-6ccd8f6a3afa for instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d on n-h1-858384-17 Oct 31 15:46:29.307306 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-bb41ebc4-0aa1-4a96-ae7f-69e980f8f78a req-34b6bb72-1ed9-4d9f-9cd8-bf10a7d71cde service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082273 Oct 31 15:46:29.309797 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2855/5551] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:46:29.352267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:29.352929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:29.371693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:29.372117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:29.373985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:29.375815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:29.377606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:29.378971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:29.799760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:29.810166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:29.812906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:29.815002 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dfbbd697-3c04-4c1f-9063-297ef883b6ad tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.467078 Oct 31 15:46:29.816054 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2697/5552] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:29 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:30.842944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:30.844201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:30.872549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:30.873052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:30.873529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:30.874888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:30.875352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:30.875782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:31.208094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:31.225148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:31.232761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:31.235495 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f089e0a4-e3e6-40d2-9715-52bd5d4cf003 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.397391 Oct 31 15:46:31.250423 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2856/5553] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:30 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:32.262366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:32.262972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:32.282202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:32.282714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:32.283161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:32.294422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:32.295063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:32.295513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:33.947004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:33.957980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:33.970482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:33.975973 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51ea8802-1c3b-41e8-ac40-4210519439f0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 1.718128 Oct 31 15:46:33.981540 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2698/5554] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:32 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:35.005247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:35.006635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:35.020094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:35.024418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:35.026609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:35.028395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:35.036109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:35.036954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:35.698822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:35.727249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:35.747126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:35.748825 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9069def9-10e9-4e16-9621-389ebf2352e3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.748036 Oct 31 15:46:35.749725 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2857/5555] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:34 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:36.777122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:36.778051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:36.790426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.793745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.794417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:36.798552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:36.799226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:36.800825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:38.378560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:38.406792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:38.413093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:38.426717 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6585cce2-605d-43e0-b8e7-5404c73ca33f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 1.654811 Oct 31 15:46:38.440709 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2699/5556] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:36 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:39.468597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:39.469459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:39.472512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:39.473183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:39.502222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:39.502735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:39.503580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:39.504315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:39.504780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:39.509338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:40.414770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:40.424814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:40.427416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:40.433313 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b08e6fc-b95f-4c51-a2e2-5a5b2fb5ee75 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.969089 Oct 31 15:46:40.438207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2858/5557] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:39 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:41.467150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:41.471598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:41.494035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:41.494536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:41.494970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:41.500634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:41.502593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:41.505675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:42.227532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:42.257559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:42.259344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:42.279039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0226d37-705d-4854-a6b1-4865dc10535f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.797597 Oct 31 15:46:42.297183 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2700/5558] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:41 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:43.315908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:43.318296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:43.367600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:43.371292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:43.374601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:43.378651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:43.382307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:43.383032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:43.438419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:45.361141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:45.379848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:45.381790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:45.387434 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-83fa4a2d-ad12-4a5d-aaad-e3af769a2355 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 2.076879 Oct 31 15:46:45.391758 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2859/5559] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:43 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:46.422590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:46.423373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:46.446760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:46.450422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:46.456781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:46.457862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:46.460895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:46.462323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:46.528542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-730750474", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "54ba4659-da70-49b3-a818-cf6b6ba25fd2"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:46.608139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=38 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:46.773747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] validate_networks() for [('54ba4659-da70-49b3-a818-cf6b6ba25fd2', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:46:47.149307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:47.162719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:47.168499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:47.175934 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80628d2f-c64a-4939-9c7d-1f9c7970df0d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.756484 Oct 31 15:46:47.177035 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2860/5560] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:46 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:48.208384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:48.210806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:48.257783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:48.262746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:48.263356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:48.267856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:48.268044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:48.268556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:48.662866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:48.678363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:48.685870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:48.688029 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6aab1071-58af-44f5-99f7-40cba4135258 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.485647 Oct 31 15:46:48.689093 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2861/5561] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:48 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:46:48.698717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-375512025", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "aaac6e12-922e-4e88-a152-612f77f88016"}], "key_name": "tempest-TestNetworkAdvancedServerOps-327270528", "security_groups": [{"name": "tempest-secgroup-smoke-1688113536"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:48.818664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:46:48.819255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:46:48.819843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:46:48.820276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:46:48.820665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:46:48.839664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:48.840184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:48.840635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:48.844051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:48.844553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:48.844991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:48.894927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Getting quotas for project 5d44ad31033f46788b7f8d519423e72a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:46:48.907275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Getting quotas for user eee804c5e68f49f0be33c1b83c550e74 and project 5d44ad31033f46788b7f8d519423e72a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:46:48.929642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] validate_networks() for [('aaac6e12-922e-4e88-a152-612f77f88016', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:46:48.945827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Going to run 3 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:46:48.948615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:46:49.034669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 417cbe6d-f424-498c-94dc-48d20b023b9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=3eb6e9e3-64a2-4755-a50d-1bdb83bce94b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:46:49.124597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=417cbe6d-f424-498c-94dc-48d20b023b9e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:46:49.271473 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be6594b8-b0a6-4116-b065-0b261a26922f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.030337 Oct 31 15:46:49.281091 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2701/5562] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:46:49.288988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:49.295434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:49.296720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Searching by: {'deleted': False, 'project_id': '5d44ad31033f46788b7f8d519423e72a'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:46:49.322617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:49.323118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:49.323571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:49.324327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:49.324797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:49.336144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:49.391307 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2ce1dc26-787d-4fc9-a435-562c1fb98819 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.101265 Oct 31 15:46:49.391981 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2702/5563] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:46:49 2022] GET /compute/v2.1/servers => generated 1015 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:49.410036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2dbd9bc3-ce83-42a4-86df-dd27fc3d0211 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:49.412199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2dbd9bc3-ce83-42a4-86df-dd27fc3d0211 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:49.574407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2dbd9bc3-ce83-42a4-86df-dd27fc3d0211 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:49.587143 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2dbd9bc3-ce83-42a4-86df-dd27fc3d0211 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1222 microversion: 2.1 time: 0.182348 Oct 31 15:46:49.594877 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2703/5564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:49 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:49.719927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:49.720647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:49.762421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:49.766667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:49.772262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:49.783097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:49.786063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:49.786732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:50.215827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:46:50.216330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:46:50.216734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:46:50.218759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:46:50.219194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:46:50.243985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:50.244981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:50.245661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:50.254179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:50.256819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:50.257331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:50.346105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for project e6a2914e44014bed857d096897727c91. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:46:50.365017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Getting quotas for user e0349502a6234609ae5eb4c4a94acf95 and project e6a2914e44014bed857d096897727c91. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:46:50.408676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:50.432454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:50.462967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:46:50.464427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:50.467887 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-20b38ca3-c1bd-4ff3-9415-3634daa0095d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.752716 Oct 31 15:46:50.476954 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2704/5565] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:49 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:50.481616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:46:50.627347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aec5dbbf-ed27-49f8-a60f-46e8972f3123 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:50.627997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aec5dbbf-ed27-49f8-a60f-46e8972f3123 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:50.669788 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85b4af40-4122-49d4-9715-44f1edfe218e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.974809 Oct 31 15:46:50.681371 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2862/5566] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:46:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:46:50.695562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-589c509d-fa1a-4e9e-8ead-9a72534cdea1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:50.698436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-589c509d-fa1a-4e9e-8ead-9a72534cdea1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:50.813516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-589c509d-fa1a-4e9e-8ead-9a72534cdea1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:50.825588 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-589c509d-fa1a-4e9e-8ead-9a72534cdea1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1265 microversion: 2.1 time: 0.142726 Oct 31 15:46:50.826968 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2863/5567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:50 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:50.883849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aec5dbbf-ed27-49f8-a60f-46e8972f3123 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:50.893176 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aec5dbbf-ed27-49f8-a60f-46e8972f3123 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1222 microversion: 2.1 time: 0.276062 Oct 31 15:46:50.910569 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2705/5568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:50 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1222 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:51.507882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:51.509114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:51.541710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:51.547646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:51.548553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:51.549446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:51.550163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:51.550960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:51.853786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a7b974c-8a43-41c0-ad20-8947d517899f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:51.854578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a7b974c-8a43-41c0-ad20-8947d517899f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:52.087613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a7b974c-8a43-41c0-ad20-8947d517899f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:52.096047 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a7b974c-8a43-41c0-ad20-8947d517899f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1265 microversion: 2.1 time: 0.247453 Oct 31 15:46:52.110319 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2706/5569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:51 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:52.125292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:52.130425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:52.131626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:52.153048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:52.155812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.156308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.158378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:52.167010 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1815e885-72df-4e24-b5e2-8fc9c41fb7d9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.661252 Oct 31 15:46:52.167829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.168605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.170426 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2864/5570] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:51 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:52.172252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.172705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.354552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:52.368045 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d704a858-45bb-4895-9cd7-3b8942ec3cce tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1226 microversion: 2.1 time: 0.256545 Oct 31 15:46:52.370992 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2707/5571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:52 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1226 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:52.512827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7218ce2-7126-45d4-b17b-f0e0f3cc9654 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:52.514617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a7218ce2-7126-45d4-b17b-f0e0f3cc9654 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:52.531937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7218ce2-7126-45d4-b17b-f0e0f3cc9654 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.535611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7218ce2-7126-45d4-b17b-f0e0f3cc9654 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.537706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7218ce2-7126-45d4-b17b-f0e0f3cc9654 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.538637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7218ce2-7126-45d4-b17b-f0e0f3cc9654 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.539253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7218ce2-7126-45d4-b17b-f0e0f3cc9654 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.539895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7218ce2-7126-45d4-b17b-f0e0f3cc9654 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.573098 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7218ce2-7126-45d4-b17b-f0e0f3cc9654 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8/ips" status: 200 len: 150 microversion: 2.1 time: 0.064401 Oct 31 15:46:52.591247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9492625c-e6e9-4f55-b343-6dd09397df7c"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:46:52.595095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:52.597769 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2865/5572] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:46:52 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8/ips => generated 150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:46:52.604057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.604613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.605368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.606371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.606928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.608210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.781333 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Invalid volume: volume 9492625c-e6e9-4f55-b343-6dd09397df7c is already attached to instances: 9993bf49-4859-4a8a-b916-c4883a14059c Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8/os-volume_attachments HTTP/1.1 Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 74 Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: {"volumeAttachment": {"volumeId": "9492625c-e6e9-4f55-b343-6dd09397df7c"}} Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid volume: volume 9492625c-e6e9-4f55-b343-6dd09397df7c is already attached to instances: 9993bf49-4859-4a8a-b916-c4883a14059c Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'server_id': '91348e48-50bd-4039-b86b-fa84f253bfe8', 'body': {'volumeAttachment': {'volumeId': '9492625c-e6e9-4f55-b343-6dd09397df7c'}}} Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in attach_volume Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4971, in _check_volume_already_attached Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9492625c-e6e9-4f55-b343-6dd09397df7c is already attached to instances: 9993bf49-4859-4a8a-b916-c4883a14059c Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:52.784522 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9492625c-e6e9-4f55-b343-6dd09397df7c is already attached to instances: 9993bf49-4859-4a8a-b916-c4883a14059c Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9492625c-e6e9-4f55-b343-6dd09397df7c is already attached to instances: 9993bf49-4859-4a8a-b916-c4883a14059c Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 400 to user: Invalid volume: volume 9492625c-e6e9-4f55-b343-6dd09397df7c is already attached to instances: 9993bf49-4859-4a8a-b916-c4883a14059c {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:46:52.790636 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-339b1c53-9a71-46ed-844c-5047fcc859f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.202286 Oct 31 15:46:52.801416 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2708/5573] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:46:52 2022] POST /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8/os-volume_attachments => generated 174 bytes in 218 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:46:52.805582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:52.806131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:52.815710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.818591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.819266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.820196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:52.823815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:52.824603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:52.871414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:46:53.139681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:53.140731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:53.159118 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5602c7cc-5258-4e2d-8614-23236a84f6bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 204 len: 0 microversion: 2.1 time: 0.364075 Oct 31 15:46:53.162115 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2866/5574] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:46:52 2022] DELETE /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:46:53.169759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.171836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.173359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.174348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.175148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.176078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:53.176228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.176332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:53.204123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.205083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.207330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.208367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.215663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.216616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.341867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:53.354035 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e10b073-2596-4195-b29c-31816d85f08a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1317 microversion: 2.1 time: 0.229800 Oct 31 15:46:53.360537 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2709/5575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:53 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:53.371016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:53.371698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:53.383313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.387525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.388249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.390911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.399481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.400464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.615974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:53.628402 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-daaad129-8662-4515-89d5-4a3f2d4e8f41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1681 microversion: 2.1 time: 0.460157 Oct 31 15:46:53.657915 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2867/5576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:53 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1681 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:53.665805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:53.666411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:53.706977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.724317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.725480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.731387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:53.732110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:53.732814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:53.736356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:53.752151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:53.755214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:53.757419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-419bcfc6-1341-4447-a12a-ef483ffeafa7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.395507 Oct 31 15:46:53.760175 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2710/5577] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:53 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:54.008168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:54.039092 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3366c19d-4f11-42c9-9f9c-42b45fd3dbcc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1218 microversion: 2.1 time: 0.370555 Oct 31 15:46:54.039753 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2868/5578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:53 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1218 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:54.396131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:54.396706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:54.428589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:54.438936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:54.441534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:54.442906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:54.444244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:54.446683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:54.661109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:54.662358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:54.675829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:54.676717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:54.677412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:54.678688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:54.679450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:54.681486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:54.839842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:54.849200 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-37c56e9e-7eb4-4ea2-b826-3680a6f47b44 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1317 microversion: 2.1 time: 0.466284 Oct 31 15:46:54.851500 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2711/5579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:54 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:54.857560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:54.858619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:54.865410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:54.866406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:54.867079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:54.867992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:54.868659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:54.869359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:55.555764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:55.575361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:55.582507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:55.592844 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-953dc9bb-fbf5-4d62-a3e3-ff941383318c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.732048 Oct 31 15:46:55.609943 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2712/5580] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:54 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:55.641478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:55.647977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:55.708346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:55.709061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:55.709529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:55.710247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:55.710920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:55.711354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:56.006052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:56.020372 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d0250b3f-d69d-4f39-908d-87dbfbffb9f5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1274 microversion: 2.1 time: 0.405362 Oct 31 15:46:56.021283 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2713/5581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:55 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1274 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:56.040548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:56.041415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:56.058596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:56.059730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:56.063306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:56.064472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:56.064965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:56.065608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:56.465257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:56.469549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:56.471992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=92 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:56.487540 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6e9e6dd9-ce81-47bb-8728-0d7dc24e30eb tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1323 microversion: 2.1 time: 0.464186 Oct 31 15:46:56.501163 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2714/5582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:56 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:56.511786 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac19b842-7531-40a6-bb62-2a7a7ec61c94 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1681 microversion: 2.1 time: 1.849239 Oct 31 15:46:56.544810 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2869/5583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:54 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1681 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:56.628366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:56.629672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:56.671391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:56.672423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:56.673555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:56.677600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:56.682329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:56.683731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.031147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:57.047405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:57.052060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:57.053490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:57.057317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:57.057894 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-45c7f326-32fa-41f7-8bbe-8b673992cae8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.438164 Oct 31 15:46:57.070682 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2715/5584] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:56 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:57.098496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:57.105316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:57.110473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.116235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:57.128246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:57.133839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.339590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:57.355657 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30680470-df13-4639-b2a1-99d17cb0f6b9 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1280 microversion: 2.1 time: 0.315119 Oct 31 15:46:57.369600 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2870/5585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:57 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:57.520175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:57.521091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:57.534723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:57.539937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:57.540686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.544465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:57.549525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:57.550388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.566039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:57.567247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:57.592632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:57.597815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:57.598523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.599884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:57.603403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:57.604029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:57.972992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:57.990690 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0f21e90-f512-4f2c-96b2-34434048511a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1681 microversion: 2.1 time: 0.424353 Oct 31 15:46:57.991648 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2871/5586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:57 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1681 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:58.095374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:58.095985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:58.117110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:58.117636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:58.118083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:58.119006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:58.119630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:58.120313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:58.226289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:58.238665 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-702e097b-ac3e-41f9-9f09-5ba6bea28933 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1323 microversion: 2.1 time: 0.722258 Oct 31 15:46:58.239883 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2716/5587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:57 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1323 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:58.384392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:58.385869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:58.398490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:58.399235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:58.399828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:58.401482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:58.404499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:58.405215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:58.563860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:58.578041 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09651c6a-ab11-4811-a739-4d4c8dd2fafc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1280 microversion: 2.1 time: 0.197863 Oct 31 15:46:58.584118 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2717/5588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:58 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1280 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:58.656742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:58.676490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:58.677982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:58.679219 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85bb7051-63e2-437b-a40a-e8e4976a42d4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.588941 Oct 31 15:46:58.689030 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2872/5589] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:58 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:46:59.018759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:59.019394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:59.031229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.032378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.035043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.035973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.038268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.039396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.141366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:59.152327 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-641010a7-0cce-4357-a02d-077cbd1005e9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1613 microversion: 2.1 time: 0.137449 Oct 31 15:46:59.156647 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2718/5590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:59 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1613 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:46:59.266227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:59.272691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:59.303577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.304276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.305607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.306635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.309279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.314246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.505764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:46:59.519708 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b4990399-da69-4491-9b99-d8c7d72e162e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1323 microversion: 2.1 time: 0.259601 Oct 31 15:46:59.520322 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2873/5591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:59 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1323 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:46:59.605835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:59.607018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:59.614517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:46:59.621288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.622510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.625433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.627767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.636055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.636727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.716391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:46:59.717234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:46:59.736406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.736915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.737388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.738115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:46:59.738575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:46:59.739007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:46:59.993888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:00.018337 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9fe89ef4-020b-43f7-a970-70cc81a978aa tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1280 microversion: 2.1 time: 0.415923 Oct 31 15:47:00.019307 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2719/5592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:46:59 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1280 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:00.031917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d7367390-f16c-4517-9072-a10f070bba33 req-5199669a-0a0b-4117-82d9-c0d76b4e0dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91348e48-50bd-4039-b86b-fa84f253bfe8", "name": "network-vif-deleted", "tag": "48f3fb0b-db4c-4a51-ba27-cab2fdc6ff4b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:00.070535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d7367390-f16c-4517-9072-a10f070bba33 req-5199669a-0a0b-4117-82d9-c0d76b4e0dcd service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.077998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d7367390-f16c-4517-9072-a10f070bba33 req-5199669a-0a0b-4117-82d9-c0d76b4e0dcd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.078726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d7367390-f16c-4517-9072-a10f070bba33 req-5199669a-0a0b-4117-82d9-c0d76b4e0dcd service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.114645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d7367390-f16c-4517-9072-a10f070bba33 req-5199669a-0a0b-4117-82d9-c0d76b4e0dcd service nova] Creating event network-vif-deleted:48f3fb0b-db4c-4a51-ba27-cab2fdc6ff4b for instance 91348e48-50bd-4039-b86b-fa84f253bfe8 on n-h2-858384-17 Oct 31 15:47:00.134898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d7367390-f16c-4517-9072-a10f070bba33 req-5199669a-0a0b-4117-82d9-c0d76b4e0dcd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112459 Oct 31 15:47:00.138152 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2720/5593] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:00.184712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:00.185795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:00.200379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.218433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.219096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.222713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.223207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.224108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.289462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:00.351281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:00.360695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.361251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.361726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.377497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lazy-loading 'fault' on Instance uuid 91348e48-50bd-4039-b86b-fa84f253bfe8 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:47:00.381348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:00.387768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:00.389375 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e889bccb-c5e8-411e-b697-a44b0947ac67 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.676526 Oct 31 15:47:00.401651 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2874/5594] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:46:59 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:47:00.434024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d0dfcbda-f6c6-49a9-b328-5f98e6a89e43 req-da209294-39c3-4cf4-8923-bab51a163f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9547ba84-a354-46e2-b2a5-4f3d4d71159d", "name": "network-vif-plugged", "status": "completed", "tag": "163e80be-44ff-4862-ae47-6ccd8f6a3afa"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:00.460338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0dfcbda-f6c6-49a9-b328-5f98e6a89e43 req-da209294-39c3-4cf4-8923-bab51a163f4e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.482736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0dfcbda-f6c6-49a9-b328-5f98e6a89e43 req-da209294-39c3-4cf4-8923-bab51a163f4e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.483616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d0dfcbda-f6c6-49a9-b328-5f98e6a89e43 req-da209294-39c3-4cf4-8923-bab51a163f4e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.530615 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d0dfcbda-f6c6-49a9-b328-5f98e6a89e43 req-da209294-39c3-4cf4-8923-bab51a163f4e service nova] Creating event network-vif-plugged:163e80be-44ff-4862-ae47-6ccd8f6a3afa for instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d on n-h1-858384-17 Oct 31 15:47:00.550099 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d0dfcbda-f6c6-49a9-b328-5f98e6a89e43 req-da209294-39c3-4cf4-8923-bab51a163f4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138422 Oct 31 15:47:00.550654 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2875/5595] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:00.566637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:00.568700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:00.594818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.595680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.596410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.601735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:00.602502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:00.609947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:00.780809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:00.806136 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30bd33bb-94c8-417f-a6ca-0a9b52d861c3 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 200 len: 1330 microversion: 2.1 time: 0.615083 Oct 31 15:47:00.806958 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2721/5596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:00 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 1330 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:00.825032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:01.047756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:01.048837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:01.058867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:01.066903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:01.067596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:01.068800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:01.070206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:01.070880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.021894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:02.038588 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83a3c286-eefd-4919-a048-d1553493854f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1322 microversion: 2.1 time: 0.995185 Oct 31 15:47:02.040177 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2722/5597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:01 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1322 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:02.051165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:02.056356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:02.069580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.070330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.071132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.072068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.073804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.079575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.140976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:02.320545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:02.330098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:02.338231 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c3e28fd-af5e-43ad-a890-7150fda08409 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1391 microversion: 2.1 time: 1.780184 Oct 31 15:47:02.356315 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2876/5598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:00 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1391 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:02.391333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:02.392226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:02.408802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.417396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.418233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.419222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.421293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.422037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.459890 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 HTTP/1.1 Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '91348e48-50bd-4039-b86b-fa84f253bfe8'} Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:02.463759 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:02.468263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:02.468263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:02.468263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:02.468263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:02.468263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:02.468263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:47:02.468263 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:02.470535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:02.471654 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-addffc62-4f50-4e46-a6fc-0fdeff608ea9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 404 len: 111 microversion: 2.1 time: 0.113872 Oct 31 15:47:02.473020 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2877/5599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:02 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:47:02.478912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-226400fa-5451-4a2a-b107-361960eaa150 req-0c6a5148-33f9-433c-94be-4070d8817c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417cbe6d-f424-498c-94dc-48d20b023b9e", "tag": "501fced1-e452-4205-b3e4-d53c73ed9dae"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:02.491162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-226400fa-5451-4a2a-b107-361960eaa150 req-0c6a5148-33f9-433c-94be-4070d8817c30 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:02.492118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-226400fa-5451-4a2a-b107-361960eaa150 req-0c6a5148-33f9-433c-94be-4070d8817c30 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:02.492931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-226400fa-5451-4a2a-b107-361960eaa150 req-0c6a5148-33f9-433c-94be-4070d8817c30 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:02.563833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-226400fa-5451-4a2a-b107-361960eaa150 req-0c6a5148-33f9-433c-94be-4070d8817c30 service nova] Creating event network-changed:501fced1-e452-4205-b3e4-d53c73ed9dae for instance 417cbe6d-f424-498c-94dc-48d20b023b9e on n-h1-858384-17 Oct 31 15:47:02.596457 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-226400fa-5451-4a2a-b107-361960eaa150 req-0c6a5148-33f9-433c-94be-4070d8817c30 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115086 Oct 31 15:47:02.600976 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2878/5600] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:02.627364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-636041f9-60ed-4f4e-bbef-b285bee0f8f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '.version_select at 0x7f16e032ee50>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:02.710338 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-636041f9-60ed-4f4e-bbef-b285bee0f8f1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-792222358" status: 202 len: 0 microversion: 2.1 time: 0.107610 Oct 31 15:47:02.714091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2879/5601] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:47:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-792222358 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:47:03.063596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:03.064465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:03.076864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.077427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.078088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:03.083243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.083979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.084578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:03.262971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:03.281781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:03.288388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:03.291489 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-713ef3b0-fe31-45b1-bd72-208958de1ed0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 1.242945 Oct 31 15:47:03.291489 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2723/5602] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:47:02 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:47:03.336203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-af467cb7-4a0e-48ad-84a3-666fe439abaa req-9a365379-71a9-411f-9dc7-574c8745bc01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb6e9e3-64a2-4755-a50d-1bdb83bce94b", "tag": "1aacf0dc-124f-432a-9583-434c0f6ad13a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:03.354524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-af467cb7-4a0e-48ad-84a3-666fe439abaa req-9a365379-71a9-411f-9dc7-574c8745bc01 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.361269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-af467cb7-4a0e-48ad-84a3-666fe439abaa req-9a365379-71a9-411f-9dc7-574c8745bc01 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.362669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-af467cb7-4a0e-48ad-84a3-666fe439abaa req-9a365379-71a9-411f-9dc7-574c8745bc01 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:03.394898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-af467cb7-4a0e-48ad-84a3-666fe439abaa req-9a365379-71a9-411f-9dc7-574c8745bc01 service nova] Creating event network-changed:1aacf0dc-124f-432a-9583-434c0f6ad13a for instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b on n-h2-858384-17 Oct 31 15:47:03.427817 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-af467cb7-4a0e-48ad-84a3-666fe439abaa req-9a365379-71a9-411f-9dc7-574c8745bc01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094178 Oct 31 15:47:03.431382 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2724/5603] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:03.440761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:03.441754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:03.449294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.450088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.451275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:03.452261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:03.454945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:03.455570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:04.123662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:04.135673 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4698cfa6-b608-43f2-a4a5-c5d9dcfc5588 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1322 microversion: 2.1 time: 1.076577 Oct 31 15:47:04.139303 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2880/5604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:03 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1322 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:04.201758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:04.214057 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23c00651-d64b-4e3c-924c-956e4d526b5e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1391 microversion: 2.1 time: 0.781123 Oct 31 15:47:04.242076 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2725/5605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:03 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1391 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:04.322197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:04.323301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:04.339809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:04.340392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:04.340994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:04.343186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:04.343769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:04.345187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:04.689820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-67236d85-8281-4bfd-b539-3984f9ee9ca4 req-3e4a91c4-4641-40c8-a003-836f8742ab59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a6e698-d8ff-424c-9858-523344add14a", "tag": "c855972b-45d8-4f2f-ae75-cba94a6d85a6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:04.716129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-67236d85-8281-4bfd-b539-3984f9ee9ca4 req-3e4a91c4-4641-40c8-a003-836f8742ab59 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:04.723273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-67236d85-8281-4bfd-b539-3984f9ee9ca4 req-3e4a91c4-4641-40c8-a003-836f8742ab59 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:04.723723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-67236d85-8281-4bfd-b539-3984f9ee9ca4 req-3e4a91c4-4641-40c8-a003-836f8742ab59 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:04.796234 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-67236d85-8281-4bfd-b539-3984f9ee9ca4 req-3e4a91c4-4641-40c8-a003-836f8742ab59 service nova] Creating event network-changed:c855972b-45d8-4f2f-ae75-cba94a6d85a6 for instance c5a6e698-d8ff-424c-9858-523344add14a on n-h2-858384-17 Oct 31 15:47:04.817799 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-67236d85-8281-4bfd-b539-3984f9ee9ca4 req-3e4a91c4-4641-40c8-a003-836f8742ab59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133358 Oct 31 15:47:04.820302 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2726/5606] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:05.010155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:05.022274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:05.024678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:05.026215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c05090d-db8b-401d-a900-b78dc1b42040 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1808 microversion: 2.20 time: 0.708157 Oct 31 15:47:05.039710 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2881/5607] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:47:04 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1808 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:47:05.168437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:05.170328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:05.177968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.178778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.180370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.181374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.186695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.187725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.248005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:05.248599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:05.261609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.262115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.262557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.264004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.264740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.265199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.592245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:05.606206 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd19b77f-cdfc-4c5b-8aa1-789804c272c5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1322 microversion: 2.1 time: 0.442070 Oct 31 15:47:05.607921 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2727/5608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:05 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:05.618076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-57236c3e-673c-4b3d-a72a-9560c964fbea req-403c0603-1ee0-4b79-a591-efa0434a27cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b346e4ef-5afc-4aa2-be89-d8f1d6d6419e", "tag": "49d597fc-04d1-4b14-97a4-2eda4b3ca80e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:05.647855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57236c3e-673c-4b3d-a72a-9560c964fbea req-403c0603-1ee0-4b79-a591-efa0434a27cb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:05.649371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57236c3e-673c-4b3d-a72a-9560c964fbea req-403c0603-1ee0-4b79-a591-efa0434a27cb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:05.650049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-57236c3e-673c-4b3d-a72a-9560c964fbea req-403c0603-1ee0-4b79-a591-efa0434a27cb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:05.651542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:05.667819 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80852114-d01e-44eb-a3da-e8d93ba8299f tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1391 microversion: 2.1 time: 0.421714 Oct 31 15:47:05.668800 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2882/5609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:05 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1391 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:05.672293 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-57236c3e-673c-4b3d-a72a-9560c964fbea req-403c0603-1ee0-4b79-a591-efa0434a27cb service nova] Creating event network-changed:49d597fc-04d1-4b14-97a4-2eda4b3ca80e for instance b346e4ef-5afc-4aa2-be89-d8f1d6d6419e on n-h2-858384-17 Oct 31 15:47:05.688703 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-57236c3e-673c-4b3d-a72a-9560c964fbea req-403c0603-1ee0-4b79-a591-efa0434a27cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079262 Oct 31 15:47:05.694122 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2728/5610] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:06.058012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:06.058977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:06.070396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:06.078395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:06.079126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:06.080041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:06.080831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:06.093718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:06.631846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:06.632943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:06.649848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:06.650820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:06.651494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:06.654492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:06.656588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:06.657648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:07.173453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:07.189318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:07.198157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:07.199402 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a30d9c08-0315-4380-8399-70ab1e3e8f98 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1795 microversion: 2.20 time: 1.145776 Oct 31 15:47:07.202422 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2883/5611] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:47:06 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1795 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:47:07.216496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:07.231421 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d7b53d02-9a14-4908-aedf-a8d4c54d002d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1322 microversion: 2.1 time: 0.600040 Oct 31 15:47:07.233723 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2729/5612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:06 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:07.249991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:07.250611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:07.261532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:07.262035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:07.262481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:07.263808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:07.264299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:07.273110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:07.306531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:07.307033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:07.318890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:07.319481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:07.320303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:07.320652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:07.321241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:07.321677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:07.516921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lazy-loading 'services' on Instance uuid 9993bf49-4859-4a8a-b916-c4883a14059c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:47:07.564105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:07.615745 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f6ae1404-6b50-429e-a001-df84c1a1e6bd tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1391 microversion: 2.1 time: 0.391919 Oct 31 15:47:07.636626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2884/5613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:07 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1391 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:07.649896 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9fb14e93-75d5-48ba-8e07-abe91fe1000b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments/9492625c-e6e9-4f55-b343-6dd09397df7c" status: 202 len: 0 microversion: 2.1 time: 0.347079 Oct 31 15:47:07.655364 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2730/5614] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:47:07 2022] DELETE /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments/9492625c-e6e9-4f55-b343-6dd09397df7c => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:47:07.664737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd4df571-0030-42f9-b2f7-052b7e69b95d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:07.667530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd4df571-0030-42f9-b2f7-052b7e69b95d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:07.701286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd4df571-0030-42f9-b2f7-052b7e69b95d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:07.702714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd4df571-0030-42f9-b2f7-052b7e69b95d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:07.704775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd4df571-0030-42f9-b2f7-052b7e69b95d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:07.707259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd4df571-0030-42f9-b2f7-052b7e69b95d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:07.712907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd4df571-0030-42f9-b2f7-052b7e69b95d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:07.714213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd4df571-0030-42f9-b2f7-052b7e69b95d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:07.789176 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd4df571-0030-42f9-b2f7-052b7e69b95d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129162 Oct 31 15:47:07.793972 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2885/5615] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:47:07 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:08.258877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:08.259573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:08.268384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.268862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.269635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.270334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.271030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.271736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.589930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:08.615146 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e102c80-b655-4bd7-8399-9db253967086 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1322 microversion: 2.1 time: 0.360752 Oct 31 15:47:08.623051 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2731/5616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:08 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:08.642068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:08.642760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:08.660203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.660711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.661170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.661879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.662505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.663084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.670125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4a68a476-1ac9-44b3-a90d-73c6a505c9bc req-cc870e1a-9205-4767-b7d6-efba8d2f6cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb6e9e3-64a2-4755-a50d-1bdb83bce94b", "name": "network-vif-plugged", "status": "completed", "tag": "1aacf0dc-124f-432a-9583-434c0f6ad13a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:08.692118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4a68a476-1ac9-44b3-a90d-73c6a505c9bc req-cc870e1a-9205-4767-b7d6-efba8d2f6cee service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.692608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4a68a476-1ac9-44b3-a90d-73c6a505c9bc req-cc870e1a-9205-4767-b7d6-efba8d2f6cee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.693046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4a68a476-1ac9-44b3-a90d-73c6a505c9bc req-cc870e1a-9205-4767-b7d6-efba8d2f6cee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.712893 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4a68a476-1ac9-44b3-a90d-73c6a505c9bc req-cc870e1a-9205-4767-b7d6-efba8d2f6cee service nova] Creating event network-vif-plugged:1aacf0dc-124f-432a-9583-434c0f6ad13a for instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b on n-h2-858384-17 Oct 31 15:47:08.719924 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4a68a476-1ac9-44b3-a90d-73c6a505c9bc req-cc870e1a-9205-4767-b7d6-efba8d2f6cee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053874 Oct 31 15:47:08.721047 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2732/5617] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:08.803125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b0d8563-0a1b-4726-94f3-87919f3a8111 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:08.806081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b0d8563-0a1b-4726-94f3-87919f3a8111 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:08.821376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0d8563-0a1b-4726-94f3-87919f3a8111 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.821875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0d8563-0a1b-4726-94f3-87919f3a8111 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.822309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0d8563-0a1b-4726-94f3-87919f3a8111 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.823017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0d8563-0a1b-4726-94f3-87919f3a8111 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:08.823482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0d8563-0a1b-4726-94f3-87919f3a8111 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:08.823915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b0d8563-0a1b-4726-94f3-87919f3a8111 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:08.884189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:08.895156 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b0d8563-0a1b-4726-94f3-87919f3a8111 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096645 Oct 31 15:47:08.902034 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2733/5618] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:47:08 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:08.949761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:08.960744 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b98a8a0d-b13b-407d-b719-5b104b78ee3c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1391 microversion: 2.1 time: 0.323197 Oct 31 15:47:08.980047 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2886/5619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:08 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1391 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:09.652776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:09.654335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:09.690611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:09.693597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:09.694073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:09.696772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:09.710575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:09.715621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:09.910780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1504db32-e619-4979-9a13-3188b041a4f2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:09.914169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1504db32-e619-4979-9a13-3188b041a4f2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:09.921689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:09.935127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1504db32-e619-4979-9a13-3188b041a4f2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:09.936105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1504db32-e619-4979-9a13-3188b041a4f2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:09.938780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1504db32-e619-4979-9a13-3188b041a4f2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:09.943081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1504db32-e619-4979-9a13-3188b041a4f2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:09.946345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1504db32-e619-4979-9a13-3188b041a4f2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:09.947399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1504db32-e619-4979-9a13-3188b041a4f2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:10.048878 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1504db32-e619-4979-9a13-3188b041a4f2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144789 Oct 31 15:47:10.050081 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2887/5620] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:47:09 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:10.057590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:10.058492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:10.067486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:10.068438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:10.072119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:10.073596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:10.074290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:10.074911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:10.216993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:10.229689 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e01da340-9fa6-4df0-9c22-556f4d322941 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1322 microversion: 2.1 time: 0.582244 Oct 31 15:47:10.230301 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2734/5621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:09 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:10.413240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:10.428475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-de16b079-43fb-41fe-97af-d63cc18f88a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1391 microversion: 2.1 time: 0.374462 Oct 31 15:47:10.455676 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2888/5622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:10 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1391 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:10.944323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2b46f7a1-f400-4f86-a207-21c8798441f0 req-8d72ee12-3a36-4b56-a909-d32e8cef77a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417cbe6d-f424-498c-94dc-48d20b023b9e", "name": "network-vif-plugged", "status": "completed", "tag": "501fced1-e452-4205-b3e4-d53c73ed9dae"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:10.968324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2b46f7a1-f400-4f86-a207-21c8798441f0 req-8d72ee12-3a36-4b56-a909-d32e8cef77a2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:10.969287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2b46f7a1-f400-4f86-a207-21c8798441f0 req-8d72ee12-3a36-4b56-a909-d32e8cef77a2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:10.972735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2b46f7a1-f400-4f86-a207-21c8798441f0 req-8d72ee12-3a36-4b56-a909-d32e8cef77a2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:10.985859 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2b46f7a1-f400-4f86-a207-21c8798441f0 req-8d72ee12-3a36-4b56-a909-d32e8cef77a2 service nova] Creating event network-vif-plugged:501fced1-e452-4205-b3e4-d53c73ed9dae for instance 417cbe6d-f424-498c-94dc-48d20b023b9e on n-h1-858384-17 Oct 31 15:47:10.991381 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2b46f7a1-f400-4f86-a207-21c8798441f0 req-8d72ee12-3a36-4b56-a909-d32e8cef77a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051378 Oct 31 15:47:10.992700 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2735/5623] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:11.062631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7540cb1e-4e8b-45d8-a890-c1b42218f451 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:11.065916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7540cb1e-4e8b-45d8-a890-c1b42218f451 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:11.080786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7540cb1e-4e8b-45d8-a890-c1b42218f451 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:11.086591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7540cb1e-4e8b-45d8-a890-c1b42218f451 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:11.087342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7540cb1e-4e8b-45d8-a890-c1b42218f451 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.088318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7540cb1e-4e8b-45d8-a890-c1b42218f451 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:11.089108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7540cb1e-4e8b-45d8-a890-c1b42218f451 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:11.092591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7540cb1e-4e8b-45d8-a890-c1b42218f451 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.166860 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7540cb1e-4e8b-45d8-a890-c1b42218f451 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109036 Oct 31 15:47:11.168221 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2889/5624] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:47:11 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:11.259646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:11.260497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:11.262717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:11.279266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:11.280194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:11.280755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.281875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:11.285323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:11.286040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.473997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:11.475249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:11.490220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:11.496336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:11.497197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.498588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:11.499279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:11.501349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:11.561070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:11.573701 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-488e5b32-6f25-4ef0-b6aa-152e7720de2a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1322 microversion: 2.1 time: 0.318349 Oct 31 15:47:11.578920 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2736/5625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:11 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:11.793316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:11.810621 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f9e5b26-9a72-4246-9d22-3bb54c8d94e5 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1391 microversion: 2.1 time: 0.353287 Oct 31 15:47:11.811446 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2890/5626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:11 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1391 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:12.180180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ed626acd-8cb1-4b21-9499-2da2467f5483 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:12.182385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ed626acd-8cb1-4b21-9499-2da2467f5483 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:12.203445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed626acd-8cb1-4b21-9499-2da2467f5483 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.203946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed626acd-8cb1-4b21-9499-2da2467f5483 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.204385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed626acd-8cb1-4b21-9499-2da2467f5483 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:12.205095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed626acd-8cb1-4b21-9499-2da2467f5483 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.205576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed626acd-8cb1-4b21-9499-2da2467f5483 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.206000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ed626acd-8cb1-4b21-9499-2da2467f5483 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:12.284474 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ed626acd-8cb1-4b21-9499-2da2467f5483 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108457 Oct 31 15:47:12.287523 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2737/5627] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:47:12 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:12.603878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:12.604589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:12.620135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.620725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.621409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:12.623082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.623835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.624485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:12.837921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:12.838741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:12.852473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.854444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.856243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:12.858377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:12.859622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:12.863932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:12.910517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:12.921579 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f6d3151-c267-4c86-bb8a-c3de54548145 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1322 microversion: 2.1 time: 0.321202 Oct 31 15:47:12.934711 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2891/5628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:12 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:13.067726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-67c7ac98-4fd6-4a0c-b31d-2adcf54eef18 req-753c1a10-eaa1-41e4-8469-0b7264f0172d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b346e4ef-5afc-4aa2-be89-d8f1d6d6419e", "name": "network-vif-plugged", "status": "completed", "tag": "49d597fc-04d1-4b14-97a4-2eda4b3ca80e"}, {"server_uuid": "c5a6e698-d8ff-424c-9858-523344add14a", "name": "network-vif-plugged", "status": "completed", "tag": "c855972b-45d8-4f2f-ae75-cba94a6d85a6"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:13.071060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:13.088694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-67c7ac98-4fd6-4a0c-b31d-2adcf54eef18 req-753c1a10-eaa1-41e4-8469-0b7264f0172d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:13.093006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-67c7ac98-4fd6-4a0c-b31d-2adcf54eef18 req-753c1a10-eaa1-41e4-8469-0b7264f0172d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:13.094083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-67c7ac98-4fd6-4a0c-b31d-2adcf54eef18 req-753c1a10-eaa1-41e4-8469-0b7264f0172d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:13.094948 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11bf8963-6671-462a-9b1f-fcbe22b87339 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1391 microversion: 2.1 time: 0.261402 Oct 31 15:47:13.101598 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2738/5629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:12 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1391 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:13.127710 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-67c7ac98-4fd6-4a0c-b31d-2adcf54eef18 req-753c1a10-eaa1-41e4-8469-0b7264f0172d service nova] Creating event network-vif-plugged:49d597fc-04d1-4b14-97a4-2eda4b3ca80e for instance b346e4ef-5afc-4aa2-be89-d8f1d6d6419e on n-h2-858384-17 Oct 31 15:47:13.128385 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-67c7ac98-4fd6-4a0c-b31d-2adcf54eef18 req-753c1a10-eaa1-41e4-8469-0b7264f0172d service nova] Creating event network-vif-plugged:c855972b-45d8-4f2f-ae75-cba94a6d85a6 for instance c5a6e698-d8ff-424c-9858-523344add14a on n-h2-858384-17 Oct 31 15:47:13.137059 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-67c7ac98-4fd6-4a0c-b31d-2adcf54eef18 req-753c1a10-eaa1-41e4-8469-0b7264f0172d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073028 Oct 31 15:47:13.138732 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2892/5630] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:13.299573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-63680822-87f6-499b-a471-0eb8cd8a4c9b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:13.301989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-63680822-87f6-499b-a471-0eb8cd8a4c9b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:13.315535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63680822-87f6-499b-a471-0eb8cd8a4c9b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:13.315881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63680822-87f6-499b-a471-0eb8cd8a4c9b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:13.316635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63680822-87f6-499b-a471-0eb8cd8a4c9b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:13.336555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63680822-87f6-499b-a471-0eb8cd8a4c9b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:13.337669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63680822-87f6-499b-a471-0eb8cd8a4c9b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:13.338345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-63680822-87f6-499b-a471-0eb8cd8a4c9b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:13.423824 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-63680822-87f6-499b-a471-0eb8cd8a4c9b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126486 Oct 31 15:47:13.426675 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2739/5631] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:47:13 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:13.955144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:13.957096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:13.967712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:13.969033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:13.969867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:13.971291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:13.972498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:13.973494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:14.126326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:14.127410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:14.149282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:14.151435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:14.153090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:14.156782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:14.158449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:14.160887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:14.247096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:14.256062 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6871af3c-781b-469e-b215-acf4cca384d2 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1322 microversion: 2.1 time: 0.311618 Oct 31 15:47:14.256691 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2893/5632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:13 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:14.436722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-30e68ae0-67c8-4ea8-8c0e-6b66f4f55c5f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:14.439728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-30e68ae0-67c8-4ea8-8c0e-6b66f4f55c5f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:14.452132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30e68ae0-67c8-4ea8-8c0e-6b66f4f55c5f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:14.452634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30e68ae0-67c8-4ea8-8c0e-6b66f4f55c5f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:14.453080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30e68ae0-67c8-4ea8-8c0e-6b66f4f55c5f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:14.453833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30e68ae0-67c8-4ea8-8c0e-6b66f4f55c5f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:14.454305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30e68ae0-67c8-4ea8-8c0e-6b66f4f55c5f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:14.454735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-30e68ae0-67c8-4ea8-8c0e-6b66f4f55c5f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:14.464641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:14.481821 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe13c461-a506-4de3-8d64-397d18d4684e tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1391 microversion: 2.1 time: 0.362213 Oct 31 15:47:14.501640 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2740/5633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:14 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1391 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:14.521433 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-30e68ae0-67c8-4ea8-8c0e-6b66f4f55c5f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088679 Oct 31 15:47:14.526811 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2894/5634] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:47:14 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:15.286585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:15.287548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:15.307200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.307715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.308161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.314316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.314818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.315268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.508441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:15.510000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:15.525047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.530075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.531554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.532518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.533244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.534157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.627170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:15.642438 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b6d44018-653c-4fc1-8135-0d92d6e8a1b4 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 200 len: 1515 microversion: 2.1 time: 0.360591 Oct 31 15:47:15.643035 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2741/5635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:15 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 1515 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:15.656228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5c7632f3-1163-4149-a100-a6f13bee0ada tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:15.666444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5c7632f3-1163-4149-a100-a6f13bee0ada tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:15.677301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c7632f3-1163-4149-a100-a6f13bee0ada tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.678284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c7632f3-1163-4149-a100-a6f13bee0ada tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.678970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c7632f3-1163-4149-a100-a6f13bee0ada tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.680105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c7632f3-1163-4149-a100-a6f13bee0ada tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.680912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c7632f3-1163-4149-a100-a6f13bee0ada tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.681588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5c7632f3-1163-4149-a100-a6f13bee0ada tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.735031 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5c7632f3-1163-4149-a100-a6f13bee0ada tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086094 Oct 31 15:47:15.735631 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2742/5636] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:47:15 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:15.741392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:15.741392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 417cbe6d-f424-498c-94dc-48d20b023b9e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:15.747691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.748554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.749096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.749934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.750456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.750917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.826481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:15.835954 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-948a497f-8e05-44c3-908d-d416017af420 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1562 microversion: 2.1 time: 0.331880 Oct 31 15:47:15.837349 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2895/5637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:15 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1562 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:15.865203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:15.866351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:15.881891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.884994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.885543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.888224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:15.889761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:15.890478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:15.919976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:16.086944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:16.099593 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b1ec7199-784e-4645-aa86-f12d93951b75 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e" status: 200 len: 1515 microversion: 2.1 time: 0.360764 Oct 31 15:47:16.101676 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2743/5638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:15 2022] GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:16.117103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:16.129157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:16.129837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:16.131013 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7bc4820-d398-4e79-b289-99b0ae4dc635 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1562 microversion: 2.1 time: 0.270919 Oct 31 15:47:16.131933 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2896/5639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:15 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1562 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:16.138697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.141329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.142700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.149925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.151504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.152226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.583688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:16.594945 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa04b6c3-5801-4a33-a487-f954a7bb6891 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b" status: 200 len: 1516 microversion: 2.1 time: 0.470870 Oct 31 15:47:16.609730 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2744/5640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:16 2022] GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b => generated 1516 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:16.632243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:16.632766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:16.647415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.648154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.648755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.649713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.650328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.650906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.718579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:47:16.750588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01772942-868f-4841-af62-08b499e068bf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:16.765882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01772942-868f-4841-af62-08b499e068bf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:16.798520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01772942-868f-4841-af62-08b499e068bf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.799135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01772942-868f-4841-af62-08b499e068bf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.799596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01772942-868f-4841-af62-08b499e068bf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.800345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01772942-868f-4841-af62-08b499e068bf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.801356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01772942-868f-4841-af62-08b499e068bf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.801820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01772942-868f-4841-af62-08b499e068bf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.823252 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-895404fb-db21-4bd4-8a0a-e343d71bb988 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b" status: 204 len: 0 microversion: 2.1 time: 0.202542 Oct 31 15:47:16.827244 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2897/5641] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:47:16 2022] DELETE /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:47:16.835136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:16.836035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:16.842577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.843066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.843505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.844286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.844673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.845094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.870526 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01772942-868f-4841-af62-08b499e068bf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127267 Oct 31 15:47:16.889579 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2745/5642] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:47:16 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:47:16.973920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:16.974417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:16.981172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.982910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.983549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:16.984448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:16.985076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:16.985710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:17.015861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:47:17.105516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:17.117786 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-519c7c68-11f2-4cf1-b231-283ef812a9b7 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b" status: 200 len: 1522 microversion: 2.1 time: 0.288851 Oct 31 15:47:17.133328 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2898/5643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:16 2022] GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:17.146387 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b1ceea8-a511-41a4-9e7f-7dec92cdb666 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 204 len: 0 microversion: 2.1 time: 0.177442 Oct 31 15:47:17.147193 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2746/5644] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:47:16 2022] DELETE /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:47:17.156588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:17.157228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:17.163246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:17.163758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:17.164200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:17.164889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:17.165367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:17.165789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:17.731272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:17.741360 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-206cdd91-3a06-4423-8568-46a7152c59b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1681 microversion: 2.1 time: 0.589485 Oct 31 15:47:17.753292 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2899/5645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:17 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1681 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:18.148476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:18.148476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:18.152202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:18.166035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:18.169197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:18.170922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:18.172373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:18.173595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:18.487258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:18.496368 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2400e202-8746-4cdb-80f7-a7b7bb304b2b tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b" status: 200 len: 1522 microversion: 2.1 time: 0.359172 Oct 31 15:47:18.500802 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2747/5646] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:18 2022] GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:18.766415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:18.767683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:18.780551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:18.781339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:18.789023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:18.790538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:18.791478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:18.792080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:19.134468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d2303009-c137-44a2-bbf3-e364061d79bf req-fbb12665-dce1-45f3-99e0-fc4c87308e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb6e9e3-64a2-4755-a50d-1bdb83bce94b", "name": "network-vif-deleted", "tag": "1aacf0dc-124f-432a-9583-434c0f6ad13a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:19.151473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d2303009-c137-44a2-bbf3-e364061d79bf req-fbb12665-dce1-45f3-99e0-fc4c87308e0c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:19.166133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d2303009-c137-44a2-bbf3-e364061d79bf req-fbb12665-dce1-45f3-99e0-fc4c87308e0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:19.166500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d2303009-c137-44a2-bbf3-e364061d79bf req-fbb12665-dce1-45f3-99e0-fc4c87308e0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:19.181280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:19.201375 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cae978d8-8fe2-4281-94cb-d1f53c2c5870 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1681 microversion: 2.1 time: 0.434294 Oct 31 15:47:19.202756 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2900/5647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:18 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1681 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:19.222674 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d2303009-c137-44a2-bbf3-e364061d79bf req-fbb12665-dce1-45f3-99e0-fc4c87308e0c service nova] Creating event network-vif-deleted:1aacf0dc-124f-432a-9583-434c0f6ad13a for instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b on n-h2-858384-17 Oct 31 15:47:19.228618 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d2303009-c137-44a2-bbf3-e364061d79bf req-fbb12665-dce1-45f3-99e0-fc4c87308e0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097600 Oct 31 15:47:19.229602 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2748/5648] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:19.522487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:19.523433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:19.537461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:19.538490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:19.541190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:19.544828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:19.545561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:19.546581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:19.618690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:19.619441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:19.620318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:19.620989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lazy-loading 'fault' on Instance uuid 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:47:19.750781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:19.761955 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5123b06a-a1d4-45e0-bfc7-b3eb76c5f008 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b" status: 200 len: 1312 microversion: 2.1 time: 0.243344 Oct 31 15:47:19.764258 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2901/5649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:19 2022] GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:20.237198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:20.238977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:20.253175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.254566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.255245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.256324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.256820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.257303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.376789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:20.378636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:20.390907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.392835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.393991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.398720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.401763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.402371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.614660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:20.625621 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c21a4d57-d64e-4c61-adfb-23be70755268 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1614 microversion: 2.1 time: 0.396703 Oct 31 15:47:20.643003 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2749/5650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:20 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1614 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:20.658538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-4aa62b57-2eee-45b0-b234-0f4ae856537d req-3a353995-f455-402f-81d9-c516ebfe3e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a6e698-d8ff-424c-9858-523344add14a", "tag": "c855972b-45d8-4f2f-ae75-cba94a6d85a6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:20.674714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4aa62b57-2eee-45b0-b234-0f4ae856537d req-3a353995-f455-402f-81d9-c516ebfe3e0b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.675213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4aa62b57-2eee-45b0-b234-0f4ae856537d req-3a353995-f455-402f-81d9-c516ebfe3e0b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.675646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-4aa62b57-2eee-45b0-b234-0f4ae856537d req-3a353995-f455-402f-81d9-c516ebfe3e0b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.682928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:20.696028 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-4aa62b57-2eee-45b0-b234-0f4ae856537d req-3a353995-f455-402f-81d9-c516ebfe3e0b service nova] Creating event network-changed:c855972b-45d8-4f2f-ae75-cba94a6d85a6 for instance c5a6e698-d8ff-424c-9858-523344add14a on n-h2-858384-17 Oct 31 15:47:20.704341 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-4aa62b57-2eee-45b0-b234-0f4ae856537d req-3a353995-f455-402f-81d9-c516ebfe3e0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054980 Oct 31 15:47:20.705395 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2750/5651] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:20.800989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:20.802901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:20.829601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.831736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.832539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.835435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.836807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.838573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.865598 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] HTTP exception thrown: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Request method failure captured: Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b HTTP/1.1 Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-3kCfWY1-4XygvyXxL9LSHad6jqsd7ulUXoGX_bjuSgKTfuONjTBfpOhdGwY3Jomy_7XtiLP0NhmBQBDEIVJExkJ5JxEiP5bPf8WoiQGB799RyxwMOwJwDFN6OZp3hLbHmZBevFGf8ET1KnFwPdTdCiyv_z0xc08Gl8sFHPlLZddbs Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d44ad31033f46788b7f8d519423e72a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d44ad31033f46788b7f8d519423e72a"}]}] Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: eee804c5e68f49f0be33c1b83c550e74 Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '3eb6e9e3-64a2-4755-a50d-1bdb83bce94b'} Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:20.867665 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:20.872926 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:20.872926 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:20.872926 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:20.872926 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:20.872926 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:20.872926 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:20.872926 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:20.872926 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:20.873668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:20.878133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Returning 404 to user: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:20.882925 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32e690ad-b1dc-40de-9c9e-a1af9560c21d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b" status: 404 len: 111 microversion: 2.1 time: 0.092352 Oct 31 15:47:20.885154 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9a0180b-1c69-419f-b75e-0c2cf2469785 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1562 microversion: 2.1 time: 0.513621 Oct 31 15:47:20.886058 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2751/5652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:20 2022] GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:47:20.886637 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2902/5653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:20 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1562 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:20.894187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:20.903469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:20.904774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '5d44ad31033f46788b7f8d519423e72a'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:47:20.910814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.911534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.912138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:20.913059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:20.913706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:20.914344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.049323 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f68db294-b163-4989-aab9-38ecb63937e8 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.158914 Oct 31 15:47:21.050809 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2752/5654] 10.222.0.20 () {58 vars in 1230 bytes} [Mon Oct 31 15:47:20 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:47:21.064887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e452d778-f18d-414e-823d-3989a6aab24c tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e452d778-f18d-414e-823d-3989a6aab24c tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Request method failure captured: Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-3kCfWY1-4XygvyXxL9LSHad6jqsd7ulUXoGX_bjuSgKTfuONjTBfpOhdGwY3Jomy_7XtiLP0NhmBQBDEIVJExkJ5JxEiP5bPf8WoiQGB799RyxwMOwJwDFN6OZp3hLbHmZBevFGf8ET1KnFwPdTdCiyv_z0xc08Gl8sFHPlLZddbs Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d44ad31033f46788b7f8d519423e72a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d44ad31033f46788b7f8d519423e72a"}]}] Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: eee804c5e68f49f0be33c1b83c550e74 Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 31 15:47:21.069743 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 31 15:47:21.073711 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.077373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e452d778-f18d-414e-823d-3989a6aab24c tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:21.078522 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e452d778-f18d-414e-823d-3989a6aab24c tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.018008 Oct 31 15:47:21.084246 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2903/5655] 10.222.0.20 () {58 vars in 1182 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:47:21.091429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.097490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:21.098353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Searching by: {'deleted': False, 'project_id': '5d44ad31033f46788b7f8d519423e72a'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:47:21.105771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.106401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.106883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.108285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.109111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.109415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.159886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:47:21.244038 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0240bce-bba3-4316-bf38-4ed3a040a000 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.158196 Oct 31 15:47:21.245703 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2753/5656] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers => generated 681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:21.260769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.289946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:21.292982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.compute.servers [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Removing options 'limit' from query {{(pid=120587) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 31 15:47:21.296403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Searching by: {'deleted': False, 'project_id': '5d44ad31033f46788b7f8d519423e72a'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:47:21.316680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.317407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.317858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.319669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.320155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.320593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.370623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.multi_cell_list [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:47:21.411037 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2679c887-536e-4d5d-a93c-8333234afb73 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.157450 Oct 31 15:47:21.412170 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2904/5657] 10.222.0.20 () {58 vars in 1144 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:21.425641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d5e5e34-6aa1-48eb-8245-313a569dc1fc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d5e5e34-6aa1-48eb-8245-313a569dc1fc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Request method failure captured: Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-3kCfWY1-4XygvyXxL9LSHad6jqsd7ulUXoGX_bjuSgKTfuONjTBfpOhdGwY3Jomy_7XtiLP0NhmBQBDEIVJExkJ5JxEiP5bPf8WoiQGB799RyxwMOwJwDFN6OZp3hLbHmZBevFGf8ET1KnFwPdTdCiyv_z0xc08Gl8sFHPlLZddbs Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d44ad31033f46788b7f8d519423e72a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d44ad31033f46788b7f8d519423e72a"}]}] Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: eee804c5e68f49f0be33c1b83c550e74 Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: action_args: {} Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '-1' Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 31 15:47:21.429763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.435493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d5e5e34-6aa1-48eb-8245-313a569dc1fc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:21.437992 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d5e5e34-6aa1-48eb-8245-313a569dc1fc tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.016520 Oct 31 15:47:21.438683 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2754/5658] 10.222.0.20 () {58 vars in 1142 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:47:21.448631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb581ffc-7bec-4f30-a068-2042b45ff99f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb581ffc-7bec-4f30-a068-2042b45ff99f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Request method failure captured: Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-3kCfWY1-4XygvyXxL9LSHad6jqsd7ulUXoGX_bjuSgKTfuONjTBfpOhdGwY3Jomy_7XtiLP0NhmBQBDEIVJExkJ5JxEiP5bPf8WoiQGB799RyxwMOwJwDFN6OZp3hLbHmZBevFGf8ET1KnFwPdTdCiyv_z0xc08Gl8sFHPlLZddbs Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d44ad31033f46788b7f8d519423e72a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d44ad31033f46788b7f8d519423e72a"}]}] Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: eee804c5e68f49f0be33c1b83c550e74 Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: action_args: {} Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'testing' Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 31 15:47:21.455006 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:21.460096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb581ffc-7bec-4f30-a068-2042b45ff99f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:21.461724 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fb581ffc-7bec-4f30-a068-2042b45ff99f tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.017440 Oct 31 15:47:21.462406 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2905/5659] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:47:21.472332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32e73f64-d6a1-4289-a161-f95c76a5d167 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.478441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-32e73f64-d6a1-4289-a161-f95c76a5d167 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:21.479492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32e73f64-d6a1-4289-a161-f95c76a5d167 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '5d44ad31033f46788b7f8d519423e72a'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:47:21.490733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.compute.servers [None req-32e73f64-d6a1-4289-a161-f95c76a5d167 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Flavor 'non_existing_flavor' could not be found {{(pid=120588) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 31 15:47:21.492694 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32e73f64-d6a1-4289-a161-f95c76a5d167 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.024321 Oct 31 15:47:21.493858 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2755/5660] 10.222.0.20 () {58 vars in 1178 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 31 15:47:21.508542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.517666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:21.519096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '5d44ad31033f46788b7f8d519423e72a'} {{(pid=120587) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:47:21.526779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.527419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.527992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.529119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.529709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.530235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.629215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-646c455a-768f-4b8a-aba8-ddfddfd4719d tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.126235 Oct 31 15:47:21.629956 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2906/5661] 10.222.0.20 () {58 vars in 1174 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:47:21.645184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.660272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:21.661142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '5d44ad31033f46788b7f8d519423e72a'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:47:21.665166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.666058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:21.677183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.678675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.680217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.681311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.682346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.683099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.685326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.685900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.687393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.689313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.690041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.690704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.852195 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9996402-b0a9-4939-a0e4-ecf916c736bf tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.213140 Oct 31 15:47:21.862978 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2756/5662] 10.222.0.20 () {58 vars in 1184 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:47:21.869277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:21.881072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:21.882763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Searching by: {'deleted': False, 'project_id': '5d44ad31033f46788b7f8d519423e72a'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:47:21.898737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:21.908074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.914064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.914665 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa62b50d-6c79-42ce-b9b7-968a3d4fed00 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 200 len: 1614 microversion: 2.1 time: 0.258814 Oct 31 15:47:21.914819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:21.915658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:21.915797 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2907/5663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 1614 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:21.916300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:21.916792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.025659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:47:22.089316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:22.101312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.102361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.102900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.465488 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-93faf129-ac7c-431f-940e-e36cd7ccc65a tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.600824 Oct 31 15:47:22.466308 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2757/5664] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 15:47:21 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:22.491791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-755e917b-7d10-449d-bd9c-8f854ff18ded tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:22.497390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-755e917b-7d10-449d-bd9c-8f854ff18ded tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:22.498629 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-755e917b-7d10-449d-bd9c-8f854ff18ded tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010811 Oct 31 15:47:22.499207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2908/5665] 10.222.0.20 () {58 vars in 1178 bytes} [Mon Oct 31 15:47:22 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:47:22.511676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:22.518207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:22.518878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Searching by: {'deleted': False, 'project_id': '5d44ad31033f46788b7f8d519423e72a'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 15:47:22.524087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.524576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.525013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.525781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.526240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.526664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.553038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 15:47:22.584394 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70f5a04d-bbbc-45fd-8055-ae3062fdb2ff tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.076555 Oct 31 15:47:22.585338 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2758/5666] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 15:47:22 2022] GET /compute/v2.1/servers => generated 681 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:22.598905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:22.599395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:22.605426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.606419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.607241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.608206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.608950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.609337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.625477 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] HTTP exception thrown: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Request method failure captured: Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b HTTP/1.1 Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-3kCfWY1-4XygvyXxL9LSHad6jqsd7ulUXoGX_bjuSgKTfuONjTBfpOhdGwY3Jomy_7XtiLP0NhmBQBDEIVJExkJ5JxEiP5bPf8WoiQGB799RyxwMOwJwDFN6OZp3hLbHmZBevFGf8ET1KnFwPdTdCiyv_z0xc08Gl8sFHPlLZddbs Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d44ad31033f46788b7f8d519423e72a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d44ad31033f46788b7f8d519423e72a"}]}] Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: eee804c5e68f49f0be33c1b83c550e74 Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '3eb6e9e3-64a2-4755-a50d-1bdb83bce94b'} Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:22.627623 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:22.631948 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:22.633442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Returning 404 to user: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:22.634446 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac747d89-3f16-455e-b208-782ec3e2a3b5 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b" status: 404 len: 111 microversion: 2.1 time: 0.040645 Oct 31 15:47:22.635640 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2909/5667] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:47:22 2022] DELETE /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:47:22.643911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:22.644854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 417cbe6d-f424-498c-94dc-48d20b023b9e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:22.652427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.653417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.654066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.655303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.656098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.656531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.704313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 417cbe6d-f424-498c-94dc-48d20b023b9e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:47:22.733820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d217da5e-a1b6-4555-86f2-c8f87cc26b5f req-78051de6-f7c2-40ba-8dd5-8dd5728a058a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9993bf49-4859-4a8a-b916-c4883a14059c", "name": "network-vif-deleted", "tag": "cf2bce7c-44ae-4462-8fe1-64047df8f3ea"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:22.745925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d217da5e-a1b6-4555-86f2-c8f87cc26b5f req-78051de6-f7c2-40ba-8dd5-8dd5728a058a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.746382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d217da5e-a1b6-4555-86f2-c8f87cc26b5f req-78051de6-f7c2-40ba-8dd5-8dd5728a058a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.752653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d217da5e-a1b6-4555-86f2-c8f87cc26b5f req-78051de6-f7c2-40ba-8dd5-8dd5728a058a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.788209 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d217da5e-a1b6-4555-86f2-c8f87cc26b5f req-78051de6-f7c2-40ba-8dd5-8dd5728a058a service nova] Creating event network-vif-deleted:cf2bce7c-44ae-4462-8fe1-64047df8f3ea for instance 9993bf49-4859-4a8a-b916-c4883a14059c on n-h1-858384-17 Oct 31 15:47:22.802574 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d217da5e-a1b6-4555-86f2-c8f87cc26b5f req-78051de6-f7c2-40ba-8dd5-8dd5728a058a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074931 Oct 31 15:47:22.806475 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2910/5668] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:22.850147 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57ccf85e-f151-435f-b525-ff0057baf258 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e" status: 204 len: 0 microversion: 2.1 time: 0.209906 Oct 31 15:47:22.853196 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2759/5669] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:47:22 2022] DELETE /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:47:22.860322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:22.861295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:22.868436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.869271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.869782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.870634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.871301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.872540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.902494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:47:22.945497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:22.950947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:22.961351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.962114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.962721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.964284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:22.964926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:22.967001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:22.992852 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c HTTP/1.1 Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9993bf49-4859-4a8a-b916-c4883a14059c'} Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:22.994993 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:23.000335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:23.000335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:23.000335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:23.000335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:23.000335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:23.000335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:47:23.000335 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:23.012097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:23.014398 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d494de08-805b-4d7a-9cfe-c0bb418206ef tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 404 len: 111 microversion: 2.1 time: 0.073365 Oct 31 15:47:23.016916 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2760/5670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:22 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:47:23.018340 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd318581-45a5-4635-8e07-b1d39ee369ac tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 204 len: 0 microversion: 2.1 time: 0.161973 Oct 31 15:47:23.019264 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2911/5671] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:47:22 2022] DELETE /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:47:23.027454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec307cea-1946-4774-a38b-0fef7d18550a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '.version_select at 0x7f16e0e4d8b0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:23.032844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:23.033573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:23.042222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:23.042713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:23.043149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:23.043879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:23.044493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:23.045055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:23.056303 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec307cea-1946-4774-a38b-0fef7d18550a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498283281" status: 202 len: 0 microversion: 2.1 time: 0.033923 Oct 31 15:47:23.057658 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2761/5672] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 15:47:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498283281 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:47:23.072201 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] HTTP exception thrown: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Request method failure captured: Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b HTTP/1.1 Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-3kCfWY1-4XygvyXxL9LSHad6jqsd7ulUXoGX_bjuSgKTfuONjTBfpOhdGwY3Jomy_7XtiLP0NhmBQBDEIVJExkJ5JxEiP5bPf8WoiQGB799RyxwMOwJwDFN6OZp3hLbHmZBevFGf8ET1KnFwPdTdCiyv_z0xc08Gl8sFHPlLZddbs Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d44ad31033f46788b7f8d519423e72a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d44ad31033f46788b7f8d519423e72a"}]}] Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: eee804c5e68f49f0be33c1b83c550e74 Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '3eb6e9e3-64a2-4755-a50d-1bdb83bce94b'} Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:23.075873 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:23.080071 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:23.080071 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:23.080071 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:23.080071 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:23.080071 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:23.080071 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:23.080071 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. Oct 31 15:47:23.080071 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:23.082261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Returning 404 to user: Instance 3eb6e9e3-64a2-4755-a50d-1bdb83bce94b could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:23.083577 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1326cf03-19bd-4fbb-8827-c46e8f910630 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b" status: 404 len: 111 microversion: 2.1 time: 0.059645 Oct 31 15:47:23.084920 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2912/5673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:23 2022] GET /compute/v2.1/servers/3eb6e9e3-64a2-4755-a50d-1bdb83bce94b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:47:23.096573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:23.097662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 417cbe6d-f424-498c-94dc-48d20b023b9e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:23.113227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:23.113791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:23.114231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:23.116675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:23.117237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:23.117680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:23.410710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:23.424372 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df7058db-eb78-4019-be20-9405feeee114 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e" status: 200 len: 1521 microversion: 2.1 time: 0.333764 Oct 31 15:47:23.425450 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2762/5674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:23 2022] GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:24.141551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29d63d38-2282-412a-9dea-1b79c94f1419 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: .version_select at 0x7f16e03600d0>, body: {"keypair": {"name": "tempest-keypair-1396516908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDE50Gq4LUuxV8mrbPp6jOFDmEUpt8lWSDaYtKc/FtwpH+QgU6xTFnSoWXN0GvY/3xKgQtFL7ivd9C6AE2XKbBjj3RXHfEO5k4dNpVhutV2SrCdUXOPPX9hZpy0mR28wRA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:24.162473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-29d63d38-2282-412a-9dea-1b79c94f1419 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for project bb201c74554c43f0a526161cf24206f3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:47:24.170072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-29d63d38-2282-412a-9dea-1b79c94f1419 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for user a5bfcc2112ea47dcb758487de253311f and project bb201c74554c43f0a526161cf24206f3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:47:24.201779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29d63d38-2282-412a-9dea-1b79c94f1419 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066952 Oct 31 15:47:24.202649 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2913/5675] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:47:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:24.450395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:24.466918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 417cbe6d-f424-498c-94dc-48d20b023b9e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:24.480018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:24.485693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:24.486637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:24.487696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:24.489502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:24.493707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:24.835346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:24.847975 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-facd35c6-a1ab-43c2-94e9-3078e35da781 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e" status: 200 len: 1521 microversion: 2.1 time: 0.402034 Oct 31 15:47:24.852713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2763/5676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:24 2022] GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:25.591119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-06a7bc00-0b4d-4152-84e1-8a00b53b4996 req-f1e9bfe3-69c3-46a6-8e46-36a64b56ed0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417cbe6d-f424-498c-94dc-48d20b023b9e", "name": "network-vif-deleted", "tag": "501fced1-e452-4205-b3e4-d53c73ed9dae"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:25.610321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-06a7bc00-0b4d-4152-84e1-8a00b53b4996 req-f1e9bfe3-69c3-46a6-8e46-36a64b56ed0e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:25.611138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-06a7bc00-0b4d-4152-84e1-8a00b53b4996 req-f1e9bfe3-69c3-46a6-8e46-36a64b56ed0e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:25.612108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-06a7bc00-0b4d-4152-84e1-8a00b53b4996 req-f1e9bfe3-69c3-46a6-8e46-36a64b56ed0e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:25.632751 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-06a7bc00-0b4d-4152-84e1-8a00b53b4996 req-f1e9bfe3-69c3-46a6-8e46-36a64b56ed0e service nova] Creating event network-vif-deleted:501fced1-e452-4205-b3e4-d53c73ed9dae for instance 417cbe6d-f424-498c-94dc-48d20b023b9e on n-h1-858384-17 Oct 31 15:47:25.654349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fec20745-4afb-43cc-a2f8-01ee5a80ef4d req-69578084-9b27-4d06-b8af-eaed1991480c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b346e4ef-5afc-4aa2-be89-d8f1d6d6419e", "name": "network-vif-deleted", "tag": "49d597fc-04d1-4b14-97a4-2eda4b3ca80e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:25.673318 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-06a7bc00-0b4d-4152-84e1-8a00b53b4996 req-f1e9bfe3-69c3-46a6-8e46-36a64b56ed0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083194 Oct 31 15:47:25.674592 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2764/5677] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:47:25.679500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fec20745-4afb-43cc-a2f8-01ee5a80ef4d req-69578084-9b27-4d06-b8af-eaed1991480c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:25.680376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fec20745-4afb-43cc-a2f8-01ee5a80ef4d req-69578084-9b27-4d06-b8af-eaed1991480c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:25.680974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fec20745-4afb-43cc-a2f8-01ee5a80ef4d req-69578084-9b27-4d06-b8af-eaed1991480c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:25.701714 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fec20745-4afb-43cc-a2f8-01ee5a80ef4d req-69578084-9b27-4d06-b8af-eaed1991480c service nova] Creating event network-vif-deleted:49d597fc-04d1-4b14-97a4-2eda4b3ca80e for instance b346e4ef-5afc-4aa2-be89-d8f1d6d6419e on n-h2-858384-17 Oct 31 15:47:25.717017 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fec20745-4afb-43cc-a2f8-01ee5a80ef4d req-69578084-9b27-4d06-b8af-eaed1991480c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384675 Oct 31 15:47:25.718786 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2914/5678] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:25.884102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:25.887480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 417cbe6d-f424-498c-94dc-48d20b023b9e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:25.906838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:25.907358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:25.907806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:25.908544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:25.914379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:25.914831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:26.019349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:26.020121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:26.020452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2071090383", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "67ca99e6-c62f-46a5-9d27-46f72e4f74ec"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:26.021242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:26.021921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lazy-loading 'fault' on Instance uuid 417cbe6d-f424-498c-94dc-48d20b023b9e {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:47:26.111207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] validate_networks() for [('67ca99e6-c62f-46a5-9d27-46f72e4f74ec', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:47:26.143054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eee804c5e68f49f0be33c1b83c550e74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d44ad31033f46788b7f8d519423e72a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:26.160244 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b06162a-a9c7-4f7f-ba76-c1306c94d52e tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e" status: 200 len: 1312 microversion: 2.1 time: 0.286563 Oct 31 15:47:26.160834 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2765/5679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:25 2022] GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e => generated 1312 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:26.710284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:47:26.711528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:47:26.712291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:47:26.713792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:47:26.714550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:47:26.725774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:26.726889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:26.727443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:26.728295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:26.730237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:26.731700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:26.757571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Getting quotas for project 6c8321916c4547caaa589204fee9ba00. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:47:26.765901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Getting quotas for user 0c219c6e29154502b84b3f7ac4577ea7 and project 6c8321916c4547caaa589204fee9ba00. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:47:26.782812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:47:26.786237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:47:26.882241 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db842fea-54b2-4653-8901-d586f814fdd2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866065 Oct 31 15:47:26.885744 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2915/5680] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:47:26.898786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a8f6abc7-9ffa-47ec-a490-1eb7ebe8f10e tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:26.899560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a8f6abc7-9ffa-47ec-a490-1eb7ebe8f10e tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:27.024689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a8f6abc7-9ffa-47ec-a490-1eb7ebe8f10e tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:27.034767 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a8f6abc7-9ffa-47ec-a490-1eb7ebe8f10e tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1214 microversion: 2.1 time: 0.140479 Oct 31 15:47:27.037202 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2766/5681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:26 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:27.188511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:27.189421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: 417cbe6d-f424-498c-94dc-48d20b023b9e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:27.207863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:27.208690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:27.209363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:27.210327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:27.214954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:27.217067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:27.257763 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] HTTP exception thrown: Instance 417cbe6d-f424-498c-94dc-48d20b023b9e could not be found. Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Request method failure captured: Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e HTTP/1.1 Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-3kCfWY1-4XygvyXxL9LSHad6jqsd7ulUXoGX_bjuSgKTfuONjTBfpOhdGwY3Jomy_7XtiLP0NhmBQBDEIVJExkJ5JxEiP5bPf8WoiQGB799RyxwMOwJwDFN6OZp3hLbHmZBevFGf8ET1KnFwPdTdCiyv_z0xc08Gl8sFHPlLZddbs Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d44ad31033f46788b7f8d519423e72a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d44ad31033f46788b7f8d519423e72a"}]}] Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: eee804c5e68f49f0be33c1b83c550e74 Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 417cbe6d-f424-498c-94dc-48d20b023b9e could not be found. Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '417cbe6d-f424-498c-94dc-48d20b023b9e'} Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417cbe6d-f424-498c-94dc-48d20b023b9e could not be found. Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417cbe6d-f424-498c-94dc-48d20b023b9e could not be found. Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.259669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417cbe6d-f424-498c-94dc-48d20b023b9e could not be found. Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Returning 404 to user: Instance 417cbe6d-f424-498c-94dc-48d20b023b9e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:27.266538 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c329744e-6fe4-4e6c-a571-af5e7c15b8f0 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e" status: 404 len: 111 microversion: 2.1 time: 0.078381 Oct 31 15:47:27.270771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:27.271352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] [instance: b346e4ef-5afc-4aa2-be89-d8f1d6d6419e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:27.283766 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2916/5682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:27 2022] GET /compute/v2.1/servers/417cbe6d-f424-498c-94dc-48d20b023b9e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:47:27.286052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:27.286565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:27.287009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:27.287743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:27.288342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:27.288783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:27.332316 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] HTTP exception thrown: Instance b346e4ef-5afc-4aa2-be89-d8f1d6d6419e could not be found. Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Request method failure captured: Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e HTTP/1.1 Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-3kCfWY1-4XygvyXxL9LSHad6jqsd7ulUXoGX_bjuSgKTfuONjTBfpOhdGwY3Jomy_7XtiLP0NhmBQBDEIVJExkJ5JxEiP5bPf8WoiQGB799RyxwMOwJwDFN6OZp3hLbHmZBevFGf8ET1KnFwPdTdCiyv_z0xc08Gl8sFHPlLZddbs Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5d44ad31033f46788b7f8d519423e72a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5d44ad31033f46788b7f8d519423e72a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5d44ad31033f46788b7f8d519423e72a"}]}] Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 5d44ad31033f46788b7f8d519423e72a Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-548163364 Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: eee804c5e68f49f0be33c1b83c550e74 Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ListServersNegativeTestJSON-548163364-project Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance b346e4ef-5afc-4aa2-be89-d8f1d6d6419e could not be found. Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'b346e4ef-5afc-4aa2-be89-d8f1d6d6419e'} Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b346e4ef-5afc-4aa2-be89-d8f1d6d6419e could not be found. Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b346e4ef-5afc-4aa2-be89-d8f1d6d6419e could not be found. Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.334213 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b346e4ef-5afc-4aa2-be89-d8f1d6d6419e could not be found. Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] Returning 404 to user: Instance b346e4ef-5afc-4aa2-be89-d8f1d6d6419e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:27.338039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-17c74a21-c6a6-4e54-a25c-6389560d4991 tempest-ListServersNegativeTestJSON-548163364 tempest-ListServersNegativeTestJSON-548163364-project] 10.222.0.20 "GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e" status: 404 len: 111 microversion: 2.1 time: 0.068886 Oct 31 15:47:27.342620 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2767/5683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:27 2022] GET /compute/v2.1/servers/b346e4ef-5afc-4aa2-be89-d8f1d6d6419e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:47:27.512763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-178016028", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f438d2d0-1357-4e21-b1cc-6088b00737d1"}], "security_groups": [{"name": "tempest-securitygroup--690529197"}], "key_name": "tempest-keypair-1396516908", "user_data": "}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:27.773727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] validate_networks() for [('f438d2d0-1357-4e21-b1cc-6088b00737d1', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:47:28.060605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:28.061249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:28.077536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:28.078545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:28.080777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:28.083959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:28.085568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:28.086026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:28.218594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:28.227884 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d89b0df-2b63-4549-b6e0-5daf704a41f0 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1266 microversion: 2.1 time: 0.171811 Oct 31 15:47:28.229163 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2768/5684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:28 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:28.667644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:47:28.670042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:47:28.670557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:47:28.671058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:47:28.671484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:47:28.688434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:28.688926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:28.689389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:28.690958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:28.691422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:28.691847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:28.727511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for project bb201c74554c43f0a526161cf24206f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:47:28.734911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:28.736176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for user a5bfcc2112ea47dcb758487de253311f and project bb201c74554c43f0a526161cf24206f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:47:28.783588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:47:28.793664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:47:28.924085 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-42cea44e-131c-4720-9168-841b1affe46f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.415548 Oct 31 15:47:28.927029 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2917/5685] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:47:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:47:28.937026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4161808d-0553-421c-91bc-53305d50883c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:28.937918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4161808d-0553-421c-91bc-53305d50883c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:29.059339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4161808d-0553-421c-91bc-53305d50883c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:29.066870 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4161808d-0553-421c-91bc-53305d50883c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1241 microversion: 2.1 time: 0.133862 Oct 31 15:47:29.080282 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2769/5686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:28 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:29.252188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:29.252871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:29.273838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:29.274342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:29.275160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:29.276405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:29.277051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:29.278263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:29.334975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:29.445819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:29.458308 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a6e1552-ba32-4038-bd0c-188e404c1554 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1272 microversion: 2.1 time: 0.209870 Oct 31 15:47:29.460174 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2918/5687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:29 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:30.095695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:30.096306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:30.118156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.118999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.119501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.128330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.129790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.131736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.265999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:30.287225 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c9bf143-299c-40fc-a4df-bf72dd07841b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1293 microversion: 2.1 time: 0.195502 Oct 31 15:47:30.288173 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2770/5688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:30 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1293 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:30.488944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:30.490445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:30.498941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.530409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.533175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:30.536437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:30.538298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:30.539207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:31.313693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:31.314471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:31.329571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:31.329946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:31.330352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:31.346160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:31.346688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:31.347116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:31.474166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:31.490077 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d729bba-0156-43cf-9c77-8f0fd946f2b5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1299 microversion: 2.1 time: 0.181869 Oct 31 15:47:31.493766 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2771/5689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:31 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:31.646608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ba3561d7-24ad-4915-a07a-a1471ab1435c req-c208975d-2684-4f74-8355-9630d3edf95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d62e586d-4d40-4c75-9259-d7e31a11d34c", "tag": "a3820428-a059-4973-82e9-26f85046158f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:31.666421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ba3561d7-24ad-4915-a07a-a1471ab1435c req-c208975d-2684-4f74-8355-9630d3edf95c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:31.666926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ba3561d7-24ad-4915-a07a-a1471ab1435c req-c208975d-2684-4f74-8355-9630d3edf95c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:31.667365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ba3561d7-24ad-4915-a07a-a1471ab1435c req-c208975d-2684-4f74-8355-9630d3edf95c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:31.698603 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ba3561d7-24ad-4915-a07a-a1471ab1435c req-c208975d-2684-4f74-8355-9630d3edf95c service nova] Creating event network-changed:a3820428-a059-4973-82e9-26f85046158f for instance d62e586d-4d40-4c75-9259-d7e31a11d34c on n-h2-858384-17 Oct 31 15:47:31.710709 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ba3561d7-24ad-4915-a07a-a1471ab1435c req-c208975d-2684-4f74-8355-9630d3edf95c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068010 Oct 31 15:47:31.711389 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2772/5690] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:31.805163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:31.818240 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69179af9-3b55-4bee-ad10-30eff20dc184 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1314 microversion: 2.1 time: 1.335168 Oct 31 15:47:31.819948 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2919/5691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:30 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1314 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:32.520324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:32.521040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:32.537086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:32.539327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:32.540287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:32.540910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:32.541892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:32.542883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:32.544591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:32.640613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:32.643479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:32.653792 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c0f36992-486e-4751-a664-8ac0cd536a81 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1299 microversion: 2.1 time: 0.138385 Oct 31 15:47:32.654756 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2773/5692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:32 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:32.843668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:32.845423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:32.852519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:32.853615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:32.854502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:32.855664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:32.856532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:32.857391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:33.358444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:33.371910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cf6afe3f-a915-480d-ad35-b742cbd477e8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1314 microversion: 2.1 time: 0.526894 Oct 31 15:47:33.381247 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2920/5693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:32 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:33.684370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:33.685825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:33.695988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:33.697917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:33.698375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:33.699161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:33.700205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:33.700435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:34.403844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:34.405041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:34.423061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:34.427459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:34.427922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:34.445479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:34.450796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:34.451545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:34.478482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:34.494659 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-215f58ee-e3b1-41d8-9632-a888b066fd2f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1366 microversion: 2.1 time: 0.818110 Oct 31 15:47:34.499436 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2774/5694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:33 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1366 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:34.867104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:34.885616 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d95a2d4-4e87-4b48-9494-e1e1c574988b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1314 microversion: 2.1 time: 0.477214 Oct 31 15:47:34.886389 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2921/5695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:34 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:35.131107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9619cac4-949d-47af-abfb-099c0d802d0b req-b1494794-3dd5-4dfb-87e0-086b9227ad5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d06c42-26cb-48da-bcce-c8afad1b023c", "tag": "ff565a9b-1238-4c16-af24-f0b16d693f7f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:35.148302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9619cac4-949d-47af-abfb-099c0d802d0b req-b1494794-3dd5-4dfb-87e0-086b9227ad5f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:35.149064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9619cac4-949d-47af-abfb-099c0d802d0b req-b1494794-3dd5-4dfb-87e0-086b9227ad5f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:35.149986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9619cac4-949d-47af-abfb-099c0d802d0b req-b1494794-3dd5-4dfb-87e0-086b9227ad5f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:35.164088 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9619cac4-949d-47af-abfb-099c0d802d0b req-b1494794-3dd5-4dfb-87e0-086b9227ad5f service nova] Creating event network-changed:ff565a9b-1238-4c16-af24-f0b16d693f7f for instance 64d06c42-26cb-48da-bcce-c8afad1b023c on n-h1-858384-17 Oct 31 15:47:35.170113 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9619cac4-949d-47af-abfb-099c0d802d0b req-b1494794-3dd5-4dfb-87e0-086b9227ad5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042990 Oct 31 15:47:35.171182 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2775/5696] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:35.520357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:35.521745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:35.532164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:35.532665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:35.533106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:35.540584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:35.541080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:35.546240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:35.854608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:35.864998 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0912a6bc-b5c8-4bd6-a413-11b8472e1470 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1366 microversion: 2.1 time: 0.348465 Oct 31 15:47:35.867442 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2922/5697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:35 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:35.912381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:35.913816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:35.916018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:35.924960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:35.925482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:35.926266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:35.928744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:35.929383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:35.929683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:36.099414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:36.109556 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-290aa65e-7fb1-4aa0-b1ca-0c8ddf1bfd1d tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1314 microversion: 2.1 time: 0.201655 Oct 31 15:47:36.110366 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2776/5698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:35 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:36.581801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1e9e9b5c-7812-4e3b-801b-eafad8da07a2 req-578eb088-9f21-4277-a86f-ffeab9a92b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62e586d-4d40-4c75-9259-d7e31a11d34c", "name": "network-vif-plugged", "status": "completed", "tag": "a3820428-a059-4973-82e9-26f85046158f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:36.621019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1e9e9b5c-7812-4e3b-801b-eafad8da07a2 req-578eb088-9f21-4277-a86f-ffeab9a92b9c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:36.621762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1e9e9b5c-7812-4e3b-801b-eafad8da07a2 req-578eb088-9f21-4277-a86f-ffeab9a92b9c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:36.622447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1e9e9b5c-7812-4e3b-801b-eafad8da07a2 req-578eb088-9f21-4277-a86f-ffeab9a92b9c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:36.641490 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1e9e9b5c-7812-4e3b-801b-eafad8da07a2 req-578eb088-9f21-4277-a86f-ffeab9a92b9c service nova] Creating event network-vif-plugged:a3820428-a059-4973-82e9-26f85046158f for instance d62e586d-4d40-4c75-9259-d7e31a11d34c on n-h2-858384-17 Oct 31 15:47:36.648177 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1e9e9b5c-7812-4e3b-801b-eafad8da07a2 req-578eb088-9f21-4277-a86f-ffeab9a92b9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090968 Oct 31 15:47:36.648958 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2923/5699] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:36.770085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36e6b243-f021-4e30-a1f4-d3bc328d870d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:36.770618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-36e6b243-f021-4e30-a1f4-d3bc328d870d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:36.789726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e6b243-f021-4e30-a1f4-d3bc328d870d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:36.790248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e6b243-f021-4e30-a1f4-d3bc328d870d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:36.790698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e6b243-f021-4e30-a1f4-d3bc328d870d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:36.798488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e6b243-f021-4e30-a1f4-d3bc328d870d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:36.798969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e6b243-f021-4e30-a1f4-d3bc328d870d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:36.799581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e6b243-f021-4e30-a1f4-d3bc328d870d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:36.892913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:36.893766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:36.897068 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-36e6b243-f021-4e30-a1f4-d3bc328d870d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments/bfc8fa33-c79b-4013-b76e-9a575b069868" status: 200 len: 194 microversion: 2.20 time: 0.132265 Oct 31 15:47:36.901699 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2777/5700] 10.222.0.20 () {60 vars in 1454 bytes} [Mon Oct 31 15:47:36 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments/bfc8fa33-c79b-4013-b76e-9a575b069868 => generated 194 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:47:36.912459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:36.913065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:36.913596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:36.914296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:36.914783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:36.915214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:37.085163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:37.087070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:37.104911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:37.105530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:37.106341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:37.112843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:37.114595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:37.115487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:37.240081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:37.258120 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-62f2ee79-083b-4dd3-a064-8de0b0b99f9a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1366 microversion: 2.1 time: 0.364611 Oct 31 15:47:37.259345 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2924/5701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:36 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:37.271451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:37.276032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:37.298350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:37.300161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:37.302899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:37.303713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:37.304196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:37.305225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:37.322030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lazy-loading 'services' on Instance uuid 9547ba84-a354-46e2-b2a5-4f3d4d71159d {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:47:37.441224 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-55158a92-f280-4a5d-af41-e49405f07f02 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments/bfc8fa33-c79b-4013-b76e-9a575b069868" status: 202 len: 0 microversion: 2.20 time: 0.360115 Oct 31 15:47:37.442723 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2778/5702] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Oct 31 15:47:37 2022] DELETE /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments/bfc8fa33-c79b-4013-b76e-9a575b069868 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:47:37.453408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f156268a-6e54-40c2-b145-519cac823bd5 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:37.456483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f156268a-6e54-40c2-b145-519cac823bd5 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:37.465487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156268a-6e54-40c2-b145-519cac823bd5 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:37.466769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156268a-6e54-40c2-b145-519cac823bd5 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:37.467644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156268a-6e54-40c2-b145-519cac823bd5 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:37.468894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156268a-6e54-40c2-b145-519cac823bd5 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:37.469839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156268a-6e54-40c2-b145-519cac823bd5 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:37.470989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f156268a-6e54-40c2-b145-519cac823bd5 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:37.551999 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f156268a-6e54-40c2-b145-519cac823bd5 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103458 Oct 31 15:47:37.554364 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2779/5703] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:37 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:47:37.840609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:37.856213 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-496a75dd-0963-4425-9f21-389a33c4def1 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1314 microversion: 2.1 time: 0.594348 Oct 31 15:47:37.857157 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2925/5704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:37 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:38.290871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:38.294353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:38.306738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.307235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.307673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:38.310313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.310802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.312499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:38.577050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:38.582747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fcc63be4-f583-4546-a1e4-b37ac36bfc83 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:38.585242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fcc63be4-f583-4546-a1e4-b37ac36bfc83 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:38.600719 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-245ebe36-3dd4-42ca-9908-9000450154c5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1366 microversion: 2.1 time: 0.317751 Oct 31 15:47:38.602974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcc63be4-f583-4546-a1e4-b37ac36bfc83 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.607591 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2780/5705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:38 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:38.609223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcc63be4-f583-4546-a1e4-b37ac36bfc83 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.609862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcc63be4-f583-4546-a1e4-b37ac36bfc83 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:38.611438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcc63be4-f583-4546-a1e4-b37ac36bfc83 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.612979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcc63be4-f583-4546-a1e4-b37ac36bfc83 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.653121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fcc63be4-f583-4546-a1e4-b37ac36bfc83 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:38.704195 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fcc63be4-f583-4546-a1e4-b37ac36bfc83 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.141563 Oct 31 15:47:38.706519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2926/5706] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:38 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:47:38.884258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:38.885316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:38.903006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.904223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.904843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:38.905779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:38.906396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:38.906992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:39.067521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:39.190491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:39.205431 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a557b95-043c-429a-a37b-cc4effa8410b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1497 microversion: 2.1 time: 0.325624 Oct 31 15:47:39.206049 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2781/5707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:38 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1497 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:39.635463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:39.636108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:39.645246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:39.645972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=16 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:39.650855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:39.651374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:39.653625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:39.654914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:39.656506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:39.657732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:39.718888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64bcdf80-171f-4ff9-a005-d16fb537b7c7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:39.721885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64bcdf80-171f-4ff9-a005-d16fb537b7c7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:39.738245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64bcdf80-171f-4ff9-a005-d16fb537b7c7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:39.738780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64bcdf80-171f-4ff9-a005-d16fb537b7c7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:39.739232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64bcdf80-171f-4ff9-a005-d16fb537b7c7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:39.740037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64bcdf80-171f-4ff9-a005-d16fb537b7c7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:39.740502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64bcdf80-171f-4ff9-a005-d16fb537b7c7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:39.740925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64bcdf80-171f-4ff9-a005-d16fb537b7c7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:39.825855 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64bcdf80-171f-4ff9-a005-d16fb537b7c7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.110873 Oct 31 15:47:39.828041 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2782/5708] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:39 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:47:39.980365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:39.989638 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c85d15ed-4bba-4a26-8a19-d01d835e042f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1366 microversion: 2.1 time: 0.358562 Oct 31 15:47:40.001824 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2927/5709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:39 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:40.146601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:40.147874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:40.163428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:40.163937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:40.164379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:40.165173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:40.165590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:40.166029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:40.210410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:47:40.318159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-fc17bbc4-9222-4047-b5d9-fd6a63c44408 req-2d511228-c0d4-491a-8e30-8ba797d7b9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d06c42-26cb-48da-bcce-c8afad1b023c", "name": "network-vif-plugged", "status": "completed", "tag": "ff565a9b-1238-4c16-af24-f0b16d693f7f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:40.340511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fc17bbc4-9222-4047-b5d9-fd6a63c44408 req-2d511228-c0d4-491a-8e30-8ba797d7b9e3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:40.345842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fc17bbc4-9222-4047-b5d9-fd6a63c44408 req-2d511228-c0d4-491a-8e30-8ba797d7b9e3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:40.351901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-fc17bbc4-9222-4047-b5d9-fd6a63c44408 req-2d511228-c0d4-491a-8e30-8ba797d7b9e3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:40.381955 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-fc17bbc4-9222-4047-b5d9-fd6a63c44408 req-2d511228-c0d4-491a-8e30-8ba797d7b9e3 service nova] Creating event network-vif-plugged:ff565a9b-1238-4c16-af24-f0b16d693f7f for instance 64d06c42-26cb-48da-bcce-c8afad1b023c on n-h1-858384-17 Oct 31 15:47:40.391747 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-fc17bbc4-9222-4047-b5d9-fd6a63c44408 req-2d511228-c0d4-491a-8e30-8ba797d7b9e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077351 Oct 31 15:47:40.399216 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2928/5710] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:40.432004 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f79aa51f-2f93-4684-ac78-6bc3b6ff0825 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 204 len: 0 microversion: 2.1 time: 0.289029 Oct 31 15:47:40.434337 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2783/5711] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:47:40 2022] DELETE /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:47:40.448754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:40.451254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:40.461656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:40.462410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:40.463018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:40.463984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:40.464764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:40.465571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:40.808329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:40.819626 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-33383c2e-c15a-45b1-a0dd-965063369819 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1503 microversion: 2.1 time: 0.376991 Oct 31 15:47:40.823347 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2929/5712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:40 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:40.843292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13005ee6-1ca5-4ea9-b0ae-8c5f814b1bcf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:40.846952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13005ee6-1ca5-4ea9-b0ae-8c5f814b1bcf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:40.862857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13005ee6-1ca5-4ea9-b0ae-8c5f814b1bcf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:40.863390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13005ee6-1ca5-4ea9-b0ae-8c5f814b1bcf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:40.863832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13005ee6-1ca5-4ea9-b0ae-8c5f814b1bcf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:40.864550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13005ee6-1ca5-4ea9-b0ae-8c5f814b1bcf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:40.865006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13005ee6-1ca5-4ea9-b0ae-8c5f814b1bcf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:40.865457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13005ee6-1ca5-4ea9-b0ae-8c5f814b1bcf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:40.918800 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13005ee6-1ca5-4ea9-b0ae-8c5f814b1bcf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.082208 Oct 31 15:47:40.923964 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2784/5713] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:40 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:47:41.024894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:41.025850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:41.036892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.039525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.041345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.042281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.043850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.047090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.385056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:41.396918 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24503b0b-abcd-4aa3-a4f4-eae4210c36f6 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1366 microversion: 2.1 time: 0.380245 Oct 31 15:47:41.399431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3348880-be6d-4fbe-864c-80782955a8c3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:41.413161 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2930/5714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:41 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:41.418464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3348880-be6d-4fbe-864c-80782955a8c3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:41.427769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3348880-be6d-4fbe-864c-80782955a8c3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.435293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3348880-be6d-4fbe-864c-80782955a8c3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.436288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3348880-be6d-4fbe-864c-80782955a8c3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.437245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3348880-be6d-4fbe-864c-80782955a8c3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.437874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3348880-be6d-4fbe-864c-80782955a8c3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.443479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3348880-be6d-4fbe-864c-80782955a8c3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.552055 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3348880-be6d-4fbe-864c-80782955a8c3 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a/action" status: 200 len: 24568 microversion: 2.1 time: 0.158036 Oct 31 15:47:41.560110 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2785/5715] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:47:41 2022] POST /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a/action => generated 24568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:47:41.854172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:41.856953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:41.888372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.888883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.903276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.904189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.904772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.905333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.931874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a30989db-58ec-4802-9c2d-ad13dc4014a7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:41.934629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a30989db-58ec-4802-9c2d-ad13dc4014a7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:41.956972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a30989db-58ec-4802-9c2d-ad13dc4014a7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.957774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a30989db-58ec-4802-9c2d-ad13dc4014a7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.959367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a30989db-58ec-4802-9c2d-ad13dc4014a7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:41.961163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a30989db-58ec-4802-9c2d-ad13dc4014a7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:41.962911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a30989db-58ec-4802-9c2d-ad13dc4014a7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:41.965370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a30989db-58ec-4802-9c2d-ad13dc4014a7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:42.050986 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a30989db-58ec-4802-9c2d-ad13dc4014a7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122028 Oct 31 15:47:42.053228 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2786/5716] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:41 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 31 15:47:42.212233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:42.223877 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae97a7ab-265c-4250-a22a-68506fe26266 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1503 microversion: 2.1 time: 0.376248 Oct 31 15:47:42.224985 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2931/5717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:41 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1503 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:42.425541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:42.426153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:42.439980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:42.441096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:42.441743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:42.442611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:42.443233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:42.443818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:43.069004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9648c5ab-34f5-42cf-bd76-b0d7281fe68f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:43.085718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9648c5ab-34f5-42cf-bd76-b0d7281fe68f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:43.110980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9648c5ab-34f5-42cf-bd76-b0d7281fe68f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:43.127895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9648c5ab-34f5-42cf-bd76-b0d7281fe68f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:43.128745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9648c5ab-34f5-42cf-bd76-b0d7281fe68f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:43.130006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9648c5ab-34f5-42cf-bd76-b0d7281fe68f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:43.134687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9648c5ab-34f5-42cf-bd76-b0d7281fe68f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:43.135444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9648c5ab-34f5-42cf-bd76-b0d7281fe68f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:43.249371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:43.266142 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-90052144-4716-40fa-bd1f-bd9cc98f1135 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1557 microversion: 2.1 time: 0.844332 Oct 31 15:47:43.267520 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2787/5718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:42 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1557 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:43.280465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:43.282279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:43.303368 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9648c5ab-34f5-42cf-bd76-b0d7281fe68f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.230997 Oct 31 15:47:43.305739 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2932/5719] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:43 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:47:43.310705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:43.311789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:43.313535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:43.317605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd8ab3b0-6142-498a-8d32-f91cacdc2941 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:43.318799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:43.319502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:43.320157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:43.320890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bd8ab3b0-6142-498a-8d32-f91cacdc2941 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:43.342344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd8ab3b0-6142-498a-8d32-f91cacdc2941 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:43.344385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd8ab3b0-6142-498a-8d32-f91cacdc2941 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:43.345082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd8ab3b0-6142-498a-8d32-f91cacdc2941 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:43.346095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd8ab3b0-6142-498a-8d32-f91cacdc2941 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:43.346779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd8ab3b0-6142-498a-8d32-f91cacdc2941 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:43.347428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd8ab3b0-6142-498a-8d32-f91cacdc2941 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:43.496878 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd8ab3b0-6142-498a-8d32-f91cacdc2941 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.188304 Oct 31 15:47:43.499240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2933/5720] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:47:43 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-interface => generated 285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:43.640289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:43.653863 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16174ed0-d499-495e-b09a-9e61f9a3c680 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1503 microversion: 2.1 time: 0.380523 Oct 31 15:47:43.655739 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2788/5721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:43 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1503 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:44.322253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85d62b5c-02a6-432a-803f-11bb48e01d24 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:44.325743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85d62b5c-02a6-432a-803f-11bb48e01d24 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:44.338922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85d62b5c-02a6-432a-803f-11bb48e01d24 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:44.341819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85d62b5c-02a6-432a-803f-11bb48e01d24 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:44.342761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85d62b5c-02a6-432a-803f-11bb48e01d24 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:44.344856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85d62b5c-02a6-432a-803f-11bb48e01d24 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:44.347144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85d62b5c-02a6-432a-803f-11bb48e01d24 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:44.350237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85d62b5c-02a6-432a-803f-11bb48e01d24 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:44.440570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9642005d-5038-4278-a6ed-c06657695fd7 req-6bd7dcaf-c889-480b-9828-57ca6dd6ee54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d62e586d-4d40-4c75-9259-d7e31a11d34c", "name": "network-vif-deleted", "tag": "a3820428-a059-4973-82e9-26f85046158f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:44.447644 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85d62b5c-02a6-432a-803f-11bb48e01d24 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130742 Oct 31 15:47:44.460773 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2934/5722] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:44 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:47:44.466061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9642005d-5038-4278-a6ed-c06657695fd7 req-6bd7dcaf-c889-480b-9828-57ca6dd6ee54 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:44.466563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9642005d-5038-4278-a6ed-c06657695fd7 req-6bd7dcaf-c889-480b-9828-57ca6dd6ee54 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:44.467082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9642005d-5038-4278-a6ed-c06657695fd7 req-6bd7dcaf-c889-480b-9828-57ca6dd6ee54 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:44.471651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:44.492942 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9642005d-5038-4278-a6ed-c06657695fd7 req-6bd7dcaf-c889-480b-9828-57ca6dd6ee54 service nova] Creating event network-vif-deleted:a3820428-a059-4973-82e9-26f85046158f for instance d62e586d-4d40-4c75-9259-d7e31a11d34c on n-h2-858384-17 Oct 31 15:47:44.514135 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9642005d-5038-4278-a6ed-c06657695fd7 req-6bd7dcaf-c889-480b-9828-57ca6dd6ee54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077135 Oct 31 15:47:44.514771 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2789/5723] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:44.679077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:44.679699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:44.694519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:44.697495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:44.699748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:44.700683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:44.702936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:44.706019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:44.804828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:44.805615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:44.806238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:44.807198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lazy-loading 'fault' on Instance uuid d62e586d-4d40-4c75-9259-d7e31a11d34c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:47:45.149411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:45.160418 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e9451b9d-47d2-4286-9198-0f423f5aebad tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 200 len: 1304 microversion: 2.1 time: 0.485162 Oct 31 15:47:45.175867 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2935/5724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:44 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 1304 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:45.461428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1f340016-9407-4350-a7fc-293c9376458d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:45.464884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1f340016-9407-4350-a7fc-293c9376458d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:45.479179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f340016-9407-4350-a7fc-293c9376458d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:45.479699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f340016-9407-4350-a7fc-293c9376458d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:45.480722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f340016-9407-4350-a7fc-293c9376458d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:45.481498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f340016-9407-4350-a7fc-293c9376458d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:45.482019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f340016-9407-4350-a7fc-293c9376458d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:45.482389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f340016-9407-4350-a7fc-293c9376458d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:45.558742 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1f340016-9407-4350-a7fc-293c9376458d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102347 Oct 31 15:47:45.559967 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2790/5725] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:45 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:47:46.028069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9d8854b2-1374-4ac6-b2ce-62b0ecf1a845 req-61f8e710-a349-4ce0-a2d1-6646b307d900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d06c42-26cb-48da-bcce-c8afad1b023c", "tag": "ff565a9b-1238-4c16-af24-f0b16d693f7f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:46.050490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9d8854b2-1374-4ac6-b2ce-62b0ecf1a845 req-61f8e710-a349-4ce0-a2d1-6646b307d900 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:46.055285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9d8854b2-1374-4ac6-b2ce-62b0ecf1a845 req-61f8e710-a349-4ce0-a2d1-6646b307d900 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:46.057694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9d8854b2-1374-4ac6-b2ce-62b0ecf1a845 req-61f8e710-a349-4ce0-a2d1-6646b307d900 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:46.104526 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9d8854b2-1374-4ac6-b2ce-62b0ecf1a845 req-61f8e710-a349-4ce0-a2d1-6646b307d900 service nova] Creating event network-changed:ff565a9b-1238-4c16-af24-f0b16d693f7f for instance 64d06c42-26cb-48da-bcce-c8afad1b023c on n-h1-858384-17 Oct 31 15:47:46.117542 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9d8854b2-1374-4ac6-b2ce-62b0ecf1a845 req-61f8e710-a349-4ce0-a2d1-6646b307d900 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093410 Oct 31 15:47:46.118170 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2936/5726] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:46.200857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:46.201846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: d62e586d-4d40-4c75-9259-d7e31a11d34c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:46.214605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:46.215176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:46.215635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:46.219500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:46.220020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:46.220490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:46.272047 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] HTTP exception thrown: Instance d62e586d-4d40-4c75-9259-d7e31a11d34c could not be found. Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Request method failure captured: Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c HTTP/1.1 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-4KMSQxG1EfuZJgPtgL4DPM21eLgyyWlX_IdtzgS4WbvHgNJgsbNLBsuylBI0OOwtKqFtU_-Ufd3t41z0icmW39_gy90qHaOn-QU6z6HwAK88KDzE-BIEzK7-6j-HO_AVV5PdEsI5pddKLnl5C8va_Bgzf9bGXU8Equ9RTNgXQ9xoA Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6c8321916c4547caaa589204fee9ba00 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesActionsTest-1337748676 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c8321916c4547caaa589204fee9ba00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c8321916c4547caaa589204fee9ba00", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c8321916c4547caaa589204fee9ba00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c8321916c4547caaa589204fee9ba00"}]}] Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-VolumesActionsTest-1337748676 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6c8321916c4547caaa589204fee9ba00 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesActionsTest-1337748676 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-VolumesActionsTest-1337748676-project Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 0c219c6e29154502b84b3f7ac4577ea7 Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-VolumesActionsTest-1337748676-project Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance d62e586d-4d40-4c75-9259-d7e31a11d34c could not be found. Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'd62e586d-4d40-4c75-9259-d7e31a11d34c'} Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d62e586d-4d40-4c75-9259-d7e31a11d34c could not be found. Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d62e586d-4d40-4c75-9259-d7e31a11d34c could not be found. Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:46.277532 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:46.282572 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:46.282572 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:46.282572 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:46.282572 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:46.282572 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:46.282572 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d62e586d-4d40-4c75-9259-d7e31a11d34c could not be found. Oct 31 15:47:46.282572 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:46.296383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Returning 404 to user: Instance d62e586d-4d40-4c75-9259-d7e31a11d34c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:46.296383 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd4876c5-2e21-4926-bc79-4b28f28a7e8c tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c" status: 404 len: 111 microversion: 2.1 time: 0.089376 Oct 31 15:47:46.301742 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2791/5727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:46 2022] GET /compute/v2.1/servers/d62e586d-4d40-4c75-9259-d7e31a11d34c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:47:46.586925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c0acef2a-9d99-4e4a-9db0-747b980701db tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:46.589343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c0acef2a-9d99-4e4a-9db0-747b980701db tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:46.624807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1144308455", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "67ca99e6-c62f-46a5-9d27-46f72e4f74ec"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:46.643441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0acef2a-9d99-4e4a-9db0-747b980701db tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:46.653498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0acef2a-9d99-4e4a-9db0-747b980701db tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:46.654001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0acef2a-9d99-4e4a-9db0-747b980701db tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:46.665337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0acef2a-9d99-4e4a-9db0-747b980701db tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:46.665337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0acef2a-9d99-4e4a-9db0-747b980701db tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:46.679725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c0acef2a-9d99-4e4a-9db0-747b980701db tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:46.692140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:46.792073 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c0acef2a-9d99-4e4a-9db0-747b980701db tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.219245 Oct 31 15:47:46.801864 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2937/5728] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:46 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:47:46.831181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] validate_networks() for [('67ca99e6-c62f-46a5-9d27-46f72e4f74ec', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:47:47.808720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd471def-40a5-4d7c-9dd0-1a58e99dc2b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:47.812493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd471def-40a5-4d7c-9dd0-1a58e99dc2b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:47.828011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd471def-40a5-4d7c-9dd0-1a58e99dc2b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:47.831980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd471def-40a5-4d7c-9dd0-1a58e99dc2b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:47.833301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd471def-40a5-4d7c-9dd0-1a58e99dc2b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:47.834873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd471def-40a5-4d7c-9dd0-1a58e99dc2b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:47.836619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd471def-40a5-4d7c-9dd0-1a58e99dc2b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:47.837317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd471def-40a5-4d7c-9dd0-1a58e99dc2b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:47.907993 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd471def-40a5-4d7c-9dd0-1a58e99dc2b6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.104050 Oct 31 15:47:47.908610 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2938/5729] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:47:47 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:48.036777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:48.037303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:48.069381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:48.069897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:48.070339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:48.071067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:48.071526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:48.071952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:48.122707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:47:48.282397 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6dbccbf-6890-4432-9602-5e3974abf978 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 204 len: 0 microversion: 2.20 time: 0.248267 Oct 31 15:47:48.283770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2939/5730] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:47:48 2022] DELETE /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:47:48.561162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-79487415", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:48.660862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:47:48.661398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:47:48.662005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:47:48.662479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:47:48.662957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:47:48.678832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:48.679309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:48.679832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:48.680657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:48.681122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:48.681652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:48.703530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] validate_networks() for [('852c1793-711a-40a6-85c9-63100e2bd3b2', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:47:48.705419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Getting quotas for project 6c8321916c4547caaa589204fee9ba00. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:47:48.711172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Getting quotas for user 0c219c6e29154502b84b3f7ac4577ea7 and project 6c8321916c4547caaa589204fee9ba00. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:47:48.726760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:47:48.729359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:47:48.822078 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f5e0161-ccc3-4e79-a78c-a1721cfbd1d8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.202235 Oct 31 15:47:48.822724 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2792/5731] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:47:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:47:48.830141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:48.830978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:48.844397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:48.845829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:48.846639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:48.847805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:48.848488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:48.849179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:49.093991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:49.108276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:49.119541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:49.122033 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f2d87b3d-39ff-415c-bc61-6cc2854ef65f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.297470 Oct 31 15:47:49.122630 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2793/5732] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:47:48 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:47:49.127164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75883fdd-4087-4ec3-ab6d-26236f41f1a4 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:49.133927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75883fdd-4087-4ec3-ab6d-26236f41f1a4 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:49.255136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-75883fdd-4087-4ec3-ab6d-26236f41f1a4 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:49.262762 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75883fdd-4087-4ec3-ab6d-26236f41f1a4 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1214 microversion: 2.1 time: 0.139118 Oct 31 15:47:49.263942 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2794/5733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:49 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:49.791365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:47:49.792588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:47:49.793641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:47:49.794437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:47:49.795075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:47:49.808364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:49.809083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:49.809727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:49.811091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:49.811728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:49.812335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:49.844475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Getting quotas for project fcb90eb236184f91a1d876339b68b99b. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:47:49.853046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Getting quotas for user 78ac0a39bc9e4214a202f26c66c41d92 and project fcb90eb236184f91a1d876339b68b99b. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:47:49.881495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:47:49.886116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:47:50.009428 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0513471f-dbcf-40b4-8472-e68f8d54afae tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.705810 Oct 31 15:47:50.017640 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2940/5734] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:47:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:47:50.023301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f36f0030-c1fc-47c3-bf47-644b1beae184 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:50.025851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f36f0030-c1fc-47c3-bf47-644b1beae184 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:50.152863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:50.153850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:50.161492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f36f0030-c1fc-47c3-bf47-644b1beae184 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:50.182531 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f36f0030-c1fc-47c3-bf47-644b1beae184 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1222 microversion: 2.1 time: 0.164229 Oct 31 15:47:50.186639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:50.187372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:50.188128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:50.189175 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2795/5735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:50 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:50.189856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:50.190511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:50.191129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:50.287247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:50.287852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:50.301574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:50.302406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:50.304028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:50.304881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:50.305368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:50.309344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:50.397049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:50.408685 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8c01576d-efc7-43ba-b46e-7efb64b98864 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1266 microversion: 2.1 time: 0.125599 Oct 31 15:47:50.409936 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2796/5736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:50 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:50.491385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:50.507389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:50.509757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:50.522729 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7d7cf43-eab2-470e-bb14-3b39e8314c16 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1723 microversion: 2.20 time: 0.364336 Oct 31 15:47:50.525221 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2941/5737] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:47:50 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:47:51.216665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:51.217311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:51.228339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.237914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.240419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.244148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.249420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.252188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.436131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:51.436734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:51.455171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.469179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.469770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.470702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.473498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.474077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.670944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:51.681924 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-821eb830-2654-4d47-85a0-f4f109e58987 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1272 microversion: 2.1 time: 0.250223 Oct 31 15:47:51.689450 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2942/5738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:51 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:51.708953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-255b13ab-0941-4385-96fa-3d4606b0137a req-214a8fc5-b014-4b71-97b6-e0c71c6b6c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9547ba84-a354-46e2-b2a5-4f3d4d71159d", "name": "network-vif-deleted", "tag": "163e80be-44ff-4862-ae47-6ccd8f6a3afa"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:51.741166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-255b13ab-0941-4385-96fa-3d4606b0137a req-214a8fc5-b014-4b71-97b6-e0c71c6b6c7f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.749983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-255b13ab-0941-4385-96fa-3d4606b0137a req-214a8fc5-b014-4b71-97b6-e0c71c6b6c7f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.750896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-255b13ab-0941-4385-96fa-3d4606b0137a req-214a8fc5-b014-4b71-97b6-e0c71c6b6c7f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.787997 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-255b13ab-0941-4385-96fa-3d4606b0137a req-214a8fc5-b014-4b71-97b6-e0c71c6b6c7f service nova] Creating event network-vif-deleted:163e80be-44ff-4862-ae47-6ccd8f6a3afa for instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d on n-h1-858384-17 Oct 31 15:47:51.788694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:51.804475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-255b13ab-0941-4385-96fa-3d4606b0137a req-214a8fc5-b014-4b71-97b6-e0c71c6b6c7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105764 Oct 31 15:47:51.806813 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2943/5739] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:51.809958 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-384dd17d-9653-4aad-86a6-fc1f293a7be2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1218 microversion: 2.1 time: 0.598111 Oct 31 15:47:51.812316 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2797/5740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:51 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1218 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:51.844695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:51.845711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:51.879550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.881225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.881904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.882847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.883524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.884219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.969232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:51.969728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:51.970156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:51.970905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lazy-loading 'fault' on Instance uuid 9547ba84-a354-46e2-b2a5-4f3d4d71159d {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:47:52.062826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:52.074963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:52.078784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:52.082434 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba6098f9-7949-4774-9418-d93522a49c52 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 200 len: 1371 microversion: 2.20 time: 0.272990 Oct 31 15:47:52.085719 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2944/5741] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:47:51 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 1371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:47:52.464905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:52.467859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:52.498228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:52.498775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:52.499171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:52.499886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:52.500539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:52.503858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:52.685880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:47:52.686308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:47:52.687123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:47:52.687576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:47:52.687998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:47:52.711697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:52.712303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:52.747387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:52.748705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:52.751179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:52.752002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:52.756147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:52.756632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:52.895172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:52.902875 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:52.903628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:52.904227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:52.905186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:52.905823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:52.906414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:52.990126 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-279c8f6d-cae1-41b9-b6dc-4f7f0260e9d1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a/action" status: 202 len: 1135 microversion: 2.1 time: 0.527508 Oct 31 15:47:52.993503 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2798/5742] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:47:52 2022] POST /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a/action => generated 1135 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 31 15:47:53.006748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:53.008173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:53.030975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:53.032232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:53.033041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:53.034141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:53.034765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:53.035355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:53.212058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:53.227925 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ce09741-f6df-49d6-9db0-1c0f0f1602a7 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1280 microversion: 2.1 time: 0.232975 Oct 31 15:47:53.247597 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2799/5743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:52 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:53.255130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:53.255746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:53.273800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:53.274329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:53.275721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:53.277487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:53.280981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:53.282028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:53.701173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:53.719776 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6213a229-2458-4d52-9657-bafecd431ac0 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1689 microversion: 2.1 time: 0.470848 Oct 31 15:47:53.720425 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2800/5744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:53 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1689 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:53.725072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:53.737623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:53.754413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:53.754906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:53.756251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:53.756965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:53.757454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:53.757874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:53.759291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:53.774162 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9758dd51-dc41-4378-a466-247ff3792f87 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1314 microversion: 2.1 time: 1.066135 Oct 31 15:47:53.781268 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2945/5745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:52 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1314 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:53.802312 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] HTTP exception thrown: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Request method failure captured: Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d HTTP/1.1 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1U_xBaoaVRcFeyFYKQARuWJSlxdcSn7oBggwpubAuS2hCO9njU-OU1IYhY3n9Q2K-__78VX8wNdvhapCAC1HIdWfBIVa0LttxehOq4R8B3cxNp9LMcB9fZlfo59LwbgvWVUfYPza07Vpnup4ycj50Q2kIC37_h-OFaHVFMVrT3UwM Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b3bb1592c2c45c181e470ce3756c812", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b3bb1592c2c45c181e470ce3756c812"}]}] Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 5c07cff9c6ae4abf994127f2f38737cb Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9547ba84-a354-46e2-b2a5-4f3d4d71159d'} Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:53.810818 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:47:53.816301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:53.816301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:47:53.816301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:47:53.816301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:47:53.816301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:47:53.816301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:47:53.816301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:47:53.816301 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:47:53.819140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Returning 404 to user: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:47:53.825046 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc011c10-09fc-4a3d-a48d-ca5dd539c6ac tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 404 len: 111 microversion: 2.20 time: 0.103567 Oct 31 15:47:53.830444 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2801/5746] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:47:53 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:47:53.840159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd1ec1c2-015a-4665-9a31-1883d2f983fc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '.version_select at 0x7f16e0719820>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:53.907714 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd1ec1c2-015a-4665-9a31-1883d2f983fc tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077340121" status: 204 len: 0 microversion: 2.20 time: 0.072013 Oct 31 15:47:53.909119 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2946/5747] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077340121 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:47:54.258359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:54.258987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:54.273545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:54.273545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:54.273545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:54.277076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:54.277748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:54.278193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:54.744270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:54.745975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:54.763406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:54.770605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:54.771376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:54.773648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:54.777999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:54.779729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:54.981048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:54.997910 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a67b8c1c-669b-46b4-95a3-53cac7513680 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.742307 Oct 31 15:47:54.999621 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2802/5748] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:54 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:55.016945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:55.018609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:55.030725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:55.031230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:55.031671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:55.032834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:55.033487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:55.034161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:55.163276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:55.178513 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b493b028-e213-43cd-b261-259cee3cd351 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1689 microversion: 2.1 time: 0.438403 Oct 31 15:47:55.179857 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2947/5749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:54 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1689 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:55.192616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1baffed6-e602-4e3a-b6f5-83a7a49410d3 req-41a79e36-984f-41fe-94ec-1b7ea3e93b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a65d1ed-049d-40eb-b426-c95107b6536e", "tag": "245bc38c-239e-49e8-ac8f-1b78378bf701"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:55.221639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1baffed6-e602-4e3a-b6f5-83a7a49410d3 req-41a79e36-984f-41fe-94ec-1b7ea3e93b62 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:55.222139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1baffed6-e602-4e3a-b6f5-83a7a49410d3 req-41a79e36-984f-41fe-94ec-1b7ea3e93b62 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:55.222580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1baffed6-e602-4e3a-b6f5-83a7a49410d3 req-41a79e36-984f-41fe-94ec-1b7ea3e93b62 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:55.248632 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1baffed6-e602-4e3a-b6f5-83a7a49410d3 req-41a79e36-984f-41fe-94ec-1b7ea3e93b62 service nova] Creating event network-changed:245bc38c-239e-49e8-ac8f-1b78378bf701 for instance 8a65d1ed-049d-40eb-b426-c95107b6536e on n-h2-858384-17 Oct 31 15:47:55.272926 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1baffed6-e602-4e3a-b6f5-83a7a49410d3 req-41a79e36-984f-41fe-94ec-1b7ea3e93b62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076696 Oct 31 15:47:55.274199 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2948/5750] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:55.464320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:55.482237 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-062c2403-dbef-469d-87ec-464e1b231380 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1314 microversion: 2.1 time: 0.479043 Oct 31 15:47:55.483242 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2803/5751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:55 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:55.514584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3195172f-383a-46fb-825b-a07a9a186b86 req-5ce0cd46-3061-4bc1-a5ab-aa88c1456dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5a7e3a-6fb3-49f7-9c02-c523670a75d4", "tag": "98e7fae7-38f2-4a2e-afef-f67383982795"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:55.526590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3195172f-383a-46fb-825b-a07a9a186b86 req-5ce0cd46-3061-4bc1-a5ab-aa88c1456dd8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:55.527833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3195172f-383a-46fb-825b-a07a9a186b86 req-5ce0cd46-3061-4bc1-a5ab-aa88c1456dd8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:55.528485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3195172f-383a-46fb-825b-a07a9a186b86 req-5ce0cd46-3061-4bc1-a5ab-aa88c1456dd8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:55.545452 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3195172f-383a-46fb-825b-a07a9a186b86 req-5ce0cd46-3061-4bc1-a5ab-aa88c1456dd8 service nova] Creating event network-changed:98e7fae7-38f2-4a2e-afef-f67383982795 for instance cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 on n-h2-858384-17 Oct 31 15:47:55.554838 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3195172f-383a-46fb-825b-a07a9a186b86 req-5ce0cd46-3061-4bc1-a5ab-aa88c1456dd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046366 Oct 31 15:47:55.556891 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2949/5752] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:47:55.992095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c08b6469-b786-4628-85f9-330da76d6a1b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'create', calling method: .version_select at 0x7f16e56c3820>, body: {"keypair": {"name": "tempest-keypair-1063272385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRrtGzMAwp7456k/Dbf2KInXXdAwRevqcC9MnpabFlnOD90O5RNCeR+JLq6pAlWsXxiX0BgEDR1F17a+3VIKG9ucO4LRCB/P4m4hl2wwruR2JqZNsGXRj5zTMpzDR+tSQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:56.023843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:56.025211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:56.037022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c08b6469-b786-4628-85f9-330da76d6a1b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Getting quotas for project 3b3bb1592c2c45c181e470ce3756c812. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:47:56.050199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:56.052977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c08b6469-b786-4628-85f9-330da76d6a1b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Getting quotas for user 5c07cff9c6ae4abf994127f2f38737cb and project 3b3bb1592c2c45c181e470ce3756c812. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:47:56.057217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:56.059989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:56.062208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:56.065629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:56.068382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:56.068939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:56.128419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c08b6469-b786-4628-85f9-330da76d6a1b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.142959 Oct 31 15:47:56.129050 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2804/5753] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Oct 31 15:47:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 31 15:47:56.208114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:56.208729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:56.221005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:56.221577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:56.222005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:56.222721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:56.223182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:56.223606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:56.382632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:56.404815 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae31aeca-48f0-4638-aba4-aa24ec3c2e8e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.377386 Oct 31 15:47:56.408855 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2950/5754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:56 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:56.508999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:56.509505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:56.510236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:56.517901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:56.518402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:56.519627 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09177c73-66ef-449a-b4eb-8b35541101a2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1689 microversion: 2.1 time: 0.315581 Oct 31 15:47:56.519927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:56.520872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:56.521735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:56.522489 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2805/5755] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:56 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1689 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:56.523720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:56.790263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:56.801954 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b9fd435-705f-4f0d-8f17-4bc58850e964 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1314 microversion: 2.1 time: 0.298221 Oct 31 15:47:56.803888 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2951/5756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:56 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:57.430493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:57.432701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:57.442367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:57.444371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:57.444648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:57.445559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:57.446333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:57.447071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:57.551939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:57.553153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:57.561882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:57.562666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:57.563300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:57.564344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:57.564966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:57.565579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:57.671260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:57.685175 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aede21b1-2f50-4a1b-b621-587cd594fefb tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.258455 Oct 31 15:47:57.686120 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2806/5757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:57 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:57.828893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:57.830880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:57.832909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:57.841857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:57.842357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:57.842803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:57.843518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:57.844206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:57.844986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:57.884051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:57.895972 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-58bb10c3-cca6-47a7-991a-a988170f4717 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1689 microversion: 2.1 time: 0.350600 Oct 31 15:47:57.896865 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2952/5758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:57 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1689 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:58.085861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:58.096296 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6db72215-69ec-43b9-a63b-34935a7f604b tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1314 microversion: 2.1 time: 0.272084 Oct 31 15:47:58.097621 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2807/5759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:57 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:58.709964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:58.710651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:58.725492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.729918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.736330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:58.737247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.742077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.748855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:58.922748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:58.924487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:58.929268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:47:58.954409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.955202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.957883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:58.958920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:58.959978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:58.960587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.115752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:59.139140 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd83d168-a1d9-4bc5-9077-65f4f42298e3 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.431325 Oct 31 15:47:59.141503 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2953/5760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:58 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:59.160253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:47:59.161736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:47:59.180620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.183750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.186581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.189158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.191055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.194196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.212213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:59.225913 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c52c652a-014c-4be9-bef7-9edec0fbea92 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1689 microversion: 2.1 time: 0.307359 Oct 31 15:47:59.229482 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2808/5761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:58 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1689 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:47:59.239571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1597561201", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10e79de8-877b-4b91-8dd5-b765b9465821"}], "security_groups": [{"name": "tempest-securitygroup--1542722271"}], "key_name": "tempest-keypair-1063272385", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:47:59.403160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] validate_networks() for [('10e79de8-877b-4b91-8dd5-b765b9465821', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:47:59.415909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:47:59.442111 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22a53a3e-ea97-494f-bdf1-c8bff0c25f33 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1314 microversion: 2.1 time: 0.299462 Oct 31 15:47:59.442921 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2954/5762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:47:59 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:47:59.889783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:47:59.890293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:47:59.890772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:47:59.891176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:47:59.891577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:47:59.907819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.908578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.909022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.909789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:47:59.910249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:47:59.910678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:47:59.928609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Getting quotas for project 3b3bb1592c2c45c181e470ce3756c812. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:47:59.936066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Getting quotas for user 5c07cff9c6ae4abf994127f2f38737cb and project 3b3bb1592c2c45c181e470ce3756c812. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:47:59.951136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:47:59.953646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:48:00.007319 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b86a730-8730-4f8c-969f-096fdae24e2d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.776406 Oct 31 15:48:00.008568 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2809/5763] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Oct 31 15:47:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 31 15:48:00.017908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:00.018737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:00.022713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-522d4416-2d22-4071-9314-8de96646ae1c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:00.023465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-522d4416-2d22-4071-9314-8de96646ae1c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:00.091043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-522d4416-2d22-4071-9314-8de96646ae1c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:00.099316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-522d4416-2d22-4071-9314-8de96646ae1c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:00.100764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-522d4416-2d22-4071-9314-8de96646ae1c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:00.101976 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-522d4416-2d22-4071-9314-8de96646ae1c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1282 microversion: 2.20 time: 0.085818 Oct 31 15:48:00.102536 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2955/5764] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:00 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:48:00.171672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:00.171672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:00.186229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.186735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.187192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.189159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.190093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.190567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.194874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:00.254548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:00.255266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:00.266389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.267659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.269686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.270998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.271850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.272482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.298471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:00.346626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:00.366486 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e31f37fb-17be-41cf-86e8-54fe151bb907 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.200742 Oct 31 15:48:00.367107 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2810/5765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:00 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:00.468102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:00.469198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:00.477957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.478832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.479581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.480719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:00.481433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:00.482081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:00.541349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:00.550944 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53d2b1b9-f153-4f48-941d-610f000e19f2 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1689 microversion: 2.1 time: 0.300102 Oct 31 15:48:00.571177 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2956/5766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:00 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1689 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:00.704800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:00.715878 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f69cf3b-410e-46a7-8547-d4229dc871b8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1314 microversion: 2.1 time: 0.253145 Oct 31 15:48:00.718905 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2811/5767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:00 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:01.092401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ec9c3e14-0b07-4f71-9f49-2be1fc183eb8 req-f56bcf1e-59c0-41fa-ac69-ee054ac162bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a65d1ed-049d-40eb-b426-c95107b6536e", "name": "network-vif-plugged", "status": "completed", "tag": "245bc38c-239e-49e8-ac8f-1b78378bf701"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:01.107649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ec9c3e14-0b07-4f71-9f49-2be1fc183eb8 req-f56bcf1e-59c0-41fa-ac69-ee054ac162bf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:01.108158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ec9c3e14-0b07-4f71-9f49-2be1fc183eb8 req-f56bcf1e-59c0-41fa-ac69-ee054ac162bf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:01.108593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ec9c3e14-0b07-4f71-9f49-2be1fc183eb8 req-f56bcf1e-59c0-41fa-ac69-ee054ac162bf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.137419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:01.138449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:01.147030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:01.147999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:01.148785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.149790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:01.150465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:01.151630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.152364 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ec9c3e14-0b07-4f71-9f49-2be1fc183eb8 req-f56bcf1e-59c0-41fa-ac69-ee054ac162bf service nova] Creating event network-vif-plugged:245bc38c-239e-49e8-ac8f-1b78378bf701 for instance 8a65d1ed-049d-40eb-b426-c95107b6536e on n-h2-858384-17 Oct 31 15:48:01.164864 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ec9c3e14-0b07-4f71-9f49-2be1fc183eb8 req-f56bcf1e-59c0-41fa-ac69-ee054ac162bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.301271 Oct 31 15:48:01.170380 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2957/5768] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:01.242490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:01.252569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:01.255036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:01.256608 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2b537d62-c5a6-45db-8b9a-3ee1cc8cd6a2 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1334 microversion: 2.20 time: 0.132657 Oct 31 15:48:01.257925 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2812/5769] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:01 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1334 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:48:01.397073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:01.397944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:01.407612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:01.408199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:01.409005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.410273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:01.410934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:01.411928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.579028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:01.581869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:01.589510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:01.590800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:01.595400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.596515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:01.597004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:01.597515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.684955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:01.706511 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b24872be-5456-4d6f-95f3-6d66d933dd3f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.315654 Oct 31 15:48:01.722218 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2958/5770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:01 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:01.744060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:01.752395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:01.782393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:01.783155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:01.783902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.784928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:01.785575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:01.786987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:01.889919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:01.913343 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b574bff0-588d-4fcc-b081-c7ccf89ea3a6 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1689 microversion: 2.1 time: 0.338109 Oct 31 15:48:01.914941 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2813/5771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:01 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1689 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:02.126270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:02.144207 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-98421639-aed8-485c-87e3-3d3f069c5c15 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1314 microversion: 2.1 time: 0.403876 Oct 31 15:48:02.144816 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2959/5772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:01 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:02.285717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:02.286896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:02.302119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.302699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.307620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.308530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.309894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.310851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.426566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:02.437979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:02.442719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:02.445884 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a1d68b9a-097d-4bd6-9663-b3863d9326bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1340 microversion: 2.20 time: 0.164012 Oct 31 15:48:02.446476 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2814/5773] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:02 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1340 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:48:02.732977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:02.734407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:02.744267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.745713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.746381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.747322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.748241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.749346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.940811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:02.941678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:02.954590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.955110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.955560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:02.959177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:02.960928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:02.962369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:03.127916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:03.141852 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdb85436-e3a6-49f7-818c-d03ca2578918 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.413717 Oct 31 15:48:03.142460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2960/5774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:02 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:03.182240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:03.187686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:03.202351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:03.202950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:03.203436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:03.204187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:03.209776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:03.210188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:03.277599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:03.289288 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6571618e-74e2-40f4-9eee-0cf8f7ca3d4c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1689 microversion: 2.1 time: 0.352841 Oct 31 15:48:03.302528 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2815/5775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:02 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1689 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:03.348838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-88abdc06-7eb9-4cc3-8f45-9bb0ac948c54 req-6d71645d-a5c6-4e27-85b2-a7ff5fc36c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5a7e3a-6fb3-49f7-9c02-c523670a75d4", "name": "network-vif-plugged", "status": "completed", "tag": "98e7fae7-38f2-4a2e-afef-f67383982795"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:03.362806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-88abdc06-7eb9-4cc3-8f45-9bb0ac948c54 req-6d71645d-a5c6-4e27-85b2-a7ff5fc36c3a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:03.363299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-88abdc06-7eb9-4cc3-8f45-9bb0ac948c54 req-6d71645d-a5c6-4e27-85b2-a7ff5fc36c3a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:03.363735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-88abdc06-7eb9-4cc3-8f45-9bb0ac948c54 req-6d71645d-a5c6-4e27-85b2-a7ff5fc36c3a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:03.377359 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-88abdc06-7eb9-4cc3-8f45-9bb0ac948c54 req-6d71645d-a5c6-4e27-85b2-a7ff5fc36c3a service nova] Creating event network-vif-plugged:98e7fae7-38f2-4a2e-afef-f67383982795 for instance cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 on n-h2-858384-17 Oct 31 15:48:03.383323 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-88abdc06-7eb9-4cc3-8f45-9bb0ac948c54 req-6d71645d-a5c6-4e27-85b2-a7ff5fc36c3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038792 Oct 31 15:48:03.384815 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2816/5776] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:03.476854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:03.477901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:03.488981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:03.489883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:03.490547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:03.491653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:03.492501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:03.493186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:03.662040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:03.684177 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c7a607a-8155-4e2c-b2e5-95722bdf09cf tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1498 microversion: 2.1 time: 0.515603 Oct 31 15:48:03.691124 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2961/5777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:03 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1498 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:03.713756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:03.727513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:03.730451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:03.731999 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7becf29-e0c4-416a-b2a1-6f44bbe73301 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1408 microversion: 2.20 time: 0.261643 Oct 31 15:48:03.746559 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2817/5778] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:03 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:48:04.168244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:04.168938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:04.182746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.183894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.184695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.185999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.187029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.188131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.273743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:04.274557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:04.282889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.283659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.285299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.286470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.287571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.288851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.332273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:48:04.443018 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e6235c4f-f4b8-4c9f-8926-6ad2e20396c8 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 204 len: 0 microversion: 2.1 time: 0.173679 Oct 31 15:48:04.444260 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2818/5779] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:48:04 2022] DELETE /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:48:04.517329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:04.527814 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-56b4a7ae-8a13-425c-996c-480cf7b71be0 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.364070 Oct 31 15:48:04.529484 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2962/5780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:04 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:04.544195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-61136953-4ad4-45f7-9408-05ceccd64a6e req-396d290c-579f-4cf2-8a90-0529c6e4d92f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289733fd-f960-4199-8fa2-216a96d2fc13", "tag": "872254c0-08bd-4300-af3d-c79a64cc12be"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:04.565818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-61136953-4ad4-45f7-9408-05ceccd64a6e req-396d290c-579f-4cf2-8a90-0529c6e4d92f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.566571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-61136953-4ad4-45f7-9408-05ceccd64a6e req-396d290c-579f-4cf2-8a90-0529c6e4d92f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.568077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-61136953-4ad4-45f7-9408-05ceccd64a6e req-396d290c-579f-4cf2-8a90-0529c6e4d92f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.586201 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-61136953-4ad4-45f7-9408-05ceccd64a6e req-396d290c-579f-4cf2-8a90-0529c6e4d92f service nova] Creating event network-changed:872254c0-08bd-4300-af3d-c79a64cc12be for instance 289733fd-f960-4199-8fa2-216a96d2fc13 on n-h1-858384-17 Oct 31 15:48:04.595431 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-61136953-4ad4-45f7-9408-05ceccd64a6e req-396d290c-579f-4cf2-8a90-0529c6e4d92f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062670 Oct 31 15:48:04.596864 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2963/5781] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:04.609050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:04.610192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:04.619182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.620840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.621656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.623089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.623790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.624474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.898452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:04.914751 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e61ce30-fe16-43e8-a06e-cb84577a37e2 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1504 microversion: 2.1 time: 0.316219 Oct 31 15:48:04.915635 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2964/5782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:04 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:04.922109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:04.922716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:04.928871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.929389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.930087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.931006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.931685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.932729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.934512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:04.936524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:04.946857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.950611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.952197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:04.956625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:04.957571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:04.958411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:05.191140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:05.201295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9fe2b3a-b925-4c21-be36-1b53b4171d1c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1689 microversion: 2.1 time: 0.755524 Oct 31 15:48:05.202294 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2819/5783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:04 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1689 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:05.210029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:05.220912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:05.222537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:05.224126 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-73911a5d-33b8-4fd9-855a-d1d5b8ba6a5b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1408 microversion: 2.20 time: 0.307605 Oct 31 15:48:05.224811 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2965/5784] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:04 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:48:05.554589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:05.555200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:05.577216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:05.577944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:05.578584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:05.579527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:05.579990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:05.580418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:05.730797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:05.739777 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4d8ad903-046d-4831-b4a6-0fcd3e4f9de6 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.188939 Oct 31 15:48:05.740828 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2820/5785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:05 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:05.939801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:05.940579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:05.949286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:05.949782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:05.950551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:05.951418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:05.952036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:05.952669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.126796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:06.140700 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f8aa3e3-b82b-4ba3-8e16-2b6c6680d3d5 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1504 microversion: 2.1 time: 0.205365 Oct 31 15:48:06.153663 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2966/5786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:05 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:06.226331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:06.227322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:06.234927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.235741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.236500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.237821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.238013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.238547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.252690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:06.253851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:06.271828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.272337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.273221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.274710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.275348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.276697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.434215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:06.442660 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2ea7496-106c-44db-8957-3731a7fae475 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1695 microversion: 2.1 time: 0.220146 Oct 31 15:48:06.443260 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2821/5787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:06 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:06.588656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:06.612180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:06.613683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:06.614816 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d02e17e4-cb2e-484b-9581-872202eebf64 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1408 microversion: 2.20 time: 0.367789 Oct 31 15:48:06.615400 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2967/5788] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:06 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1408 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:48:06.770849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:06.772404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:06.781975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.782849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.783561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.784479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:06.785191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:06.785955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:06.975340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:06.984652 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb462817-6aa9-4183-a740-d997cccdb98a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1322 microversion: 2.1 time: 0.217995 Oct 31 15:48:06.985347 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2822/5789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:06 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:07.165816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:07.167030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:07.174573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.175165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.175850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.176721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.177554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.178318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.340525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:07.349414 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7fdc6c4f-178b-429f-98e7-1a831a30804a tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1504 microversion: 2.1 time: 0.187609 Oct 31 15:48:07.350197 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2968/5790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:07 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:07.468597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:07.469366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:07.486324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.487501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.488337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.489883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.490541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.491142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.647736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:07.648363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:07.658138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.658641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.659079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.660483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:07.661935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:07.662728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:07.843356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:07.859028 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df4a1644-6876-4a51-be58-c96162886a9a tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1695 microversion: 2.1 time: 0.394126 Oct 31 15:48:07.859984 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2823/5791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:07 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1695 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:07.973741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:07.983604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:07.984980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:07.986122 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-188f7530-f054-4711-9199-c329a23cd2a6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1408 microversion: 2.20 time: 0.349460 Oct 31 15:48:07.986696 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2969/5792] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:07 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1408 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:48:08.007834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:08.008452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:08.015677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.016176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.016615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.017564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.018188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.018780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.186637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:08.197343 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b46d443-69ad-4ff5-9b4e-da8e66fc707a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1517 microversion: 2.1 time: 0.192592 Oct 31 15:48:08.214839 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2824/5793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:08 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:08.353247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d8ae959-3454-415d-898b-fd8e759af150 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-624192980", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d8ae959-3454-415d-898b-fd8e759af150 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Request method failure captured: Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 242 Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-4j52j7kzzzvhAeXykt2XqxueabJT9r7pmUlZlzsJZI0JFtBaOzbCuZA_2CrYLs98Dh7nUO7ffpWQ9-gQ1gKzYUkw86kdvDf_RQyoycuNEEHWDLAlM0p_lMW0wqwKdv0UWyhCbilzZxlQTobYS4ENXDi20qd8bwkWZG0nwQWPaVfh4 Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcb90eb236184f91a1d876339b68b99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcb90eb236184f91a1d876339b68b99b"}]}] Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 78ac0a39bc9e4214a202f26c66c41d92 Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-624192980", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-624192980', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '852c1793-711a-40a6-85c9-63100e2bd3b2'}]}}} Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:08.365980 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9d8ae959-3454-415d-898b-fd8e759af150 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9d8ae959-3454-415d-898b-fd8e759af150 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.019808 Oct 31 15:48:08.371667 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2970/5794] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:48:08 2022] POST /compute/v2.1/servers => generated 175 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:48:08.379817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:08.380452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:08.382539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e726892e-2aba-40bc-b1dc-6d03bec79e03 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:08.383053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e726892e-2aba-40bc-b1dc-6d03bec79e03 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: 518404f5-4e93-4b7e-b229-d1f0981a4b7c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:08.388849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.389397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.390735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.390860 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e726892e-2aba-40bc-b1dc-6d03bec79e03 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] HTTP exception thrown: Instance 518404f5-4e93-4b7e-b229-d1f0981a4b7c could not be found. Oct 31 15:48:08.391460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.392644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.393967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e726892e-2aba-40bc-b1dc-6d03bec79e03 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Request method failure captured: Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/518404f5-4e93-4b7e-b229-d1f0981a4b7c/metadata HTTP/1.1 Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-4j52j7kzzzvhAeXykt2XqxueabJT9r7pmUlZlzsJZI0JFtBaOzbCuZA_2CrYLs98Dh7nUO7ffpWQ9-gQ1gKzYUkw86kdvDf_RQyoycuNEEHWDLAlM0p_lMW0wqwKdv0UWyhCbilzZxlQTobYS4ENXDi20qd8bwkWZG0nwQWPaVfh4 Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcb90eb236184f91a1d876339b68b99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcb90eb236184f91a1d876339b68b99b"}]}] Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 78ac0a39bc9e4214a202f26c66c41d92 Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 518404f5-4e93-4b7e-b229-d1f0981a4b7c could not be found. Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': '518404f5-4e93-4b7e-b229-d1f0981a4b7c'} Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518404f5-4e93-4b7e-b229-d1f0981a4b7c could not be found. Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518404f5-4e93-4b7e-b229-d1f0981a4b7c could not be found. Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.401376 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.405116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:08.405116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:08.405116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518404f5-4e93-4b7e-b229-d1f0981a4b7c could not be found. Oct 31 15:48:08.405116 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.418362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e726892e-2aba-40bc-b1dc-6d03bec79e03 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Returning 404 to user: Instance 518404f5-4e93-4b7e-b229-d1f0981a4b7c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:08.420711 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e726892e-2aba-40bc-b1dc-6d03bec79e03 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/518404f5-4e93-4b7e-b229-d1f0981a4b7c/metadata" status: 404 len: 111 microversion: 2.1 time: 0.043914 Oct 31 15:48:08.421567 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2971/5795] 10.222.0.20 () {58 vars in 1263 bytes} [Mon Oct 31 15:48:08 2022] GET /compute/v2.1/servers/518404f5-4e93-4b7e-b229-d1f0981a4b7c/metadata => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:08.430246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-1f56369f-2d39-466a-94e9-2cde2d837c87 req-394f12bd-6548-49a3-959f-87f2b93c4de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a65d1ed-049d-40eb-b426-c95107b6536e", "name": "network-vif-deleted", "tag": "245bc38c-239e-49e8-ac8f-1b78378bf701"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:08.454665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f56369f-2d39-466a-94e9-2cde2d837c87 req-394f12bd-6548-49a3-959f-87f2b93c4de7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.455506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f56369f-2d39-466a-94e9-2cde2d837c87 req-394f12bd-6548-49a3-959f-87f2b93c4de7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.456134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-1f56369f-2d39-466a-94e9-2cde2d837c87 req-394f12bd-6548-49a3-959f-87f2b93c4de7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.468502 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-1f56369f-2d39-466a-94e9-2cde2d837c87 req-394f12bd-6548-49a3-959f-87f2b93c4de7 service nova] Creating event network-vif-deleted:245bc38c-239e-49e8-ac8f-1b78378bf701 for instance 8a65d1ed-049d-40eb-b426-c95107b6536e on n-h2-858384-17 Oct 31 15:48:08.475413 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-1f56369f-2d39-466a-94e9-2cde2d837c87 req-394f12bd-6548-49a3-959f-87f2b93c4de7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050338 Oct 31 15:48:08.476207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2972/5796] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:08.492028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c219c6e29154502b84b3f7ac4577ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8321916c4547caaa589204fee9ba00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:08.497199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:08.512449 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-912b8aa4-fc6a-45fe-938d-74e6afcb5c51 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 200 len: 1462 microversion: 2.1 time: 0.143072 Oct 31 15:48:08.518450 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2825/5797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:08 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 1462 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:08.592019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3809937d-d5f2-4d8a-a1fc-de973d51076f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1489363455", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3809937d-d5f2-4d8a-a1fc-de973d51076f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Request method failure captured: Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 499 Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-4j52j7kzzzvhAeXykt2XqxueabJT9r7pmUlZlzsJZI0JFtBaOzbCuZA_2CrYLs98Dh7nUO7ffpWQ9-gQ1gKzYUkw86kdvDf_RQyoycuNEEHWDLAlM0p_lMW0wqwKdv0UWyhCbilzZxlQTobYS4ENXDi20qd8bwkWZG0nwQWPaVfh4 Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcb90eb236184f91a1d876339b68b99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcb90eb236184f91a1d876339b68b99b"}]}] Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 78ac0a39bc9e4214a202f26c66c41d92 Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1489363455", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1489363455', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '852c1793-711a-40a6-85c9-63100e2bd3b2'}]}}} Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:48:08.596871 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.600325 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.607421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3809937d-d5f2-4d8a-a1fc-de973d51076f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:08.607421 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3809937d-d5f2-4d8a-a1fc-de973d51076f tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.019999 Oct 31 15:48:08.607421 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2973/5798] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:48:08 2022] POST /compute/v2.1/servers => generated 687 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:48:08.676830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d04a212-35c9-4bc1-a9d8-c5af9f74f18b tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-908404375", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d04a212-35c9-4bc1-a9d8-c5af9f74f18b tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Request method failure captured: Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 499 Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-4j52j7kzzzvhAeXykt2XqxueabJT9r7pmUlZlzsJZI0JFtBaOzbCuZA_2CrYLs98Dh7nUO7ffpWQ9-gQ1gKzYUkw86kdvDf_RQyoycuNEEHWDLAlM0p_lMW0wqwKdv0UWyhCbilzZxlQTobYS4ENXDi20qd8bwkWZG0nwQWPaVfh4 Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcb90eb236184f91a1d876339b68b99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcb90eb236184f91a1d876339b68b99b"}]}] Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 78ac0a39bc9e4214a202f26c66c41d92 Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-908404375", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-908404375', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '852c1793-711a-40a6-85c9-63100e2bd3b2'}]}}} Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:48:08.682710 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.686562 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.690185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d04a212-35c9-4bc1-a9d8-c5af9f74f18b tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:08.691599 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d04a212-35c9-4bc1-a9d8-c5af9f74f18b tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.018957 Oct 31 15:48:08.692447 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2826/5799] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:48:08 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:48:08.764258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21f1466a-2cf5-4aba-93c0-3ffb7b266f91 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1985541203", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21f1466a-2cf5-4aba-93c0-3ffb7b266f91 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Request method failure captured: Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 754 Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-4j52j7kzzzvhAeXykt2XqxueabJT9r7pmUlZlzsJZI0JFtBaOzbCuZA_2CrYLs98Dh7nUO7ffpWQ9-gQ1gKzYUkw86kdvDf_RQyoycuNEEHWDLAlM0p_lMW0wqwKdv0UWyhCbilzZxlQTobYS4ENXDi20qd8bwkWZG0nwQWPaVfh4 Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcb90eb236184f91a1d876339b68b99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcb90eb236184f91a1d876339b68b99b"}]}] Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 78ac0a39bc9e4214a202f26c66c41d92 Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1985541203", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1985541203', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '852c1793-711a-40a6-85c9-63100e2bd3b2'}]}}} Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:48:08.770373 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:48:08.773695 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:48:08.776633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.776633 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.776633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21f1466a-2cf5-4aba-93c0-3ffb7b266f91 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:08.776633 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21f1466a-2cf5-4aba-93c0-3ffb7b266f91 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.012208 Oct 31 15:48:08.776633 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2974/5800] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:48:08 2022] POST /compute/v2.1/servers => generated 1197 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 31 15:48:08.886116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:08.887581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:08.918258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.919819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.920452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.923726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:08.924756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:08.928210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:08.967704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-725d4c5a-d0ae-492f-928e-5fb30bf6d32e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2014501506", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-725d4c5a-d0ae-492f-928e-5fb30bf6d32e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Request method failure captured: Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 1266 Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-4j52j7kzzzvhAeXykt2XqxueabJT9r7pmUlZlzsJZI0JFtBaOzbCuZA_2CrYLs98Dh7nUO7ffpWQ9-gQ1gKzYUkw86kdvDf_RQyoycuNEEHWDLAlM0p_lMW0wqwKdv0UWyhCbilzZxlQTobYS4ENXDi20qd8bwkWZG0nwQWPaVfh4 Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcb90eb236184f91a1d876339b68b99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcb90eb236184f91a1d876339b68b99b"}]}] Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 78ac0a39bc9e4214a202f26c66c41d92 Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2014501506", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "852c1793-711a-40a6-85c9-63100e2bd3b2"}]}} Oct 31 15:48:08.974671 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2014501506', 'imageRef': '524d630e-d0c9-4d4c-9057-837f830c46f6', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '852c1793-711a-40a6-85c9-63100e2bd3b2'}]}}} Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise error Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.977450 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 15:48:08.979060 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 15:48:08.980817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 31 15:48:08.980817 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:08.980817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-725d4c5a-d0ae-492f-928e-5fb30bf6d32e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:08.980817 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-725d4c5a-d0ae-492f-928e-5fb30bf6d32e tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.016107 Oct 31 15:48:08.980817 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2975/5801] 10.222.0.20 () {60 vars in 1148 bytes} [Mon Oct 31 15:48:08 2022] POST /compute/v2.1/servers => generated 2221 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 31 15:48:08.990613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e393edd-f280-4f3c-844d-d01c7582298a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:08.991819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e393edd-f280-4f3c-844d-d01c7582298a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: 33456311-12bb-41e7-bb66-48f9be565200] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:09.001419 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4e393edd-f280-4f3c-844d-d01c7582298a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] HTTP exception thrown: Instance 33456311-12bb-41e7-bb66-48f9be565200 could not be found. Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e393edd-f280-4f3c-844d-d01c7582298a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Request method failure captured: Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/33456311-12bb-41e7-bb66-48f9be565200/metadata/test2 HTTP/1.1 Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-4j52j7kzzzvhAeXykt2XqxueabJT9r7pmUlZlzsJZI0JFtBaOzbCuZA_2CrYLs98Dh7nUO7ffpWQ9-gQ1gKzYUkw86kdvDf_RQyoycuNEEHWDLAlM0p_lMW0wqwKdv0UWyhCbilzZxlQTobYS4ENXDi20qd8bwkWZG0nwQWPaVfh4 Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcb90eb236184f91a1d876339b68b99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcb90eb236184f91a1d876339b68b99b"}]}] Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 78ac0a39bc9e4214a202f26c66c41d92 Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 33456311-12bb-41e7-bb66-48f9be565200 could not be found. Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': '33456311-12bb-41e7-bb66-48f9be565200', 'id': 'test2'} Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33456311-12bb-41e7-bb66-48f9be565200 could not be found. Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33456311-12bb-41e7-bb66-48f9be565200 could not be found. Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:09.004162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:09.008349 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:09.008349 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:09.008349 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33456311-12bb-41e7-bb66-48f9be565200 could not be found. Oct 31 15:48:09.008349 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.008349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e393edd-f280-4f3c-844d-d01c7582298a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Returning 404 to user: Instance 33456311-12bb-41e7-bb66-48f9be565200 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:09.010323 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e393edd-f280-4f3c-844d-d01c7582298a tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/33456311-12bb-41e7-bb66-48f9be565200/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.023554 Oct 31 15:48:09.020394 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2976/5802] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 31 15:48:08 2022] GET /compute/v2.1/servers/33456311-12bb-41e7-bb66-48f9be565200/metadata/test2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:48:09.027796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:09.028721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:09.039632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.040475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.041114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.043456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.044585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.045286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.192350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:09.209240 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51192ed5-1afe-40e9-8b75-8ef8452a6cbe tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1680 microversion: 2.1 time: 0.328856 Oct 31 15:48:09.209844 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2827/5803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:08 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1680 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:09.216045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:09.216542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:09.233991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.244697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.245619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.246557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.247179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.247608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.297946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:48:09.335786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:09.350291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:09.356750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:09.360573 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5831dda-69a9-4294-abd1-b068003ccf66 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1408 microversion: 2.20 time: 0.338450 Oct 31 15:48:09.377170 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2977/5804] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:09 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:48:09.377170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c8c4abb3-7701-41d3-8f9e-b694ef06e4e0 req-9b55036e-69ae-4bf2-8edd-639a077391f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a6e698-d8ff-424c-9858-523344add14a", "name": "network-vif-unplugged", "status": "completed", "tag": "c855972b-45d8-4f2f-ae75-cba94a6d85a6"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:09.406335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c8c4abb3-7701-41d3-8f9e-b694ef06e4e0 req-9b55036e-69ae-4bf2-8edd-639a077391f4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.408426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c8c4abb3-7701-41d3-8f9e-b694ef06e4e0 req-9b55036e-69ae-4bf2-8edd-639a077391f4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.410378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c8c4abb3-7701-41d3-8f9e-b694ef06e4e0 req-9b55036e-69ae-4bf2-8edd-639a077391f4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.444944 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c8c4abb3-7701-41d3-8f9e-b694ef06e4e0 req-9b55036e-69ae-4bf2-8edd-639a077391f4 service nova] Creating event network-vif-unplugged:c855972b-45d8-4f2f-ae75-cba94a6d85a6 for instance c5a6e698-d8ff-424c-9858-523344add14a on n-h2-858384-17 Oct 31 15:48:09.456062 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c8c4abb3-7701-41d3-8f9e-b694ef06e4e0 req-9b55036e-69ae-4bf2-8edd-639a077391f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090337 Oct 31 15:48:09.456982 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2978/5805] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:09.502631 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a79a4d6e-099a-48ea-9217-78252632beb2 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 204 len: 0 microversion: 2.1 time: 0.291029 Oct 31 15:48:09.503908 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2828/5806] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:48:09 2022] DELETE /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:48:09.515721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:09.517169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:09.527721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.528407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.529247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.530290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.530768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.531339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.542559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:09.543267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] [instance: 8a65d1ed-049d-40eb-b426-c95107b6536e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:09.551413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.561922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.562655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.563567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:09.564171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:09.564768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:09.606809 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] HTTP exception thrown: Instance 8a65d1ed-049d-40eb-b426-c95107b6536e could not be found. Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Request method failure captured: Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e HTTP/1.1 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-4KMSQxG1EfuZJgPtgL4DPM21eLgyyWlX_IdtzgS4WbvHgNJgsbNLBsuylBI0OOwtKqFtU_-Ufd3t41z0icmW39_gy90qHaOn-QU6z6HwAK88KDzE-BIEzK7-6j-HO_AVV5PdEsI5pddKLnl5C8va_Bgzf9bGXU8Equ9RTNgXQ9xoA Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 6c8321916c4547caaa589204fee9ba00 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesActionsTest-1337748676 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c8321916c4547caaa589204fee9ba00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6c8321916c4547caaa589204fee9ba00", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6c8321916c4547caaa589204fee9ba00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6c8321916c4547caaa589204fee9ba00"}]}] Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-VolumesActionsTest-1337748676 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 6c8321916c4547caaa589204fee9ba00 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesActionsTest-1337748676 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-VolumesActionsTest-1337748676-project Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 0c219c6e29154502b84b3f7ac4577ea7 Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-VolumesActionsTest-1337748676-project Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 8a65d1ed-049d-40eb-b426-c95107b6536e could not be found. Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '8a65d1ed-049d-40eb-b426-c95107b6536e'} Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a65d1ed-049d-40eb-b426-c95107b6536e could not be found. Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a65d1ed-049d-40eb-b426-c95107b6536e could not be found. Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:09.608495 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.612375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:09.612375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:09.612375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:09.612375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:09.612375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:09.612375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a65d1ed-049d-40eb-b426-c95107b6536e could not be found. Oct 31 15:48:09.612375 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:09.612375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] Returning 404 to user: Instance 8a65d1ed-049d-40eb-b426-c95107b6536e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:09.613030 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-800ff181-824d-46e2-94f5-2d6a31f0a356 tempest-VolumesActionsTest-1337748676 tempest-VolumesActionsTest-1337748676-project] 10.222.0.20 "GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e" status: 404 len: 111 microversion: 2.1 time: 0.076405 Oct 31 15:48:09.614869 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2829/5807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:09 2022] GET /compute/v2.1/servers/8a65d1ed-049d-40eb-b426-c95107b6536e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:48:09.820437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:09.831181 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-81c4a050-8fe3-4dc3-9f61-0ed4c317b639 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1523 microversion: 2.1 time: 0.322371 Oct 31 15:48:09.840587 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2979/5808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:09 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:10.392199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:10.393386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:10.398014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:10.400286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=20 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:10.408301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.409121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.409958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.410666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.411127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.411555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.588502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:10.606030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:10.609716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:10.613268 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87fbea7a-b344-4d99-ad7b-a03c5bf70b44 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1408 microversion: 2.20 time: 0.229923 Oct 31 15:48:10.614514 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2830/5809] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:10 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:48:10.855903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:10.857428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:10.859802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:10.866125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.866875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.867558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:10.870339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:10.871225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:10.872025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.143707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:11.153877 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d821c9de-8c58-4367-8693-d24c375f9c73 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1523 microversion: 2.1 time: 0.302404 Oct 31 15:48:11.155471 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2980/5810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:10 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:11.476135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-17bd15ee-0a68-48d9-a56b-e2b9770ed92a req-4c8e5d6b-d092-4388-b9c9-41a42cf7ff0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289733fd-f960-4199-8fa2-216a96d2fc13", "name": "network-vif-plugged", "status": "completed", "tag": "872254c0-08bd-4300-af3d-c79a64cc12be"}, {"server_uuid": "c5a6e698-d8ff-424c-9858-523344add14a", "name": "network-vif-plugged", "status": "completed", "tag": "c855972b-45d8-4f2f-ae75-cba94a6d85a6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:11.491251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-17bd15ee-0a68-48d9-a56b-e2b9770ed92a req-4c8e5d6b-d092-4388-b9c9-41a42cf7ff0f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:11.491898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-17bd15ee-0a68-48d9-a56b-e2b9770ed92a req-4c8e5d6b-d092-4388-b9c9-41a42cf7ff0f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:11.492641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-17bd15ee-0a68-48d9-a56b-e2b9770ed92a req-4c8e5d6b-d092-4388-b9c9-41a42cf7ff0f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.513115 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-17bd15ee-0a68-48d9-a56b-e2b9770ed92a req-4c8e5d6b-d092-4388-b9c9-41a42cf7ff0f service nova] Creating event network-vif-plugged:872254c0-08bd-4300-af3d-c79a64cc12be for instance 289733fd-f960-4199-8fa2-216a96d2fc13 on n-h1-858384-17 Oct 31 15:48:11.514208 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-17bd15ee-0a68-48d9-a56b-e2b9770ed92a req-4c8e5d6b-d092-4388-b9c9-41a42cf7ff0f service nova] Creating event network-vif-plugged:c855972b-45d8-4f2f-ae75-cba94a6d85a6 for instance c5a6e698-d8ff-424c-9858-523344add14a on n-h2-858384-17 Oct 31 15:48:11.523024 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-17bd15ee-0a68-48d9-a56b-e2b9770ed92a req-4c8e5d6b-d092-4388-b9c9-41a42cf7ff0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051346 Oct 31 15:48:11.524259 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2831/5811] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:48:11.653217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7d14e53f-1a20-4080-8027-482e3a02bc74 req-c16992d0-248c-4c3f-9966-b6d4ce00b58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5a7e3a-6fb3-49f7-9c02-c523670a75d4", "name": "network-vif-deleted", "tag": "98e7fae7-38f2-4a2e-afef-f67383982795"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:11.653783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:11.654627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:11.692043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:11.705977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:11.707181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.711668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:11.712562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:11.713928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.715420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7d14e53f-1a20-4080-8027-482e3a02bc74 req-c16992d0-248c-4c3f-9966-b6d4ce00b58f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:11.716176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7d14e53f-1a20-4080-8027-482e3a02bc74 req-c16992d0-248c-4c3f-9966-b6d4ce00b58f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:11.717365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7d14e53f-1a20-4080-8027-482e3a02bc74 req-c16992d0-248c-4c3f-9966-b6d4ce00b58f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:11.732705 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7d14e53f-1a20-4080-8027-482e3a02bc74 req-c16992d0-248c-4c3f-9966-b6d4ce00b58f service nova] Creating event network-vif-deleted:98e7fae7-38f2-4a2e-afef-f67383982795 for instance cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 on n-h2-858384-17 Oct 31 15:48:11.747985 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7d14e53f-1a20-4080-8027-482e3a02bc74 req-c16992d0-248c-4c3f-9966-b6d4ce00b58f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103325 Oct 31 15:48:11.757052 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2832/5812] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:48:11.980475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:11.994686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:12.003973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:12.005655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:12.006996 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3c85c2c3-9723-4eb8-bf92-4e3053e17866 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1408 microversion: 2.20 time: 0.368710 Oct 31 15:48:12.022106 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2981/5813] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:11 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:48:12.179664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:12.180374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:12.194068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:12.194573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:12.196489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:12.197826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:12.198293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:12.200847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:12.299517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:12.300527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:12.301258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:12.303463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lazy-loading 'fault' on Instance uuid cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:48:12.356858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ac0a39bc9e4214a202f26c66c41d92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcb90eb236184f91a1d876339b68b99b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:12.367864 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04a9a6bd-ad3c-4243-bfdd-0ea2a7199ac9 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 200 len: 1312 microversion: 2.1 time: 0.192614 Oct 31 15:48:12.373376 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2833/5814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:12 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:13.036862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:13.038616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:13.051769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:13.052592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:13.053330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:13.054752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:13.057629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:13.058723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:13.272444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:13.286350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:13.289365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:13.293500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7ec4258-5e4b-4a82-b057-022d5668d402 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1600 microversion: 2.20 time: 0.262336 Oct 31 15:48:13.295127 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2982/5815] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:13 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1600 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:48:13.321038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ea6bfe0-41c3-49f6-9a5b-7bac29b8baa6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:13.321627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ea6bfe0-41c3-49f6-9a5b-7bac29b8baa6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:13.329988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea6bfe0-41c3-49f6-9a5b-7bac29b8baa6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:13.345381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea6bfe0-41c3-49f6-9a5b-7bac29b8baa6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:13.345843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea6bfe0-41c3-49f6-9a5b-7bac29b8baa6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:13.346914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea6bfe0-41c3-49f6-9a5b-7bac29b8baa6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:13.347556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea6bfe0-41c3-49f6-9a5b-7bac29b8baa6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:13.347981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ea6bfe0-41c3-49f6-9a5b-7bac29b8baa6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:13.394499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:13.395395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] [instance: cb5a7e3a-6fb3-49f7-9c02-c523670a75d4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:13.404449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:13.405495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:13.406560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:13.407455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:13.408297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:13.409107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:13.429915 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] HTTP exception thrown: Instance cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 could not be found. Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Request method failure captured: Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 HTTP/1.1 Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-4j52j7kzzzvhAeXykt2XqxueabJT9r7pmUlZlzsJZI0JFtBaOzbCuZA_2CrYLs98Dh7nUO7ffpWQ9-gQ1gKzYUkw86kdvDf_RQyoycuNEEHWDLAlM0p_lMW0wqwKdv0UWyhCbilzZxlQTobYS4ENXDi20qd8bwkWZG0nwQWPaVfh4 Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fcb90eb236184f91a1d876339b68b99b", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fcb90eb236184f91a1d876339b68b99b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fcb90eb236184f91a1d876339b68b99b"}]}] Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fcb90eb236184f91a1d876339b68b99b Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1000894543 Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 78ac0a39bc9e4214a202f26c66c41d92 Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1000894543-project Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 could not be found. Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'cb5a7e3a-6fb3-49f7-9c02-c523670a75d4'} Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 could not be found. Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 could not be found. Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:13.433557 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:13.438638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:13.438638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:13.438638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:13.438638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:13.438638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:13.438638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:13.438638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 could not be found. Oct 31 15:48:13.438638 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:13.441236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] Returning 404 to user: Instance cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:13.442576 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-84b70a90-06e2-4c28-84eb-15e3d5c36e75 tempest-ServerMetadataNegativeTestJSON-1000894543 tempest-ServerMetadataNegativeTestJSON-1000894543-project] 10.222.0.20 "GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4" status: 404 len: 111 microversion: 2.1 time: 0.052382 Oct 31 15:48:13.449622 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2983/5816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:13 2022] GET /compute/v2.1/servers/cb5a7e3a-6fb3-49f7-9c02-c523670a75d4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:13.461693 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ea6bfe0-41c3-49f6-9a5b-7bac29b8baa6 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.144472 Oct 31 15:48:13.462544 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2834/5817] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Oct 31 15:48:13 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:48:15.567669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4e31b599-1d7c-4dfb-8181-637035a9aa61 req-b26f5a42-50e9-4ab6-811b-98913f8c841d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289733fd-f960-4199-8fa2-216a96d2fc13", "tag": "872254c0-08bd-4300-af3d-c79a64cc12be"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:15.591112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4e31b599-1d7c-4dfb-8181-637035a9aa61 req-b26f5a42-50e9-4ab6-811b-98913f8c841d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:15.594833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4e31b599-1d7c-4dfb-8181-637035a9aa61 req-b26f5a42-50e9-4ab6-811b-98913f8c841d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:15.597491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4e31b599-1d7c-4dfb-8181-637035a9aa61 req-b26f5a42-50e9-4ab6-811b-98913f8c841d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:15.632910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4e31b599-1d7c-4dfb-8181-637035a9aa61 req-b26f5a42-50e9-4ab6-811b-98913f8c841d service nova] Creating event network-changed:872254c0-08bd-4300-af3d-c79a64cc12be for instance 289733fd-f960-4199-8fa2-216a96d2fc13 on n-h1-858384-17 Oct 31 15:48:15.655002 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4e31b599-1d7c-4dfb-8181-637035a9aa61 req-b26f5a42-50e9-4ab6-811b-98913f8c841d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090799 Oct 31 15:48:15.656932 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2984/5818] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:18.427996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:18.429506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:18.446861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:18.448952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:18.453933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:18.454945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:18.456603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:18.458373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:18.548065 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/ips" status: 200 len: 151 microversion: 2.1 time: 0.125324 Oct 31 15:48:18.566894 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2835/5819] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:48:18 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/ips => generated 151 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:21.515442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17cd6245-254c-4ef1-ae8c-5c5ef9c9856a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9aca5b6-fe57-41d5-ab23-3efc7adf936d"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:21.517925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17cd6245-254c-4ef1-ae8c-5c5ef9c9856a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:21.528246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17cd6245-254c-4ef1-ae8c-5c5ef9c9856a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:21.529069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17cd6245-254c-4ef1-ae8c-5c5ef9c9856a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:21.529845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17cd6245-254c-4ef1-ae8c-5c5ef9c9856a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:21.530862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17cd6245-254c-4ef1-ae8c-5c5ef9c9856a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:21.531494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17cd6245-254c-4ef1-ae8c-5c5ef9c9856a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:21.532137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17cd6245-254c-4ef1-ae8c-5c5ef9c9856a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:22.145538 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17cd6245-254c-4ef1-ae8c-5c5ef9c9856a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.635379 Oct 31 15:48:22.146688 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2985/5820] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:48:21 2022] POST /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:23.717888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:23.720041 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e7a2296-8912-49c5-abca-760ebfb78357 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002606 Oct 31 15:48:23.721205 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2836/5821] 10.222.0.20 () {56 vars in 886 bytes} [Mon Oct 31 15:48:23 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 31 15:48:27.093848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f31fe192-230f-4e89-a589-c26e80d35079 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Action: 'create', calling method: .version_select at 0x7f16e00ae310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1719508306", "metadata": {"Type": "work"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:27.892486 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f31fe192-230f-4e89-a589-c26e80d35079 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.026966 Oct 31 15:48:27.893359 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2986/5822] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Oct 31 15:48:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1029 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 15:48:27.906402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-267193a9-7d3b-4575-83fe-975781cf727a tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e0192940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:28.072676 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-267193a9-7d3b-4575-83fe-975781cf727a tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 200 len: 353 microversion: 2.1 time: 0.169027 Oct 31 15:48:28.079771 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2837/5823] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:48:27 2022] GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:29.098391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e3e75f0c-9785-42f9-9ba2-93abd382058c tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e02b4430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:29.201250 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e3e75f0c-9785-42f9-9ba2-93abd382058c tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 200 len: 353 microversion: 2.1 time: 0.117693 Oct 31 15:48:29.208128 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2987/5824] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:48:29 2022] GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:30.218331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2087e09b-b07f-4447-ac04-a19ae8840e6e tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e03059d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:30.232463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:30.239532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:30.364309 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2087e09b-b07f-4447-ac04-a19ae8840e6e tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 200 len: 354 microversion: 2.1 time: 0.152198 Oct 31 15:48:30.364905 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2838/5825] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:48:30 2022] GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:30.379087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6930a534-5f02-4391-b8d9-6443d5188330 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e00c1dc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:30.483050 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6930a534-5f02-4391-b8d9-6443d5188330 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 200 len: 354 microversion: 2.1 time: 0.108742 Oct 31 15:48:30.501005 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2988/5826] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:48:30 2022] GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:30.502539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11ad2642-2ded-4fe1-b1c4-2ae01928c092 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e0340c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:30.686812 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11ad2642-2ded-4fe1-b1c4-2ae01928c092 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 202 len: 0 microversion: 2.1 time: 0.188901 Oct 31 15:48:30.687621 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2839/5827] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:48:30 2022] DELETE /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:48:30.695691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f9ab6b06-e268-4905-96ad-53dba212c18a tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e01fbee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:30.827154 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f9ab6b06-e268-4905-96ad-53dba212c18a tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 200 len: 353 microversion: 2.1 time: 0.135624 Oct 31 15:48:30.827952 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2989/5828] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:48:30 2022] GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:48:31.847459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-430169bd-6f94-47cd-ac7a-a6dfacea3acc tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e03405e0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:31.922551 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-430169bd-6f94-47cd-ac7a-a6dfacea3acc tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 200 len: 353 microversion: 2.1 time: 0.083682 Oct 31 15:48:31.924759 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2840/5829] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:48:31 2022] GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:32.936832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=65 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:32.938460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:32.943171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-07a44dd2-ebdc-49ee-b8d7-60853584e126 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e00ae4c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:33.060973 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-07a44dd2-ebdc-49ee-b8d7-60853584e126 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 200 len: 353 microversion: 2.1 time: 0.125776 Oct 31 15:48:33.061601 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2990/5830] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:48:32 2022] GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:34.076855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7de3ce8-93f2-4e0b-814c-131d57dbf866 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e0192670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:34.172938 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7de3ce8-93f2-4e0b-814c-131d57dbf866 tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 200 len: 353 microversion: 2.1 time: 0.100239 Oct 31 15:48:34.174300 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2841/5831] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:48:34 2022] GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:35.192649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78848ed7-c856-4286-827d-98b65d1c550b tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Calling method '.version_select at 0x7f16e00cb550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:35.285390 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-78848ed7-c856-4286-827d-98b65d1c550b tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] HTTP exception thrown: Volume 2116948d-2069-449f-99fd-5e8bb744783f could not be found. Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78848ed7-c856-4286-827d-98b65d1c550b tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Request method failure captured: Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f HTTP/1.1 Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-5K4cfHm3J79WW9Bfs6H0SW-wUPOnkuOaA648Seo8eMwNP8p2SACRhkzG_-ChMu7sx4nGA1ovb0AGsfOHkaN5T1ijtqyotJJGmA_lsBvLDDG0bpIAX8x2AHMKvFOOt_6Jrh-FJqsYqx04bb5_GqVx0cD-YuUFV2e8rtvrKB8fdvr-o Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 85a5622510ff4fdbb5dce140f4bac3d8 Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesGetTestJSON-1325364709 Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85a5622510ff4fdbb5dce140f4bac3d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_85a5622510ff4fdbb5dce140f4bac3d8", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/85a5622510ff4fdbb5dce140f4bac3d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/85a5622510ff4fdbb5dce140f4bac3d8"}]}] Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesGetTestJSON-1325364709 Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 85a5622510ff4fdbb5dce140f4bac3d8 Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesGetTestJSON-1325364709 Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesGetTestJSON-1325364709-project Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: fa03c5c6de104f31b016b88700e71ecc Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesGetTestJSON-1325364709-project Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: exception: Volume 2116948d-2069-449f-99fd-5e8bb744783f could not be found. Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '2116948d-2069-449f-99fd-5e8bb744783f'} Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2116948d-2069-449f-99fd-5e8bb744783f could not be found. (HTTP 404) (Request-ID: req-ac16fbbb-d0ee-4a6a-a2ef-810d1322bd82) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:48:35.296162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2116948d-2069-449f-99fd-5e8bb744783f could not be found. Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2116948d-2069-449f-99fd-5e8bb744783f could not be found. Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2116948d-2069-449f-99fd-5e8bb744783f could not be found. Oct 31 15:48:35.301110 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:35.304828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78848ed7-c856-4286-827d-98b65d1c550b tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] Returning 404 to user: Volume 2116948d-2069-449f-99fd-5e8bb744783f could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:35.305990 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78848ed7-c856-4286-827d-98b65d1c550b tempest-VolumesGetTestJSON-1325364709 tempest-VolumesGetTestJSON-1325364709-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f" status: 404 len: 109 microversion: 2.1 time: 0.118098 Oct 31 15:48:35.307030 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2991/5832] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:48:35 2022] GET /compute/v2.1/os-volumes/2116948d-2069-449f-99fd-5e8bb744783f => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:36.021163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d39887d-128e-4abe-aa70-bdefe26dc76c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:36.024926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d39887d-128e-4abe-aa70-bdefe26dc76c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:36.053345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d39887d-128e-4abe-aa70-bdefe26dc76c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:36.059542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d39887d-128e-4abe-aa70-bdefe26dc76c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:36.060028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d39887d-128e-4abe-aa70-bdefe26dc76c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:36.060803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d39887d-128e-4abe-aa70-bdefe26dc76c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:36.061836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d39887d-128e-4abe-aa70-bdefe26dc76c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:36.062243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d39887d-128e-4abe-aa70-bdefe26dc76c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:36.205801 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d39887d-128e-4abe-aa70-bdefe26dc76c tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "POST /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a/action" status: 200 len: 24568 microversion: 2.1 time: 0.188882 Oct 31 15:48:36.206812 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2842/5833] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:48:36 2022] POST /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a/action => generated 24568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:48:39.488316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9aca5b6-fe57-41d5-ab23-3efc7adf936d"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:39.497846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:39.513942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:39.516092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:39.517772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:39.520871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:39.522841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:39.523520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:39.788760 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Invalid volume: volume b9aca5b6-fe57-41d5-ab23-3efc7adf936d is already attached to instances: 64d06c42-26cb-48da-bcce-c8afad1b023c Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments HTTP/1.1 Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 74 Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: {"volumeAttachment": {"volumeId": "b9aca5b6-fe57-41d5-ab23-3efc7adf936d"}} Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: exception: Invalid volume: volume b9aca5b6-fe57-41d5-ab23-3efc7adf936d is already attached to instances: 64d06c42-26cb-48da-bcce-c8afad1b023c Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': '64d06c42-26cb-48da-bcce-c8afad1b023c', 'body': {'volumeAttachment': {'volumeId': 'b9aca5b6-fe57-41d5-ab23-3efc7adf936d'}}} Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5131, in attach_volume Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4971, in _check_volume_already_attached Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b9aca5b6-fe57-41d5-ab23-3efc7adf936d is already attached to instances: 64d06c42-26cb-48da-bcce-c8afad1b023c Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:39.797970 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b9aca5b6-fe57-41d5-ab23-3efc7adf936d is already attached to instances: 64d06c42-26cb-48da-bcce-c8afad1b023c Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b9aca5b6-fe57-41d5-ab23-3efc7adf936d is already attached to instances: 64d06c42-26cb-48da-bcce-c8afad1b023c Oct 31 15:48:39.802428 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:39.806807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 400 to user: Invalid volume: volume b9aca5b6-fe57-41d5-ab23-3efc7adf936d is already attached to instances: 64d06c42-26cb-48da-bcce-c8afad1b023c {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:39.808101 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-20ad8b5d-31ed-477b-a891-746dfacae7dd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.324850 Oct 31 15:48:39.810289 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2992/5834] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:48:39 2022] POST /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 174 bytes in 328 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 31 15:48:39.947285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:39.948061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:39.957567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:39.958279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:39.958984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:39.959743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:39.960387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:39.961001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:40.113915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lazy-loading 'services' on Instance uuid 64d06c42-26cb-48da-bcce-c8afad1b023c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:48:40.283903 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0b70a752-327f-4d4d-b1c4-88ea6db046ca tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments/b9aca5b6-fe57-41d5-ab23-3efc7adf936d" status: 202 len: 0 microversion: 2.1 time: 0.341426 Oct 31 15:48:40.285165 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2843/5835] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:48:39 2022] DELETE /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments/b9aca5b6-fe57-41d5-ab23-3efc7adf936d => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:48:40.300082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-377e5cdd-5fc4-441a-bba3-8119d6dec80b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:40.304101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-377e5cdd-5fc4-441a-bba3-8119d6dec80b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:40.354924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-377e5cdd-5fc4-441a-bba3-8119d6dec80b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:40.357442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-377e5cdd-5fc4-441a-bba3-8119d6dec80b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:40.359007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-377e5cdd-5fc4-441a-bba3-8119d6dec80b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:40.361352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-377e5cdd-5fc4-441a-bba3-8119d6dec80b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:40.362457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-377e5cdd-5fc4-441a-bba3-8119d6dec80b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:40.364976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-377e5cdd-5fc4-441a-bba3-8119d6dec80b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:40.453996 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-377e5cdd-5fc4-441a-bba3-8119d6dec80b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164223 Oct 31 15:48:40.462349 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2993/5836] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:40 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:41.473274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-178d1ab4-478c-4e53-904d-c91d1697920e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:41.483429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-178d1ab4-478c-4e53-904d-c91d1697920e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:41.510260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-178d1ab4-478c-4e53-904d-c91d1697920e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:41.518997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-178d1ab4-478c-4e53-904d-c91d1697920e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:41.519853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-178d1ab4-478c-4e53-904d-c91d1697920e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:41.520878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-178d1ab4-478c-4e53-904d-c91d1697920e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:41.522750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-178d1ab4-478c-4e53-904d-c91d1697920e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:41.523609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-178d1ab4-478c-4e53-904d-c91d1697920e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:41.649730 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-178d1ab4-478c-4e53-904d-c91d1697920e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180615 Oct 31 15:48:41.660330 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2844/5837] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:41 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:42.672256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e5e50a62-3377-45a4-9030-863c128e5dce tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:42.676030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e5e50a62-3377-45a4-9030-863c128e5dce tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:42.696181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e50a62-3377-45a4-9030-863c128e5dce tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:42.697041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e50a62-3377-45a4-9030-863c128e5dce tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:42.697748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e50a62-3377-45a4-9030-863c128e5dce tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:42.698884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e50a62-3377-45a4-9030-863c128e5dce tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:42.699571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e50a62-3377-45a4-9030-863c128e5dce tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:42.701793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5e50a62-3377-45a4-9030-863c128e5dce tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:42.784645 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e5e50a62-3377-45a4-9030-863c128e5dce tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117503 Oct 31 15:48:42.785408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2994/5838] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:42 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:43.799615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a5ccb0d6-1b12-4422-a933-b749db73d1b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:43.802316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a5ccb0d6-1b12-4422-a933-b749db73d1b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:43.824189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5ccb0d6-1b12-4422-a933-b749db73d1b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:43.834658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5ccb0d6-1b12-4422-a933-b749db73d1b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:43.835990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5ccb0d6-1b12-4422-a933-b749db73d1b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:43.842626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5ccb0d6-1b12-4422-a933-b749db73d1b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:43.844055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5ccb0d6-1b12-4422-a933-b749db73d1b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:43.844672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a5ccb0d6-1b12-4422-a933-b749db73d1b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:43.968888 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a5ccb0d6-1b12-4422-a933-b749db73d1b2 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171301 Oct 31 15:48:43.969578 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2845/5839] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:43 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:44.981803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5555956-0ad2-42fe-a095-be3bf6b2ee37 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:44.983903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5555956-0ad2-42fe-a095-be3bf6b2ee37 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:44.997496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5555956-0ad2-42fe-a095-be3bf6b2ee37 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:44.997994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5555956-0ad2-42fe-a095-be3bf6b2ee37 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:44.998436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5555956-0ad2-42fe-a095-be3bf6b2ee37 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:44.999148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5555956-0ad2-42fe-a095-be3bf6b2ee37 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:44.999600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5555956-0ad2-42fe-a095-be3bf6b2ee37 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:45.008973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5555956-0ad2-42fe-a095-be3bf6b2ee37 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:45.075132 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5555956-0ad2-42fe-a095-be3bf6b2ee37 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097452 Oct 31 15:48:45.087022 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2995/5840] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:44 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:46.094506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2512d6fe-f079-456f-b9e2-1213346bbdb1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:46.100911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2512d6fe-f079-456f-b9e2-1213346bbdb1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:46.124782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2512d6fe-f079-456f-b9e2-1213346bbdb1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:46.126191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2512d6fe-f079-456f-b9e2-1213346bbdb1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:46.128853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2512d6fe-f079-456f-b9e2-1213346bbdb1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:46.130998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2512d6fe-f079-456f-b9e2-1213346bbdb1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:46.133381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2512d6fe-f079-456f-b9e2-1213346bbdb1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:46.134393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2512d6fe-f079-456f-b9e2-1213346bbdb1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:46.278904 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2512d6fe-f079-456f-b9e2-1213346bbdb1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188585 Oct 31 15:48:46.292137 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2846/5841] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:46 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:47.297268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52921b57-bf8e-4e63-b775-4e0edce155ac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:47.300163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52921b57-bf8e-4e63-b775-4e0edce155ac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:47.311787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52921b57-bf8e-4e63-b775-4e0edce155ac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:47.316572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52921b57-bf8e-4e63-b775-4e0edce155ac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:47.319584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52921b57-bf8e-4e63-b775-4e0edce155ac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:47.321231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52921b57-bf8e-4e63-b775-4e0edce155ac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:47.323356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52921b57-bf8e-4e63-b775-4e0edce155ac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:47.324610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52921b57-bf8e-4e63-b775-4e0edce155ac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:47.454797 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52921b57-bf8e-4e63-b775-4e0edce155ac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162081 Oct 31 15:48:47.458776 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2996/5842] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:47 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:48.471031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58eb2fe3-d1b8-493a-acd9-2c881e9eefcf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:48.473619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58eb2fe3-d1b8-493a-acd9-2c881e9eefcf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:48.492324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eb2fe3-d1b8-493a-acd9-2c881e9eefcf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:48.495115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eb2fe3-d1b8-493a-acd9-2c881e9eefcf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:48.496074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eb2fe3-d1b8-493a-acd9-2c881e9eefcf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:48.498799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eb2fe3-d1b8-493a-acd9-2c881e9eefcf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:48.507425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eb2fe3-d1b8-493a-acd9-2c881e9eefcf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:48.508598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58eb2fe3-d1b8-493a-acd9-2c881e9eefcf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:48.660155 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58eb2fe3-d1b8-493a-acd9-2c881e9eefcf tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193816 Oct 31 15:48:48.671499 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2847/5843] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:48 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:48.927079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c57efd33-abf6-45e1-9793-8fe7cca28f74 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:48.927704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c57efd33-abf6-45e1-9793-8fe7cca28f74 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:48.949226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c57efd33-abf6-45e1-9793-8fe7cca28f74 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:48.949891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c57efd33-abf6-45e1-9793-8fe7cca28f74 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:48.953086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c57efd33-abf6-45e1-9793-8fe7cca28f74 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:48.956369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c57efd33-abf6-45e1-9793-8fe7cca28f74 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:48.958528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c57efd33-abf6-45e1-9793-8fe7cca28f74 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:48.960035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c57efd33-abf6-45e1-9793-8fe7cca28f74 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:49.080786 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c57efd33-abf6-45e1-9793-8fe7cca28f74 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/ips" status: 200 len: 152 microversion: 2.20 time: 0.157517 Oct 31 15:48:49.085119 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2997/5844] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Oct 31 15:48:48 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/ips => generated 152 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:48:49.685270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e24473e7-c070-41a5-88e4-d7338e3b5155 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:49.687500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e24473e7-c070-41a5-88e4-d7338e3b5155 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:49.704428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24473e7-c070-41a5-88e4-d7338e3b5155 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:49.713418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24473e7-c070-41a5-88e4-d7338e3b5155 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:49.713917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24473e7-c070-41a5-88e4-d7338e3b5155 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:49.714697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24473e7-c070-41a5-88e4-d7338e3b5155 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:49.723107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24473e7-c070-41a5-88e4-d7338e3b5155 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:49.724892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e24473e7-c070-41a5-88e4-d7338e3b5155 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:49.818834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:49.819338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:49.856258 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e24473e7-c070-41a5-88e4-d7338e3b5155 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176362 Oct 31 15:48:49.859399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:49.860093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:49.860556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:49.861340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:49.865035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:49.870642 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2848/5845] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:49 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:49.875145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:49.896679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c64c2f7a-c748-4c86-83ac-fcec6539a023 req-661abdac-0697-484e-bb93-bfbc6cf74e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a6e698-d8ff-424c-9858-523344add14a", "tag": "c855972b-45d8-4f2f-ae75-cba94a6d85a6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:49.967251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c64c2f7a-c748-4c86-83ac-fcec6539a023 req-661abdac-0697-484e-bb93-bfbc6cf74e01 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:49.967752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c64c2f7a-c748-4c86-83ac-fcec6539a023 req-661abdac-0697-484e-bb93-bfbc6cf74e01 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:49.968192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c64c2f7a-c748-4c86-83ac-fcec6539a023 req-661abdac-0697-484e-bb93-bfbc6cf74e01 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:50.032357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:48:50.035773 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c64c2f7a-c748-4c86-83ac-fcec6539a023 req-661abdac-0697-484e-bb93-bfbc6cf74e01 service nova] Creating event network-changed:c855972b-45d8-4f2f-ae75-cba94a6d85a6 for instance c5a6e698-d8ff-424c-9858-523344add14a on n-h2-858384-17 Oct 31 15:48:50.064719 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c64c2f7a-c748-4c86-83ac-fcec6539a023 req-661abdac-0697-484e-bb93-bfbc6cf74e01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192764 Oct 31 15:48:50.078209 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2849/5846] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:50.357552 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2cf42bdd-cb0c-43e2-83fd-c3dedc286399 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 204 len: 0 microversion: 2.1 time: 0.546146 Oct 31 15:48:50.361946 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2998/5847] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:48:49 2022] DELETE /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:48:50.367721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:50.368583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:50.387711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:50.388223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:50.388708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:50.389403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:50.389873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:50.390307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:50.869772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2cf2ce0a-6033-44ab-8be6-fc5859da411c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:50.872025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2cf2ce0a-6033-44ab-8be6-fc5859da411c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:50.885659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:50.891535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf2ce0a-6033-44ab-8be6-fc5859da411c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:50.892036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf2ce0a-6033-44ab-8be6-fc5859da411c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:50.892490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf2ce0a-6033-44ab-8be6-fc5859da411c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:50.897636 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c67d73e-4d23-4d75-a898-ca6833cfe4be tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1686 microversion: 2.1 time: 0.534546 Oct 31 15:48:50.901780 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2850/5848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:50 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1686 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:50.917390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf2ce0a-6033-44ab-8be6-fc5859da411c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:50.918324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf2ce0a-6033-44ab-8be6-fc5859da411c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:50.918962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2cf2ce0a-6033-44ab-8be6-fc5859da411c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:51.607091 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2cf2ce0a-6033-44ab-8be6-fc5859da411c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.737942 Oct 31 15:48:51.608518 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 2999/5849] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:48:50 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c/os-volume_attachments => generated 25 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:48:51.748116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:51.748612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:51.769156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:51.769667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:51.772623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:51.775363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:51.775853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:51.778811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:51.863481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:48:51.925425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:51.926215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:51.946226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:51.950625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:51.959999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:51.961908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:51.970357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:51.971183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:52.171703 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b1385f78-7eed-4b8c-a0df-7b25b1d5fbb8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 204 len: 0 microversion: 2.1 time: 0.427565 Oct 31 15:48:52.174994 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2851/5850] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:48:51 2022] DELETE /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:48:52.192419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:52.199181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:52.216453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:52.217024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:52.217494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:52.218204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:52.218678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:52.219383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:52.830468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:52.846923 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f102ef4f-b71c-4267-8d13-9a948bcec044 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1682 microversion: 2.1 time: 0.664571 Oct 31 15:48:52.861158 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2852/5851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:52 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1682 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:53.168306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0349502a6234609ae5eb4c4a94acf95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a2914e44014bed857d096897727c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:53.186096 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cb501a52-fd1f-49d3-a3cb-4a3b28e8a041 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 200 len: 1686 microversion: 2.1 time: 1.262702 Oct 31 15:48:53.187955 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3000/5852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:51 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 1686 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:48:53.600460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-166e4eac-ae25-458e-9d89-040199d7747f req-7a34925b-ace1-43cb-b210-cd904b4e9454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a6e698-d8ff-424c-9858-523344add14a", "name": "network-vif-deleted", "tag": "c855972b-45d8-4f2f-ae75-cba94a6d85a6"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:53.632669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-166e4eac-ae25-458e-9d89-040199d7747f req-7a34925b-ace1-43cb-b210-cd904b4e9454 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:53.635387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-166e4eac-ae25-458e-9d89-040199d7747f req-7a34925b-ace1-43cb-b210-cd904b4e9454 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:53.638635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-166e4eac-ae25-458e-9d89-040199d7747f req-7a34925b-ace1-43cb-b210-cd904b4e9454 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:53.679884 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-166e4eac-ae25-458e-9d89-040199d7747f req-7a34925b-ace1-43cb-b210-cd904b4e9454 service nova] Creating event network-vif-deleted:c855972b-45d8-4f2f-ae75-cba94a6d85a6 for instance c5a6e698-d8ff-424c-9858-523344add14a on n-h2-858384-17 Oct 31 15:48:53.691998 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-166e4eac-ae25-458e-9d89-040199d7747f req-7a34925b-ace1-43cb-b210-cd904b4e9454 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096421 Oct 31 15:48:53.694507 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2853/5853] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:53.874920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:53.875533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:53.889898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:53.892805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:53.893305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:53.894062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:53.894521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:53.894947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:54.035361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:54.046933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:54.069038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:54.072201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:54.076207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:54.077631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:54.080181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:54.082110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:54.166273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lazy-loading 'flavor' on Instance uuid 289733fd-f960-4199-8fa2-216a96d2fc13 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:48:54.625355 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e36d619c-69da-423b-bef4-2a63e1c27636 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/action" status: 202 len: 0 microversion: 2.20 time: 0.598898 Oct 31 15:48:54.628079 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2854/5854] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:48:54 2022] POST /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:48:54.655389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:54.657914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] [instance: c5a6e698-d8ff-424c-9858-523344add14a] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:54.677589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:54.680832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:54.681615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:54.682685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:54.683311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:54.684455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:54.752457 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] HTTP exception thrown: Instance c5a6e698-d8ff-424c-9858-523344add14a could not be found. Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Request method failure captured: Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a HTTP/1.1 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-vYXw5CPfxI9qsbE5oWLVlabEwpa9M6Ef1fkrw4QAYPij6FJOM5Xg0DltLoV49P2_qcAx8GePrGwc670IZtI8hUhpzWNxVFvZtPDOo7wHEVWRZyCE_xyV_MDmU4WDjceseG9A24j1fET0QbEoX61XLGsvVw_--5yurHZAMewB53Ikw Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: e6a2914e44014bed857d096897727c91 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6a2914e44014bed857d096897727c91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e6a2914e44014bed857d096897727c91", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e6a2914e44014bed857d096897727c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e6a2914e44014bed857d096897727c91"}]}] Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: e6a2914e44014bed857d096897727c91 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2127797092 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestNetworkAdvancedServerOps-2127797092-project Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e0349502a6234609ae5eb4c4a94acf95 Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2127797092-project Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance c5a6e698-d8ff-424c-9858-523344add14a could not be found. Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'c5a6e698-d8ff-424c-9858-523344add14a'} Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a6e698-d8ff-424c-9858-523344add14a could not be found. Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a6e698-d8ff-424c-9858-523344add14a could not be found. Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:54.755434 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:54.760188 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:54.760188 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:54.760188 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:54.760188 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:54.760188 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:54.760188 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:54.760188 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a6e698-d8ff-424c-9858-523344add14a could not be found. Oct 31 15:48:54.760188 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:48:54.762669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Returning 404 to user: Instance c5a6e698-d8ff-424c-9858-523344add14a could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:54.766132 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0f9273ea-a53f-4fab-b251-e22520eca9e1 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a" status: 404 len: 111 microversion: 2.1 time: 0.122144 Oct 31 15:48:54.771451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2855/5855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:54 2022] GET /compute/v2.1/servers/c5a6e698-d8ff-424c-9858-523344add14a => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:54.782278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:54.784690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:54.799623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:54.801303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:54.801909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:54.802789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:54.803531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:54.805281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:54.807815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:54.818178 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b2d462f3-8632-4f94-b5e4-ff28d815d501 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1682 microversion: 2.1 time: 0.947147 Oct 31 15:48:54.820976 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3001/5856] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:53 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1682 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:54.855628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:48:55.120791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:55.131699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:55.133739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:55.134907 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e2c7bc2-574d-4aa0-9bce-92fd75288d9c tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1725 microversion: 2.20 time: 0.362294 Oct 31 15:48:55.135464 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2856/5857] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:54 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1725 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:48:55.845114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:55.846743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:55.870793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:55.871295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:55.871737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:55.872458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:55.873059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:55.874656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.166805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:56.167676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:56.186078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:56.186610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:56.197752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.198607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:56.199084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:56.201078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:56.575267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:56.583542 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4a967f2-551b-403c-a399-28c613fd3c4d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1615 microversion: 2.1 time: 0.743603 Oct 31 15:48:56.584140 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3002/5858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:55 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1615 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:57.271103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ab042fe1-2f18-40a0-97e7-5d4ba9e890f0 req-c472ebfb-1268-433f-b13d-575257b9c1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d06c42-26cb-48da-bcce-c8afad1b023c", "name": "network-vif-deleted", "tag": "ff565a9b-1238-4c16-af24-f0b16d693f7f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:48:57.306306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ab042fe1-2f18-40a0-97e7-5d4ba9e890f0 req-c472ebfb-1268-433f-b13d-575257b9c1d2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:57.306921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ab042fe1-2f18-40a0-97e7-5d4ba9e890f0 req-c472ebfb-1268-433f-b13d-575257b9c1d2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:57.307442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ab042fe1-2f18-40a0-97e7-5d4ba9e890f0 req-c472ebfb-1268-433f-b13d-575257b9c1d2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:57.345774 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ab042fe1-2f18-40a0-97e7-5d4ba9e890f0 req-c472ebfb-1268-433f-b13d-575257b9c1d2 service nova] Creating event network-vif-deleted:ff565a9b-1238-4c16-af24-f0b16d693f7f for instance 64d06c42-26cb-48da-bcce-c8afad1b023c on n-h1-858384-17 Oct 31 15:48:57.358606 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ab042fe1-2f18-40a0-97e7-5d4ba9e890f0 req-c472ebfb-1268-433f-b13d-575257b9c1d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.468566 Oct 31 15:48:57.361533 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3003/5859] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:48:57.611940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:57.612834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:57.625044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:57.626395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:57.628049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:57.629037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:57.630947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:57.632326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:57.729415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:57.730163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:57.730807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:57.732833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lazy-loading 'fault' on Instance uuid 64d06c42-26cb-48da-bcce-c8afad1b023c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:48:57.821968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:57.840910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:57.846333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:57.852348 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b503cb5-c994-4313-96ee-549e1cd9c6b0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1725 microversion: 2.20 time: 1.690839 Oct 31 15:48:57.852937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2857/5860] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:56 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1725 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:48:57.878445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:57.895713 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d20c7ec-2d7a-403e-a282-5ff606243d58 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 200 len: 1331 microversion: 2.1 time: 0.278595 Oct 31 15:48:57.909793 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3004/5861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:57 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 1331 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:48:58.883574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:58.884658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:58.897921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:58.900714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:58.901431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:58.902405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:58.904762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:58.905468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:58.927163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:58.927977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:48:58.948024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:58.948521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:58.951289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:58.952184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:48:58.953773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:48:58.954771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:48:59.005179 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c HTTP/1.1 Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '64d06c42-26cb-48da-bcce-c8afad1b023c'} Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:48:59.019649 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.025149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:48:59.025149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:48:59.025149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:48:59.025149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:48:59.025149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:48:59.025149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:48:59.025149 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:48:59.025149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:48:59.027209 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f1f794c-15a4-4619-b685-adc1b653cf1c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 404 len: 111 microversion: 2.1 time: 0.105823 Oct 31 15:48:59.028145 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3005/5862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:48:58 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:48:59.074033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60213ee5-902a-4d33-b479-fd3df105069b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '.version_select at 0x7f16e0158c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:48:59.160209 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60213ee5-902a-4d33-b479-fd3df105069b tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396516908" status: 202 len: 0 microversion: 2.1 time: 0.119179 Oct 31 15:48:59.167128 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3006/5863] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 15:48:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396516908 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:48:59.687094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:59.708668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:59.717073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:48:59.720790 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eab281f8-e6fb-4b94-a6ae-93eca6831934 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1725 microversion: 2.20 time: 0.842229 Oct 31 15:48:59.723663 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2858/5864] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:48:58 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1725 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:00.760867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:00.761525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:00.789074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:00.802002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:00.802788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:00.807416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:00.807909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:00.808605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:01.973579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:01.990259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:01.997381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:02.001402 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-38249b8e-f204-4413-9096-8d63ff86656e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1725 microversion: 2.20 time: 1.244838 Oct 31 15:49:02.002603 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3007/5865] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:00 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1725 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:03.035806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:03.037545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:03.042041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:03.050408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:03.051286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:03.052004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:03.053301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:03.054078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:03.055974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:03.408961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:03.424839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:03.427050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:03.428392 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e2abed1-c8bd-47f1-933e-5a62c8561752 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1725 microversion: 2.20 time: 0.403054 Oct 31 15:49:03.429973 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2859/5866] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:03 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1725 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:03.838746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc700c36-3469-42c3-981b-9041a85c9334 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: .version_select at 0x7f16e01b0670>, body: {"keypair": {"name": "tempest-keypair-1480817129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOu3wOOl858KhH2x2Pwgnk47OD7Co8SPA6CtYDLxO0aVW0pZtSBgMv86l7jWq5ReY8M6HWuDHjARihFps1WQQF7ju/WnX2Kdx7uhOi9rVTRRstXYVLXeGhQ3Uazn+wJ/Q=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:03.858343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:03.888076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fc700c36-3469-42c3-981b-9041a85c9334 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for project bb201c74554c43f0a526161cf24206f3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:49:03.912684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fc700c36-3469-42c3-981b-9041a85c9334 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for user a5bfcc2112ea47dcb758487de253311f and project bb201c74554c43f0a526161cf24206f3. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:49:03.949596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc700c36-3469-42c3-981b-9041a85c9334 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116843 Oct 31 15:49:03.965616 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3008/5867] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:49:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:04.459788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:04.460515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:04.478793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:04.479262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:04.479705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:04.480429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:04.480884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:04.481336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:04.843867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:04.854112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:04.856158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:04.858024 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3ee960ab-bf02-49f0-a160-3be548c1c84a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1725 microversion: 2.20 time: 0.402040 Oct 31 15:49:04.861616 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2860/5868] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:04 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1725 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:05.888868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:05.889555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:05.914884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:05.915497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:05.916047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:05.919622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:05.920233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:05.920826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:05.977261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:06.167638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9738a768-3ece-4c5c-a7f8-b0831ff1f0e4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] Calling method '.version_select at 0x7f16e01d8040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:06.214336 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9738a768-3ece-4c5c-a7f8-b0831ff1f0e4 tempest-TestNetworkAdvancedServerOps-2127797092 tempest-TestNetworkAdvancedServerOps-2127797092-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-327270528" status: 202 len: 0 microversion: 2.1 time: 0.052704 Oct 31 15:49:06.220713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2861/5869] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 31 15:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-327270528 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:49:06.539681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:06.552913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:06.556427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:06.562405 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cba74c9d-4c5f-466a-aa57-5a133e17470f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1746 microversion: 2.20 time: 0.678275 Oct 31 15:49:06.563011 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3009/5870] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:05 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1746 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:07.592763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:07.593519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:07.615711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:07.616215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:07.626475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:07.629462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:07.629972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:07.630442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:07.972825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:07.986424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:07.987954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:07.991871 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b748279d-88d9-4bdf-bba9-ccb89d0de1b8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1741 microversion: 2.20 time: 0.403086 Oct 31 15:49:07.994380 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2862/5871] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:07 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1741 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:09.023326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:09.027745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:09.048852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:09.056458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:09.057396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:09.059088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:09.063064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:09.064559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:09.258324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1044838258", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f438d2d0-1357-4e21-b1cc-6088b00737d1"}], "security_groups": [{"name": "tempest-securitygroup--872154052"}], "key_name": "tempest-keypair-1480817129", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:09.600248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] validate_networks() for [('f438d2d0-1357-4e21-b1cc-6088b00737d1', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:49:10.544356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:10.560976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:10.564709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:10.566931 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8ade27c-5eb7-48db-8ccb-2a5e539e1679 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1741 microversion: 2.20 time: 1.548436 Oct 31 15:49:10.591365 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3010/5872] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:09 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1741 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:11.575548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:49:11.576958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:49:11.578217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:49:11.578954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:49:11.579553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:49:11.602538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:11.603196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:11.642148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:11.642660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:11.643102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:11.643823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:11.655979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:11.656734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:11.662384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:11.662900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:11.671748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:11.672627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:11.673155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:11.673596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:11.779450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for project bb201c74554c43f0a526161cf24206f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:49:11.799325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Getting quotas for user a5bfcc2112ea47dcb758487de253311f and project bb201c74554c43f0a526161cf24206f3. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:49:11.868109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:49:11.880136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:49:12.047874 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ac80c4e-fbd5-48f5-935f-d98054baddc9 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.794662 Oct 31 15:49:12.058302 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2863/5873] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:49:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:49:12.090478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f69837d8-fc21-4e12-b7df-606bfc722ff6 req-5abeb87a-fc0a-4cf4-a042-311b96f64d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289733fd-f960-4199-8fa2-216a96d2fc13", "name": "network-vif-plugged", "status": "completed", "tag": "872254c0-08bd-4300-af3d-c79a64cc12be"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:12.148123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f69837d8-fc21-4e12-b7df-606bfc722ff6 req-5abeb87a-fc0a-4cf4-a042-311b96f64d8c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:12.152140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f69837d8-fc21-4e12-b7df-606bfc722ff6 req-5abeb87a-fc0a-4cf4-a042-311b96f64d8c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:12.157833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f69837d8-fc21-4e12-b7df-606bfc722ff6 req-5abeb87a-fc0a-4cf4-a042-311b96f64d8c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:12.196478 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f69837d8-fc21-4e12-b7df-606bfc722ff6 req-5abeb87a-fc0a-4cf4-a042-311b96f64d8c service nova] Creating event network-vif-plugged:872254c0-08bd-4300-af3d-c79a64cc12be for instance 289733fd-f960-4199-8fa2-216a96d2fc13 on n-h1-858384-17 Oct 31 15:49:12.216409 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f69837d8-fc21-4e12-b7df-606bfc722ff6 req-5abeb87a-fc0a-4cf4-a042-311b96f64d8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156492 Oct 31 15:49:12.224140 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2864/5874] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:12.237722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-301f87e3-1ce8-4600-8cef-d4e285ad6d2e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:12.238468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-301f87e3-1ce8-4600-8cef-d4e285ad6d2e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:12.366109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-301f87e3-1ce8-4600-8cef-d4e285ad6d2e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:12.384065 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-301f87e3-1ce8-4600-8cef-d4e285ad6d2e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1242 microversion: 2.1 time: 0.153855 Oct 31 15:49:12.384565 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2865/5875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:12 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:12.427774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:12.472901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:12.474824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:12.481068 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f08ca73e-af04-4f96-8d04-3b8f1827da3e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1741 microversion: 2.20 time: 0.886904 Oct 31 15:49:12.482941 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3011/5876] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:11 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1741 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:13.414460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fcf4d12e-041b-444f-81ce-98b75a659524 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:13.415598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fcf4d12e-041b-444f-81ce-98b75a659524 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:13.659300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a7a3653-018a-49ff-a6a8-0f4e4a0f7e28 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:13.661681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7a3653-018a-49ff-a6a8-0f4e4a0f7e28 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:13.662367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7a3653-018a-49ff-a6a8-0f4e4a0f7e28 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:13.663540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7a3653-018a-49ff-a6a8-0f4e4a0f7e28 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:13.665549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7a3653-018a-49ff-a6a8-0f4e4a0f7e28 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:13.666469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7a3653-018a-49ff-a6a8-0f4e4a0f7e28 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:13.670092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a7a3653-018a-49ff-a6a8-0f4e4a0f7e28 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:13.830818 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a7a3653-018a-49ff-a6a8-0f4e4a0f7e28 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.798523 Oct 31 15:49:13.831437 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2866/5877] 10.222.0.20 () {58 vars in 1185 bytes} [Mon Oct 31 15:49:13 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:13.863763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fcf4d12e-041b-444f-81ce-98b75a659524 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:13.875530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:13.876156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:13.877383 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fcf4d12e-041b-444f-81ce-98b75a659524 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1242 microversion: 2.1 time: 0.467731 Oct 31 15:49:13.878027 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3012/5878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:13 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1242 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:13.927418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:13.935546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:13.938479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:13.939433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:13.940067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:13.941558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:14.166868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-965752939", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "availability_zone": "nova:n-h1-858384-17", "networks": [{"uuid": "4bcf4f2d-8402-4b58-924c-5486819e169b"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:14.676946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:14.696773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:14.707861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:14.712098 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ba420f6-8667-44df-a6c7-b9cb7ff0094a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1741 microversion: 2.20 time: 0.867674 Oct 31 15:49:14.713067 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2867/5879] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:13 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1741 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:14.906811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:14.907438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:14.919153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:14.919662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:14.920104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:14.920821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:14.921322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:14.932042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:15.211001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:15.234478 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c34fa3c5-959d-4629-978a-dba5ceda49e1 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1238 microversion: 2.1 time: 0.330136 Oct 31 15:49:15.235775 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2868/5880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:14 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1238 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:15.742028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:15.742678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:15.766296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:15.777328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:15.778174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:15.779393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:15.780217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:15.783656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:16.298935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:16.332567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:16.336133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:16.341953 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a410751-f608-44d8-8db6-6af782206e5d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1741 microversion: 2.20 time: 0.604634 Oct 31 15:49:16.344915 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2869/5881] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:15 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1741 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:49:16.365810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:16.388912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:16.405843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:16.410692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:16.411354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:16.412544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:16.417344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:16.417788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:16.661209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:16.673558 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a5cf40d-6e4c-45e0-b5d3-e4311cf22e41 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1300 microversion: 2.1 time: 0.327228 Oct 31 15:49:16.674583 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2870/5882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:16 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1300 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:17.377106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:17.378768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:17.420025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:17.423495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:17.426141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:17.427637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:17.446543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:17.450841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:18.060440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:18.078853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:18.093157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:18.098692 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5539f1e8-a35a-43d9-b25c-f7c2da8efb15 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1741 microversion: 2.20 time: 0.722003 Oct 31 15:49:18.108930 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2871/5883] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:17 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1741 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:18.134141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:18.140637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:18.183467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:18.184291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:18.188119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:18.191657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:18.193948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:18.195597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:18.529375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:18.545358 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c63fa59d-e3d8-44b0-a25f-9096dde6bf4c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1300 microversion: 2.1 time: 0.432596 Oct 31 15:49:18.568091 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2872/5884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:18 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1300 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:19.146781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:19.148541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:19.162953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:19.163770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:19.177537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:19.179044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:19.188583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:19.189052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:19.574981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:19.584368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:19.588473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:19.592547 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ae3a44c-d120-42a4-9d31-5d8c8976a073 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1741 microversion: 2.20 time: 0.455353 Oct 31 15:49:19.593808 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2873/5885] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:19 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1741 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:19.617754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:19.618693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:19.638660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:19.639164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:19.639605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:19.640317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:19.646087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:19.646592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:20.160993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:20.176818 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49ed172b-2641-44ef-b68f-bdb40e1e218e tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1367 microversion: 2.1 time: 0.581616 Oct 31 15:49:20.179068 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2874/5886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:19 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1367 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:21.424888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:21.426836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:21.434317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:21.435026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:21.435624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:21.436499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:21.437121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:21.437748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:21.732649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:21.746188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:21.752798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:21.755709 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f7a8690-5dc9-4736-84f5-6e1197a9a720 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1741 microversion: 2.20 time: 1.136180 Oct 31 15:49:21.759466 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2875/5887] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:20 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1741 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:49:21.780866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:21.788720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:21.832338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:21.833090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:21.834952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:21.847328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:21.847841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:21.848296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:22.251125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:22.263393 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40268724-1dd5-4661-9e91-86ac7a37f03f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1367 microversion: 2.1 time: 0.500463 Oct 31 15:49:22.271314 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2876/5888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:21 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:22.378470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:22.436228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1441973966", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "4bb06f37-1392-4478-b20a-ab1b1916093e"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:22.466640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=17 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:23.692784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:23.875271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:24.281693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:29.894743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] validate_networks() for [('4bcf4f2d-8402-4b58-924c-5486819e169b', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:49:30.012686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] validate_networks() for [('4bb06f37-1392-4478-b20a-ab1b1916093e', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:49:30.519163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:49:30.519659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:49:30.520352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:49:30.520879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:49:30.521634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:49:30.535656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:30.536892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:30.538126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:30.543033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:30.544215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:30.545389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:30.556036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:30.577296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Getting quotas for project 4911ab7a90f94c05ad1f9bb5183388d3. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:49:30.583971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Getting quotas for user 9451c8442b3d438b9728e95a8ab4031a and project 4911ab7a90f94c05ad1f9bb5183388d3. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:49:30.602616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:49:30.605900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:49:30.684618 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7cddd55e-879a-410c-ab30-0c7cd50217aa tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.405973 Oct 31 15:49:30.685944 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2877/5889] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:49:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 8414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:49:30.693047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d3e4d15c-90e5-456a-aa01-507069a33c4a req-1da07908-b05c-46c0-a0b4-411727fa0df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f4dfcbe-26a7-4c59-837a-4acc9af2b893", "tag": "7b04b72b-ab60-4904-ac4a-8a9a333ff436"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:30.706835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d3e4d15c-90e5-456a-aa01-507069a33c4a req-1da07908-b05c-46c0-a0b4-411727fa0df0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:30.707609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d3e4d15c-90e5-456a-aa01-507069a33c4a req-1da07908-b05c-46c0-a0b4-411727fa0df0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:30.708216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d3e4d15c-90e5-456a-aa01-507069a33c4a req-1da07908-b05c-46c0-a0b4-411727fa0df0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:30.742877 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d3e4d15c-90e5-456a-aa01-507069a33c4a req-1da07908-b05c-46c0-a0b4-411727fa0df0 service nova] Creating event network-changed:7b04b72b-ab60-4904-ac4a-8a9a333ff436 for instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 on n-h2-858384-17 Oct 31 15:49:30.751643 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d3e4d15c-90e5-456a-aa01-507069a33c4a req-1da07908-b05c-46c0-a0b4-411727fa0df0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062289 Oct 31 15:49:30.754748 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2878/5890] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:30.762594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:30.773106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:30.785831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:30.790963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:30.791629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:30.792578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:30.793280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:30.793927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:30.933049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:49:30.934533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:49:30.935289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:49:30.936528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:49:30.937239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:49:30.961179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:30.965334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:30.966114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:30.968431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:30.969108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:30.971114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:30.997607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Getting quotas for project 302eb7e86bb34437b17e837cda644634. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:49:31.004850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Getting quotas for user 9bb58d5ae9684f49980da256b4efd033 and project 302eb7e86bb34437b17e837cda644634. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:49:31.021398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:49:31.022565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:31.025266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:49:31.031585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:31.039528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:31.040729 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1249ee01-9757-467e-8970-5b32be185808 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1723 microversion: 2.20 time: 0.283229 Oct 31 15:49:31.045769 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2879/5891] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:30 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:31.149298 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d48f2bd7-5a8d-4d72-b7c7-e0eb09eb250d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.983164 Oct 31 15:49:31.150799 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3013/5892] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 16989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:49:31.160341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-28f07cc8-2f48-4014-a1db-f36751ac50b5 req-338fb48b-c4e0-4a68-a90e-5f968dd7c2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4dfcbe-26a7-4c59-837a-4acc9af2b893", "name": "network-vif-plugged", "status": "completed", "tag": "7b04b72b-ab60-4904-ac4a-8a9a333ff436"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:31.192830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-28f07cc8-2f48-4014-a1db-f36751ac50b5 req-338fb48b-c4e0-4a68-a90e-5f968dd7c2be service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:31.194199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-28f07cc8-2f48-4014-a1db-f36751ac50b5 req-338fb48b-c4e0-4a68-a90e-5f968dd7c2be service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:31.205550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-28f07cc8-2f48-4014-a1db-f36751ac50b5 req-338fb48b-c4e0-4a68-a90e-5f968dd7c2be service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:31.250985 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-28f07cc8-2f48-4014-a1db-f36751ac50b5 req-338fb48b-c4e0-4a68-a90e-5f968dd7c2be service nova] Creating event network-vif-plugged:7b04b72b-ab60-4904-ac4a-8a9a333ff436 for instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 on n-h2-858384-17 Oct 31 15:49:31.262987 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-28f07cc8-2f48-4014-a1db-f36751ac50b5 req-338fb48b-c4e0-4a68-a90e-5f968dd7c2be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110700 Oct 31 15:49:31.266317 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3014/5893] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:31.274810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8042cb3c-602c-44ed-a89c-44e408b12b47 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:31.278607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8042cb3c-602c-44ed-a89c-44e408b12b47 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:31.328069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:31.328953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:31.339721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:31.341691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:31.342527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:31.344294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:31.348772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:31.359637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:31.487035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8042cb3c-602c-44ed-a89c-44e408b12b47 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:31.495503 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8042cb3c-602c-44ed-a89c-44e408b12b47 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1215 microversion: 2.1 time: 0.227462 Oct 31 15:49:31.499515 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3015/5894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:31 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1215 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:31.509840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ca7ec66-6633-4104-9741-ef7235dd32f5 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:31.510468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7ca7ec66-6633-4104-9741-ef7235dd32f5 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:31.692596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ca7ec66-6633-4104-9741-ef7235dd32f5 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1328 microversion: 2.1 time: 0.192083 Oct 31 15:49:31.700496 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3016/5895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:31 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1328 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:31.735080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:31.749447 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-082ccb78-3c91-419c-ae6d-340300891d1d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1367 microversion: 2.1 time: 0.700577 Oct 31 15:49:31.769367 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2880/5896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:31 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1367 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:32.075510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:32.076428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:32.099290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:32.103777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:32.104346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:32.105964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:32.117841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:32.118457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:32.526859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:32.527395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:32.538503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:32.540679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:32.543613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:32.544760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:32.545551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:32.546444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:32.650352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:32.666586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:32.668554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:32.676261 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2ba2bbb-e78f-4360-a357-7b7a3ca5250e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1723 microversion: 2.20 time: 0.604338 Oct 31 15:49:32.678401 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3017/5897] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:32 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1723 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:32.717284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af38dc78-9e3f-4eda-b905-982578186b7c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:32.718224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af38dc78-9e3f-4eda-b905-982578186b7c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:32.752525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:32.759211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af38dc78-9e3f-4eda-b905-982578186b7c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:32.760683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af38dc78-9e3f-4eda-b905-982578186b7c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:32.761703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af38dc78-9e3f-4eda-b905-982578186b7c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:32.762626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af38dc78-9e3f-4eda-b905-982578186b7c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:32.763525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af38dc78-9e3f-4eda-b905-982578186b7c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:32.764552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af38dc78-9e3f-4eda-b905-982578186b7c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:32.764920 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b1c79d4-77f4-497d-b1e2-f40c01d39621 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1267 microversion: 2.1 time: 0.239271 Oct 31 15:49:32.768869 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2881/5898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:32 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:32.782212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:32.783541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:32.796728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:32.797165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:32.797628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:32.798338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:32.798804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:32.799235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:32.983666 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af38dc78-9e3f-4eda-b905-982578186b7c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1337 microversion: 2.1 time: 0.271164 Oct 31 15:49:32.984509 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3018/5899] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:32 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1337 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:33.071188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:33.102469 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4170b3c9-9f6f-47b9-bc46-54b918aeff55 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1367 microversion: 2.1 time: 0.331819 Oct 31 15:49:33.113266 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2882/5900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:32 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1367 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:33.721154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:33.723980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:33.734092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:33.734976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:33.735878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:33.737051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:33.737991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:33.738616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:33.794803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:33.795878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:33.800137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:33.806345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:33.806977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:33.807771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:33.808613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:33.809202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:33.810360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:33.893441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:33.903822 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d32fb1b9-ce45-42cc-bb8c-bbfd0a2bbb90 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1267 microversion: 2.1 time: 0.112776 Oct 31 15:49:33.904991 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2883/5901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:33 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:34.011357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d66215b-b372-4122-b7de-e97302741310 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:34.012373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5d66215b-b372-4122-b7de-e97302741310 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:34.026155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d66215b-b372-4122-b7de-e97302741310 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:34.029226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d66215b-b372-4122-b7de-e97302741310 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:34.029989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d66215b-b372-4122-b7de-e97302741310 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:34.034095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d66215b-b372-4122-b7de-e97302741310 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:34.034895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d66215b-b372-4122-b7de-e97302741310 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:34.035959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d66215b-b372-4122-b7de-e97302741310 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:34.205083 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d66215b-b372-4122-b7de-e97302741310 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1337 microversion: 2.1 time: 0.197767 Oct 31 15:49:34.218331 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2884/5902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:34 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1337 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:34.237578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:34.238787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:34.247024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:34.248428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:34.249115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:34.250144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:34.251695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:34.252393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:34.498525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:34.509269 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54ad4bdd-6730-46f6-90a4-1b40e99449c4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1558 microversion: 2.1 time: 0.289631 Oct 31 15:49:34.509935 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2885/5903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:34 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1558 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:34.540388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-469e4a0d-7084-4cfe-b9aa-72bedf0bec87 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:34.540953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-469e4a0d-7084-4cfe-b9aa-72bedf0bec87 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:34.551416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-469e4a0d-7084-4cfe-b9aa-72bedf0bec87 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:34.552202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-469e4a0d-7084-4cfe-b9aa-72bedf0bec87 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:34.556371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-469e4a0d-7084-4cfe-b9aa-72bedf0bec87 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:34.559408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-469e4a0d-7084-4cfe-b9aa-72bedf0bec87 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:34.560273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-469e4a0d-7084-4cfe-b9aa-72bedf0bec87 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:34.562665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-469e4a0d-7084-4cfe-b9aa-72bedf0bec87 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:34.885059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:34.902917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:34.905109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:34.906995 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9db8e134-0bb0-403c-ae6d-01d252a4114a tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1723 microversion: 2.20 time: 1.200792 Oct 31 15:49:34.907882 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3019/5904] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:33 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1723 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:34.914356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-bb2e1c98-674a-4a60-9117-3b7347f44a79 req-3bd119f9-80cd-4f76-8e50-f033d338db7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289733fd-f960-4199-8fa2-216a96d2fc13", "name": "network-vif-unplugged", "status": "completed", "tag": "872254c0-08bd-4300-af3d-c79a64cc12be"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:34.937410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bb2e1c98-674a-4a60-9117-3b7347f44a79 req-3bd119f9-80cd-4f76-8e50-f033d338db7f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:34.938358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bb2e1c98-674a-4a60-9117-3b7347f44a79 req-3bd119f9-80cd-4f76-8e50-f033d338db7f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:34.939171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bb2e1c98-674a-4a60-9117-3b7347f44a79 req-3bd119f9-80cd-4f76-8e50-f033d338db7f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:34.958746 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-bb2e1c98-674a-4a60-9117-3b7347f44a79 req-3bd119f9-80cd-4f76-8e50-f033d338db7f service nova] Creating event network-vif-unplugged:872254c0-08bd-4300-af3d-c79a64cc12be for instance 289733fd-f960-4199-8fa2-216a96d2fc13 on n-h1-858384-17 Oct 31 15:49:34.969914 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-bb2e1c98-674a-4a60-9117-3b7347f44a79 req-3bd119f9-80cd-4f76-8e50-f033d338db7f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060575 Oct 31 15:49:34.970964 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3020/5905] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:34.979213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:34.980321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:34.991722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:34.992709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:34.993896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:34.995031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:34.996149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:34.996812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:35.332069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:35.350248 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a02e9480-cbd7-442c-931d-5b27ff2b5d87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1273 microversion: 2.1 time: 0.374810 Oct 31 15:49:35.351050 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3021/5906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:34 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1273 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:35.374625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b852cacc-8395-4d37-990d-c6d6bf485a2d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:35.376170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b852cacc-8395-4d37-990d-c6d6bf485a2d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:35.384867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852cacc-8395-4d37-990d-c6d6bf485a2d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:35.385683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852cacc-8395-4d37-990d-c6d6bf485a2d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:35.386311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852cacc-8395-4d37-990d-c6d6bf485a2d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:35.390185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852cacc-8395-4d37-990d-c6d6bf485a2d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:35.390966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852cacc-8395-4d37-990d-c6d6bf485a2d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:35.391576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b852cacc-8395-4d37-990d-c6d6bf485a2d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:35.611065 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b852cacc-8395-4d37-990d-c6d6bf485a2d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1435 microversion: 2.1 time: 0.251884 Oct 31 15:49:35.613208 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3022/5907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:35 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1435 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:35.753701 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-469e4a0d-7084-4cfe-b9aa-72bedf0bec87 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.222342 Oct 31 15:49:35.755280 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2886/5908] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 15:49:34 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-interface => generated 285 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:49:35.936638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:35.937362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:35.956697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:35.958743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:35.959957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:35.963137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:35.964785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:35.965460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:36.320277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:36.334637 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:36.344035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:36.345596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2bd0858-d246-4da1-abdd-cd96410bbf34 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1666 microversion: 2.20 time: 0.414867 Oct 31 15:49:36.350157 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3023/5909] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:35 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1666 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:36.383608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:36.393802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-224152bf-96d4-4b0c-b3b3-5a7c621f75d7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b31e050-5ad9-4cbf-a3ac-a825176e119a"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:36.393802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-224152bf-96d4-4b0c-b3b3-5a7c621f75d7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:36.395132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:36.406274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-224152bf-96d4-4b0c-b3b3-5a7c621f75d7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:36.407440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-224152bf-96d4-4b0c-b3b3-5a7c621f75d7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:36.408007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-224152bf-96d4-4b0c-b3b3-5a7c621f75d7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:36.409502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-224152bf-96d4-4b0c-b3b3-5a7c621f75d7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:36.410077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-224152bf-96d4-4b0c-b3b3-5a7c621f75d7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:36.410614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-224152bf-96d4-4b0c-b3b3-5a7c621f75d7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:36.415700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:36.416221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:36.416767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:36.417521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:36.417980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:36.418408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:36.720701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:36.730298 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9048b31-2749-4b43-8b8b-7f80ebe568fd tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1315 microversion: 2.1 time: 0.351902 Oct 31 15:49:36.749569 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2887/5910] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:36 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:36.759284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-72305203-25b1-4d92-b6a9-61987689a838 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:36.766314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-72305203-25b1-4d92-b6a9-61987689a838 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:36.784818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72305203-25b1-4d92-b6a9-61987689a838 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:36.785720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72305203-25b1-4d92-b6a9-61987689a838 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:36.789570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72305203-25b1-4d92-b6a9-61987689a838 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:36.790532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72305203-25b1-4d92-b6a9-61987689a838 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:36.791078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72305203-25b1-4d92-b6a9-61987689a838 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:36.794377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72305203-25b1-4d92-b6a9-61987689a838 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:37.016875 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-224152bf-96d4-4b0c-b3b3-5a7c621f75d7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.637636 Oct 31 15:49:37.024517 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3024/5911] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Oct 31 15:49:36 2022] POST /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/os-volume_attachments => generated 188 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:49:37.024705 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-72305203-25b1-4d92-b6a9-61987689a838 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1423 microversion: 2.1 time: 0.268346 Oct 31 15:49:37.024705 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2888/5912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:36 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1423 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:37.298553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f84ca39-6b3f-4911-a969-efaefe2bcd2b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:37.299326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f84ca39-6b3f-4911-a969-efaefe2bcd2b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:37.315402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f84ca39-6b3f-4911-a969-efaefe2bcd2b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:37.316914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f84ca39-6b3f-4911-a969-efaefe2bcd2b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:37.318547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f84ca39-6b3f-4911-a969-efaefe2bcd2b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:37.320620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f84ca39-6b3f-4911-a969-efaefe2bcd2b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:37.322383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f84ca39-6b3f-4911-a969-efaefe2bcd2b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:37.323424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f84ca39-6b3f-4911-a969-efaefe2bcd2b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:37.763920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:37.764555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:37.785745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:37.786491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:37.787328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:37.788219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:37.788868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:37.789479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:37.976945 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f84ca39-6b3f-4911-a969-efaefe2bcd2b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/os-volume_attachments/8b31e050-5ad9-4cbf-a3ac-a825176e119a" status: 202 len: 0 microversion: 2.20 time: 0.685132 Oct 31 15:49:37.978707 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2889/5913] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Oct 31 15:49:37 2022] DELETE /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/os-volume_attachments/8b31e050-5ad9-4cbf-a3ac-a825176e119a => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:49:37.985485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a3b64ec8-2c31-4a8a-81e3-0f2a23b51288 req-b3472f2d-0dac-482a-bae9-52219aa80cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd15a891-58cd-4424-8f4c-c1a85c95e23e", "tag": "26b2a25d-d992-49b8-b6b5-6ebad4232d8e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:38.017820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a3b64ec8-2c31-4a8a-81e3-0f2a23b51288 req-b3472f2d-0dac-482a-bae9-52219aa80cfc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:38.018499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a3b64ec8-2c31-4a8a-81e3-0f2a23b51288 req-b3472f2d-0dac-482a-bae9-52219aa80cfc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:38.020492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a3b64ec8-2c31-4a8a-81e3-0f2a23b51288 req-b3472f2d-0dac-482a-bae9-52219aa80cfc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:38.047205 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a3b64ec8-2c31-4a8a-81e3-0f2a23b51288 req-b3472f2d-0dac-482a-bae9-52219aa80cfc service nova] Creating event network-changed:26b2a25d-d992-49b8-b6b5-6ebad4232d8e for instance fd15a891-58cd-4424-8f4c-c1a85c95e23e on n-h1-858384-17 Oct 31 15:49:38.057874 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a3b64ec8-2c31-4a8a-81e3-0f2a23b51288 req-b3472f2d-0dac-482a-bae9-52219aa80cfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077200 Oct 31 15:49:38.059182 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2890/5914] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:38.064974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-32e5477c-e509-4f52-891d-0e20268f76b3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:38.066143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-32e5477c-e509-4f52-891d-0e20268f76b3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:38.075007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e5477c-e509-4f52-891d-0e20268f76b3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:38.075706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e5477c-e509-4f52-891d-0e20268f76b3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:38.077958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e5477c-e509-4f52-891d-0e20268f76b3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:38.079115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e5477c-e509-4f52-891d-0e20268f76b3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:38.080461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e5477c-e509-4f52-891d-0e20268f76b3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:38.081089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-32e5477c-e509-4f52-891d-0e20268f76b3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:38.485868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-32e5477c-e509-4f52-891d-0e20268f76b3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1465 microversion: 2.1 time: 0.425171 Oct 31 15:49:38.504955 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2891/5915] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:38 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1465 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:38.510793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:38.517978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:38.529787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:38.530547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:38.531564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:38.532522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:38.533241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:38.534153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:38.641529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120588) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 15:49:38.731955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:38.780767 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ddae74f-f330-4173-a9c7-425691aed7bb tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "POST /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/action" status: 202 len: 0 microversion: 2.20 time: 0.271915 Oct 31 15:49:38.781464 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2892/5916] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Oct 31 15:49:38 2022] POST /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:49:38.796447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:38.797075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:38.814483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:38.815406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:38.816014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:38.816923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:38.817583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:38.818432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:38.829941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:38.841169 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ff3b0f7-c4d2-4092-a2d8-0cbc96f70d95 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1315 microversion: 2.1 time: 1.082254 Oct 31 15:49:38.857516 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3025/5917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:37 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1315 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:38.862569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9b362a4d-267a-43a8-a9bb-f235bad250b6 req-ef091c07-216c-47e3-a672-b2cdb1cc9afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f4dfcbe-26a7-4c59-837a-4acc9af2b893", "tag": "7b04b72b-ab60-4904-ac4a-8a9a333ff436"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:38.891867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b362a4d-267a-43a8-a9bb-f235bad250b6 req-ef091c07-216c-47e3-a672-b2cdb1cc9afb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:38.904869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b362a4d-267a-43a8-a9bb-f235bad250b6 req-ef091c07-216c-47e3-a672-b2cdb1cc9afb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:38.905666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b362a4d-267a-43a8-a9bb-f235bad250b6 req-ef091c07-216c-47e3-a672-b2cdb1cc9afb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:38.929581 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9b362a4d-267a-43a8-a9bb-f235bad250b6 req-ef091c07-216c-47e3-a672-b2cdb1cc9afb service nova] Creating event network-changed:7b04b72b-ab60-4904-ac4a-8a9a333ff436 for instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 on n-h2-858384-17 Oct 31 15:49:38.945745 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9b362a4d-267a-43a8-a9bb-f235bad250b6 req-ef091c07-216c-47e3-a672-b2cdb1cc9afb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086327 Oct 31 15:49:38.946831 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3026/5918] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:39.532357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dbedae58-5d7a-4d5c-a1ee-e37ea19ef67d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:39.533417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dbedae58-5d7a-4d5c-a1ee-e37ea19ef67d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:39.549692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbedae58-5d7a-4d5c-a1ee-e37ea19ef67d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:39.551236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbedae58-5d7a-4d5c-a1ee-e37ea19ef67d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:39.553347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbedae58-5d7a-4d5c-a1ee-e37ea19ef67d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:39.554728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbedae58-5d7a-4d5c-a1ee-e37ea19ef67d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:39.556585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbedae58-5d7a-4d5c-a1ee-e37ea19ef67d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:39.559180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dbedae58-5d7a-4d5c-a1ee-e37ea19ef67d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:39.696652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:39.718340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:39.730766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:39.735892 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83db7d64-f003-4e33-9a5c-45fff8a01fde tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1674 microversion: 2.20 time: 0.946818 Oct 31 15:49:39.737732 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2893/5919] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:38 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1674 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:39.878402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:39.879424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:39.892710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:39.893614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:39.898333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:39.899472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:39.900193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:39.900869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:40.281472 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dbedae58-5d7a-4d5c-a1ee-e37ea19ef67d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1465 microversion: 2.1 time: 0.772579 Oct 31 15:49:40.282895 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3027/5920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:39 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1465 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:40.283250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:40.296380 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6112212f-b835-49ea-a980-8491be8f1609 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1315 microversion: 2.1 time: 0.421831 Oct 31 15:49:40.309356 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2894/5921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:39 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:40.770368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:40.771894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:40.786077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:40.787203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:40.787831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:40.788545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:40.789001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:40.802020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:40.987349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:41.077853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1a0cecf0-4d7d-4bad-857b-c6631c5019cb req-d5461bb1-8e73-4815-bcf4-e9388bb8a78c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5667cccb-411a-429e-b9d1-1ffa1228dce7", "tag": "df8cac4b-de59-4497-a28a-b4a2496d7389"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:41.103998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:41.106574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:41.111809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1a0cecf0-4d7d-4bad-857b-c6631c5019cb req-d5461bb1-8e73-4815-bcf4-e9388bb8a78c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:41.116693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1a0cecf0-4d7d-4bad-857b-c6631c5019cb req-d5461bb1-8e73-4815-bcf4-e9388bb8a78c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:41.117575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1a0cecf0-4d7d-4bad-857b-c6631c5019cb req-d5461bb1-8e73-4815-bcf4-e9388bb8a78c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:41.146667 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1a0cecf0-4d7d-4bad-857b-c6631c5019cb req-d5461bb1-8e73-4815-bcf4-e9388bb8a78c service nova] Creating event network-changed:df8cac4b-de59-4497-a28a-b4a2496d7389 for instance 5667cccb-411a-429e-b9d1-1ffa1228dce7 on n-h1-858384-17 Oct 31 15:49:41.152959 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1a0cecf0-4d7d-4bad-857b-c6631c5019cb req-d5461bb1-8e73-4815-bcf4-e9388bb8a78c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079204 Oct 31 15:49:41.153986 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2895/5922] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:49:41.319518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14ae231a-507a-424b-bb05-a3ebe9aaf246 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:41.320650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14ae231a-507a-424b-bb05-a3ebe9aaf246 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:41.334584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14ae231a-507a-424b-bb05-a3ebe9aaf246 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:41.336714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14ae231a-507a-424b-bb05-a3ebe9aaf246 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:41.337351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14ae231a-507a-424b-bb05-a3ebe9aaf246 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:41.339389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14ae231a-507a-424b-bb05-a3ebe9aaf246 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:41.340876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:41.341555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14ae231a-507a-424b-bb05-a3ebe9aaf246 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:41.342650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14ae231a-507a-424b-bb05-a3ebe9aaf246 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:41.360462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:41.368788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:41.370097 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-14780870-d6e7-42e0-81d5-45c6327adb3d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1674 microversion: 2.20 time: 0.604154 Oct 31 15:49:41.386223 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3028/5923] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:40 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1674 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:41.423528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:41.424509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:41.457259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:41.461745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:41.462391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:41.463317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:41.466020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:41.467832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:41.687612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:41.867151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:41.879363 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2ef5c4d-c7de-4fe7-9ca4-67389b386013 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1315 microversion: 2.1 time: 0.484698 Oct 31 15:49:41.884627 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3029/5924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:41 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:42.340979 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14ae231a-507a-424b-bb05-a3ebe9aaf246 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1465 microversion: 2.1 time: 1.029012 Oct 31 15:49:42.360981 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2896/5925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:41 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1465 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:42.406220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:42.407080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:42.415062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:42.415861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:42.416450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:42.417223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:42.417871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:42.418300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:42.738850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:42.753445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:42.756873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:42.759884 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ff719fcb-560e-402e-a3e2-74a97ae842e0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.357690 Oct 31 15:49:42.761098 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3030/5926] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:42 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:42.914005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:42.914965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:42.924285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:42.924777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:42.925293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:42.926020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:42.926755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:42.927270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:43.259486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:43.277799 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f69f16f7-6303-4aef-924c-252534b7a7eb tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1315 microversion: 2.1 time: 0.367531 Oct 31 15:49:43.293155 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2897/5927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:42 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:43.366506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f43b8c4-5d50-487a-8c0c-c8755db6860c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:43.367294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f43b8c4-5d50-487a-8c0c-c8755db6860c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:43.375565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f43b8c4-5d50-487a-8c0c-c8755db6860c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:43.385846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f43b8c4-5d50-487a-8c0c-c8755db6860c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:43.386466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f43b8c4-5d50-487a-8c0c-c8755db6860c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:43.387340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f43b8c4-5d50-487a-8c0c-c8755db6860c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:43.387942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f43b8c4-5d50-487a-8c0c-c8755db6860c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:43.388476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f43b8c4-5d50-487a-8c0c-c8755db6860c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:43.424159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:43.792698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:43.793509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:43.805813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:43.807993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:43.808545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:43.809475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:43.812143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:43.812671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:44.102137 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f43b8c4-5d50-487a-8c0c-c8755db6860c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1465 microversion: 2.1 time: 0.719923 Oct 31 15:49:44.111210 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3031/5928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:43 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1465 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:44.163031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:44.173313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:44.174925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:44.176278 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3241b13b-9686-4640-8706-899f3b5b0b30 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.387996 Oct 31 15:49:44.177070 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2898/5929] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:43 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:49:44.303822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:44.304445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:44.316854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:44.318573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:44.319357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:44.320269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:44.320903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:44.321524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:44.435868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-666e6b62-c2ea-46aa-a74c-e271eb422699 req-a2e00c80-2e86-4976-a210-af20e4ef33b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "289733fd-f960-4199-8fa2-216a96d2fc13", "tag": "872254c0-08bd-4300-af3d-c79a64cc12be"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:44.461503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-666e6b62-c2ea-46aa-a74c-e271eb422699 req-a2e00c80-2e86-4976-a210-af20e4ef33b0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:44.461998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-666e6b62-c2ea-46aa-a74c-e271eb422699 req-a2e00c80-2e86-4976-a210-af20e4ef33b0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:44.462435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-666e6b62-c2ea-46aa-a74c-e271eb422699 req-a2e00c80-2e86-4976-a210-af20e4ef33b0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:44.501785 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-666e6b62-c2ea-46aa-a74c-e271eb422699 req-a2e00c80-2e86-4976-a210-af20e4ef33b0 service nova] Creating event network-changed:872254c0-08bd-4300-af3d-c79a64cc12be for instance 289733fd-f960-4199-8fa2-216a96d2fc13 on n-h2-858384-17 Oct 31 15:49:44.510342 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-666e6b62-c2ea-46aa-a74c-e271eb422699 req-a2e00c80-2e86-4976-a210-af20e4ef33b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079159 Oct 31 15:49:44.511619 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2899/5930] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:44.728724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:44.737073 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c357974-6ac7-4988-9fed-bacf15c5bf19 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1315 microversion: 2.1 time: 0.437476 Oct 31 15:49:44.740906 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3032/5931] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:44 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:45.143705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26023f22-b21e-4ab4-a558-e355f0ec5849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:45.144541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26023f22-b21e-4ab4-a558-e355f0ec5849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:45.163798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26023f22-b21e-4ab4-a558-e355f0ec5849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:45.164371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26023f22-b21e-4ab4-a558-e355f0ec5849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:45.164872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26023f22-b21e-4ab4-a558-e355f0ec5849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:45.165703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26023f22-b21e-4ab4-a558-e355f0ec5849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:45.166161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26023f22-b21e-4ab4-a558-e355f0ec5849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:45.166585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26023f22-b21e-4ab4-a558-e355f0ec5849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:45.203691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:45.204299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:45.218283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:45.223172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:45.223826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:45.228271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:45.228938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:45.239836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:45.503431 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26023f22-b21e-4ab4-a558-e355f0ec5849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1465 microversion: 2.1 time: 0.364042 Oct 31 15:49:45.506723 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2900/5932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:45 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1465 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:45.525238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-dd9d425b-1f2a-4ffb-953d-94d3cc3c6fa8 req-0545afb4-d42f-48f4-b630-27255f6df50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd15a891-58cd-4424-8f4c-c1a85c95e23e", "name": "network-vif-plugged", "status": "completed", "tag": "26b2a25d-d992-49b8-b6b5-6ebad4232d8e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:45.551583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dd9d425b-1f2a-4ffb-953d-94d3cc3c6fa8 req-0545afb4-d42f-48f4-b630-27255f6df50e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:45.554436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dd9d425b-1f2a-4ffb-953d-94d3cc3c6fa8 req-0545afb4-d42f-48f4-b630-27255f6df50e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:45.555037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dd9d425b-1f2a-4ffb-953d-94d3cc3c6fa8 req-0545afb4-d42f-48f4-b630-27255f6df50e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:45.585468 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-dd9d425b-1f2a-4ffb-953d-94d3cc3c6fa8 req-0545afb4-d42f-48f4-b630-27255f6df50e service nova] Creating event network-vif-plugged:26b2a25d-d992-49b8-b6b5-6ebad4232d8e for instance fd15a891-58cd-4424-8f4c-c1a85c95e23e on n-h1-858384-17 Oct 31 15:49:45.600666 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-dd9d425b-1f2a-4ffb-953d-94d3cc3c6fa8 req-0545afb4-d42f-48f4-b630-27255f6df50e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092378 Oct 31 15:49:45.601430 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2901/5933] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:45.769260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:45.770050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:45.795042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:45.796576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:45.797040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:45.802110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:45.802651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:45.806205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:46.126134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:46.149666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:46.151626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:46.153233 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f7baa07c-5be9-4bbb-90f2-93d8109c908d tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.954475 Oct 31 15:49:46.161038 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3033/5934] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:45 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:46.232670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:46.254981 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89b7903b-2ca6-4cb2-ad54-8d30a32ffae6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1315 microversion: 2.1 time: 0.492108 Oct 31 15:49:46.259268 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2902/5935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:45 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:46.533883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d43fdc79-b95a-4d2d-9321-27b3f98b2109 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:46.534917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d43fdc79-b95a-4d2d-9321-27b3f98b2109 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:46.560353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43fdc79-b95a-4d2d-9321-27b3f98b2109 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:46.570753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43fdc79-b95a-4d2d-9321-27b3f98b2109 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:46.585519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43fdc79-b95a-4d2d-9321-27b3f98b2109 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:46.586568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43fdc79-b95a-4d2d-9321-27b3f98b2109 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:46.590331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43fdc79-b95a-4d2d-9321-27b3f98b2109 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:46.591083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d43fdc79-b95a-4d2d-9321-27b3f98b2109 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:47.199227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:47.200213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:47.211888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:47.213766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:47.217705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:47.218735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:47.219504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:47.220230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:47.374745 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d43fdc79-b95a-4d2d-9321-27b3f98b2109 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1465 microversion: 2.1 time: 0.844777 Oct 31 15:49:47.381312 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3034/5936] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:46 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1465 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:47.397491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:47.404100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:47.424864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:47.425715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:47.426366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:47.427415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:47.428085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:47.429511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:47.650046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:47.662715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:47.666054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:47.669839 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-799ed5b4-7606-45ee-9059-31e50e91a762 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.474594 Oct 31 15:49:47.672448 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2903/5937] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:47 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:48.023289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:48.034565 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a00e18fc-340e-4c88-9f05-797bcfda656c tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1502 microversion: 2.1 time: 0.651801 Oct 31 15:49:48.058855 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3035/5938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:47 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1502 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:48.063769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:48.064392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:48.072035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.072535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.073307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:48.087154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.087670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.092780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:48.405557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f214e52a-04c7-43e4-83df-9c075522ed15 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:48.406985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f214e52a-04c7-43e4-83df-9c075522ed15 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:48.415276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f214e52a-04c7-43e4-83df-9c075522ed15 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.417810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f214e52a-04c7-43e4-83df-9c075522ed15 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.420273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f214e52a-04c7-43e4-83df-9c075522ed15 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:48.421316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f214e52a-04c7-43e4-83df-9c075522ed15 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.423656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f214e52a-04c7-43e4-83df-9c075522ed15 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.425009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f214e52a-04c7-43e4-83df-9c075522ed15 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:48.507923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:48.516673 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d71db8ed-146f-44bb-a5c3-2a388a52f22f tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1502 microversion: 2.1 time: 0.456725 Oct 31 15:49:48.522218 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2904/5939] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:48 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1502 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:48.549751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:48.550560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:48.585095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.585827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.586292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:48.587051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.590080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.590789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:48.648016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lazy-loading 'flavor' on Instance uuid fd15a891-58cd-4424-8f4c-c1a85c95e23e {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:49:48.817657 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06b7e1e1-c5e2-4259-91f4-59d634899759 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "POST /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e/action" status: 202 len: 0 microversion: 2.1 time: 0.271569 Oct 31 15:49:48.833657 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2905/5940] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:49:48 2022] POST /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:49:48.844445 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f214e52a-04c7-43e4-83df-9c075522ed15 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1465 microversion: 2.1 time: 0.438822 Oct 31 15:49:48.845802 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3036/5941] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:48 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1465 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:48.852458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:48.857977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:48.874217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.876581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:48.882786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:48.883179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.883879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:48.885053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.886167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.887493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:48.904934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.915709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.916364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:48.917391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:48.917951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:48.918469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:49.314092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:49.322949 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac6c6ef8-4cff-49be-88cd-8ca3975c6fef tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1510 microversion: 2.1 time: 0.475894 Oct 31 15:49:49.337376 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3037/5942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:48 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:49.418340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:49.427881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:49.449521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:49.450806 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d66e5fa-85c3-454d-9810-1b8044863158 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.613066 Oct 31 15:49:49.451645 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2906/5943] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:48 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:49.777456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f290a4cc-8fe8-4ea3-bf6d-7e6f822dd76c req-53bbfe45-8ba3-46d0-a42d-e6ef1b1e2f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5667cccb-411a-429e-b9d1-1ffa1228dce7", "name": "network-vif-plugged", "status": "completed", "tag": "df8cac4b-de59-4497-a28a-b4a2496d7389"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:49.800263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f290a4cc-8fe8-4ea3-bf6d-7e6f822dd76c req-53bbfe45-8ba3-46d0-a42d-e6ef1b1e2f86 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:49.801041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f290a4cc-8fe8-4ea3-bf6d-7e6f822dd76c req-53bbfe45-8ba3-46d0-a42d-e6ef1b1e2f86 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:49.801696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f290a4cc-8fe8-4ea3-bf6d-7e6f822dd76c req-53bbfe45-8ba3-46d0-a42d-e6ef1b1e2f86 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:49.836182 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f290a4cc-8fe8-4ea3-bf6d-7e6f822dd76c req-53bbfe45-8ba3-46d0-a42d-e6ef1b1e2f86 service nova] Creating event network-vif-plugged:df8cac4b-de59-4497-a28a-b4a2496d7389 for instance 5667cccb-411a-429e-b9d1-1ffa1228dce7 on n-h1-858384-17 Oct 31 15:49:49.842393 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f290a4cc-8fe8-4ea3-bf6d-7e6f822dd76c req-53bbfe45-8ba3-46d0-a42d-e6ef1b1e2f86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068484 Oct 31 15:49:49.843877 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3038/5944] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:49:49.870329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0fd62e1b-2ef7-4c67-8eee-de07eb9537cc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:49.871563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0fd62e1b-2ef7-4c67-8eee-de07eb9537cc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:49.878351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fd62e1b-2ef7-4c67-8eee-de07eb9537cc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:49.879072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fd62e1b-2ef7-4c67-8eee-de07eb9537cc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:49.879681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fd62e1b-2ef7-4c67-8eee-de07eb9537cc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:49.881622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fd62e1b-2ef7-4c67-8eee-de07eb9537cc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:49.882249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fd62e1b-2ef7-4c67-8eee-de07eb9537cc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:49.882841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0fd62e1b-2ef7-4c67-8eee-de07eb9537cc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:50.355633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:50.356515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:50.378556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:50.380793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:50.381383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:50.382140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:50.382606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:50.383036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:50.938772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:50.951308 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b6416a2-946f-445f-a4f6-6f988b36b0d6 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1493 microversion: 2.1 time: 0.598722 Oct 31 15:49:50.961282 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3039/5945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:50 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1493 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:50.974603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:50.982012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:51.005716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:51.011353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:51.011956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:51.012926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:51.013529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:51.014074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:51.094185 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0fd62e1b-2ef7-4c67-8eee-de07eb9537cc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1465 microversion: 2.1 time: 1.228697 Oct 31 15:49:51.109231 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2907/5946] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:49 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1465 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:51.120312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b45d1929-6d26-4099-bcfd-24a1f9acacb0 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:51.121160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b45d1929-6d26-4099-bcfd-24a1f9acacb0 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:51.131054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45d1929-6d26-4099-bcfd-24a1f9acacb0 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:51.132294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45d1929-6d26-4099-bcfd-24a1f9acacb0 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:51.132914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45d1929-6d26-4099-bcfd-24a1f9acacb0 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:51.133838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45d1929-6d26-4099-bcfd-24a1f9acacb0 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:51.134807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45d1929-6d26-4099-bcfd-24a1f9acacb0 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:51.135440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b45d1929-6d26-4099-bcfd-24a1f9acacb0 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:51.307831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:51.426391 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b45d1929-6d26-4099-bcfd-24a1f9acacb0 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "POST /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e/action" status: 202 len: 0 microversion: 2.1 time: 0.315437 Oct 31 15:49:51.433972 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2908/5947] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:49:51 2022] POST /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:49:51.459224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:51.460254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:51.483570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:51.494869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:51.501727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:51.503417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:51.504104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:51.505387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:51.515159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:51.515911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:51.516498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:51.528622 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-08400455-b9fe-49d7-ab8b-8d4a7df37fa8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.556604 Oct 31 15:49:51.529812 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3040/5948] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:50 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:52.122079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc2e34e6-1129-465e-b20c-c343f89123d3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:52.124385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc2e34e6-1129-465e-b20c-c343f89123d3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:52.136935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2e34e6-1129-465e-b20c-c343f89123d3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:52.137841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2e34e6-1129-465e-b20c-c343f89123d3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:52.139569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2e34e6-1129-465e-b20c-c343f89123d3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:52.147218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2e34e6-1129-465e-b20c-c343f89123d3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:52.148226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2e34e6-1129-465e-b20c-c343f89123d3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:52.149419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc2e34e6-1129-465e-b20c-c343f89123d3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:52.565979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:52.576466 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-289aea31-9aa5-4a6f-aff5-6af2fdb2a092 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1499 microversion: 2.1 time: 1.134282 Oct 31 15:49:52.597618 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2909/5949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:51 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1499 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:52.621687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:52.624636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:52.640116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:52.650437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:52.651182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:52.652109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:52.654883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:52.655578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:52.747781 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc2e34e6-1129-465e-b20c-c343f89123d3 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1651 microversion: 2.1 time: 0.629540 Oct 31 15:49:52.767661 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3041/5950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:52 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1651 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:52.786953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-921a8634-e723-4f80-970e-64e440f464e6 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:52.800486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-921a8634-e723-4f80-970e-64e440f464e6 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:52.832657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-921a8634-e723-4f80-970e-64e440f464e6 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:52.833985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-921a8634-e723-4f80-970e-64e440f464e6 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:52.838513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-921a8634-e723-4f80-970e-64e440f464e6 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:52.839676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-921a8634-e723-4f80-970e-64e440f464e6 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:52.842902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-921a8634-e723-4f80-970e-64e440f464e6 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:52.843699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-921a8634-e723-4f80-970e-64e440f464e6 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:53.193701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:53.218335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:53.220198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:53.232549 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-22bc0f7c-47bd-4161-951e-c6eb4691c8a4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.633719 Oct 31 15:49:53.233163 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2910/5951] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:52 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:53.350103 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-921a8634-e723-4f80-970e-64e440f464e6 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1651 microversion: 2.1 time: 0.569459 Oct 31 15:49:53.365749 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3042/5952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:52 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1651 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:53.375900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc5386a9-866f-4b69-af3e-847cb51bafcc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:53.376603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc5386a9-866f-4b69-af3e-847cb51bafcc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:53.389994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5386a9-866f-4b69-af3e-847cb51bafcc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:53.390665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5386a9-866f-4b69-af3e-847cb51bafcc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:53.391120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5386a9-866f-4b69-af3e-847cb51bafcc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:53.391975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5386a9-866f-4b69-af3e-847cb51bafcc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:53.393717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5386a9-866f-4b69-af3e-847cb51bafcc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:53.394322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc5386a9-866f-4b69-af3e-847cb51bafcc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:53.611511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:53.612433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:53.622963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:53.626156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:53.628439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:53.629437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:53.630187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:53.630684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:53.772322 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc5386a9-866f-4b69-af3e-847cb51bafcc tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1651 microversion: 2.1 time: 0.400345 Oct 31 15:49:53.772946 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2911/5953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:53 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1651 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:53.940227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:53.952933 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4bdb479-3bd9-466f-91f4-da969259f974 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1499 microversion: 2.1 time: 0.345172 Oct 31 15:49:53.956441 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3043/5954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:53 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1499 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:54.079553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-354122938", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "availability_zone": "nova:n-h2-858384-17", "networks": [{"uuid": "4bcf4f2d-8402-4b58-924c-5486819e169b"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:54.262771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:54.263656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:54.264687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] validate_networks() for [('4bcf4f2d-8402-4b58-924c-5486819e169b', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:49:54.276299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:54.282718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:54.287209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:54.289869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:54.294495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:54.299471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:54.681543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:54.699805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:54.705522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:54.710290 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a573437-1988-482e-96c5-27c6d0d4a212 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.452152 Oct 31 15:49:54.713414 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3044/5955] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:54 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:49:55.001073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:55.022594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:55.028919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:55.048628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:55.053292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:55.054336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:55.055671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:55.059716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:55.060880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:55.393753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:55.404194 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4db2c3d2-6cfa-4ed2-8ade-1da8709cea9b tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1502 microversion: 2.1 time: 0.422830 Oct 31 15:49:55.409643 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3045/5956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:54 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1502 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:55.452276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:55.453227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:55.463180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:55.466103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:55.467229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:55.468139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:55.468829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:55.469548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:55.499931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lazy-loading 'flavor' on Instance uuid fd15a891-58cd-4424-8f4c-c1a85c95e23e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:49:55.649332 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c65acd96-0e5c-4373-90b6-fb38f16d5e17 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "POST /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e/action" status: 202 len: 0 microversion: 2.1 time: 0.200637 Oct 31 15:49:55.653692 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3046/5957] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:49:55 2022] POST /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:49:55.674666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:55.675151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:55.706579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:55.707275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:55.707493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:55.717783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:55.722560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:55.725699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:55.783550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:49:56.104046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:49:56.105028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:49:56.106049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:49:56.106652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:49:56.107230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:49:56.131353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:56.132038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:56.132904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:56.135000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:56.135466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:56.149924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:56.217821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Getting quotas for project 302eb7e86bb34437b17e837cda644634. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:49:56.236788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Getting quotas for user 9bb58d5ae9684f49980da256b4efd033 and project 302eb7e86bb34437b17e837cda644634. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:49:56.315108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:49:56.319874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:49:56.507379 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cba1d1e7-bd27-437d-ba12-c7521c8f4069 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.432481 Oct 31 15:49:56.527016 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2912/5958] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:49:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:49:56.582272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:56.583116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:56.618800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:56.630360 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c388e62e-abf9-4bac-a190-dbf437dcc012 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1510 microversion: 2.1 time: 0.972028 Oct 31 15:49:56.633052 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3047/5959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:55 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1510 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:49:56.650763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e826e0c-3da8-45c0-94b4-b713f78fef71 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:56.654221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7e826e0c-3da8-45c0-94b4-b713f78fef71 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:56.656160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:56.657887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:56.658600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:56.663006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:56.668205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:56.672586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:56.913963 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e826e0c-3da8-45c0-94b4-b713f78fef71 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1328 microversion: 2.1 time: 0.273081 Oct 31 15:49:56.937920 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3048/5960] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:56 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1328 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:57.186803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:57.222570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:57.236213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:57.239637 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c3ee24a-cbc0-4419-963b-7e24b7a366a8 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.709882 Oct 31 15:49:57.243678 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2913/5961] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:56 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:57.663000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:57.663801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:57.686640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:57.687502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:57.688191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:57.702625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:57.706311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:57.712771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:57.952386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-187d1689-2521-4de5-8556-d09eadad4989 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:57.953040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-187d1689-2521-4de5-8556-d09eadad4989 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:58.195470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:58.208758 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ef50322-e6bb-43c9-947a-f8e9ce18fd18 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1493 microversion: 2.1 time: 0.551054 Oct 31 15:49:58.209770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3049/5962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:57 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1493 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:58.247341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2472435b-5998-406b-8373-ea1160cd05c8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:49:58.251765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2472435b-5998-406b-8373-ea1160cd05c8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:58.256793 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-187d1689-2521-4de5-8556-d09eadad4989 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1328 microversion: 2.1 time: 0.309048 Oct 31 15:49:58.269757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2472435b-5998-406b-8373-ea1160cd05c8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:58.273621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2472435b-5998-406b-8373-ea1160cd05c8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:58.273621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2472435b-5998-406b-8373-ea1160cd05c8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:58.273621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2472435b-5998-406b-8373-ea1160cd05c8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:58.273621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2472435b-5998-406b-8373-ea1160cd05c8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:58.273621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2472435b-5998-406b-8373-ea1160cd05c8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:58.275143 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2914/5963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:57 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1328 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:58.304972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:58.310394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:58.364197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:58.373030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:58.381700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:58.386446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:58.395841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:58.397314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:58.481233 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2472435b-5998-406b-8373-ea1160cd05c8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "POST /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e/action" status: 202 len: 0 microversion: 2.1 time: 0.246214 Oct 31 15:49:58.482470 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3050/5964] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:49:58 2022] POST /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 15:49:58.517946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:58.519771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:58.540592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:58.542152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:58.542769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:58.543671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:58.545096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:58.546524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:59.211165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:59.241368 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6bb98785-6ef2-4bb5-9a04-64359ae9d79a tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1499 microversion: 2.1 time: 0.751418 Oct 31 15:49:59.249390 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3051/5965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:58 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1499 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:49:59.302000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5a84b3c9-f5b8-4f2b-bcc6-c2c915307a95 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:49:59.303429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5a84b3c9-f5b8-4f2b-bcc6-c2c915307a95 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:49:59.321346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a84b3c9-f5b8-4f2b-bcc6-c2c915307a95 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:59.321969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a84b3c9-f5b8-4f2b-bcc6-c2c915307a95 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:59.322596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a84b3c9-f5b8-4f2b-bcc6-c2c915307a95 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:59.323521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a84b3c9-f5b8-4f2b-bcc6-c2c915307a95 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:49:59.324158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a84b3c9-f5b8-4f2b-bcc6-c2c915307a95 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:49:59.324777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5a84b3c9-f5b8-4f2b-bcc6-c2c915307a95 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:49:59.340932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:59.371228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:59.383037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:49:59.394652 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3ac5bc1-13ca-4c04-83d4-4f30a247067f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 1.100202 Oct 31 15:49:59.409460 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2915/5966] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:49:58 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:49:59.473761 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5a84b3c9-f5b8-4f2b-bcc6-c2c915307a95 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1417 microversion: 2.1 time: 0.171368 Oct 31 15:49:59.475245 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3052/5967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:49:59 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1417 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:00.274916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:00.275650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:00.293969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:00.295528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:00.296899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:00.299080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:00.304378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:00.306821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:00.431972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:00.432653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:00.447697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:00.453907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:00.456541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:00.458374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:00.460338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:00.464828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:01.213650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:01.222744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:01.236918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:01.238300 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f9d8baf-6850-4afd-94e0-f2a612e9cdbf tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.812079 Oct 31 15:50:01.262698 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3053/5968] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:00 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:50:01.278948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98f6644c-90fd-4b48-a5dd-1c2c8bab2a18 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:01.279582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-98f6644c-90fd-4b48-a5dd-1c2c8bab2a18 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:01.304167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f6644c-90fd-4b48-a5dd-1c2c8bab2a18 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:01.306719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f6644c-90fd-4b48-a5dd-1c2c8bab2a18 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:01.309816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f6644c-90fd-4b48-a5dd-1c2c8bab2a18 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:01.311619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f6644c-90fd-4b48-a5dd-1c2c8bab2a18 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:01.321345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f6644c-90fd-4b48-a5dd-1c2c8bab2a18 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:01.327348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f6644c-90fd-4b48-a5dd-1c2c8bab2a18 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:01.468783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:01.488257 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e3b206f0-cf6e-45ae-b5b2-5b7796251210 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1499 microversion: 2.1 time: 1.217765 Oct 31 15:50:01.518505 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2916/5969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:00 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1499 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:01.668328 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-98f6644c-90fd-4b48-a5dd-1c2c8bab2a18 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1423 microversion: 2.1 time: 0.401321 Oct 31 15:50:01.685154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3054/5970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:01 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1423 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:02.279735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:02.281419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:02.309144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:02.318429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:02.319147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:02.320607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:02.325500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:02.326225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:02.536758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:02.538490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:02.555732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:02.560086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:02.583752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:02.585003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:02.585761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:02.586439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:03.774487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:03.795460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:03.799272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:03.812848 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04baaf24-3a5f-4bf5-baaa-f8c302f7fa1e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 1.547837 Oct 31 15:50:03.816165 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2917/5971] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:02 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:50:03.826214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-629bf35c-23c0-4272-9f0b-c4d3c4dd636a tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:03.827135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-629bf35c-23c0-4272-9f0b-c4d3c4dd636a tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:03.858146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:03.868162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-629bf35c-23c0-4272-9f0b-c4d3c4dd636a tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:03.872574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-629bf35c-23c0-4272-9f0b-c4d3c4dd636a tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:03.873459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-629bf35c-23c0-4272-9f0b-c4d3c4dd636a tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:03.877988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-629bf35c-23c0-4272-9f0b-c4d3c4dd636a tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:03.883573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-629bf35c-23c0-4272-9f0b-c4d3c4dd636a tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:03.884312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-629bf35c-23c0-4272-9f0b-c4d3c4dd636a tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:04.002558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:04.016925 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24eb05d5-88e9-4c64-acb9-d28da0120f87 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1502 microversion: 2.1 time: 1.486425 Oct 31 15:50:04.020276 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3055/5972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:02 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1502 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:04.055201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:04.055918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:04.068563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:04.069479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:04.070103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:04.071138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:04.071864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:04.073004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:04.121306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:50:04.284438 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-629bf35c-23c0-4272-9f0b-c4d3c4dd636a tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1465 microversion: 2.1 time: 0.465058 Oct 31 15:50:04.290466 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2918/5973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:03 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1465 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:04.318142 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2bce8886-94e4-4fb4-92e0-533dc04e6181 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 204 len: 0 microversion: 2.1 time: 0.268122 Oct 31 15:50:04.318761 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3056/5974] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:50:04 2022] DELETE /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:50:04.327129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:04.327757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:04.341667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:04.342171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:04.342618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:04.343364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:04.343821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:04.357793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:04.743968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:04.754841 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc5d8dbb-93a5-40cb-a438-d9a2f1aaa031 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1508 microversion: 2.1 time: 0.430907 Oct 31 15:50:04.756978 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2919/5975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:04 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:04.850127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:04.850853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:04.871447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:04.871948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:04.872388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:04.873135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:04.873586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:04.874008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:05.151760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c2af2cff-2230-4c3b-88db-5da5bd21f435 req-983b9733-7f33-4672-91d5-6f4768efdce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72bb8a07-1b15-4d30-bf92-e36c6eb4204d", "tag": "9700d2b5-77f8-43d3-8dd1-6291db5d4c8b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:05.168838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c2af2cff-2230-4c3b-88db-5da5bd21f435 req-983b9733-7f33-4672-91d5-6f4768efdce1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:05.169739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c2af2cff-2230-4c3b-88db-5da5bd21f435 req-983b9733-7f33-4672-91d5-6f4768efdce1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:05.170432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c2af2cff-2230-4c3b-88db-5da5bd21f435 req-983b9733-7f33-4672-91d5-6f4768efdce1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:05.201278 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c2af2cff-2230-4c3b-88db-5da5bd21f435 req-983b9733-7f33-4672-91d5-6f4768efdce1 service nova] Creating event network-changed:9700d2b5-77f8-43d3-8dd1-6291db5d4c8b for instance 72bb8a07-1b15-4d30-bf92-e36c6eb4204d on n-h2-858384-17 Oct 31 15:50:05.213552 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c2af2cff-2230-4c3b-88db-5da5bd21f435 req-983b9733-7f33-4672-91d5-6f4768efdce1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065239 Oct 31 15:50:05.218595 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2920/5976] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:50:05.277829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:05.290585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:05.292028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:05.293248 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df79f8f0-b7a5-4e0f-83a0-a133fe8731d0 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.449113 Oct 31 15:50:05.294630 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3057/5977] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:04 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:50:05.307860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-979715bf-8ed9-470a-af19-de26e3cf19e7 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:05.308812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-979715bf-8ed9-470a-af19-de26e3cf19e7 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:05.315624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979715bf-8ed9-470a-af19-de26e3cf19e7 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:05.316370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979715bf-8ed9-470a-af19-de26e3cf19e7 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:05.317690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979715bf-8ed9-470a-af19-de26e3cf19e7 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:05.318696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979715bf-8ed9-470a-af19-de26e3cf19e7 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:05.319320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979715bf-8ed9-470a-af19-de26e3cf19e7 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:05.319904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-979715bf-8ed9-470a-af19-de26e3cf19e7 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:05.538423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-979715bf-8ed9-470a-af19-de26e3cf19e7 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1465 microversion: 2.1 time: 0.234889 Oct 31 15:50:05.539020 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2921/5978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:05 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1465 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:05.780273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:05.786610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:05.799648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:05.802892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:05.804101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:05.806671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:05.809658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:05.810413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:06.271975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:06.285748 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bdc8499d-2ab9-433e-a714-3bed124c0bf8 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1508 microversion: 2.1 time: 0.508804 Oct 31 15:50:06.312920 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3058/5979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:05 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:06.319277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:06.319906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:06.331757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:06.336709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:06.337253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:06.337710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:06.338445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:06.338913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:06.343575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:06.573664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a4ce5065-67d8-4a58-a8b6-c080a924961f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:06.575541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a4ce5065-67d8-4a58-a8b6-c080a924961f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:06.599475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ce5065-67d8-4a58-a8b6-c080a924961f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:06.600082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ce5065-67d8-4a58-a8b6-c080a924961f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:06.600611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ce5065-67d8-4a58-a8b6-c080a924961f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:06.601647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ce5065-67d8-4a58-a8b6-c080a924961f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:06.602267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ce5065-67d8-4a58-a8b6-c080a924961f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:06.602706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a4ce5065-67d8-4a58-a8b6-c080a924961f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:06.903057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:06.922131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:06.932894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:06.939917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:06.947055 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b946f2b-744f-4a21-9e52-890a6dc4773b tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.626715 Oct 31 15:50:06.947806 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2922/5980] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:06 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:50:07.113187 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a4ce5065-67d8-4a58-a8b6-c080a924961f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1465 microversion: 2.1 time: 0.546658 Oct 31 15:50:07.114019 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3059/5981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:06 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1465 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:07.326109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:07.330219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:07.339848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:07.340803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:07.341670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:07.342870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:07.343476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:07.344148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:07.478408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f22b016c-afb6-47ee-9b0a-31aa18642971 req-da68f142-920c-4554-a0b1-e4dad91c06ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd15a891-58cd-4424-8f4c-c1a85c95e23e", "name": "network-vif-deleted", "tag": "26b2a25d-d992-49b8-b6b5-6ebad4232d8e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:07.503791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f22b016c-afb6-47ee-9b0a-31aa18642971 req-da68f142-920c-4554-a0b1-e4dad91c06ec service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:07.504855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f22b016c-afb6-47ee-9b0a-31aa18642971 req-da68f142-920c-4554-a0b1-e4dad91c06ec service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:07.511686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f22b016c-afb6-47ee-9b0a-31aa18642971 req-da68f142-920c-4554-a0b1-e4dad91c06ec service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:07.526196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9451c8442b3d438b9728e95a8ab4031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4911ab7a90f94c05ad1f9bb5183388d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:07.539538 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f22b016c-afb6-47ee-9b0a-31aa18642971 req-da68f142-920c-4554-a0b1-e4dad91c06ec service nova] Creating event network-vif-deleted:26b2a25d-d992-49b8-b6b5-6ebad4232d8e for instance fd15a891-58cd-4424-8f4c-c1a85c95e23e on n-h1-858384-17 Oct 31 15:50:07.540197 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00c56a05-19d3-4cac-a6cb-d9ad46f02e94 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 200 len: 1466 microversion: 2.1 time: 0.221783 Oct 31 15:50:07.541456 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2923/5982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:07 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 1466 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:07.556455 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f22b016c-afb6-47ee-9b0a-31aa18642971 req-da68f142-920c-4554-a0b1-e4dad91c06ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088591 Oct 31 15:50:07.573293 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3060/5983] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:07.975302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:07.976157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:07.986919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:07.987967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:07.989181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:07.991043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:07.995704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:07.996191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:08.139516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b8e5a21-f05e-42ef-b5c1-a6b6fc2cf849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:08.140814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9b8e5a21-f05e-42ef-b5c1-a6b6fc2cf849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:08.159948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8e5a21-f05e-42ef-b5c1-a6b6fc2cf849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:08.161602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8e5a21-f05e-42ef-b5c1-a6b6fc2cf849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:08.162060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8e5a21-f05e-42ef-b5c1-a6b6fc2cf849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:08.163981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8e5a21-f05e-42ef-b5c1-a6b6fc2cf849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:08.164461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8e5a21-f05e-42ef-b5c1-a6b6fc2cf849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:08.166937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b8e5a21-f05e-42ef-b5c1-a6b6fc2cf849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:08.259835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:08.386576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:08.409952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:08.412001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:08.413220 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0a6b5cb7-a503-4a82-81fa-012c7462fdb3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.441946 Oct 31 15:50:08.413792 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2924/5984] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:07 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:50:08.431109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5295b599-8821-4d86-bec3-31345f7dccb7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:08.433843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5295b599-8821-4d86-bec3-31345f7dccb7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:08.443673 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9b8e5a21-f05e-42ef-b5c1-a6b6fc2cf849 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1465 microversion: 2.1 time: 0.309330 Oct 31 15:50:08.444281 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3061/5985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:08 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1465 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:50:08.449159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5295b599-8821-4d86-bec3-31345f7dccb7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:08.456451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5295b599-8821-4d86-bec3-31345f7dccb7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:08.458135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5295b599-8821-4d86-bec3-31345f7dccb7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:08.462840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5295b599-8821-4d86-bec3-31345f7dccb7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:08.464086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5295b599-8821-4d86-bec3-31345f7dccb7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:08.464766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5295b599-8821-4d86-bec3-31345f7dccb7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:08.507259 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5295b599-8821-4d86-bec3-31345f7dccb7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/ips" status: 200 len: 151 microversion: 2.1 time: 0.080025 Oct 31 15:50:08.508336 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2925/5986] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:50:08 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:08.578879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:08.579504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] [instance: fd15a891-58cd-4424-8f4c-c1a85c95e23e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:08.594508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:08.595056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:08.595575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:08.596299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:08.596785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:08.597297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:08.659827 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] HTTP exception thrown: Instance fd15a891-58cd-4424-8f4c-c1a85c95e23e could not be found. Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Request method failure captured: Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e HTTP/1.1 Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-57dsiffcPy5dpgslIaUDA0a77OkqULr7yex_bIxPzlLrsh7dgpDYBojA5hXqcb2ifE0z9LRukALNdiOonlCph9PMe8v3m-nCvR2lj540TnGVT9SQA-FIJf-oSgjt8t9aw2NU0ZsuMrBojOlPq62SQxoPysVPqNdkQeawDH5AkopuI Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 4911ab7a90f94c05ad1f9bb5183388d3 Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestServerAdvancedOps-1427823409 Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4911ab7a90f94c05ad1f9bb5183388d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4911ab7a90f94c05ad1f9bb5183388d3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4911ab7a90f94c05ad1f9bb5183388d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4911ab7a90f94c05ad1f9bb5183388d3"}]}] Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestServerAdvancedOps-1427823409 Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 4911ab7a90f94c05ad1f9bb5183388d3 Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestServerAdvancedOps-1427823409 Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestServerAdvancedOps-1427823409-project Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 9451c8442b3d438b9728e95a8ab4031a Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestServerAdvancedOps-1427823409-project Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance fd15a891-58cd-4424-8f4c-c1a85c95e23e could not be found. Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'fd15a891-58cd-4424-8f4c-c1a85c95e23e'} Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd15a891-58cd-4424-8f4c-c1a85c95e23e could not be found. Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd15a891-58cd-4424-8f4c-c1a85c95e23e could not be found. Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:08.665086 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:08.670217 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:08.670217 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:08.670217 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:08.670217 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:08.670217 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:08.670217 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd15a891-58cd-4424-8f4c-c1a85c95e23e could not be found. Oct 31 15:50:08.670217 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:08.672430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] Returning 404 to user: Instance fd15a891-58cd-4424-8f4c-c1a85c95e23e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:08.675610 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6582921-23a9-4ffa-a6f6-23a6f79777b9 tempest-TestServerAdvancedOps-1427823409 tempest-TestServerAdvancedOps-1427823409-project] 10.222.0.20 "GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e" status: 404 len: 111 microversion: 2.1 time: 0.115214 Oct 31 15:50:08.681481 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3062/5987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:08 2022] GET /compute/v2.1/servers/fd15a891-58cd-4424-8f4c-c1a85c95e23e => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:50:09.446657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:09.448083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:09.469989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6247e0c-a411-4eb8-b73d-66f2df1ce1df tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:09.470857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b6247e0c-a411-4eb8-b73d-66f2df1ce1df tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:09.475393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:09.475959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:09.477596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:09.479918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:09.481445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:09.484207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:09.502687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6247e0c-a411-4eb8-b73d-66f2df1ce1df tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:09.503891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6247e0c-a411-4eb8-b73d-66f2df1ce1df tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:09.510439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6247e0c-a411-4eb8-b73d-66f2df1ce1df tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:09.511518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6247e0c-a411-4eb8-b73d-66f2df1ce1df tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:09.512193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6247e0c-a411-4eb8-b73d-66f2df1ce1df tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:09.512816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6247e0c-a411-4eb8-b73d-66f2df1ce1df tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:09.605258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:10.124404 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6247e0c-a411-4eb8-b73d-66f2df1ce1df tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1465 microversion: 2.1 time: 0.658981 Oct 31 15:50:10.145521 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3063/5988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:09 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1465 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:50:10.150828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-4ab44ca4-a442-41af-89e9-955f8ded1022 req-d8b93fe4-a13d-410f-bd8d-9188e1d11e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289733fd-f960-4199-8fa2-216a96d2fc13", "name": "network-vif-plugged", "status": "completed", "tag": "872254c0-08bd-4300-af3d-c79a64cc12be"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:10.169307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:10.187720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:10.189391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:10.200756 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aadd8b06-292c-4c76-8a8b-715259fd6e38 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.761346 Oct 31 15:50:10.216437 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2926/5989] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:09 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:50:10.218547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4ab44ca4-a442-41af-89e9-955f8ded1022 req-d8b93fe4-a13d-410f-bd8d-9188e1d11e0c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:10.219032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4ab44ca4-a442-41af-89e9-955f8ded1022 req-d8b93fe4-a13d-410f-bd8d-9188e1d11e0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:10.219462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-4ab44ca4-a442-41af-89e9-955f8ded1022 req-d8b93fe4-a13d-410f-bd8d-9188e1d11e0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:10.245187 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-4ab44ca4-a442-41af-89e9-955f8ded1022 req-d8b93fe4-a13d-410f-bd8d-9188e1d11e0c service nova] Creating event network-vif-plugged:872254c0-08bd-4300-af3d-c79a64cc12be for instance 289733fd-f960-4199-8fa2-216a96d2fc13 on n-h2-858384-17 Oct 31 15:50:10.267461 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-4ab44ca4-a442-41af-89e9-955f8ded1022 req-d8b93fe4-a13d-410f-bd8d-9188e1d11e0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119609 Oct 31 15:50:10.268952 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3064/5990] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:11.171191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5379e372-76c3-4fe9-b5cd-cfbf7df02884 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:11.171191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5379e372-76c3-4fe9-b5cd-cfbf7df02884 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:11.173283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5379e372-76c3-4fe9-b5cd-cfbf7df02884 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:11.173283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5379e372-76c3-4fe9-b5cd-cfbf7df02884 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:11.173283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5379e372-76c3-4fe9-b5cd-cfbf7df02884 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:11.174006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5379e372-76c3-4fe9-b5cd-cfbf7df02884 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:11.174471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5379e372-76c3-4fe9-b5cd-cfbf7df02884 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:11.174895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5379e372-76c3-4fe9-b5cd-cfbf7df02884 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:11.235575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:11.237641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:11.253575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:11.258373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:11.258791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:11.259551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:11.262436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:11.264394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:11.597955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:11.605573 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5379e372-76c3-4fe9-b5cd-cfbf7df02884 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1465 microversion: 2.1 time: 0.455549 Oct 31 15:50:11.607642 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2927/5991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:11 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1465 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:11.631972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:11.636929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86b1533c-1194-4bbe-9995-1b0d93292dac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5371dc0a-fd7a-44c8-a149-c946c3627c4b"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:11.643254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:11.646535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:11.648006 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c792bd0c-9fa2-4feb-b0ce-952a3d375947 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.417284 Oct 31 15:50:11.649108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-86b1533c-1194-4bbe-9995-1b0d93292dac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:11.662432 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3065/5992] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:11 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:50:11.672786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b1533c-1194-4bbe-9995-1b0d93292dac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:11.674237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b1533c-1194-4bbe-9995-1b0d93292dac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:11.675414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b1533c-1194-4bbe-9995-1b0d93292dac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:11.681653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b1533c-1194-4bbe-9995-1b0d93292dac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:11.682479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b1533c-1194-4bbe-9995-1b0d93292dac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:11.683081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86b1533c-1194-4bbe-9995-1b0d93292dac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:12.310550 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86b1533c-1194-4bbe-9995-1b0d93292dac tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "POST /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699110 Oct 31 15:50:12.319018 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2928/5993] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:50:11 2022] POST /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:12.631894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a2d70a8-2d0d-4fef-8a11-a0017255e16d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:12.632669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a2d70a8-2d0d-4fef-8a11-a0017255e16d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:12.647143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a2d70a8-2d0d-4fef-8a11-a0017255e16d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:12.648875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a2d70a8-2d0d-4fef-8a11-a0017255e16d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:12.650297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a2d70a8-2d0d-4fef-8a11-a0017255e16d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:12.651373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a2d70a8-2d0d-4fef-8a11-a0017255e16d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:12.653608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a2d70a8-2d0d-4fef-8a11-a0017255e16d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:12.655340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a2d70a8-2d0d-4fef-8a11-a0017255e16d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:12.678563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:12.679501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:12.699016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:12.699517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:12.699954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:12.701592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:12.702053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:12.702614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:13.074554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:13.086991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:13.090972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:13.092207 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f1d086b4-13fa-4587-a1f4-6e6c06e98de3 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1732 microversion: 2.20 time: 0.420172 Oct 31 15:50:13.092858 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2929/5994] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:12 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1732 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:50:14.009726 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a2d70a8-2d0d-4fef-8a11-a0017255e16d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1465 microversion: 2.1 time: 1.381252 Oct 31 15:50:14.012138 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3066/5995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:12 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1465 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:14.118735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:14.119450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:14.134170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:14.135933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:14.136472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:14.137329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:14.139186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:14.139697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:14.332964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:14.342470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:14.344132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:14.345499 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d19882b6-a5b6-4ed8-8c0b-b62089211cc9 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1719 microversion: 2.20 time: 0.230560 Oct 31 15:50:14.346416 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2930/5996] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:14 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:50:15.064939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b34f2208-c330-480a-b27e-9f720d6474e8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:15.079010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b34f2208-c330-480a-b27e-9f720d6474e8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:15.094010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b34f2208-c330-480a-b27e-9f720d6474e8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:15.095116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b34f2208-c330-480a-b27e-9f720d6474e8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:15.095908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b34f2208-c330-480a-b27e-9f720d6474e8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:15.096979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b34f2208-c330-480a-b27e-9f720d6474e8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:15.098308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b34f2208-c330-480a-b27e-9f720d6474e8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:15.098991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b34f2208-c330-480a-b27e-9f720d6474e8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:15.358210 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b34f2208-c330-480a-b27e-9f720d6474e8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1465 microversion: 2.1 time: 0.319232 Oct 31 15:50:15.360110 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3067/5997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:15 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1465 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:15.808252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-aa6b7bd3-2ae5-4e97-adac-32566963e115 req-caea0f14-5d20-4835-b1b9-0da7ae59b129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bb8a07-1b15-4d30-bf92-e36c6eb4204d", "name": "network-vif-plugged", "status": "completed", "tag": "9700d2b5-77f8-43d3-8dd1-6291db5d4c8b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:15.834168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aa6b7bd3-2ae5-4e97-adac-32566963e115 req-caea0f14-5d20-4835-b1b9-0da7ae59b129 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:15.835116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aa6b7bd3-2ae5-4e97-adac-32566963e115 req-caea0f14-5d20-4835-b1b9-0da7ae59b129 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:15.836772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-aa6b7bd3-2ae5-4e97-adac-32566963e115 req-caea0f14-5d20-4835-b1b9-0da7ae59b129 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:15.859870 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-aa6b7bd3-2ae5-4e97-adac-32566963e115 req-caea0f14-5d20-4835-b1b9-0da7ae59b129 service nova] Creating event network-vif-plugged:9700d2b5-77f8-43d3-8dd1-6291db5d4c8b for instance 72bb8a07-1b15-4d30-bf92-e36c6eb4204d on n-h2-858384-17 Oct 31 15:50:15.874603 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-aa6b7bd3-2ae5-4e97-adac-32566963e115 req-caea0f14-5d20-4835-b1b9-0da7ae59b129 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068606 Oct 31 15:50:15.876577 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2931/5998] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:16.388427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea079f92-b84b-4999-a4c4-70db05836874 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:16.389992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea079f92-b84b-4999-a4c4-70db05836874 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:16.409565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea079f92-b84b-4999-a4c4-70db05836874 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:16.413750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea079f92-b84b-4999-a4c4-70db05836874 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:16.414582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea079f92-b84b-4999-a4c4-70db05836874 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:16.417593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea079f92-b84b-4999-a4c4-70db05836874 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:16.420032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea079f92-b84b-4999-a4c4-70db05836874 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:16.420702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea079f92-b84b-4999-a4c4-70db05836874 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:16.703055 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea079f92-b84b-4999-a4c4-70db05836874 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1465 microversion: 2.1 time: 0.321011 Oct 31 15:50:16.703662 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3068/5999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:16 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1465 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:17.734086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4f33903c-61e3-4119-bd41-f3ceec93cc72 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:17.735478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4f33903c-61e3-4119-bd41-f3ceec93cc72 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:17.755099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f33903c-61e3-4119-bd41-f3ceec93cc72 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:17.755742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f33903c-61e3-4119-bd41-f3ceec93cc72 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:17.756308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f33903c-61e3-4119-bd41-f3ceec93cc72 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:17.757223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f33903c-61e3-4119-bd41-f3ceec93cc72 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:17.757739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f33903c-61e3-4119-bd41-f3ceec93cc72 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:17.761891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4f33903c-61e3-4119-bd41-f3ceec93cc72 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:17.914335 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4f33903c-61e3-4119-bd41-f3ceec93cc72 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1651 microversion: 2.1 time: 0.186288 Oct 31 15:50:17.915568 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2932/6000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:17 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1651 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:17.939094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-210fdc75-a246-4626-91cc-6145c014393b tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:17.940277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-210fdc75-a246-4626-91cc-6145c014393b tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:17.947430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210fdc75-a246-4626-91cc-6145c014393b tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:17.948099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210fdc75-a246-4626-91cc-6145c014393b tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:17.948746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210fdc75-a246-4626-91cc-6145c014393b tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:17.949646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210fdc75-a246-4626-91cc-6145c014393b tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:17.950269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210fdc75-a246-4626-91cc-6145c014393b tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:17.950955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-210fdc75-a246-4626-91cc-6145c014393b tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:18.297858 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-210fdc75-a246-4626-91cc-6145c014393b tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1651 microversion: 2.1 time: 0.363332 Oct 31 15:50:18.298775 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3069/6001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:17 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1651 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:50:18.322242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-077a2783-1248-4bb7-a61c-a8fd7daaed7f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:18.323121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-077a2783-1248-4bb7-a61c-a8fd7daaed7f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:18.336841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-077a2783-1248-4bb7-a61c-a8fd7daaed7f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:18.337659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-077a2783-1248-4bb7-a61c-a8fd7daaed7f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:18.340030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-077a2783-1248-4bb7-a61c-a8fd7daaed7f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:18.340947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-077a2783-1248-4bb7-a61c-a8fd7daaed7f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:18.342784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-077a2783-1248-4bb7-a61c-a8fd7daaed7f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:18.343460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-077a2783-1248-4bb7-a61c-a8fd7daaed7f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:18.599417 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-077a2783-1248-4bb7-a61c-a8fd7daaed7f tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1651 microversion: 2.1 time: 0.278870 Oct 31 15:50:18.602658 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2933/6002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:18 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1651 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:18.628573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:18.629795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:18.640292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:18.645175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:18.646074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:18.652001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:18.652824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:18.657790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:18.705237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:50:18.891734 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d47f92f4-10df-4cbe-b5b0-cf9be0e1d557 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 204 len: 0 microversion: 2.1 time: 0.267698 Oct 31 15:50:18.892455 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3070/6003] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:50:18 2022] DELETE /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:50:18.902069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27f322c7-4f1f-4216-b1a8-25cd861ef47d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:18.902772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27f322c7-4f1f-4216-b1a8-25cd861ef47d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:18.914395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f322c7-4f1f-4216-b1a8-25cd861ef47d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:18.914994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f322c7-4f1f-4216-b1a8-25cd861ef47d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:18.917631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f322c7-4f1f-4216-b1a8-25cd861ef47d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:18.919368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f322c7-4f1f-4216-b1a8-25cd861ef47d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:18.923831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f322c7-4f1f-4216-b1a8-25cd861ef47d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:18.925387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f322c7-4f1f-4216-b1a8-25cd861ef47d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:19.199984 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27f322c7-4f1f-4216-b1a8-25cd861ef47d tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1657 microversion: 2.1 time: 0.301693 Oct 31 15:50:19.201211 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2934/6004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:18 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1657 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:20.251881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a4d799c-bf83-41bc-ad68-e913629cb3c8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:20.253328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a4d799c-bf83-41bc-ad68-e913629cb3c8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:20.262717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4d799c-bf83-41bc-ad68-e913629cb3c8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:20.263448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4d799c-bf83-41bc-ad68-e913629cb3c8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:20.266277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4d799c-bf83-41bc-ad68-e913629cb3c8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:20.267325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4d799c-bf83-41bc-ad68-e913629cb3c8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:20.268037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4d799c-bf83-41bc-ad68-e913629cb3c8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:20.269865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4d799c-bf83-41bc-ad68-e913629cb3c8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:20.724328 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a4d799c-bf83-41bc-ad68-e913629cb3c8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1657 microversion: 2.1 time: 0.476590 Oct 31 15:50:20.747413 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3071/6005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:20 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1657 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:21.369503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-88b004b2-c344-4ae9-a266-cec59dbbd7e9 req-3784f6f7-a8e5-41c9-89f7-bdd40263ca95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bb8a07-1b15-4d30-bf92-e36c6eb4204d", "name": "network-vif-deleted", "tag": "9700d2b5-77f8-43d3-8dd1-6291db5d4c8b"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:21.407406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-88b004b2-c344-4ae9-a266-cec59dbbd7e9 req-3784f6f7-a8e5-41c9-89f7-bdd40263ca95 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:21.408564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-88b004b2-c344-4ae9-a266-cec59dbbd7e9 req-3784f6f7-a8e5-41c9-89f7-bdd40263ca95 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:21.412681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-88b004b2-c344-4ae9-a266-cec59dbbd7e9 req-3784f6f7-a8e5-41c9-89f7-bdd40263ca95 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:21.464146 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-88b004b2-c344-4ae9-a266-cec59dbbd7e9 req-3784f6f7-a8e5-41c9-89f7-bdd40263ca95 service nova] Creating event network-vif-deleted:9700d2b5-77f8-43d3-8dd1-6291db5d4c8b for instance 72bb8a07-1b15-4d30-bf92-e36c6eb4204d on n-h2-858384-17 Oct 31 15:50:21.478500 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-88b004b2-c344-4ae9-a266-cec59dbbd7e9 req-3784f6f7-a8e5-41c9-89f7-bdd40263ca95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113978 Oct 31 15:50:21.479689 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2935/6006] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:21.775489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:21.776217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:21.790380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:21.791690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:21.792622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:21.794705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:21.795845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:21.796555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:21.874384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:21.875190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:21.876033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:21.876728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lazy-loading 'fault' on Instance uuid 72bb8a07-1b15-4d30-bf92-e36c6eb4204d {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:50:21.988286 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3e33a673-6ef6-4302-805e-461045bb79f2 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 200 len: 1455 microversion: 2.1 time: 0.230839 Oct 31 15:50:21.988875 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3072/6007] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:21 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 1455 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:23.015236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:23.016610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 72bb8a07-1b15-4d30-bf92-e36c6eb4204d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:23.058120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:23.059807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:23.061831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:23.062697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:23.063596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:23.064261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:23.079470 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] HTTP exception thrown: Instance 72bb8a07-1b15-4d30-bf92-e36c6eb4204d could not be found. Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Request method failure captured: Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d HTTP/1.1 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-54gH2vAdFZ69OGCRnOOoojVYSALejq_ofR3_vREw8dG3yTSGa5wuFQycxXSSRtqEkiWFDNpMtfP-B7HA9YOY_YDDUNRn48i5UWO-FxWUp_gC8ezj5W6LWvUCjY_8z__O7CgmHzAelYLC8FieJHCcu-yxGRjn5MTcN61gu4derBUUc Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 302eb7e86bb34437b17e837cda644634 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestServerMultinode-56957103 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302eb7e86bb34437b17e837cda644634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302eb7e86bb34437b17e837cda644634", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302eb7e86bb34437b17e837cda644634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302eb7e86bb34437b17e837cda644634"}]}] Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestServerMultinode-56957103 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 302eb7e86bb34437b17e837cda644634 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestServerMultinode-56957103 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestServerMultinode-56957103-project-admin Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 9bb58d5ae9684f49980da256b4efd033 Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestServerMultinode-56957103-project-admin Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 72bb8a07-1b15-4d30-bf92-e36c6eb4204d could not be found. Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '72bb8a07-1b15-4d30-bf92-e36c6eb4204d'} Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72bb8a07-1b15-4d30-bf92-e36c6eb4204d could not be found. Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72bb8a07-1b15-4d30-bf92-e36c6eb4204d could not be found. Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:23.081989 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72bb8a07-1b15-4d30-bf92-e36c6eb4204d could not be found. Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Returning 404 to user: Instance 72bb8a07-1b15-4d30-bf92-e36c6eb4204d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b2b85465-5f5a-4955-aa3f-bdfc4434a4f8 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d" status: 404 len: 111 microversion: 2.1 time: 0.072430 Oct 31 15:50:23.093226 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2936/6008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:23 2022] GET /compute/v2.1/servers/72bb8a07-1b15-4d30-bf92-e36c6eb4204d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:50:23.094350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:23.094350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:23.106672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:23.116593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:23.116979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:23.117819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:23.118375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:23.118678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:23.158376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:50:23.311723 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-965f5b79-a07a-40c1-8b98-f2a8bd57ee36 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 204 len: 0 microversion: 2.1 time: 0.220294 Oct 31 15:50:23.312363 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3073/6009] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:50:23 2022] DELETE /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:50:23.322944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b286c386-456b-4704-ab58-e2264ac196a1 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:23.323848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b286c386-456b-4704-ab58-e2264ac196a1 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:23.345351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b286c386-456b-4704-ab58-e2264ac196a1 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:23.346132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b286c386-456b-4704-ab58-e2264ac196a1 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:23.346823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b286c386-456b-4704-ab58-e2264ac196a1 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:23.347772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b286c386-456b-4704-ab58-e2264ac196a1 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:23.350635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b286c386-456b-4704-ab58-e2264ac196a1 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:23.351737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b286c386-456b-4704-ab58-e2264ac196a1 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:23.614117 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b286c386-456b-4704-ab58-e2264ac196a1 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1657 microversion: 2.1 time: 0.296430 Oct 31 15:50:23.615832 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2937/6010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:23 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1657 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:24.643325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-604eba8a-a93c-440d-9815-87ee9ca48b48 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:24.644167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-604eba8a-a93c-440d-9815-87ee9ca48b48 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:24.651350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604eba8a-a93c-440d-9815-87ee9ca48b48 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:24.651841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604eba8a-a93c-440d-9815-87ee9ca48b48 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:24.652574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604eba8a-a93c-440d-9815-87ee9ca48b48 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:24.653496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604eba8a-a93c-440d-9815-87ee9ca48b48 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:24.654126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604eba8a-a93c-440d-9815-87ee9ca48b48 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:24.654726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-604eba8a-a93c-440d-9815-87ee9ca48b48 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:24.869142 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-604eba8a-a93c-440d-9815-87ee9ca48b48 tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1657 microversion: 2.1 time: 0.229813 Oct 31 15:50:24.869730 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3074/6011] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:24 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1657 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:25.412299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5d875b18-79f1-4fa7-aa68-d56c38cf3166 req-810c851b-f35b-47e4-8b39-b9a7eadc433d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5667cccb-411a-429e-b9d1-1ffa1228dce7", "name": "network-vif-deleted", "tag": "df8cac4b-de59-4497-a28a-b4a2496d7389"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:25.430570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5d875b18-79f1-4fa7-aa68-d56c38cf3166 req-810c851b-f35b-47e4-8b39-b9a7eadc433d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:25.431635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5d875b18-79f1-4fa7-aa68-d56c38cf3166 req-810c851b-f35b-47e4-8b39-b9a7eadc433d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:25.432238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5d875b18-79f1-4fa7-aa68-d56c38cf3166 req-810c851b-f35b-47e4-8b39-b9a7eadc433d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:25.450926 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5d875b18-79f1-4fa7-aa68-d56c38cf3166 req-810c851b-f35b-47e4-8b39-b9a7eadc433d service nova] Creating event network-vif-deleted:df8cac4b-de59-4497-a28a-b4a2496d7389 for instance 5667cccb-411a-429e-b9d1-1ffa1228dce7 on n-h1-858384-17 Oct 31 15:50:25.460563 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5d875b18-79f1-4fa7-aa68-d56c38cf3166 req-810c851b-f35b-47e4-8b39-b9a7eadc433d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052479 Oct 31 15:50:25.465073 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2938/6012] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:25.891890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:25.892500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:25.896503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:25.915827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:25.916505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:25.916967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:25.917747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:25.918213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:25.918643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:26.024542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:26.028128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:26.029767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:26.039663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lazy-loading 'fault' on Instance uuid 5667cccb-411a-429e-b9d1-1ffa1228dce7 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:50:26.160970 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-43a95dc5-3092-41a3-ae25-c55cfd6579bd tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 200 len: 1455 microversion: 2.1 time: 0.273005 Oct 31 15:50:26.169784 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3075/6013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:25 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 1455 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:27.193543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:27.194848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] [instance: 5667cccb-411a-429e-b9d1-1ffa1228dce7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:27.213648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:27.214513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:27.215165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:27.216422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:27.216940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:27.217558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:27.248482 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] HTTP exception thrown: Instance 5667cccb-411a-429e-b9d1-1ffa1228dce7 could not be found. Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Request method failure captured: Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 HTTP/1.1 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-54gH2vAdFZ69OGCRnOOoojVYSALejq_ofR3_vREw8dG3yTSGa5wuFQycxXSSRtqEkiWFDNpMtfP-B7HA9YOY_YDDUNRn48i5UWO-FxWUp_gC8ezj5W6LWvUCjY_8z__O7CgmHzAelYLC8FieJHCcu-yxGRjn5MTcN61gu4derBUUc Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 302eb7e86bb34437b17e837cda644634 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestServerMultinode-56957103 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302eb7e86bb34437b17e837cda644634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_302eb7e86bb34437b17e837cda644634", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/302eb7e86bb34437b17e837cda644634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/302eb7e86bb34437b17e837cda644634"}]}] Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestServerMultinode-56957103 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 302eb7e86bb34437b17e837cda644634 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestServerMultinode-56957103 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestServerMultinode-56957103-project-admin Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 9bb58d5ae9684f49980da256b4efd033 Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestServerMultinode-56957103-project-admin Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 5667cccb-411a-429e-b9d1-1ffa1228dce7 could not be found. Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '5667cccb-411a-429e-b9d1-1ffa1228dce7'} Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5667cccb-411a-429e-b9d1-1ffa1228dce7 could not be found. Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5667cccb-411a-429e-b9d1-1ffa1228dce7 could not be found. Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:27.257977 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5667cccb-411a-429e-b9d1-1ffa1228dce7 could not be found. Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] Returning 404 to user: Instance 5667cccb-411a-429e-b9d1-1ffa1228dce7 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d3f50ad4-dcd8-4773-b780-9358e8b21e5c tempest-TestServerMultinode-56957103 tempest-TestServerMultinode-56957103-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7" status: 404 len: 111 microversion: 2.1 time: 0.073446 Oct 31 15:50:27.274368 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2939/6014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:27 2022] GET /compute/v2.1/servers/5667cccb-411a-429e-b9d1-1ffa1228dce7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:50:29.848453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:29.849701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:29.866740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:29.869906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:29.870476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:29.873334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:29.876612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:29.877311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:30.156717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:30.162878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lazy-loading 'services' on Instance uuid 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:50:30.367438 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-076e859b-61ab-43a2-baea-a4f5677fc71d tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments/5371dc0a-fd7a-44c8-a149-c946c3627c4b" status: 202 len: 0 microversion: 2.1 time: 0.523965 Oct 31 15:50:30.368725 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3076/6015] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:50:29 2022] DELETE /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments/5371dc0a-fd7a-44c8-a149-c946c3627c4b => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:50:30.377043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85cd6a38-dc7d-4658-9dd8-afac54ac7a04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:30.380063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85cd6a38-dc7d-4658-9dd8-afac54ac7a04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:30.406923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cd6a38-dc7d-4658-9dd8-afac54ac7a04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:30.407432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cd6a38-dc7d-4658-9dd8-afac54ac7a04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:30.407989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cd6a38-dc7d-4658-9dd8-afac54ac7a04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:30.413567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cd6a38-dc7d-4658-9dd8-afac54ac7a04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:30.414206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cd6a38-dc7d-4658-9dd8-afac54ac7a04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:30.414663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85cd6a38-dc7d-4658-9dd8-afac54ac7a04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:30.599488 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85cd6a38-dc7d-4658-9dd8-afac54ac7a04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.223190 Oct 31 15:50:30.607767 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2940/6016] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:50:30 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:31.616162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a5f268b7-d1d0-4761-b86f-dea023e3b871 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:31.619161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a5f268b7-d1d0-4761-b86f-dea023e3b871 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:31.644286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5f268b7-d1d0-4761-b86f-dea023e3b871 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:31.654054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5f268b7-d1d0-4761-b86f-dea023e3b871 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:31.655743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5f268b7-d1d0-4761-b86f-dea023e3b871 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:31.657049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5f268b7-d1d0-4761-b86f-dea023e3b871 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:31.657859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5f268b7-d1d0-4761-b86f-dea023e3b871 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:31.658494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a5f268b7-d1d0-4761-b86f-dea023e3b871 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:31.701559 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a5f268b7-d1d0-4761-b86f-dea023e3b871 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093033 Oct 31 15:50:31.725313 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3077/6017] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:50:31 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:32.732328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07022afe-cd8d-4132-90fb-9eb304a816d4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:32.736928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07022afe-cd8d-4132-90fb-9eb304a816d4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:32.762857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07022afe-cd8d-4132-90fb-9eb304a816d4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:32.764184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07022afe-cd8d-4132-90fb-9eb304a816d4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:32.768323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07022afe-cd8d-4132-90fb-9eb304a816d4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:32.773206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07022afe-cd8d-4132-90fb-9eb304a816d4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:32.776268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07022afe-cd8d-4132-90fb-9eb304a816d4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:32.777083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07022afe-cd8d-4132-90fb-9eb304a816d4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:32.932036 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07022afe-cd8d-4132-90fb-9eb304a816d4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202471 Oct 31 15:50:32.940905 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2941/6018] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:50:32 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:33.947003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-38299dd7-e64e-4efb-b53f-e751c88b4d34 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:33.950522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-38299dd7-e64e-4efb-b53f-e751c88b4d34 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:33.966802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38299dd7-e64e-4efb-b53f-e751c88b4d34 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:33.967317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38299dd7-e64e-4efb-b53f-e751c88b4d34 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:33.969474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38299dd7-e64e-4efb-b53f-e751c88b4d34 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:33.969474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38299dd7-e64e-4efb-b53f-e751c88b4d34 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:33.969474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38299dd7-e64e-4efb-b53f-e751c88b4d34 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:33.969474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-38299dd7-e64e-4efb-b53f-e751c88b4d34 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:34.063265 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-38299dd7-e64e-4efb-b53f-e751c88b4d34 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120380 Oct 31 15:50:34.066644 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3078/6019] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:50:33 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:35.079705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba2e63d6-72b6-417d-afb4-fa19a36d6b49 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:35.085085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba2e63d6-72b6-417d-afb4-fa19a36d6b49 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:35.091630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=48 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:35.101525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba2e63d6-72b6-417d-afb4-fa19a36d6b49 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:35.125333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba2e63d6-72b6-417d-afb4-fa19a36d6b49 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:35.126215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba2e63d6-72b6-417d-afb4-fa19a36d6b49 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:35.127212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba2e63d6-72b6-417d-afb4-fa19a36d6b49 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:35.128802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba2e63d6-72b6-417d-afb4-fa19a36d6b49 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:35.133771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba2e63d6-72b6-417d-afb4-fa19a36d6b49 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:35.252113 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba2e63d6-72b6-417d-afb4-fa19a36d6b49 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178055 Oct 31 15:50:35.256768 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2942/6020] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:50:35 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:36.273797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc5c4a71-63e0-4549-bd86-2de6e01c7f89 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:36.280063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dc5c4a71-63e0-4549-bd86-2de6e01c7f89 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:36.310020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc5c4a71-63e0-4549-bd86-2de6e01c7f89 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:36.317058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc5c4a71-63e0-4549-bd86-2de6e01c7f89 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:36.317556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc5c4a71-63e0-4549-bd86-2de6e01c7f89 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:36.318318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc5c4a71-63e0-4549-bd86-2de6e01c7f89 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:36.318788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc5c4a71-63e0-4549-bd86-2de6e01c7f89 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:36.319223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc5c4a71-63e0-4549-bd86-2de6e01c7f89 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:36.434444 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc5c4a71-63e0-4549-bd86-2de6e01c7f89 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.169491 Oct 31 15:50:36.447837 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3079/6021] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:50:36 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:37.447959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0a42db5d-169e-45e6-bb8b-325e884507bd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:37.451364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0a42db5d-169e-45e6-bb8b-325e884507bd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:37.469736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a42db5d-169e-45e6-bb8b-325e884507bd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:37.470614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a42db5d-169e-45e6-bb8b-325e884507bd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:37.472180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a42db5d-169e-45e6-bb8b-325e884507bd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:37.475121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a42db5d-169e-45e6-bb8b-325e884507bd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:37.476347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a42db5d-169e-45e6-bb8b-325e884507bd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:37.478714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a42db5d-169e-45e6-bb8b-325e884507bd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:37.572062 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0a42db5d-169e-45e6-bb8b-325e884507bd tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128539 Oct 31 15:50:37.581325 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2943/6022] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:50:37 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:38.588261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e09f8d73-924d-4148-a594-d673ec524668 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:38.591079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e09f8d73-924d-4148-a594-d673ec524668 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:38.649011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09f8d73-924d-4148-a594-d673ec524668 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:38.656761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09f8d73-924d-4148-a594-d673ec524668 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:38.658376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09f8d73-924d-4148-a594-d673ec524668 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:38.660453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09f8d73-924d-4148-a594-d673ec524668 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:38.661122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09f8d73-924d-4148-a594-d673ec524668 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:38.661755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e09f8d73-924d-4148-a594-d673ec524668 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:38.716433 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e09f8d73-924d-4148-a594-d673ec524668 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132093 Oct 31 15:50:38.719796 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3080/6023] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:50:38 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:39.731194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea821605-6493-49bf-af73-d2e918bc416a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:39.733629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea821605-6493-49bf-af73-d2e918bc416a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:39.747172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea821605-6493-49bf-af73-d2e918bc416a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:39.747672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea821605-6493-49bf-af73-d2e918bc416a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:39.748123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea821605-6493-49bf-af73-d2e918bc416a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:39.748832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea821605-6493-49bf-af73-d2e918bc416a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:39.756813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea821605-6493-49bf-af73-d2e918bc416a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:39.757440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea821605-6493-49bf-af73-d2e918bc416a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:39.824238 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea821605-6493-49bf-af73-d2e918bc416a tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097768 Oct 31 15:50:39.831963 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2944/6024] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 15:50:39 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 15:50:39.928270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:39.929527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:39.950361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:39.951204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:39.970663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:39.972050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:39.972944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:39.973664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:40.011095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:50:40.222379 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71479d9c-6fc8-4411-a617-23974f7c921c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 204 len: 0 microversion: 2.1 time: 0.298941 Oct 31 15:50:40.226257 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3081/6025] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:50:39 2022] DELETE /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:50:40.235033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:40.235652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:40.244976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:40.245501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:40.249832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:40.250678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:40.251317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:40.253929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:40.574838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:40.588459 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2c84d81-8ab2-4144-bd5f-5c24d1caf65c tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1683 microversion: 2.1 time: 0.357483 Oct 31 15:50:40.590653 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2945/6026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:40 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1683 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:41.627960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:41.634198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:41.657028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:41.657557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:41.663381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:41.664211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:41.664690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:41.665307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:42.209816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:42.219922 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-550815a9-b0d7-40d7-9e04-5207e8995ce8 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1683 microversion: 2.1 time: 0.608905 Oct 31 15:50:42.226257 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3082/6027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:41 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1683 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:43.255825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:43.257801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:43.279713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:43.281273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:43.289908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:43.291056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:43.291795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:43.292626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:43.322153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:43.896053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:43.907261 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1abe131f-bed4-41ab-bd3d-7422faa51bd4 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1683 microversion: 2.1 time: 0.658058 Oct 31 15:50:43.909163 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2946/6028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:43 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1683 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:44.936139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:44.936871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:44.953944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:44.954736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:44.955519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:44.956505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:44.957151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:44.961850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:45.170875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:45.185680 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0c02417-0288-4576-bfb8-f07db964d3e5 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1616 microversion: 2.1 time: 0.254517 Oct 31 15:50:45.197230 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3083/6029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:44 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1616 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:46.216826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:46.217608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:46.234314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.234821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.237279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.238364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.238833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.247799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.383216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b5f0b99b-5923-41d0-83f1-a27a5bc08dcd req-639985c6-f53c-4d09-8c62-7e134044d39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4dfcbe-26a7-4c59-837a-4acc9af2b893", "name": "network-vif-deleted", "tag": "7b04b72b-ab60-4904-ac4a-8a9a333ff436"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:46.439429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b5f0b99b-5923-41d0-83f1-a27a5bc08dcd req-639985c6-f53c-4d09-8c62-7e134044d39a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.440347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b5f0b99b-5923-41d0-83f1-a27a5bc08dcd req-639985c6-f53c-4d09-8c62-7e134044d39a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.440807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b5f0b99b-5923-41d0-83f1-a27a5bc08dcd req-639985c6-f53c-4d09-8c62-7e134044d39a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.472589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5bfcc2112ea47dcb758487de253311f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb201c74554c43f0a526161cf24206f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:46.487234 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-41bc8dbf-fced-437d-8f45-154b9a382095 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 200 len: 1616 microversion: 2.1 time: 0.275401 Oct 31 15:50:46.504475 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b5f0b99b-5923-41d0-83f1-a27a5bc08dcd req-639985c6-f53c-4d09-8c62-7e134044d39a service nova] Creating event network-vif-deleted:7b04b72b-ab60-4904-ac4a-8a9a333ff436 for instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 on n-h2-858384-17 Oct 31 15:50:46.518220 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2947/6030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:46 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 1616 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:46.525575 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b5f0b99b-5923-41d0-83f1-a27a5bc08dcd req-639985c6-f53c-4d09-8c62-7e134044d39a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150569 Oct 31 15:50:46.527020 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3084/6031] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:46.588532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a71671b-7e59-4250-810c-940f6dfb2ae7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:46.592700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a71671b-7e59-4250-810c-940f6dfb2ae7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:46.612424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a71671b-7e59-4250-810c-940f6dfb2ae7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.614055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a71671b-7e59-4250-810c-940f6dfb2ae7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.614672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a71671b-7e59-4250-810c-940f6dfb2ae7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.616047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a71671b-7e59-4250-810c-940f6dfb2ae7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.618129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a71671b-7e59-4250-810c-940f6dfb2ae7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.621115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a71671b-7e59-4250-810c-940f6dfb2ae7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.665200 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a71671b-7e59-4250-810c-940f6dfb2ae7 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.086406 Oct 31 15:50:46.681941 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2948/6032] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Oct 31 15:50:46 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:50:46.801763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:46.802375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:46.820457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.821747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.822418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.827349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:46.829485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:46.830820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:46.924782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:50:47.119251 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a2d2b5f-7dff-448d-968c-1a6c0e3b09ab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 204 len: 0 microversion: 2.20 time: 0.321812 Oct 31 15:50:47.120176 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3085/6033] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:50:46 2022] DELETE /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:50:47.133962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:47.134879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:47.148102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:47.150804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:47.151586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:47.153328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:47.155796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:47.156311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:47.516636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:47.519182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:47.534429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:47.536930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:47.538055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:47.540848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:47.545251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:47.545991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:47.600121 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 HTTP/1.1 Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '0f4dfcbe-26a7-4c59-837a-4acc9af2b893'} Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:47.606165 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc14cb76-8f0f-4fe6-bec0-c076cf7ffc04 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 404 len: 111 microversion: 2.1 time: 0.095793 Oct 31 15:50:47.614297 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3086/6034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:47 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:50:47.621002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fbbf0b7f-a002-4370-b40d-cfbdae565138 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '.version_select at 0x7f16e02ca550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:47.664260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:47.666425 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fbbf0b7f-a002-4370-b40d-cfbdae565138 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480817129" status: 202 len: 0 microversion: 2.1 time: 0.049340 Oct 31 15:50:47.667357 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3087/6035] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 15:50:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480817129 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:50:47.695969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:47.698374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:47.713217 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1eb4d967-0cb8-4906-ad21-4bb00c5b84c1 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1725 microversion: 2.20 time: 0.573126 Oct 31 15:50:47.713217 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2949/6036] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:47 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1725 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:50:48.728277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:48.728899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:48.754030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:48.756621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:48.759188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:48.760011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:48.763387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:48.764008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:49.600685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:49.610468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:49.614722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:49.617891 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61b881af-b145-469e-a4e3-0f7a7aa32e48 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1725 microversion: 2.20 time: 0.893524 Oct 31 15:50:49.621525 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3088/6037] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:48 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1725 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 31 15:50:50.648526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:50.649151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:50.664100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:50.664604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:50.665037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:50.665798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:50.666252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:50.666892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:50.771480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-77f18b4d-cf26-4c5c-b2aa-f985f47e58bb req-8d180c99-a1a2-420c-abbe-80b0c7e1b1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "289733fd-f960-4199-8fa2-216a96d2fc13", "name": "network-vif-deleted", "tag": "872254c0-08bd-4300-af3d-c79a64cc12be"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:50:50.793318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-77f18b4d-cf26-4c5c-b2aa-f985f47e58bb req-8d180c99-a1a2-420c-abbe-80b0c7e1b1c0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:50.794083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-77f18b4d-cf26-4c5c-b2aa-f985f47e58bb req-8d180c99-a1a2-420c-abbe-80b0c7e1b1c0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:50.794709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-77f18b4d-cf26-4c5c-b2aa-f985f47e58bb req-8d180c99-a1a2-420c-abbe-80b0c7e1b1c0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:50.817996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:50.833163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:50.836432 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-77f18b4d-cf26-4c5c-b2aa-f985f47e58bb req-8d180c99-a1a2-420c-abbe-80b0c7e1b1c0 service nova] Creating event network-vif-deleted:872254c0-08bd-4300-af3d-c79a64cc12be for instance 289733fd-f960-4199-8fa2-216a96d2fc13 on n-h2-858384-17 Oct 31 15:50:50.849748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5c07cff9c6ae4abf994127f2f38737cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b3bb1592c2c45c181e470ce3756c812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:50:50.851097 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eae8a015-597c-4b58-9370-6ca1ee7d595f tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 200 len: 1657 microversion: 2.20 time: 0.206409 Oct 31 15:50:50.852031 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2950/6038] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:50 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 1657 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 31 15:50:50.853837 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-77f18b4d-cf26-4c5c-b2aa-f985f47e58bb req-8d180c99-a1a2-420c-abbe-80b0c7e1b1c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087539 Oct 31 15:50:50.854688 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3089/6039] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:50:51.879739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:51.880745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:51.887157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:51.887742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:51.888074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:51.889191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:51.889822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:51.890420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:51.909374 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] HTTP exception thrown: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Request method failure captured: Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 HTTP/1.1 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1U_xBaoaVRcFeyFYKQARuWJSlxdcSn7oBggwpubAuS2hCO9njU-OU1IYhY3n9Q2K-__78VX8wNdvhapCAC1HIdWfBIVa0LttxehOq4R8B3cxNp9LMcB9fZlfo59LwbgvWVUfYPza07Vpnup4ycj50Q2kIC37_h-OFaHVFMVrT3UwM Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b3bb1592c2c45c181e470ce3756c812", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b3bb1592c2c45c181e470ce3756c812"}]}] Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 5c07cff9c6ae4abf994127f2f38737cb Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '289733fd-f960-4199-8fa2-216a96d2fc13'} Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:51.911041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Returning 404 to user: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-916d5fd4-b9b6-44ce-8c3d-0ecf8b73f13e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 404 len: 111 microversion: 2.20 time: 0.036850 Oct 31 15:50:51.916860 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2951/6040] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:51 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:50:51.922545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-154c9c2c-a786-4a29-b524-6eaaf0957e8e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '.version_select at 0x7f16e0d15040>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:51.951872 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-154c9c2c-a786-4a29-b524-6eaaf0957e8e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063272385" status: 204 len: 0 microversion: 2.20 time: 0.033821 Oct 31 15:50:51.956330 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3090/6041] 10.222.0.20 () {60 vars in 1262 bytes} [Mon Oct 31 15:50:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1063272385 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 31 15:50:55.428453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:55.429744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:55.447842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:55.456606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:55.457266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:55.458053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:55.458535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:55.458974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:55.499199 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 HTTP/1.1 Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '0f4dfcbe-26a7-4c59-837a-4acc9af2b893'} Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:55.508605 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-624ab7b8-a17a-4ef7-a323-d7395d04a682 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 404 len: 111 microversion: 2.1 time: 0.086953 Oct 31 15:50:55.512798 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2952/6042] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:50:55 2022] DELETE /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:50:55.526088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:55.527625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 0f4dfcbe-26a7-4c59-837a-4acc9af2b893] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:55.540438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:55.540945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:55.541414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:55.542181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:55.542595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:55.543029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:55.584195 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 HTTP/1.1 Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '0f4dfcbe-26a7-4c59-837a-4acc9af2b893'} Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:55.586162 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.591404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:55.591404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:55.591404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:55.591404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:55.591404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:55.591404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. Oct 31 15:50:55.591404 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:55.593030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 0f4dfcbe-26a7-4c59-837a-4acc9af2b893 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:55.594116 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34d3bfe5-b5c4-43d3-b3b7-36fb524a49de tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893" status: 404 len: 111 microversion: 2.1 time: 0.076477 Oct 31 15:50:55.600387 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3091/6043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:50:55 2022] GET /compute/v2.1/servers/0f4dfcbe-26a7-4c59-837a-4acc9af2b893 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:50:56.379588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:56.380097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:56.393612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.394166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.394618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.395351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.395814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.396248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.430921 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] HTTP exception thrown: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Request method failure captured: Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 HTTP/1.1 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1U_xBaoaVRcFeyFYKQARuWJSlxdcSn7oBggwpubAuS2hCO9njU-OU1IYhY3n9Q2K-__78VX8wNdvhapCAC1HIdWfBIVa0LttxehOq4R8B3cxNp9LMcB9fZlfo59LwbgvWVUfYPza07Vpnup4ycj50Q2kIC37_h-OFaHVFMVrT3UwM Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b3bb1592c2c45c181e470ce3756c812", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b3bb1592c2c45c181e470ce3756c812"}]}] Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 5c07cff9c6ae4abf994127f2f38737cb Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '289733fd-f960-4199-8fa2-216a96d2fc13'} Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:56.437037 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.443041 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.444838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Returning 404 to user: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:56.449439 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2593b225-43f0-4a66-bf5e-f1a462b80184 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 404 len: 111 microversion: 2.20 time: 0.073634 Oct 31 15:50:56.451476 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2953/6044] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:50:56 2022] DELETE /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:50:56.459777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:50:56.460699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 289733fd-f960-4199-8fa2-216a96d2fc13] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:50:56.467809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:50:56.469690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.471161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.471681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.472681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:50:56.473574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:50:56.474473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:50:56.503433 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] HTTP exception thrown: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Request method failure captured: Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 HTTP/1.1 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1U_xBaoaVRcFeyFYKQARuWJSlxdcSn7oBggwpubAuS2hCO9njU-OU1IYhY3n9Q2K-__78VX8wNdvhapCAC1HIdWfBIVa0LttxehOq4R8B3cxNp9LMcB9fZlfo59LwbgvWVUfYPza07Vpnup4ycj50Q2kIC37_h-OFaHVFMVrT3UwM Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b3bb1592c2c45c181e470ce3756c812", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b3bb1592c2c45c181e470ce3756c812"}]}] Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 5c07cff9c6ae4abf994127f2f38737cb Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '289733fd-f960-4199-8fa2-216a96d2fc13'} Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.512734 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:50:56.518157 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.518157 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:50:56.518157 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:50:56.518157 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:50:56.518157 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:50:56.518157 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:50:56.518157 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. Oct 31 15:50:56.518157 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:50:56.519647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Returning 404 to user: Instance 289733fd-f960-4199-8fa2-216a96d2fc13 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:50:56.520769 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0668e766-4b17-483c-a7f8-3dd4c4ffb9c4 tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13" status: 404 len: 111 microversion: 2.20 time: 0.064925 Oct 31 15:50:56.521549 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3092/6045] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:50:56 2022] GET /compute/v2.1/servers/289733fd-f960-4199-8fa2-216a96d2fc13 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:51:01.276453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:01.282185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:01.298848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.299236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.299762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.305599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.306131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.306534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.360303 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c HTTP/1.1 Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '64d06c42-26cb-48da-bcce-c8afad1b023c'} Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:01.362946 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2fbf8c59-121e-4514-93eb-9e69e1bb9a8f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 404 len: 111 microversion: 2.1 time: 0.095086 Oct 31 15:51:01.368314 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2954/6046] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:51:01 2022] DELETE /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:51:01.377438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:01.378836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 64d06c42-26cb-48da-bcce-c8afad1b023c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:01.401641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.404034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.404642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.406549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.413579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.414050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.417117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:01.455619 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c HTTP/1.1 Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '64d06c42-26cb-48da-bcce-c8afad1b023c'} Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:01.458971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.466775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.466775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:01.466775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:01.466775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:01.466775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:01.466775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. Oct 31 15:51:01.466775 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.472080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 64d06c42-26cb-48da-bcce-c8afad1b023c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:01.474520 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5aec0cc6-38a4-4e84-a093-fc2f0e6a03a7 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c" status: 404 len: 111 microversion: 2.1 time: 0.103874 Oct 31 15:51:01.480653 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3093/6047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:01 2022] GET /compute/v2.1/servers/64d06c42-26cb-48da-bcce-c8afad1b023c => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:51:01.484861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:01.489080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:01.502533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.503106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.503562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.507488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.508311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.509062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.539341 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 HTTP/1.1 Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '91348e48-50bd-4039-b86b-fa84f253bfe8'} Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:01.542034 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.547682 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.552136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:01.553724 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5600533-90f4-4d35-b2d1-66980f2ad710 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 404 len: 111 microversion: 2.1 time: 0.072487 Oct 31 15:51:01.555087 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2955/6048] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:51:01 2022] DELETE /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:51:01.584563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:01.585378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 91348e48-50bd-4039-b86b-fa84f253bfe8] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:01.601023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.603432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.604178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.606154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:01.606695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:01.607099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:01.627384 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 HTTP/1.1 Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '91348e48-50bd-4039-b86b-fa84f253bfe8'} Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:01.629191 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 91348e48-50bd-4039-b86b-fa84f253bfe8 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f2f569c-c8e5-4755-a4e1-0e553fd6bf0f tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8" status: 404 len: 111 microversion: 2.1 time: 0.071275 Oct 31 15:51:01.634381 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3094/6049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:01 2022] GET /compute/v2.1/servers/91348e48-50bd-4039-b86b-fa84f253bfe8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:51:03.290759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:03.291339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:03.306496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.317353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.317641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.318390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.318844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.319268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.399008 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] HTTP exception thrown: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Request method failure captured: Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d HTTP/1.1 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1U_xBaoaVRcFeyFYKQARuWJSlxdcSn7oBggwpubAuS2hCO9njU-OU1IYhY3n9Q2K-__78VX8wNdvhapCAC1HIdWfBIVa0LttxehOq4R8B3cxNp9LMcB9fZlfo59LwbgvWVUfYPza07Vpnup4ycj50Q2kIC37_h-OFaHVFMVrT3UwM Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b3bb1592c2c45c181e470ce3756c812", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b3bb1592c2c45c181e470ce3756c812"}]}] Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 5c07cff9c6ae4abf994127f2f38737cb Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9547ba84-a354-46e2-b2a5-4f3d4d71159d'} Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:03.403656 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.408808 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.410334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Returning 404 to user: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:03.416951 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-485f45e0-f3c8-476c-a2d9-02f15ec4bbab tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 404 len: 111 microversion: 2.20 time: 0.128242 Oct 31 15:51:03.419016 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2956/6050] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Oct 31 15:51:03 2022] DELETE /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:51:03.429107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:03.432295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] [instance: 9547ba84-a354-46e2-b2a5-4f3d4d71159d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:03.462823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.479857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.480319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.481083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:03.481588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:03.483464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:03.551608 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] HTTP exception thrown: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Request method failure captured: Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d HTTP/1.1 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1U_xBaoaVRcFeyFYKQARuWJSlxdcSn7oBggwpubAuS2hCO9njU-OU1IYhY3n9Q2K-__78VX8wNdvhapCAC1HIdWfBIVa0LttxehOq4R8B3cxNp9LMcB9fZlfo59LwbgvWVUfYPza07Vpnup4ycj50Q2kIC37_h-OFaHVFMVrT3UwM Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Openstack-Nova-Api-Version: 2.20 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3b3bb1592c2c45c181e470ce3756c812", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3b3bb1592c2c45c181e470ce3756c812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3b3bb1592c2c45c181e470ce3756c812"}]}] Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 3b3bb1592c2c45c181e470ce3756c812 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1388784409 Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 5c07cff9c6ae4abf994127f2f38737cb Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1388784409-project Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '9547ba84-a354-46e2-b2a5-4f3d4d71159d'} Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.556418 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:03.561286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.561286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:03.561286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:03.561286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:03.561286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:03.561286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:03.561286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. Oct 31 15:51:03.561286 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:03.563403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] Returning 404 to user: Instance 9547ba84-a354-46e2-b2a5-4f3d4d71159d could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:03.565783 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-27c6de38-387f-4940-891c-02bab69cb17e tempest-AttachVolumeShelveTestJSON-1388784409 tempest-AttachVolumeShelveTestJSON-1388784409-project] 10.222.0.20 "GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d" status: 404 len: 111 microversion: 2.20 time: 0.141101 Oct 31 15:51:03.570534 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3095/6051] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Oct 31 15:51:03 2022] GET /compute/v2.1/servers/9547ba84-a354-46e2-b2a5-4f3d4d71159d => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 31 15:51:08.536819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:08.537383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:08.544403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=30 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:08.550779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:08.551809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:08.552277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:08.553033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:08.553654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:08.554419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:08.579939 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c HTTP/1.1 Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9993bf49-4859-4a8a-b916-c4883a14059c'} Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:08.581791 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:08.587327 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d04a201b-4f25-4dd7-83e3-504ba2199803 tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 404 len: 111 microversion: 2.1 time: 0.055586 Oct 31 15:51:08.589387 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2957/6052] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:51:08 2022] DELETE /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:51:08.596603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:08.597879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] [instance: 9993bf49-4859-4a8a-b916-c4883a14059c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:51:08.608453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:08.611858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:08.612564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:08.613535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:51:08.623002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:51:08.623762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:51:08.640801 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] HTTP exception thrown: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Request method failure captured: Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c HTTP/1.1 Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-1YZE70KVfryHCOXRStcOJ8KZcCQBVoDcg4javsdjFBudX7DXK24V8RvWrk9Nb3pMeHkcAZBfC5wWr9q2_iIEsxeIHQFTMJLA1kTCQU7v68USjKGepfjpoJxfoqVkS13pXcXcaK-E7iVfHTGY5kFnNr20kP-kR6TAwPoDGsasAHfZc Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_bb201c74554c43f0a526161cf24206f3", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/bb201c74554c43f0a526161cf24206f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/bb201c74554c43f0a526161cf24206f3"}]}] Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: bb201c74554c43f0a526161cf24206f3 Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-164549290 Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: a5bfcc2112ea47dcb758487de253311f Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-AttachVolumeNegativeTest-164549290-project Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '9993bf49-4859-4a8a-b916-c4883a14059c'} Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:08.654732 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.659831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:08.659831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:08.659831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:08.659831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:08.659831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:08.659831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. Oct 31 15:51:08.659831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:08.661873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] Returning 404 to user: Instance 9993bf49-4859-4a8a-b916-c4883a14059c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:08.665330 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1734edb-de9b-40c5-9f30-507298dba4bb tempest-AttachVolumeNegativeTest-164549290 tempest-AttachVolumeNegativeTest-164549290-project] 10.222.0.20 "GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c" status: 404 len: 111 microversion: 2.1 time: 0.071484 Oct 31 15:51:08.668505 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3096/6053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:51:08 2022] GET /compute/v2.1/servers/9993bf49-4859-4a8a-b916-c4883a14059c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:51:12.541644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-151ca6c6-652a-4120-af72-0c1f60bafacd tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Action: 'create', calling method: .version_select at 0x7f16e56c3700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-944203269"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:13.038199 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-151ca6c6-652a-4120-af72-0c1f60bafacd tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.716558 Oct 31 15:51:13.039512 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2958/6054] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Oct 31 15:51:12 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 718 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 31 15:51:13.055332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f880591-3621-46f4-b96a-6a8a018c903b tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e0dc2550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:13.129109 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f880591-3621-46f4-b96a-6a8a018c903b tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 200 len: 344 microversion: 2.1 time: 0.079979 Oct 31 15:51:13.130283 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3097/6055] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:13 2022] GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:14.148745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8586b04e-81c2-495b-9ba6-7aeb5ba5a5cb tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e56c3a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:14.468954 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8586b04e-81c2-495b-9ba6-7aeb5ba5a5cb tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 200 len: 344 microversion: 2.1 time: 0.329962 Oct 31 15:51:14.470194 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2959/6056] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:14 2022] GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 344 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:15.492508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-762be6ae-d9e8-4791-9f53-e1d3c51542a3 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e0c24ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:15.546494 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-762be6ae-d9e8-4791-9f53-e1d3c51542a3 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 200 len: 345 microversion: 2.1 time: 0.063579 Oct 31 15:51:15.547095 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3098/6057] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:15 2022] GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:15.563581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b94b02b5-ccc3-4114-b857-0dd0e15b6b47 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Action: 'create', calling method: .version_select at 0x7f16e55e4160>, body: {"snapshot": {"volume_id": "d8672ba1-98b7-4c3f-a3bb-5196f2e49b61", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1888921771"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:51:15.775868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b94b02b5-ccc3-4114-b857-0dd0e15b6b47 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.218226 Oct 31 15:51:15.776473 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2960/6058] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Oct 31 15:51:15 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:15.788153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9ba32b98-bcb6-438d-8b25-29c8ee2b36d0 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e014e5e0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:15.847225 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9ba32b98-bcb6-438d-8b25-29c8ee2b36d0 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c" status: 200 len: 287 microversion: 2.1 time: 0.062880 Oct 31 15:51:15.848228 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3099/6059] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:51:15 2022] GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:51:15.859512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5cc0b7f6-3044-41f3-b23c-c64f7ebdc487 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e0305280>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:15.905761 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5cc0b7f6-3044-41f3-b23c-c64f7ebdc487 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.050166 Oct 31 15:51:15.906555 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2961/6060] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Oct 31 15:51:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:15.921507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7e5a24f9-9990-4412-9931-2b39eb351949 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e0df3c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:15.954339 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7e5a24f9-9990-4412-9931-2b39eb351949 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c" status: 200 len: 287 microversion: 2.1 time: 0.036152 Oct 31 15:51:15.955080 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3100/6061] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:51:15 2022] GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:16.970759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-304fe206-3bf4-4638-8dbb-d71bfe12250b tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e012a940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:17.038349 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-304fe206-3bf4-4638-8dbb-d71bfe12250b tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c" status: 200 len: 287 microversion: 2.1 time: 0.074622 Oct 31 15:51:17.038931 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2962/6062] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:51:16 2022] GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:18.054747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20e4dd37-7532-466d-8ad1-a338b46bf126 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e0df30d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:18.152656 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-20e4dd37-7532-466d-8ad1-a338b46bf126 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c" status: 200 len: 288 microversion: 2.1 time: 0.104159 Oct 31 15:51:18.154982 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3101/6063] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:51:18 2022] GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c => generated 288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:18.176416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c08f1afd-1124-4cea-8b29-9d27392e7478 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e015fee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:18.314295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c08f1afd-1124-4cea-8b29-9d27392e7478 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c" status: 202 len: 0 microversion: 2.1 time: 0.147512 Oct 31 15:51:18.318194 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2963/6064] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Oct 31 15:51:18 2022] DELETE /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:51:18.324434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c4a5454-f961-45dd-bfe3-78d759f17e94 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e0df3280>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:18.404549 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c4a5454-f961-45dd-bfe3-78d759f17e94 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c" status: 200 len: 287 microversion: 2.1 time: 0.083611 Oct 31 15:51:18.405279 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3102/6065] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:51:18 2022] GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:19.417913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-efea2222-963b-4c24-88a9-293ad1d55032 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e012a550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:19.425430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:19.429347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=43 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:19.483703 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-efea2222-963b-4c24-88a9-293ad1d55032 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c" status: 200 len: 287 microversion: 2.1 time: 0.069514 Oct 31 15:51:19.485332 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2964/6066] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:51:19 2022] GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:20.494974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=9 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:20.495923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=7 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:51:20.501938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aaa87a71-c950-42ba-8ec4-64b7b5274280 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e0147940>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:20.572424 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-aaa87a71-c950-42ba-8ec4-64b7b5274280 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] HTTP exception thrown: Snapshot ae9bf18b-890a-4609-9558-451007c2d85c could not be found. Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aaa87a71-c950-42ba-8ec4-64b7b5274280 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Request method failure captured: Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c HTTP/1.1 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-7w3-q3A8N6jwpHD__ZVX9-ZzIv28FoMP38mhgFIMLdRpPrbux4KMuQUe8N8kMUEV6shhZ0cbcd4jmQ9l1UNuFvFTauACkU8gnvS1YuOfIj3wn0MN6zuCOHdcOzqM52x9m1TqvKQvFW9vwB9LLuYoTYl6h4mgW7svO4x7FH2E0_a0o Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 236f2b0697d040bbbe106f926eac3903 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/236f2b0697d040bbbe106f926eac3903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_236f2b0697d040bbbe106f926eac3903", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/236f2b0697d040bbbe106f926eac3903"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/236f2b0697d040bbbe106f926eac3903"}]}] Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 236f2b0697d040bbbe106f926eac3903 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotsTestJSON-923099971-project Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ffd7d7fea2b8482c8542d07bf16dc000 Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotsTestJSON-923099971-project Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: exception: Snapshot ae9bf18b-890a-4609-9558-451007c2d85c could not be found. Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'ae9bf18b-890a-4609-9558-451007c2d85c'} Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ae9bf18b-890a-4609-9558-451007c2d85c could not be found. (HTTP 404) (Request-ID: req-cc808040-c2dd-4047-8092-1c8a9df5549a) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:51:20.588594 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ae9bf18b-890a-4609-9558-451007c2d85c could not be found. Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ae9bf18b-890a-4609-9558-451007c2d85c could not be found. Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ae9bf18b-890a-4609-9558-451007c2d85c could not be found. Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aaa87a71-c950-42ba-8ec4-64b7b5274280 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Returning 404 to user: Snapshot ae9bf18b-890a-4609-9558-451007c2d85c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:20.594625 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aaa87a71-c950-42ba-8ec4-64b7b5274280 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c" status: 404 len: 111 microversion: 2.1 time: 0.100123 Oct 31 15:51:20.600018 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3103/6067] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Oct 31 15:51:20 2022] GET /compute/v2.1/os-snapshots/ae9bf18b-890a-4609-9558-451007c2d85c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:51:20.603823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03bb1e28-9317-4f65-ab57-197f530c75ee tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e05d6430>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:20.722414 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03bb1e28-9317-4f65-ab57-197f530c75ee tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 202 len: 0 microversion: 2.1 time: 0.122872 Oct 31 15:51:20.726378 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2965/6068] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:51:20 2022] DELETE /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:51:20.732943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eaac56db-ff64-4d9b-b7fe-bf027afee2f4 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e01478b0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:20.807597 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eaac56db-ff64-4d9b-b7fe-bf027afee2f4 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 200 len: 344 microversion: 2.1 time: 0.078598 Oct 31 15:51:20.808650 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3104/6069] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:20 2022] GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:21.824125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc1acd7b-f89d-4670-b392-6372349e5f6b tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e012a940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:21.967495 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc1acd7b-f89d-4670-b392-6372349e5f6b tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 200 len: 344 microversion: 2.1 time: 0.147175 Oct 31 15:51:21.968090 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2966/6070] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:21 2022] GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:22.983519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aedb310a-2185-4cc5-be9a-dce52579197e tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e14cbb80>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:23.463710 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aedb310a-2185-4cc5-be9a-dce52579197e tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 200 len: 344 microversion: 2.1 time: 0.485362 Oct 31 15:51:23.464306 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3105/6071] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:22 2022] GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 344 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:24.479310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73b4fb1c-24ff-42ea-9d22-fd960cbc8de7 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e05a70d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:24.530699 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-73b4fb1c-24ff-42ea-9d22-fd960cbc8de7 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] HTTP exception thrown: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73b4fb1c-24ff-42ea-9d22-fd960cbc8de7 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Request method failure captured: Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 HTTP/1.1 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-7w3-q3A8N6jwpHD__ZVX9-ZzIv28FoMP38mhgFIMLdRpPrbux4KMuQUe8N8kMUEV6shhZ0cbcd4jmQ9l1UNuFvFTauACkU8gnvS1YuOfIj3wn0MN6zuCOHdcOzqM52x9m1TqvKQvFW9vwB9LLuYoTYl6h4mgW7svO4x7FH2E0_a0o Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 236f2b0697d040bbbe106f926eac3903 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/236f2b0697d040bbbe106f926eac3903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_236f2b0697d040bbbe106f926eac3903", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/236f2b0697d040bbbe106f926eac3903"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/236f2b0697d040bbbe106f926eac3903"}]}] Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 236f2b0697d040bbbe106f926eac3903 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-VolumesSnapshotsTestJSON-923099971-project Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ffd7d7fea2b8482c8542d07bf16dc000 Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-VolumesSnapshotsTestJSON-923099971-project Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: exception: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'd8672ba1-98b7-4c3f-a3bb-5196f2e49b61'} Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. (HTTP 404) (Request-ID: req-03984e50-e7de-46fa-a8a0-40de700c4467) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:51:24.532881 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73b4fb1c-24ff-42ea-9d22-fd960cbc8de7 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Returning 404 to user: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:24.539261 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73b4fb1c-24ff-42ea-9d22-fd960cbc8de7 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 404 len: 109 microversion: 2.1 time: 0.059141 Oct 31 15:51:24.545998 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2967/6072] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:24 2022] GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:51:24.549286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4dccddda-2a29-48a9-9855-4367a0777261 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e0d853a0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:24.622414 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4dccddda-2a29-48a9-9855-4367a0777261 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] HTTP exception thrown: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4dccddda-2a29-48a9-9855-4367a0777261 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Request method failure captured: Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 HTTP/1.1 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-7w3-q3A8N6jwpHD__ZVX9-ZzIv28FoMP38mhgFIMLdRpPrbux4KMuQUe8N8kMUEV6shhZ0cbcd4jmQ9l1UNuFvFTauACkU8gnvS1YuOfIj3wn0MN6zuCOHdcOzqM52x9m1TqvKQvFW9vwB9LLuYoTYl6h4mgW7svO4x7FH2E0_a0o Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 236f2b0697d040bbbe106f926eac3903 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/236f2b0697d040bbbe106f926eac3903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_236f2b0697d040bbbe106f926eac3903", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/236f2b0697d040bbbe106f926eac3903"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/236f2b0697d040bbbe106f926eac3903"}]}] Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 236f2b0697d040bbbe106f926eac3903 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotsTestJSON-923099971-project Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: ffd7d7fea2b8482c8542d07bf16dc000 Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotsTestJSON-923099971-project Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: method: Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: exception: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'd8672ba1-98b7-4c3f-a3bb-5196f2e49b61'} Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. (HTTP 404) (Request-ID: req-c6ec3ba1-d41d-4b96-bb4d-3ee869546c8a) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:51:24.625694 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.630152 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.632793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4dccddda-2a29-48a9-9855-4367a0777261 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Returning 404 to user: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:24.633497 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4dccddda-2a29-48a9-9855-4367a0777261 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 404 len: 109 microversion: 2.1 time: 0.087183 Oct 31 15:51:24.635051 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3106/6073] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 15:51:24 2022] DELETE /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:51:24.643029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-72db3c92-8bbb-481a-b9ac-7b0852199553 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Calling method '.version_select at 0x7f16e0305940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:24.701343 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-72db3c92-8bbb-481a-b9ac-7b0852199553 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] HTTP exception thrown: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-72db3c92-8bbb-481a-b9ac-7b0852199553 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Request method failure captured: Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 HTTP/1.1 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-7w3-q3A8N6jwpHD__ZVX9-ZzIv28FoMP38mhgFIMLdRpPrbux4KMuQUe8N8kMUEV6shhZ0cbcd4jmQ9l1UNuFvFTauACkU8gnvS1YuOfIj3wn0MN6zuCOHdcOzqM52x9m1TqvKQvFW9vwB9LLuYoTYl6h4mgW7svO4x7FH2E0_a0o Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 236f2b0697d040bbbe106f926eac3903 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/236f2b0697d040bbbe106f926eac3903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_236f2b0697d040bbbe106f926eac3903", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/236f2b0697d040bbbe106f926eac3903"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/236f2b0697d040bbbe106f926eac3903"}]}] Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 236f2b0697d040bbbe106f926eac3903 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-923099971 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-VolumesSnapshotsTestJSON-923099971-project Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: ffd7d7fea2b8482c8542d07bf16dc000 Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-VolumesSnapshotsTestJSON-923099971-project Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: method: Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: exception: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'd8672ba1-98b7-4c3f-a3bb-5196f2e49b61'} Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. (HTTP 404) (Request-ID: req-e5fd818c-6d04-4100-8c11-e92cbb166ed9) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 31 15:51:24.703353 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-72db3c92-8bbb-481a-b9ac-7b0852199553 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] Returning 404 to user: Volume d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:51:24.707973 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-72db3c92-8bbb-481a-b9ac-7b0852199553 tempest-VolumesSnapshotsTestJSON-923099971 tempest-VolumesSnapshotsTestJSON-923099971-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61" status: 404 len: 109 microversion: 2.1 time: 0.065953 Oct 31 15:51:24.715249 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2968/6074] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:24 2022] GET /compute/v2.1/os-volumes/d8672ba1-98b7-4c3f-a3bb-5196f2e49b61 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:51:30.400779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-28f8a1b1-1c9e-4686-b568-b1e66afeb7f3 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e1e66820>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:30.519462 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-28f8a1b1-1c9e-4686-b568-b1e66afeb7f3 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d008a734-b5e9-4404-84e6-9e70dbe3b355" status: 200 len: 351 microversion: 2.1 time: 0.124410 Oct 31 15:51:30.520039 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3107/6075] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:30 2022] GET /compute/v2.1/os-volumes/d008a734-b5e9-4404-84e6-9e70dbe3b355 => generated 351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:33.294153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bce5c96c-b337-427f-af14-7e46580d2f9f tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e05d6ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:33.370121 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bce5c96c-b337-427f-af14-7e46580d2f9f tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2c8eb891-b8aa-4a32-ae23-a8173c293be5" status: 200 len: 351 microversion: 2.1 time: 0.080551 Oct 31 15:51:33.373642 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2969/6076] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:33 2022] GET /compute/v2.1/os-volumes/2c8eb891-b8aa-4a32-ae23-a8173c293be5 => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:36.226304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80021920-1c58-4110-8e5f-719965054086 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e02ca670>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:36.321069 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80021920-1c58-4110-8e5f-719965054086 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/a75062a1-5553-4ee1-b9d2-fb6ac26bdd1e" status: 200 len: 351 microversion: 2.1 time: 0.104520 Oct 31 15:51:36.322198 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3108/6077] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Oct 31 15:51:36 2022] GET /compute/v2.1/os-volumes/a75062a1-5553-4ee1-b9d2-fb6ac26bdd1e => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:36.336866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2b2fb87-7b3c-4fc8-a12f-7e91c2da5502 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e5741a60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:36.463982 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2b2fb87-7b3c-4fc8-a12f-7e91c2da5502 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.131843 Oct 31 15:51:36.465191 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2970/6078] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 31 15:51:36 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:36.481663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-514eaf0c-006d-441c-91c0-132a64a99f05 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e0dc23a0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:36.637762 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-514eaf0c-006d-441c-91c0-132a64a99f05 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.161336 Oct 31 15:51:36.638359 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3109/6079] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Oct 31 15:51:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:36.653909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a9f8fdb9-ff42-43c7-8090-2e093ecef4aa tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e574a550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:36.785299 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a9f8fdb9-ff42-43c7-8090-2e093ecef4aa tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.136181 Oct 31 15:51:36.794954 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2971/6080] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Oct 31 15:51:36 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:36.802193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53323e9a-5496-43be-a2fd-7d1f97fae9f4 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e06e61f0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:37.030324 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53323e9a-5496-43be-a2fd-7d1f97fae9f4 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.234004 Oct 31 15:51:37.031593 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3110/6081] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Oct 31 15:51:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:37.045616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a07b8564-132c-4191-a310-655e0060dfa5 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e00e8ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:37.216335 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a07b8564-132c-4191-a310-655e0060dfa5 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.174621 Oct 31 15:51:37.217400 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2972/6082] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Oct 31 15:51:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:37.231760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-96d791ca-4aec-4ca9-8345-1c024de1b010 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e0d1b9d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:37.362410 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-96d791ca-4aec-4ca9-8345-1c024de1b010 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.134805 Oct 31 15:51:37.363154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3111/6083] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:51:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:51:37.392113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce552286-56e4-4368-82d1-29e5edf9c8f7 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e5696c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:37.611659 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce552286-56e4-4368-82d1-29e5edf9c8f7 tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.236659 Oct 31 15:51:37.612816 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2973/6084] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Oct 31 15:51:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:51:37.627359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bda59a69-e523-4b38-b596-d3b344112e3d tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] Calling method '.version_select at 0x7f16e0d15dc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:51:37.863460 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bda59a69-e523-4b38-b596-d3b344112e3d tempest-VolumesTestJSON-917061158 tempest-VolumesTestJSON-917061158-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.240091 Oct 31 15:51:37.864188 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3112/6085] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:51:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:10.125030 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:53:10.125915 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 15:53:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 31 15:53:10.128176 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:53:10.128280 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 15:53:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 31 15:53:10.136338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75f240d3-3bcd-495c-8406-3d28ec920611 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Action: 'create', calling method: .version_select at 0x7f16e5642b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-283358670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn1s7dW7rVJa30MACkZZn+ByI93dJPBbhza81H0JqiptWWeGD5VIgLoriZ35Zlqxm4I4JeD78tgFd7+JrtENIkPfuOzOr41Lm3cMHcj0sRvcfF7qSf0y5VS6TGWUGEnmA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:53:10.180037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-75f240d3-3bcd-495c-8406-3d28ec920611 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for project 773d57c947194cebabe8ac26a5c7c521. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:53:10.189996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-75f240d3-3bcd-495c-8406-3d28ec920611 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for user 6b5e818de5bf4b349acbf9c7bd81c6f3 and project 773d57c947194cebabe8ac26a5c7c521. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:53:10.227298 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75f240d3-3bcd-495c-8406-3d28ec920611 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.108799 Oct 31 15:53:10.228680 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2974/6086] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:53:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:53:11.880146 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:53:11.881625 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 15:53:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 31 15:53:11.893336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-11637651", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "14719781-ded2-4d81-a0af-020ced8b867d"}], "key_name": "tempest-TestNetworkBasicOps-283358670", "security_groups": [{"name": "tempest-secgroup-smoke-1160325583"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:53:12.107884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] validate_networks() for [('14719781-ded2-4d81-a0af-020ced8b867d', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:53:13.045085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:53:13.045625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:53:13.046012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:53:13.046422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:53:13.046834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:53:13.065358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:13.065896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:13.066323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:13.067059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:13.067640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:13.068062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:13.090924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for project 773d57c947194cebabe8ac26a5c7c521. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:53:13.098540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for user 6b5e818de5bf4b349acbf9c7bd81c6f3 and project 773d57c947194cebabe8ac26a5c7c521. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:53:13.131273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:53:13.135746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:53:13.230888 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec8f3e9f-1a28-40e3-9bb8-1427df1da2aa tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.355178 Oct 31 15:53:13.232226 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3113/6087] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:53:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:53:13.249347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3acc9b1f-3baf-4d32-b132-83bab4a40fd6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:13.251718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3acc9b1f-3baf-4d32-b132-83bab4a40fd6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:13.360629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3acc9b1f-3baf-4d32-b132-83bab4a40fd6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:13.370444 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3acc9b1f-3baf-4d32-b132-83bab4a40fd6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1246 microversion: 2.1 time: 0.130447 Oct 31 15:53:13.375026 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2975/6088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:13 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1246 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:14.402169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:14.402793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:14.416902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:14.417951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:14.418400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:14.419308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:14.419599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:14.420102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:14.504731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:14.514784 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5a5d0ac-d506-4db6-8867-7b7286145b5e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1298 microversion: 2.1 time: 0.117332 Oct 31 15:53:14.515640 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3114/6089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:14 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:15.539581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:15.541734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:15.550706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:15.552023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:15.552689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:15.553624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:15.554280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:15.554954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:15.640281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:15.651926 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b1fe8d9-0109-41cc-b627-89db49eb0a6e tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1304 microversion: 2.1 time: 0.116151 Oct 31 15:53:15.653170 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2976/6090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:15 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:16.682778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:16.684997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:16.698700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:16.699484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:16.700122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:16.701174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:16.702355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:16.702922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:16.965463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:16.979625 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5dd9171-f15f-4aae-8114-47796f8a337a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1372 microversion: 2.1 time: 0.306405 Oct 31 15:53:16.981368 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3115/6091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:16 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1372 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:17.011431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-913ba863-e282-476b-8e26-2b8641fa7aad req-0646c48f-fe03-4f20-8585-3f252f223583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3519be36-35e5-45a0-ad67-6022a2f2ca21", "tag": "0454a7db-6760-4ce2-a6f7-1927b9156d02"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:53:17.058533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-913ba863-e282-476b-8e26-2b8641fa7aad req-0646c48f-fe03-4f20-8585-3f252f223583 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:17.059313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-913ba863-e282-476b-8e26-2b8641fa7aad req-0646c48f-fe03-4f20-8585-3f252f223583 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:17.060951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-913ba863-e282-476b-8e26-2b8641fa7aad req-0646c48f-fe03-4f20-8585-3f252f223583 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:17.077487 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-913ba863-e282-476b-8e26-2b8641fa7aad req-0646c48f-fe03-4f20-8585-3f252f223583 service nova] Creating event network-changed:0454a7db-6760-4ce2-a6f7-1927b9156d02 for instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 on n-h2-858384-17 Oct 31 15:53:17.085640 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-913ba863-e282-476b-8e26-2b8641fa7aad req-0646c48f-fe03-4f20-8585-3f252f223583 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079347 Oct 31 15:53:17.086544 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2977/6092] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:53:18.004575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:18.005704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:18.013697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:18.014192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:18.014792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:18.015598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:18.016056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:18.016479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:18.163688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:18.172894 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3df1a9d9-78d7-48c3-8d80-d0acd3e00651 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1372 microversion: 2.1 time: 0.172643 Oct 31 15:53:18.173575 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3116/6093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:17 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:19.197978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:19.198705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:19.224732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:19.227131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:19.229832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:19.241254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:19.243610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:19.244732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:19.429907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:19.442898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-333bbece-9d27-4824-86a8-9acb2265153d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1372 microversion: 2.1 time: 0.249683 Oct 31 15:53:19.443806 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2978/6094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:19 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:20.467292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:20.468939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:20.476467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:20.477286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:20.477914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:20.479162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:20.479760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:20.480387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:20.662131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:20.672289 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc6693d1-ff68-4d62-81a2-2b49ca4cbb14 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1372 microversion: 2.1 time: 0.209503 Oct 31 15:53:20.672928 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3117/6095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:20 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:21.696187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:21.696822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:21.703556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:21.704340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:21.704785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:21.705560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:21.706030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:21.706461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:21.868213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:21.877336 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c8c281a-b5aa-4a6e-a52e-592857b8f54c tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1372 microversion: 2.1 time: 0.185146 Oct 31 15:53:21.877935 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2979/6096] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:21 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:22.905430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:22.906378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:22.924740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:22.926976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:22.928355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:22.930331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:22.934173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:22.934904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:23.077685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:23.097897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:23.107779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b627af72-bfd6-4a70-a0c0-a1d27fdd7597 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1372 microversion: 2.1 time: 0.209297 Oct 31 15:53:23.109161 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3118/6097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:22 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:53:24.131836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:24.132487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:24.135989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:24.141806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:24.142302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:24.142777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:24.143485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:24.143948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:24.144380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:24.289636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:24.297660 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-847c44c8-d85d-472b-96b2-2bf22f58da79 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1372 microversion: 2.1 time: 0.169703 Oct 31 15:53:24.309210 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2980/6098] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:24 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:24.396650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:24.542403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b82a8115-7a51-4f36-8617-503357e16c09 req-4af1f59e-9e5b-45f1-9d3f-5d85d8ae04c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3519be36-35e5-45a0-ad67-6022a2f2ca21", "name": "network-vif-plugged", "status": "completed", "tag": "0454a7db-6760-4ce2-a6f7-1927b9156d02"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:53:24.552537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b82a8115-7a51-4f36-8617-503357e16c09 req-4af1f59e-9e5b-45f1-9d3f-5d85d8ae04c4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:24.553046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b82a8115-7a51-4f36-8617-503357e16c09 req-4af1f59e-9e5b-45f1-9d3f-5d85d8ae04c4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:24.553509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b82a8115-7a51-4f36-8617-503357e16c09 req-4af1f59e-9e5b-45f1-9d3f-5d85d8ae04c4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:24.565847 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b82a8115-7a51-4f36-8617-503357e16c09 req-4af1f59e-9e5b-45f1-9d3f-5d85d8ae04c4 service nova] Creating event network-vif-plugged:0454a7db-6760-4ce2-a6f7-1927b9156d02 for instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 on n-h2-858384-17 Oct 31 15:53:24.571017 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b82a8115-7a51-4f36-8617-503357e16c09 req-4af1f59e-9e5b-45f1-9d3f-5d85d8ae04c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178720 Oct 31 15:53:24.571624 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3119/6099] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:53:25.323181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:25.323918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:25.331365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:25.332155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:25.332602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:25.333344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:25.333806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:25.334383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:25.498946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:25.509691 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eac3d3a9-c8a9-45e4-9a1c-9ce812e905a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1372 microversion: 2.1 time: 0.190973 Oct 31 15:53:25.510783 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2981/6100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:25 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:26.535444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:26.536143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:26.542661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:26.543153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:26.543588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:26.544285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:26.544743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:26.545266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:26.697684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:26.706682 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f3489a0-bdf5-4e27-88c5-5367f408c1ba tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1544 microversion: 2.1 time: 0.176308 Oct 31 15:53:26.707466 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3120/6101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:26 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1544 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:26.731003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:26.732242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:26.739294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:26.739774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:26.740209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:26.741332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:26.741963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:26.742533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:26.885983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:26.893900 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5151e4f2-c878-4fd2-960b-e641a6417e91 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1544 microversion: 2.1 time: 0.167797 Oct 31 15:53:26.894744 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2982/6102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:26 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1544 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:29.124365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c670e815-e2fe-47c8-bec6-8e236f0a2998 req-03a2153f-f99c-475e-bbc5-694902939b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3519be36-35e5-45a0-ad67-6022a2f2ca21", "tag": "0454a7db-6760-4ce2-a6f7-1927b9156d02"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:53:29.136242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c670e815-e2fe-47c8-bec6-8e236f0a2998 req-03a2153f-f99c-475e-bbc5-694902939b0c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:29.136732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c670e815-e2fe-47c8-bec6-8e236f0a2998 req-03a2153f-f99c-475e-bbc5-694902939b0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:29.137192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c670e815-e2fe-47c8-bec6-8e236f0a2998 req-03a2153f-f99c-475e-bbc5-694902939b0c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:29.149405 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c670e815-e2fe-47c8-bec6-8e236f0a2998 req-03a2153f-f99c-475e-bbc5-694902939b0c service nova] Creating event network-changed:0454a7db-6760-4ce2-a6f7-1927b9156d02 for instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 on n-h2-858384-17 Oct 31 15:53:29.155865 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c670e815-e2fe-47c8-bec6-8e236f0a2998 req-03a2153f-f99c-475e-bbc5-694902939b0c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035117 Oct 31 15:53:29.159688 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3121/6103] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:53:51.492165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:51.494810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=38 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:51.653283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-985224949", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "d9968683-4dd6-4c1c-8f4e-1d8ac7023b6b"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:53:51.681794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:51.682453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=42 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:53:51.687020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3aa72667-9524-436f-b0fd-2cbf8c294c27 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:53:51.689670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3aa72667-9524-436f-b0fd-2cbf8c294c27 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:51.696902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aa72667-9524-436f-b0fd-2cbf8c294c27 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:51.697669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aa72667-9524-436f-b0fd-2cbf8c294c27 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:51.698281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aa72667-9524-436f-b0fd-2cbf8c294c27 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:51.699164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aa72667-9524-436f-b0fd-2cbf8c294c27 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:51.699781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aa72667-9524-436f-b0fd-2cbf8c294c27 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:51.700377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3aa72667-9524-436f-b0fd-2cbf8c294c27 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:51.721271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] validate_networks() for [('d9968683-4dd6-4c1c-8f4e-1d8ac7023b6b', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:53:51.776331 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3aa72667-9524-436f-b0fd-2cbf8c294c27 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "POST /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21/action" status: 200 len: 24562 microversion: 2.1 time: 0.097072 Oct 31 15:53:51.777713 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3122/6104] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:53:51 2022] POST /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21/action => generated 24562 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:53:52.157466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:53:52.158707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:53:52.159806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:53:52.161116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:53:52.161879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:53:52.172407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:52.173105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:52.173566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:52.174479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:52.175134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:52.175546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:52.196935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Getting quotas for project 8063f5e88d7544cebc3a7a22194e327a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:53:52.203186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Getting quotas for user 083bc170017d4baf858268212c366aac and project 8063f5e88d7544cebc3a7a22194e327a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:53:52.219214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:53:52.221806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:53:52.278446 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bea1bb02-5ac9-41ee-b438-9377d20694b3 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791138 Oct 31 15:53:52.279831 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2983/6105] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:53:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:53:52.293080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69c54428-fe2e-493c-8270-8376cfe0ea4e tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:52.293846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69c54428-fe2e-493c-8270-8376cfe0ea4e tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:52.427067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-69c54428-fe2e-493c-8270-8376cfe0ea4e tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:52.446513 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69c54428-fe2e-493c-8270-8376cfe0ea4e tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1213 microversion: 2.1 time: 0.159214 Oct 31 15:53:52.461151 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3123/6106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:52 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:53.481638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:53.482578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:53.496677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:53.501704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:53.502494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:53.503631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:53.504181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:53.504691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:53.678443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:53.689690 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2677fb64-b8f9-4700-8ec5-777d4fc39b23 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1273 microversion: 2.1 time: 0.219347 Oct 31 15:53:53.697825 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2984/6107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:53 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:54.715772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:54.716390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:54.723814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:54.724473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:54.725080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:54.726112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:54.727381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:54.727973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:55.074968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:55.083322 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4649ef98-32d8-418f-8d08-8541f92dacfe tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1313 microversion: 2.1 time: 0.373040 Oct 31 15:53:55.083935 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3124/6108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:54 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:55.494377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3df1cf92-c5ca-48ee-a7ba-2ef4645602a8 req-700e1c17-4915-416e-860b-4a504ead474c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29904ff6-92e4-479f-a7dc-a22cc953652c", "tag": "c3d59e6f-3b9e-45e5-b6f5-a9356a47b608"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:53:55.532340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3df1cf92-c5ca-48ee-a7ba-2ef4645602a8 req-700e1c17-4915-416e-860b-4a504ead474c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:55.534124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3df1cf92-c5ca-48ee-a7ba-2ef4645602a8 req-700e1c17-4915-416e-860b-4a504ead474c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:55.534795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3df1cf92-c5ca-48ee-a7ba-2ef4645602a8 req-700e1c17-4915-416e-860b-4a504ead474c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:55.552136 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3df1cf92-c5ca-48ee-a7ba-2ef4645602a8 req-700e1c17-4915-416e-860b-4a504ead474c service nova] Creating event network-changed:c3d59e6f-3b9e-45e5-b6f5-a9356a47b608 for instance 29904ff6-92e4-479f-a7dc-a22cc953652c on n-h1-858384-17 Oct 31 15:53:55.560929 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3df1cf92-c5ca-48ee-a7ba-2ef4645602a8 req-700e1c17-4915-416e-860b-4a504ead474c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073515 Oct 31 15:53:55.564800 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2985/6109] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:53:56.107580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:56.108745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:56.117291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:56.118898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:56.119553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:56.120497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:56.121312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:56.123118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:56.317294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:56.327101 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3dbae93b-1a9e-4fd9-912c-8d2998dfebf0 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1313 microversion: 2.1 time: 0.223101 Oct 31 15:53:56.331936 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3125/6110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:56 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:57.355048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:57.356290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:57.365964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:57.366813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:57.367731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:57.368812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:57.370538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:57.371234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:57.634652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:57.644521 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-28cd9bd6-dccf-4e40-9427-db2e12798cac tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1313 microversion: 2.1 time: 0.295628 Oct 31 15:53:57.653745 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2986/6111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:57 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:58.672127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:58.673067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:58.680873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:58.681569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:58.682082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:58.682870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:58.683402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:58.683902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:58.887475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:53:58.899425 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ba773fcf-ddb5-4de3-a58e-6f04b0539a67 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1313 microversion: 2.1 time: 0.231043 Oct 31 15:53:58.901145 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3126/6112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:58 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:53:59.924721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:53:59.925585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:53:59.935684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:59.936277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:59.936974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:53:59.938010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:53:59.938554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:53:59.939078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:00.136345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:00.165237 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e35d67f-a72a-4d1e-89dc-4aaedf6360cb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1313 microversion: 2.1 time: 0.243551 Oct 31 15:54:00.167346 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2987/6113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:53:59 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:00.185542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ac20c128-8f0c-4df8-b4cb-3a823e9d9100 req-61a78cdc-8489-4d57-aea0-fe90ccc50a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29904ff6-92e4-479f-a7dc-a22cc953652c", "name": "network-vif-plugged", "status": "completed", "tag": "c3d59e6f-3b9e-45e5-b6f5-a9356a47b608"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:00.215763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ac20c128-8f0c-4df8-b4cb-3a823e9d9100 req-61a78cdc-8489-4d57-aea0-fe90ccc50a95 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:00.216546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ac20c128-8f0c-4df8-b4cb-3a823e9d9100 req-61a78cdc-8489-4d57-aea0-fe90ccc50a95 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:00.217241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ac20c128-8f0c-4df8-b4cb-3a823e9d9100 req-61a78cdc-8489-4d57-aea0-fe90ccc50a95 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:00.240216 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ac20c128-8f0c-4df8-b4cb-3a823e9d9100 req-61a78cdc-8489-4d57-aea0-fe90ccc50a95 service nova] Creating event network-vif-plugged:c3d59e6f-3b9e-45e5-b6f5-a9356a47b608 for instance 29904ff6-92e4-479f-a7dc-a22cc953652c on n-h1-858384-17 Oct 31 15:54:00.246559 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ac20c128-8f0c-4df8-b4cb-3a823e9d9100 req-61a78cdc-8489-4d57-aea0-fe90ccc50a95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067644 Oct 31 15:54:00.247399 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3127/6114] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:54:01.194264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:01.195516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:01.207735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:01.208500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:01.208963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:01.209714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:01.210186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:01.210700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:01.430868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:01.442829 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8d4f4c2-d3da-4c37-b989-70a1ebb0f302 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1313 microversion: 2.1 time: 0.251357 Oct 31 15:54:01.443681 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2988/6115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:01 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:02.464797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:02.469143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:02.469845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:02.476973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:02.477493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:02.477943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:02.479118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:02.479118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:02.479506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:02.686353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:02.696832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f62aad9-74a7-404e-aecb-f874e408383b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1495 microversion: 2.1 time: 0.233831 Oct 31 15:54:02.697458 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3128/6116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:02 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1495 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:05.247045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:05.248568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:05.251852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:05.253368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:05.264204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:05.264715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:05.265212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:05.265933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:05.266393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:05.266822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:05.308283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:54:05.408026 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-74934bc7-5733-4406-9265-2bc9e99c7d8b tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "DELETE /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 204 len: 0 microversion: 2.1 time: 0.163585 Oct 31 15:54:05.413552 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2989/6117] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:54:05 2022] DELETE /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:54:05.422041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:05.423754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:05.434815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:05.435321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:05.435764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:05.437055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:05.440065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:05.441150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:05.694381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:05.707059 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0dfeacff-98db-4fc9-8952-072a09b8ad3f tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1501 microversion: 2.1 time: 0.291550 Oct 31 15:54:05.708307 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3129/6118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:05 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:06.734668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:06.736200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:06.743574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:06.744296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:06.744937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:06.745683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:06.746308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:06.746891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:07.041337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:07.056407 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b5c5a5b-618d-4548-9137-6f8be6ecbe98 tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1501 microversion: 2.1 time: 0.326183 Oct 31 15:54:07.058313 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2990/6119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:06 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1501 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:07.135056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95b747f4-f5d2-4843-bfc8-8bc24619199b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Action: 'create', calling method: .version_select at 0x7f16e574e310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1067374090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbrbpN+eJm3iNXLdt0m5Te8JIk+/S1mZHtWSU/JYg/XFQFHLDliM05LMHlZ45cNdmX7L/s9qPEondR4U9oNboBMqVTFmzE9hvSSBbqTH6eyMw5+w12T7sTx8SUYrwGTfA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:07.156103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-95b747f4-f5d2-4843-bfc8-8bc24619199b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for project 773d57c947194cebabe8ac26a5c7c521. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:54:07.164229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-95b747f4-f5d2-4843-bfc8-8bc24619199b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for user 6b5e818de5bf4b349acbf9c7bd81c6f3 and project 773d57c947194cebabe8ac26a5c7c521. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:54:07.206184 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95b747f4-f5d2-4843-bfc8-8bc24619199b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.075739 Oct 31 15:54:07.214856 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3130/6120] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:54:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:54:07.873531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-47d72f5c-d83e-4f6f-994d-98f824b80ad8 req-d245babf-99ec-46fc-bb90-91af3b6ca823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29904ff6-92e4-479f-a7dc-a22cc953652c", "name": "network-vif-deleted", "tag": "c3d59e6f-3b9e-45e5-b6f5-a9356a47b608"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:07.889587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-47d72f5c-d83e-4f6f-994d-98f824b80ad8 req-d245babf-99ec-46fc-bb90-91af3b6ca823 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:07.890346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-47d72f5c-d83e-4f6f-994d-98f824b80ad8 req-d245babf-99ec-46fc-bb90-91af3b6ca823 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:07.890932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-47d72f5c-d83e-4f6f-994d-98f824b80ad8 req-d245babf-99ec-46fc-bb90-91af3b6ca823 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:07.904492 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-47d72f5c-d83e-4f6f-994d-98f824b80ad8 req-d245babf-99ec-46fc-bb90-91af3b6ca823 service nova] Creating event network-vif-deleted:c3d59e6f-3b9e-45e5-b6f5-a9356a47b608 for instance 29904ff6-92e4-479f-a7dc-a22cc953652c on n-h1-858384-17 Oct 31 15:54:07.912645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-47d72f5c-d83e-4f6f-994d-98f824b80ad8 req-d245babf-99ec-46fc-bb90-91af3b6ca823 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145761 Oct 31 15:54:07.914585 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2991/6121] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:54:08.082836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:08.083457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:08.092642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:08.093174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:08.098362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:08.099137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:08.101703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:08.103546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:08.155743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:08.158340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:08.159223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:08.159931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lazy-loading 'fault' on Instance uuid 29904ff6-92e4-479f-a7dc-a22cc953652c {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:54:08.617953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '083bc170017d4baf858268212c366aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8063f5e88d7544cebc3a7a22194e327a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:08.635050 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48213598-9135-4cf0-924a-04ccf1c3a6eb tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 200 len: 1303 microversion: 2.1 time: 0.555740 Oct 31 15:54:08.637366 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3131/6122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:08 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 1303 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:09.019926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1423184233", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "f59fedbd-ab34-4006-8f8c-a50bd9031787"}], "key_name": "tempest-TestNetworkBasicOps-1067374090", "security_groups": [{"name": "tempest-secgroup-smoke-1119675593"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:09.203097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] validate_networks() for [('f59fedbd-ab34-4006-8f8c-a50bd9031787', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:54:09.661148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:09.661783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] [instance: 29904ff6-92e4-479f-a7dc-a22cc953652c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:09.676719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:09.677256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:09.677794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:09.678648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:09.680328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:09.681075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:09.698685 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] HTTP exception thrown: Instance 29904ff6-92e4-479f-a7dc-a22cc953652c could not be found. Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Request method failure captured: Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c HTTP/1.1 Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX--Ni12ZsO78zDRf9ZLnY9bqr2-E9bK2_2v1Sdx7VHWKueGJgyuSR-gwwOz5rkVhy_G61mv-JcN6zJ2bpSbIV7cug8J2iiP8uuRDTdovqgtS0SR0tO6PcJTvZkp1MAYsonAgTPUSgkmlbt6jzTEyHV1hl2SxqMyl-cjFvCzA1tU51Yw Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 8063f5e88d7544cebc3a7a22194e327a Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesActionsTest-1014023437 Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8063f5e88d7544cebc3a7a22194e327a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8063f5e88d7544cebc3a7a22194e327a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8063f5e88d7544cebc3a7a22194e327a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8063f5e88d7544cebc3a7a22194e327a"}]}] Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesActionsTest-1014023437 Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 8063f5e88d7544cebc3a7a22194e327a Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesActionsTest-1014023437 Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesActionsTest-1014023437-project Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 083bc170017d4baf858268212c366aac Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesActionsTest-1014023437-project Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 29904ff6-92e4-479f-a7dc-a22cc953652c could not be found. Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '29904ff6-92e4-479f-a7dc-a22cc953652c'} Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29904ff6-92e4-479f-a7dc-a22cc953652c could not be found. Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29904ff6-92e4-479f-a7dc-a22cc953652c could not be found. Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:54:09.701678 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:09.705867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:54:09.705867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:54:09.705867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:54:09.705867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:54:09.705867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:54:09.705867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29904ff6-92e4-479f-a7dc-a22cc953652c could not be found. Oct 31 15:54:09.705867 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:09.705867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] Returning 404 to user: Instance 29904ff6-92e4-479f-a7dc-a22cc953652c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:54:09.705867 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bfc61a8e-cf5c-4233-ba3b-a203e9e4328d tempest-VolumesActionsTest-1014023437 tempest-VolumesActionsTest-1014023437-project] 10.222.0.20 "GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c" status: 404 len: 111 microversion: 2.1 time: 0.046211 Oct 31 15:54:09.707426 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3132/6123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:09 2022] GET /compute/v2.1/servers/29904ff6-92e4-479f-a7dc-a22cc953652c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:54:09.996626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:54:09.997455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:54:09.998115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:54:09.998744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:54:09.999375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:54:10.021358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:10.021891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:10.022283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:10.023984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:10.024446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:10.024879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:10.052341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for project 773d57c947194cebabe8ac26a5c7c521. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:54:10.059371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for user 6b5e818de5bf4b349acbf9c7bd81c6f3 and project 773d57c947194cebabe8ac26a5c7c521. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:54:10.074963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:54:10.078482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:54:10.160961 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6576421a-141c-4d70-b40d-0836a4881898 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.145719 Oct 31 15:54:10.173862 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2992/6124] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:54:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:54:10.188547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-022e37ab-4bdc-4a80-a1c7-e9918cdd0af3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:10.189181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-022e37ab-4bdc-4a80-a1c7-e9918cdd0af3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:10.333460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-022e37ab-4bdc-4a80-a1c7-e9918cdd0af3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:10.343306 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-022e37ab-4bdc-4a80-a1c7-e9918cdd0af3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1249 microversion: 2.1 time: 0.160372 Oct 31 15:54:10.369241 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3133/6125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:10 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1249 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:11.372403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:11.372990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:11.389018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:11.389544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:11.389978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:11.390687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:11.391139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:11.391563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:11.651596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:11.671216 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-939ba0ac-7390-4c71-9b32-ef874076ff94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1245 microversion: 2.1 time: 0.302585 Oct 31 15:54:11.674672 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2993/6126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:11 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1245 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:12.702770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:12.703481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:12.711502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:12.712006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:12.712460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:12.713223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:12.713691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:12.714124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:12.820006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:12.835048 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c22387bf-1801-43ee-90a4-69aecb0db49f tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1307 microversion: 2.1 time: 0.135560 Oct 31 15:54:12.835048 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3134/6127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:12 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1307 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:13.862536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:13.863873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:13.871197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:13.871698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:13.872133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:13.872847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:13.873338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:13.873773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:14.176743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:14.185894 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56157a2a-016c-42b2-9ee9-00e493cafcd7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1375 microversion: 2.1 time: 0.327395 Oct 31 15:54:14.187821 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2994/6128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:13 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1375 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:15.211556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:15.212669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:15.237021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:15.252285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:15.255193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:15.255850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:15.256339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:15.257490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:15.362724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-284aa922-6ce1-4823-b18b-8bede8113cfe req-3c4d120f-a832-4dcf-90cd-aec1786c7f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b4078c-e386-43de-a051-2c60b5c1dd1e", "tag": "a20536e2-4ab4-4c66-8ea2-4008c080c213"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:15.392447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-284aa922-6ce1-4823-b18b-8bede8113cfe req-3c4d120f-a832-4dcf-90cd-aec1786c7f65 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:15.392944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-284aa922-6ce1-4823-b18b-8bede8113cfe req-3c4d120f-a832-4dcf-90cd-aec1786c7f65 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:15.393599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-284aa922-6ce1-4823-b18b-8bede8113cfe req-3c4d120f-a832-4dcf-90cd-aec1786c7f65 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:15.409914 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-284aa922-6ce1-4823-b18b-8bede8113cfe req-3c4d120f-a832-4dcf-90cd-aec1786c7f65 service nova] Creating event network-changed:a20536e2-4ab4-4c66-8ea2-4008c080c213 for instance 41b4078c-e386-43de-a051-2c60b5c1dd1e on n-h1-858384-17 Oct 31 15:54:15.419292 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-284aa922-6ce1-4823-b18b-8bede8113cfe req-3c4d120f-a832-4dcf-90cd-aec1786c7f65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059934 Oct 31 15:54:15.425492 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2995/6129] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:54:15.754722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:15.763842 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b0383a38-7589-40ef-b14e-eca13a2ea603 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1375 microversion: 2.1 time: 0.556957 Oct 31 15:54:15.767612 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3135/6130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:15 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1375 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:16.792881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:16.793731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:16.808603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:16.809014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:16.809494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:16.812970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:16.812970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:16.812970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:17.134672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:17.142767 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-363e94e2-89ab-403a-9c13-b524a6668d54 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1375 microversion: 2.1 time: 0.355169 Oct 31 15:54:17.143365 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2996/6131] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:16 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1375 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:18.174552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:18.175890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:18.187366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:18.188250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:18.188992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:18.190206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:18.191104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:18.192334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:18.498430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:18.507455 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a341b8a8-31fd-4686-99d3-01a207113ce3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1375 microversion: 2.1 time: 0.339231 Oct 31 15:54:18.509493 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3136/6132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:18 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1375 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:19.533020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:19.533667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:19.543935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:19.557986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:19.558693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:19.559608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:19.560232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:19.570132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:19.876355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:19.885892 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8fd8759f-b1fd-425e-ac02-dd55f1062b42 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1375 microversion: 2.1 time: 0.357804 Oct 31 15:54:19.890045 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2997/6133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:19 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1375 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:20.343584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-f2b8dd31-20e7-4482-bde2-01c92020b39e req-f9b152c0-d6bf-4b2d-b9cb-0a7ef7605e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b4078c-e386-43de-a051-2c60b5c1dd1e", "name": "network-vif-plugged", "status": "completed", "tag": "a20536e2-4ab4-4c66-8ea2-4008c080c213"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:20.351930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:20.387213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f2b8dd31-20e7-4482-bde2-01c92020b39e req-f9b152c0-d6bf-4b2d-b9cb-0a7ef7605e41 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:20.389510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f2b8dd31-20e7-4482-bde2-01c92020b39e req-f9b152c0-d6bf-4b2d-b9cb-0a7ef7605e41 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:20.390004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-f2b8dd31-20e7-4482-bde2-01c92020b39e req-f9b152c0-d6bf-4b2d-b9cb-0a7ef7605e41 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:20.419672 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-f2b8dd31-20e7-4482-bde2-01c92020b39e req-f9b152c0-d6bf-4b2d-b9cb-0a7ef7605e41 service nova] Creating event network-vif-plugged:a20536e2-4ab4-4c66-8ea2-4008c080c213 for instance 41b4078c-e386-43de-a051-2c60b5c1dd1e on n-h1-858384-17 Oct 31 15:54:20.431623 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-f2b8dd31-20e7-4482-bde2-01c92020b39e req-f9b152c0-d6bf-4b2d-b9cb-0a7ef7605e41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092554 Oct 31 15:54:20.434890 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3137/6134] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:54:20.916242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:20.916916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:20.930075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:20.933679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:20.941844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:20.947205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:20.952327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:20.953235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:20.953736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:20.954204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:21.815053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:21.817624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:21.853903 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b9525ef1-eb66-49e5-a163-32b910751ae6 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1375 microversion: 2.1 time: 0.940998 Oct 31 15:54:21.855954 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2998/6135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:20 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1375 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:22.884177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:22.884850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:22.894915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:22.896534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:22.902080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:22.906827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:22.907628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:22.908115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:22.908550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:22.912198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=67 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:23.275891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:23.286021 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4f43276-384e-4962-9871-3b70b3050d18 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1548 microversion: 2.1 time: 0.406780 Oct 31 15:54:23.286392 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3138/6136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:22 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1548 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:23.318126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:23.321389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:23.330590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:23.332182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:23.332883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:23.333522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:23.334560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:23.335454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:23.345468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:23.800931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:23.812162 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-386792d4-0dbd-470b-9dd6-34f21be8cbf5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1548 microversion: 2.1 time: 0.501302 Oct 31 15:54:23.812890 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 2999/6137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:23 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1548 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:48.276256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:48.276875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:48.283290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:48.284373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:48.286989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:48.288113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:48.288802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:48.289836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:48.290560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:48.291210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:48.323561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:54:48.436342 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7df0a247-86bb-449b-ad42-00f5d0e79f4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 204 len: 0 microversion: 2.1 time: 0.166101 Oct 31 15:54:48.440300 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3139/6138] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:54:48 2022] DELETE /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:54:48.445947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:48.447232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:48.450406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:48.454792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:54:48.468557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:48.470446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:48.471249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:48.472191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:48.473916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:48.475047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:48.736050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:48.745263 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-528d59b7-300c-4816-b9f9-fe2b42df2800 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1554 microversion: 2.1 time: 0.303860 Oct 31 15:54:48.763178 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3000/6139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:48 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1554 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:54:49.775186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:49.775906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:49.792792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:49.800342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:49.801044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:49.802355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:49.803082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:49.803516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:50.128758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:50.143234 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-245632fe-f172-4df7-ae84-5d30e9ae0a7d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1554 microversion: 2.1 time: 0.372545 Oct 31 15:54:50.157554 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3140/6140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:49 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1554 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:50.809046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1e77133f-3e7a-46ca-b208-3091bda76717 req-1a508c69-19db-45f6-acef-6945a25b888b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b4078c-e386-43de-a051-2c60b5c1dd1e", "name": "network-vif-deleted", "tag": "a20536e2-4ab4-4c66-8ea2-4008c080c213"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:50.842069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1e77133f-3e7a-46ca-b208-3091bda76717 req-1a508c69-19db-45f6-acef-6945a25b888b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:50.842572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1e77133f-3e7a-46ca-b208-3091bda76717 req-1a508c69-19db-45f6-acef-6945a25b888b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:50.843013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1e77133f-3e7a-46ca-b208-3091bda76717 req-1a508c69-19db-45f6-acef-6945a25b888b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:50.861906 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1e77133f-3e7a-46ca-b208-3091bda76717 req-1a508c69-19db-45f6-acef-6945a25b888b service nova] Creating event network-vif-deleted:a20536e2-4ab4-4c66-8ea2-4008c080c213 for instance 41b4078c-e386-43de-a051-2c60b5c1dd1e on n-h1-858384-17 Oct 31 15:54:50.877526 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1e77133f-3e7a-46ca-b208-3091bda76717 req-1a508c69-19db-45f6-acef-6945a25b888b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070807 Oct 31 15:54:50.878320 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3001/6141] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:54:51.173546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:51.174277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:51.186267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:51.186984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:51.187522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:51.188305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:51.191765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:51.192944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:51.237661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:51.238173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:51.238601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:51.239041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lazy-loading 'fault' on Instance uuid 41b4078c-e386-43de-a051-2c60b5c1dd1e {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:54:51.329505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:51.345320 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9301790-44a1-4f87-bcc2-3ff5be31b793 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 200 len: 1339 microversion: 2.1 time: 0.172858 Oct 31 15:54:51.346589 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3141/6142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:51 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 1339 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:52.376454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:52.377966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 41b4078c-e386-43de-a051-2c60b5c1dd1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:52.385896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:52.388954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:52.390627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:52.391600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:52.392409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:52.393192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:52.414232 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] HTTP exception thrown: Instance 41b4078c-e386-43de-a051-2c60b5c1dd1e could not be found. Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Request method failure captured: Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e HTTP/1.1 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-9dFfjUVS2_Qi6-31yObY2SOv6PVoQJTuyXMaLE0iMcMo3HGh9QAut-nCnMi5st6vOvn8565riGdusMOBgZ3OKKFYyc1I6TZonK37ZEMgsGgeByYXCKACq0_Vr1HCcF2o2ja_ZTIw1feuSfcT5FmN-Oq3528t5yfTS2hwekw-51BeI Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 773d57c947194cebabe8ac26a5c7c521 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestNetworkBasicOps-1195050683 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/773d57c947194cebabe8ac26a5c7c521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_773d57c947194cebabe8ac26a5c7c521", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/773d57c947194cebabe8ac26a5c7c521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/773d57c947194cebabe8ac26a5c7c521"}]}] Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestNetworkBasicOps-1195050683 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 773d57c947194cebabe8ac26a5c7c521 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestNetworkBasicOps-1195050683 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestNetworkBasicOps-1195050683-project Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 6b5e818de5bf4b349acbf9c7bd81c6f3 Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestNetworkBasicOps-1195050683-project Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 41b4078c-e386-43de-a051-2c60b5c1dd1e could not be found. Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '41b4078c-e386-43de-a051-2c60b5c1dd1e'} Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b4078c-e386-43de-a051-2c60b5c1dd1e could not be found. Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b4078c-e386-43de-a051-2c60b5c1dd1e could not be found. Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:54:52.416382 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:54:52.421224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:54:52.421224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:54:52.421224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:54:52.421224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:54:52.421224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:54:52.421224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b4078c-e386-43de-a051-2c60b5c1dd1e could not be found. Oct 31 15:54:52.421224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:54:52.422593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Returning 404 to user: Instance 41b4078c-e386-43de-a051-2c60b5c1dd1e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:54:52.423714 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c6f2af8c-7ce6-4758-afca-0241c7162121 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e" status: 404 len: 111 microversion: 2.1 time: 0.056619 Oct 31 15:54:52.424849 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3002/6143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:52 2022] GET /compute/v2.1/servers/41b4078c-e386-43de-a051-2c60b5c1dd1e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:54:52.721448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c248ee9a-0e3b-4577-bd75-f88bb31695d3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '.version_select at 0x7f16e0c24160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:52.790790 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c248ee9a-0e3b-4577-bd75-f88bb31695d3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1067374090" status: 202 len: 0 microversion: 2.1 time: 0.073386 Oct 31 15:54:52.797712 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3142/6144] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 31 15:54:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1067374090 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:54:56.012569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:56.013084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:56.061916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:56.069014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:56.069798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:56.070940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:56.073259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:56.075295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:56.141202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:54:56.303352 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a66f7266-d2fe-4e82-920c-889d1a78d8a3 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 204 len: 0 microversion: 2.1 time: 0.292365 Oct 31 15:54:56.305213 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3003/6145] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:54:56 2022] DELETE /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:54:56.335903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-78f657e6-60e1-4d0d-b552-f1d343ba5245 req-ca132688-2c4a-4e22-867a-0073e324c84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3519be36-35e5-45a0-ad67-6022a2f2ca21", "tag": "0454a7db-6760-4ce2-a6f7-1927b9156d02"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:56.338742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:56.341078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:56.356125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:56.361695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:56.362369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:56.363260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:56.364454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:56.365051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:56.369732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-78f657e6-60e1-4d0d-b552-f1d343ba5245 req-ca132688-2c4a-4e22-867a-0073e324c84d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:56.374662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-78f657e6-60e1-4d0d-b552-f1d343ba5245 req-ca132688-2c4a-4e22-867a-0073e324c84d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:56.375056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-78f657e6-60e1-4d0d-b552-f1d343ba5245 req-ca132688-2c4a-4e22-867a-0073e324c84d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:56.398639 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-78f657e6-60e1-4d0d-b552-f1d343ba5245 req-ca132688-2c4a-4e22-867a-0073e324c84d service nova] Creating event network-changed:0454a7db-6760-4ce2-a6f7-1927b9156d02 for instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 on n-h2-858384-17 Oct 31 15:54:56.411973 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-78f657e6-60e1-4d0d-b552-f1d343ba5245 req-ca132688-2c4a-4e22-867a-0073e324c84d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.383492 Oct 31 15:54:56.417048 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3143/6146] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:54:56.729966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:56.738641 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73264ffd-dd6d-4dcd-9321-c446bb6fae94 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1669 microversion: 2.1 time: 0.428014 Oct 31 15:54:56.743599 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3004/6147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:56 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1669 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:57.776212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:57.777566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:57.788338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:57.792418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:57.793070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:57.794024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:57.794664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:57.795097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:58.276598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:54:58.291286 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d9e2bee-f462-470d-b617-fc04f0e687de tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 200 len: 1669 microversion: 2.1 time: 0.521231 Oct 31 15:54:58.293385 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3144/6148] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:57 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 1669 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:54:58.590288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-22dfeb8c-55c0-4e99-8065-e20e35a0ed92 req-76bcaf37-3932-4545-a119-b402e4f03884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3519be36-35e5-45a0-ad67-6022a2f2ca21", "name": "network-vif-deleted", "tag": "0454a7db-6760-4ce2-a6f7-1927b9156d02"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:54:58.602956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22dfeb8c-55c0-4e99-8065-e20e35a0ed92 req-76bcaf37-3932-4545-a119-b402e4f03884 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:58.603515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22dfeb8c-55c0-4e99-8065-e20e35a0ed92 req-76bcaf37-3932-4545-a119-b402e4f03884 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:58.604415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22dfeb8c-55c0-4e99-8065-e20e35a0ed92 req-76bcaf37-3932-4545-a119-b402e4f03884 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:58.621008 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-22dfeb8c-55c0-4e99-8065-e20e35a0ed92 req-76bcaf37-3932-4545-a119-b402e4f03884 service nova] Creating event network-vif-deleted:0454a7db-6760-4ce2-a6f7-1927b9156d02 for instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 on n-h2-858384-17 Oct 31 15:54:58.628092 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-22dfeb8c-55c0-4e99-8065-e20e35a0ed92 req-76bcaf37-3932-4545-a119-b402e4f03884 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045806 Oct 31 15:54:58.628936 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3005/6149] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:54:59.318205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:59.319260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: 3519be36-35e5-45a0-ad67-6022a2f2ca21] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:54:59.327592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:59.328212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:59.328754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:59.329773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:54:59.330434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:54:59.333340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:54:59.349517 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] HTTP exception thrown: Instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 could not be found. Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Request method failure captured: Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 HTTP/1.1 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX-9dFfjUVS2_Qi6-31yObY2SOv6PVoQJTuyXMaLE0iMcMo3HGh9QAut-nCnMi5st6vOvn8565riGdusMOBgZ3OKKFYyc1I6TZonK37ZEMgsGgeByYXCKACq0_Vr1HCcF2o2ja_ZTIw1feuSfcT5FmN-Oq3528t5yfTS2hwekw-51BeI Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 773d57c947194cebabe8ac26a5c7c521 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestNetworkBasicOps-1195050683 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/773d57c947194cebabe8ac26a5c7c521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_773d57c947194cebabe8ac26a5c7c521", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/773d57c947194cebabe8ac26a5c7c521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/773d57c947194cebabe8ac26a5c7c521"}]}] Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestNetworkBasicOps-1195050683 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 773d57c947194cebabe8ac26a5c7c521 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestNetworkBasicOps-1195050683 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestNetworkBasicOps-1195050683-project Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 6b5e818de5bf4b349acbf9c7bd81c6f3 Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestNetworkBasicOps-1195050683-project Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 could not be found. Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '3519be36-35e5-45a0-ad67-6022a2f2ca21'} Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 could not be found. Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 could not be found. Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:54:59.351733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:59.356170 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:54:59.356170 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:54:59.356170 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:54:59.356170 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:54:59.356170 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:54:59.356170 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 could not be found. Oct 31 15:54:59.356170 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:54:59.357276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Returning 404 to user: Instance 3519be36-35e5-45a0-ad67-6022a2f2ca21 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:54:59.358355 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6a2dc827-ae81-4c6c-88e0-aaa469b0582a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21" status: 404 len: 111 microversion: 2.1 time: 0.046075 Oct 31 15:54:59.359027 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3145/6150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:54:59 2022] GET /compute/v2.1/servers/3519be36-35e5-45a0-ad67-6022a2f2ca21 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:54:59.599933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6801655d-51dc-4f94-b76b-273bfdb2fb28 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '.version_select at 0x7f16e5604040>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:54:59.660538 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6801655d-51dc-4f94-b76b-273bfdb2fb28 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-283358670" status: 202 len: 0 microversion: 2.1 time: 0.066042 Oct 31 15:54:59.661468 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3006/6151] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Oct 31 15:54:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-283358670 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:55:14.220455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc3e75d1-34a2-4caf-9942-559963a556c5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Action: 'create', calling method: .version_select at 0x7f16e0d85940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1245196133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzqWKJhHrx3DzIwT9u4X+igV2N0BoPiG7LrGF7UBadMsGxq2SC5eceftEKmn8TtmjDpt1aQiVUVMQ6BspLrSy7/ZpP1D1ANPYXz1yi02Ac3ZJseYWdpPeVZp85Rtr+9wA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:14.237748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:14.239161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:14.303157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bc3e75d1-34a2-4caf-9942-559963a556c5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for project 773d57c947194cebabe8ac26a5c7c521. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:55:14.319506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-bc3e75d1-34a2-4caf-9942-559963a556c5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for user 6b5e818de5bf4b349acbf9c7bd81c6f3 and project 773d57c947194cebabe8ac26a5c7c521. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:55:14.387121 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc3e75d1-34a2-4caf-9942-559963a556c5 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.167850 Oct 31 15:55:14.406366 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3146/6152] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:55:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:16.321048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-329215121", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "8e15f864-775b-4851-a9bf-e14ed12c7e2f"}], "key_name": "tempest-TestNetworkBasicOps-1245196133", "security_groups": [{"name": "tempest-secgroup-smoke-1357174676"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:16.363413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:16.364391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:16.512265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] validate_networks() for [('8e15f864-775b-4851-a9bf-e14ed12c7e2f', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:55:17.393862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:55:17.394804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:55:17.395972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:55:17.396589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:55:17.397039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:55:17.407722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:17.408514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:17.409200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:17.410885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:17.411593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:17.412240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:17.446129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for project 773d57c947194cebabe8ac26a5c7c521. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:55:17.454898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Getting quotas for user 6b5e818de5bf4b349acbf9c7bd81c6f3 and project 773d57c947194cebabe8ac26a5c7c521. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:55:17.473189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:55:17.475734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:55:17.541444 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-248cafda-9dcd-4586-8979-2039655027a7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.224115 Oct 31 15:55:17.554721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6dcaa09c-3293-4735-9e60-23890ec2bbff tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:17.555340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6dcaa09c-3293-4735-9e60-23890ec2bbff tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:17.559355 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3007/6153] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:55:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:55:17.646392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6dcaa09c-3293-4735-9e60-23890ec2bbff tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:17.664310 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6dcaa09c-3293-4735-9e60-23890ec2bbff tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1248 microversion: 2.1 time: 0.113949 Oct 31 15:55:17.667804 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3147/6154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:17 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1248 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:18.696625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:18.697277 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:18.711024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:18.711530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:18.711970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:18.719738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:18.720218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:18.720683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:18.884327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:18.901811 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ef5cf14f-2493-49e7-ab8a-263d359fffa9 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1252 microversion: 2.1 time: 0.203679 Oct 31 15:55:18.913887 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3008/6155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:18 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1252 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:19.931135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:19.932373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:19.945716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:19.947167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:19.947753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:19.949830 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:19.951105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:19.952142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:20.086148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:20.101340 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8610806f-c759-4661-a097-d7153017cd0b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1306 microversion: 2.1 time: 0.173942 Oct 31 15:55:20.102146 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3148/6156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:19 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1306 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:21.130486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:21.131212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:21.139307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:21.140064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:21.140992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:21.141953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:21.142649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:21.143288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:21.398685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:21.407705 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-edddbb07-c213-4161-9d58-d116d3780518 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1374 microversion: 2.1 time: 0.285977 Oct 31 15:55:21.413586 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3009/6157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:21 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1374 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:21.881794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b75aa312-33e5-4faa-b506-1a9887ac7a98 req-eeb3a821-c22b-4732-ac10-df084e56c9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa237220-9b0a-47db-9f21-f50180e20f1f", "tag": "f826e7e1-b687-4391-a35a-34eb695907a2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:21.908626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b75aa312-33e5-4faa-b506-1a9887ac7a98 req-eeb3a821-c22b-4732-ac10-df084e56c9ec service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:21.911256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b75aa312-33e5-4faa-b506-1a9887ac7a98 req-eeb3a821-c22b-4732-ac10-df084e56c9ec service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:21.911928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b75aa312-33e5-4faa-b506-1a9887ac7a98 req-eeb3a821-c22b-4732-ac10-df084e56c9ec service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:21.928830 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b75aa312-33e5-4faa-b506-1a9887ac7a98 req-eeb3a821-c22b-4732-ac10-df084e56c9ec service nova] Creating event network-changed:f826e7e1-b687-4391-a35a-34eb695907a2 for instance aa237220-9b0a-47db-9f21-f50180e20f1f on n-h2-858384-17 Oct 31 15:55:21.937775 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b75aa312-33e5-4faa-b506-1a9887ac7a98 req-eeb3a821-c22b-4732-ac10-df084e56c9ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062471 Oct 31 15:55:21.939130 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3149/6158] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:22.433227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:22.434590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:22.448019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:22.452051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:22.452777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:22.453916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:22.454612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:22.455674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:22.685503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:22.696242 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a4c4471-0aa6-4a8f-8622-82436cf116ad tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1374 microversion: 2.1 time: 0.267288 Oct 31 15:55:22.696843 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3010/6159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:22 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:23.728388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:23.729413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:23.736047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:23.736735 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:23.737299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:23.738554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:23.739652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:23.740283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:23.977832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:23.991823 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2220a76-b591-4ec0-a905-bca54565ad4a tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1374 microversion: 2.1 time: 0.271296 Oct 31 15:55:23.993358 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3150/6160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:23 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1374 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:25.015795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:25.016564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:25.035861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:25.036505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:25.037042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:25.037882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:25.038727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:25.039247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:25.653974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:25.666899 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc79bb41-2c7a-4732-af8a-c24e63637623 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1374 microversion: 2.1 time: 0.654859 Oct 31 15:55:25.668413 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3011/6161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:25 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1374 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:26.694333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:26.695089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:26.701930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:26.702650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:26.703074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:26.703780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:26.704241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:26.704914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:26.921564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:26.933730 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23369b3e-e0c1-4ec6-93c2-5527b7a3b173 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1374 microversion: 2.1 time: 0.244367 Oct 31 15:55:26.934341 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3151/6162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:26 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1374 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:27.010803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-634dbb93-e96a-40b6-ad59-2783312f286c req-d707dba5-4dcf-40e0-84bf-5c4ecd16ff31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa237220-9b0a-47db-9f21-f50180e20f1f", "name": "network-vif-plugged", "status": "completed", "tag": "f826e7e1-b687-4391-a35a-34eb695907a2"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:27.035362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-634dbb93-e96a-40b6-ad59-2783312f286c req-d707dba5-4dcf-40e0-84bf-5c4ecd16ff31 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:27.035877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-634dbb93-e96a-40b6-ad59-2783312f286c req-d707dba5-4dcf-40e0-84bf-5c4ecd16ff31 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:27.036316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-634dbb93-e96a-40b6-ad59-2783312f286c req-d707dba5-4dcf-40e0-84bf-5c4ecd16ff31 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:27.073422 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-634dbb93-e96a-40b6-ad59-2783312f286c req-d707dba5-4dcf-40e0-84bf-5c4ecd16ff31 service nova] Creating event network-vif-plugged:f826e7e1-b687-4391-a35a-34eb695907a2 for instance aa237220-9b0a-47db-9f21-f50180e20f1f on n-h2-858384-17 Oct 31 15:55:27.084830 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-634dbb93-e96a-40b6-ad59-2783312f286c req-d707dba5-4dcf-40e0-84bf-5c4ecd16ff31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077719 Oct 31 15:55:27.085982 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3012/6163] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:27.963433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:27.964561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:27.967015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:27.975619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:27.976293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:27.976901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:27.977839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:27.978826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:27.979544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:28.141903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:28.150091 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05672ea9-2d67-43c3-b1a5-4189f8438db7 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1374 microversion: 2.1 time: 0.195597 Oct 31 15:55:28.150673 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3152/6164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:27 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:29.176281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:29.177900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:29.183970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:29.185010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:29.187947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:29.188686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:29.189557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:29.190545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:29.191537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:29.192165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:29.406830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:29.418296 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8981adc3-5008-4e7d-9c4a-0e5fe05f13fe tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1546 microversion: 2.1 time: 0.247288 Oct 31 15:55:29.419670 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3013/6165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:29 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1546 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:55:29.442088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:29.442629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:29.449918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:29.450411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:29.450850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:29.451555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:29.452017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:29.452442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:29.656963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:29.676943 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d8d8619d-d8dc-4df4-adcd-39546d6cc530 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1546 microversion: 2.1 time: 0.239076 Oct 31 15:55:29.679362 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3153/6166] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:29 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1546 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:55:32.187395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2ab88e73-1930-4d41-a4e3-fef1fe56bd73 req-a4899496-3841-4f23-bb48-cd2d01fd9359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa237220-9b0a-47db-9f21-f50180e20f1f", "tag": "f826e7e1-b687-4391-a35a-34eb695907a2"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:32.215418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2ab88e73-1930-4d41-a4e3-fef1fe56bd73 req-a4899496-3841-4f23-bb48-cd2d01fd9359 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:32.215904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2ab88e73-1930-4d41-a4e3-fef1fe56bd73 req-a4899496-3841-4f23-bb48-cd2d01fd9359 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:32.216335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2ab88e73-1930-4d41-a4e3-fef1fe56bd73 req-a4899496-3841-4f23-bb48-cd2d01fd9359 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:32.271255 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2ab88e73-1930-4d41-a4e3-fef1fe56bd73 req-a4899496-3841-4f23-bb48-cd2d01fd9359 service nova] Creating event network-changed:f826e7e1-b687-4391-a35a-34eb695907a2 for instance aa237220-9b0a-47db-9f21-f50180e20f1f on n-h2-858384-17 Oct 31 15:55:32.282710 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2ab88e73-1930-4d41-a4e3-fef1fe56bd73 req-a4899496-3841-4f23-bb48-cd2d01fd9359 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098276 Oct 31 15:55:32.283340 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3014/6167] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:42.720712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:42.721716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=32 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:42.726767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-138458635", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "869405ec-2a69-4494-9c77-e064fa875558"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:42.791555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] validate_networks() for [('869405ec-2a69-4494-9c77-e064fa875558', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:55:43.362146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:55:43.362848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:55:43.363396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:55:43.363841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:55:43.364265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:55:43.374507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:43.374999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:43.375451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:43.376166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:43.376797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:43.377933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:43.396800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Getting quotas for project e8ae467501884cc084d306dba1266447. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:55:43.402888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Getting quotas for user 2e09bf3d04534af69a487be8ad5d2b5c and project e8ae467501884cc084d306dba1266447. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:55:43.418062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:55:43.420834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:55:43.470510 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f8dd225a-23aa-41c8-ae1c-7960d9989d97 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751782 Oct 31 15:55:43.478572 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3154/6168] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:55:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:55:43.484097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb013f27-706d-4c18-a850-12dc835e45e7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:43.484958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb013f27-706d-4c18-a850-12dc835e45e7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:43.488787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:43.489475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=36 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:43.560507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb013f27-706d-4c18-a850-12dc835e45e7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:43.569959 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb013f27-706d-4c18-a850-12dc835e45e7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1218 microversion: 2.1 time: 0.090282 Oct 31 15:55:43.572430 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3015/6169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:43 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:44.597274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:44.598341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:44.610339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:44.614322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:44.615101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:44.616056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:44.616754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:44.621217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:44.735920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:44.756205 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4bc40ec-295e-4a29-8962-3649cc97cb1f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1270 microversion: 2.1 time: 0.164516 Oct 31 15:55:44.769744 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3155/6170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:44 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:45.785810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:45.787574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:45.795751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:45.796255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:45.796696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:45.797507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:45.797973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:45.798570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:45.949256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:45.958316 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e03634c5-d392-4714-a0e1-66ea2a34a8b0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1318 microversion: 2.1 time: 0.176867 Oct 31 15:55:45.958917 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3016/6171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:45 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:46.366391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-56e02cdf-4896-4466-8881-c27d5813db16 req-a4b18397-43b8-4355-b6f1-452421662c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3022bbcb-d416-4bd7-af57-4b7f3efb705d", "tag": "9e9dd32e-fdc6-4d13-9e02-79614167f45f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:46.382979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-56e02cdf-4896-4466-8881-c27d5813db16 req-a4b18397-43b8-4355-b6f1-452421662c86 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:46.383462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-56e02cdf-4896-4466-8881-c27d5813db16 req-a4b18397-43b8-4355-b6f1-452421662c86 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:46.383896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-56e02cdf-4896-4466-8881-c27d5813db16 req-a4b18397-43b8-4355-b6f1-452421662c86 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:46.396237 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-56e02cdf-4896-4466-8881-c27d5813db16 req-a4b18397-43b8-4355-b6f1-452421662c86 service nova] Creating event network-changed:9e9dd32e-fdc6-4d13-9e02-79614167f45f for instance 3022bbcb-d416-4bd7-af57-4b7f3efb705d on n-h1-858384-17 Oct 31 15:55:46.401826 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-56e02cdf-4896-4466-8881-c27d5813db16 req-a4b18397-43b8-4355-b6f1-452421662c86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040204 Oct 31 15:55:46.402569 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3156/6172] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:46.982901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:46.983589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:46.991516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:46.992012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:46.992459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:46.993191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:46.993793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:46.994234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:47.168346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:47.178313 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-328a3a6f-2cd8-45d6-9a5a-bcf2adb6bd8f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1318 microversion: 2.1 time: 0.199348 Oct 31 15:55:47.178950 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3017/6173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:46 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:48.208069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:48.208069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:48.214218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:48.214710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:48.215150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:48.215845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:48.216659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:48.217785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:48.386202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:48.395100 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05369491-3bb8-4f54-b492-9150e64c8663 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1318 microversion: 2.1 time: 0.197632 Oct 31 15:55:48.401423 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3157/6174] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:48 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:49.424681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:49.425287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:49.433362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:49.433937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:49.434585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:49.435315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:49.436156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:49.436606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:49.606360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:49.625560 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98d17c84-475b-42aa-a5d4-f727c7935725 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1318 microversion: 2.1 time: 0.210221 Oct 31 15:55:49.629317 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3018/6175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:49 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:50.525517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-84ff90c4-66bc-43fc-86d0-8797c43cfa55 req-aeb6e2ff-685d-4a7c-9bee-b6bbf96a306f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3022bbcb-d416-4bd7-af57-4b7f3efb705d", "name": "network-vif-plugged", "status": "completed", "tag": "9e9dd32e-fdc6-4d13-9e02-79614167f45f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:50.542219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-84ff90c4-66bc-43fc-86d0-8797c43cfa55 req-aeb6e2ff-685d-4a7c-9bee-b6bbf96a306f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:50.543081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-84ff90c4-66bc-43fc-86d0-8797c43cfa55 req-aeb6e2ff-685d-4a7c-9bee-b6bbf96a306f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:50.544432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-84ff90c4-66bc-43fc-86d0-8797c43cfa55 req-aeb6e2ff-685d-4a7c-9bee-b6bbf96a306f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:50.559914 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-84ff90c4-66bc-43fc-86d0-8797c43cfa55 req-aeb6e2ff-685d-4a7c-9bee-b6bbf96a306f service nova] Creating event network-vif-plugged:9e9dd32e-fdc6-4d13-9e02-79614167f45f for instance 3022bbcb-d416-4bd7-af57-4b7f3efb705d on n-h1-858384-17 Oct 31 15:55:50.584205 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-84ff90c4-66bc-43fc-86d0-8797c43cfa55 req-aeb6e2ff-685d-4a7c-9bee-b6bbf96a306f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063928 Oct 31 15:55:50.585503 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3158/6176] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:55:50.663887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:50.665070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:50.678383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:50.678893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:50.679345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:50.680046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:50.680507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:50.681571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:50.837461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:50.845553 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-793083ee-eeeb-469c-a102-0d2f2abbe380 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1318 microversion: 2.1 time: 0.195168 Oct 31 15:55:50.846317 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3019/6177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:50 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:51.872772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:55:51.873594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:51.881235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:51.881941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:51.882537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:51.883190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:51.883654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:51.884080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:52.037614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:55:52.047035 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9ff3b57-60ca-41c1-8516-7a3c180bf05b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1508 microversion: 2.1 time: 0.179147 Oct 31 15:55:52.048433 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3159/6178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:55:51 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:55:55.013053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-02015e0a-9f0a-4e8c-9d38-7878bc6ff05d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:55:55.016871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-02015e0a-9f0a-4e8c-9d38-7878bc6ff05d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:55:55.025142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:55:55.027911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02015e0a-9f0a-4e8c-9d38-7878bc6ff05d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:55.028863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02015e0a-9f0a-4e8c-9d38-7878bc6ff05d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:55.029551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02015e0a-9f0a-4e8c-9d38-7878bc6ff05d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:55.030578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02015e0a-9f0a-4e8c-9d38-7878bc6ff05d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:55:55.031413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02015e0a-9f0a-4e8c-9d38-7878bc6ff05d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:55:55.032005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-02015e0a-9f0a-4e8c-9d38-7878bc6ff05d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:55:55.105662 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-02015e0a-9f0a-4e8c-9d38-7878bc6ff05d tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "POST /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f/action" status: 200 len: 24564 microversion: 2.1 time: 0.096704 Oct 31 15:55:55.116709 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3020/6179] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:55:55 2022] POST /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f/action => generated 24564 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:56:06.232996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f3cc4646-a9d7-4449-97f5-bc4aa321ae38 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:06.236864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f3cc4646-a9d7-4449-97f5-bc4aa321ae38 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:06.243586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:06.244491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:06.245550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:06.246791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=24 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:06.248626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3cc4646-a9d7-4449-97f5-bc4aa321ae38 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:06.249912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3cc4646-a9d7-4449-97f5-bc4aa321ae38 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:06.252167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3cc4646-a9d7-4449-97f5-bc4aa321ae38 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:06.253356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3cc4646-a9d7-4449-97f5-bc4aa321ae38 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:06.254559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3cc4646-a9d7-4449-97f5-bc4aa321ae38 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:06.255850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3cc4646-a9d7-4449-97f5-bc4aa321ae38 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:06.383507 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f3cc4646-a9d7-4449-97f5-bc4aa321ae38 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "POST /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f/action" status: 200 len: 32639 microversion: 2.1 time: 0.153790 Oct 31 15:56:06.388929 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3160/6180] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 15:56:06 2022] POST /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f/action => generated 32639 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 15:56:08.087352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:08.087945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:08.091307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:08.092025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=28 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:08.116989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:08.117530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:08.117971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:08.118651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-91714043-fc80-4a55-be91-068e7d1b49e4 req-a313726c-4ddb-4299-ba85-ae57fa7a199c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa237220-9b0a-47db-9f21-f50180e20f1f", "tag": "f826e7e1-b687-4391-a35a-34eb695907a2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:08.119697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:08.120244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:08.121368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:08.151355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-91714043-fc80-4a55-be91-068e7d1b49e4 req-a313726c-4ddb-4299-ba85-ae57fa7a199c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:08.153519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-91714043-fc80-4a55-be91-068e7d1b49e4 req-a313726c-4ddb-4299-ba85-ae57fa7a199c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:08.154951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-91714043-fc80-4a55-be91-068e7d1b49e4 req-a313726c-4ddb-4299-ba85-ae57fa7a199c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:08.196886 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-91714043-fc80-4a55-be91-068e7d1b49e4 req-a313726c-4ddb-4299-ba85-ae57fa7a199c service nova] Creating event network-changed:f826e7e1-b687-4391-a35a-34eb695907a2 for instance aa237220-9b0a-47db-9f21-f50180e20f1f on n-h2-858384-17 Oct 31 15:56:08.211151 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-91714043-fc80-4a55-be91-068e7d1b49e4 req-a313726c-4ddb-4299-ba85-ae57fa7a199c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096857 Oct 31 15:56:08.212223 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3161/6181] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:56:08.219516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:56:08.454051 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-361f5365-fe73-4318-a149-c1354f99897b tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 204 len: 0 microversion: 2.1 time: 0.371538 Oct 31 15:56:08.458158 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3021/6182] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:56:08 2022] DELETE /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:56:08.464782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:08.465542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:08.475404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:08.475903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:08.480629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:08.481440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:08.481927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:08.482371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:08.713507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:08.723247 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2724ec98-a84d-480c-82e0-9575fe208842 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1670 microversion: 2.1 time: 0.263542 Oct 31 15:56:08.723764 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3162/6183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:08 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1670 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:09.750664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:09.752250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:09.770030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:09.771044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:09.771769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:09.772879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:09.773666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:09.774444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:09.943059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:09.953167 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-241ed398-2dd0-4f95-b888-52b762b6a756 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1670 microversion: 2.1 time: 0.208594 Oct 31 15:56:09.957448 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3022/6184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:09 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:10.707864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d5760dd9-d70d-457d-8bce-6a685ea96e6e req-b1fdd9bf-29e1-4bad-b776-c57910610b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa237220-9b0a-47db-9f21-f50180e20f1f", "name": "network-vif-deleted", "tag": "f826e7e1-b687-4391-a35a-34eb695907a2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:10.721190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d5760dd9-d70d-457d-8bce-6a685ea96e6e req-b1fdd9bf-29e1-4bad-b776-c57910610b77 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:10.721938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d5760dd9-d70d-457d-8bce-6a685ea96e6e req-b1fdd9bf-29e1-4bad-b776-c57910610b77 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:10.722537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d5760dd9-d70d-457d-8bce-6a685ea96e6e req-b1fdd9bf-29e1-4bad-b776-c57910610b77 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:10.739434 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d5760dd9-d70d-457d-8bce-6a685ea96e6e req-b1fdd9bf-29e1-4bad-b776-c57910610b77 service nova] Creating event network-vif-deleted:f826e7e1-b687-4391-a35a-34eb695907a2 for instance aa237220-9b0a-47db-9f21-f50180e20f1f on n-h2-858384-17 Oct 31 15:56:10.745437 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d5760dd9-d70d-457d-8bce-6a685ea96e6e req-b1fdd9bf-29e1-4bad-b776-c57910610b77 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041317 Oct 31 15:56:10.746424 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3163/6185] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:56:10.986613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:10.987235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:11.001301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:11.001821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:11.002267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:11.003329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:11.008416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:11.008872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:11.088445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:11.089831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:11.090427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:11.091038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lazy-loading 'fault' on Instance uuid aa237220-9b0a-47db-9f21-f50180e20f1f {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:56:11.163592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5e818de5bf4b349acbf9c7bd81c6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d57c947194cebabe8ac26a5c7c521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:11.175474 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30f17870-e5e1-4414-88de-3e0f4d7e5788 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 200 len: 1338 microversion: 2.1 time: 0.193445 Oct 31 15:56:11.176932 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3023/6186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:10 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 1338 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:11.764023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-31243627", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:11.820793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] validate_networks() for None {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:56:12.202020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:12.202634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] [instance: aa237220-9b0a-47db-9f21-f50180e20f1f] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:12.217932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:12.218357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:12.218807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:12.219800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:12.220274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:12.220711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:12.246749 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] HTTP exception thrown: Instance aa237220-9b0a-47db-9f21-f50180e20f1f could not be found. Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Request method failure captured: Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f HTTP/1.1 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX-9dFfjUVS2_Qi6-31yObY2SOv6PVoQJTuyXMaLE0iMcMo3HGh9QAut-nCnMi5st6vOvn8565riGdusMOBgZ3OKKFYyc1I6TZonK37ZEMgsGgeByYXCKACq0_Vr1HCcF2o2ja_ZTIw1feuSfcT5FmN-Oq3528t5yfTS2hwekw-51BeI Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 773d57c947194cebabe8ac26a5c7c521 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestNetworkBasicOps-1195050683 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/773d57c947194cebabe8ac26a5c7c521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_773d57c947194cebabe8ac26a5c7c521", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/773d57c947194cebabe8ac26a5c7c521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/773d57c947194cebabe8ac26a5c7c521"}]}] Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestNetworkBasicOps-1195050683 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 773d57c947194cebabe8ac26a5c7c521 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestNetworkBasicOps-1195050683 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestNetworkBasicOps-1195050683-project Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 6b5e818de5bf4b349acbf9c7bd81c6f3 Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestNetworkBasicOps-1195050683-project Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance aa237220-9b0a-47db-9f21-f50180e20f1f could not be found. Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'aa237220-9b0a-47db-9f21-f50180e20f1f'} Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa237220-9b0a-47db-9f21-f50180e20f1f could not be found. Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa237220-9b0a-47db-9f21-f50180e20f1f could not be found. Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:56:12.248748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:12.253245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:12.253245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:56:12.253245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:56:12.253245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:56:12.253245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:56:12.253245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa237220-9b0a-47db-9f21-f50180e20f1f could not be found. Oct 31 15:56:12.253245 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:12.255914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Returning 404 to user: Instance aa237220-9b0a-47db-9f21-f50180e20f1f could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:56:12.257070 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b358241-93d2-4a38-a94d-7047f59bf144 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f" status: 404 len: 111 microversion: 2.1 time: 0.058937 Oct 31 15:56:12.258480 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3024/6187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:12 2022] GET /compute/v2.1/servers/aa237220-9b0a-47db-9f21-f50180e20f1f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:56:12.527684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:56:12.528116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:56:12.528594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:56:12.529042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:56:12.529919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:56:12.537524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-95e3947e-4053-4599-97c7-9284e9ad9222 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] Calling method '.version_select at 0x7f16e01293a0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:12.541945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:12.542436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:12.543298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:12.544263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:12.544930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:12.545601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:12.568219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Getting quotas for project 708799f868de4675b3e5af3f38bf2949. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:56:12.583846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Getting quotas for user 041dd4daa75d4aed8b149fbcf4903195 and project 708799f868de4675b3e5af3f38bf2949. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:56:12.601025 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-95e3947e-4053-4599-97c7-9284e9ad9222 tempest-TestNetworkBasicOps-1195050683 tempest-TestNetworkBasicOps-1195050683-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1245196133" status: 202 len: 0 microversion: 2.1 time: 0.066405 Oct 31 15:56:12.605005 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3025/6188] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 31 15:56:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1245196133 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:56:12.605882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:56:12.608689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:56:12.666185 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9656b05c-9dad-4ff5-a5bd-811e0276010f tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907027 Oct 31 15:56:12.667097 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3164/6189] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:56:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:56:12.679446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df330d04-a2f8-47df-baec-927984206fe2 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:12.680303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df330d04-a2f8-47df-baec-927984206fe2 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:12.872849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-df330d04-a2f8-47df-baec-927984206fe2 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:12.885792 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df330d04-a2f8-47df-baec-927984206fe2 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1212 microversion: 2.1 time: 0.209783 Oct 31 15:56:12.887077 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3026/6190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:12 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1212 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:13.911365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:13.911987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:13.928991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:13.929767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:13.930399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:13.931285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:13.931932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:13.932522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:14.161800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:14.170387 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1044d1bf-1c1f-4964-852a-9563a6d2e785 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1264 microversion: 2.1 time: 0.264421 Oct 31 15:56:14.171735 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3165/6191] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:13 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1264 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:56:15.197494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:15.198750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:15.217779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:15.218298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:15.218793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:15.220245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:15.220479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:15.220918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:15.562333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9dea5a94-3a9b-4f0b-934b-ac78a2364667 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c61254d7-050b-49fa-861a-f568e3814cab", "device": "/dev/sdb"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:15.565534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9dea5a94-3a9b-4f0b-934b-ac78a2364667 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:15.576151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dea5a94-3a9b-4f0b-934b-ac78a2364667 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:15.577844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dea5a94-3a9b-4f0b-934b-ac78a2364667 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:15.579413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dea5a94-3a9b-4f0b-934b-ac78a2364667 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:15.581750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dea5a94-3a9b-4f0b-934b-ac78a2364667 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:15.582389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dea5a94-3a9b-4f0b-934b-ac78a2364667 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:15.583805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9dea5a94-3a9b-4f0b-934b-ac78a2364667 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:15.602891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:15.611595 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00962176-d1e1-4a07-8698-0b7df9a7d5c3 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1270 microversion: 2.1 time: 0.418248 Oct 31 15:56:15.612190 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3027/6192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:15 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1270 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:16.119435 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9dea5a94-3a9b-4f0b-934b-ac78a2364667 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "POST /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.560970 Oct 31 15:56:16.121254 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3166/6193] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:56:15 2022] POST /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:56:16.638933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:16.639534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:16.653830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:16.658121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:16.658583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:16.659322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:16.659787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:16.660215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:16.810584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:16.819758 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f486ffb-c684-43a9-8319-01c8c82bedd9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1270 microversion: 2.1 time: 0.184769 Oct 31 15:56:16.824928 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3028/6194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:16 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:17.852107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:17.853047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:17.870491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:17.870994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:17.876442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:17.877883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:17.879243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:17.883687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:18.101880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:18.113863 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0356099-deeb-43a4-93d6-8b02e8139fff tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1312 microversion: 2.1 time: 0.265798 Oct 31 15:56:18.114708 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3167/6195] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:17 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1312 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:56:19.142474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:19.144437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:19.155256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:19.161285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:19.161950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:19.163312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:19.163938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:19.164545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:19.505503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-79dd7bc8-8315-475f-97fc-4c511ca51568 req-2b4e154e-496f-4217-8b2a-f7bea4a11a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "534f8bae-26c1-4961-9c9f-2c8c50887773", "tag": "8be0b180-5874-46c1-9834-e49d9f790397"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:19.539712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-79dd7bc8-8315-475f-97fc-4c511ca51568 req-2b4e154e-496f-4217-8b2a-f7bea4a11a47 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:19.540396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-79dd7bc8-8315-475f-97fc-4c511ca51568 req-2b4e154e-496f-4217-8b2a-f7bea4a11a47 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:19.540930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-79dd7bc8-8315-475f-97fc-4c511ca51568 req-2b4e154e-496f-4217-8b2a-f7bea4a11a47 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:19.561870 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-79dd7bc8-8315-475f-97fc-4c511ca51568 req-2b4e154e-496f-4217-8b2a-f7bea4a11a47 service nova] Creating event network-changed:8be0b180-5874-46c1-9834-e49d9f790397 for instance 534f8bae-26c1-4961-9c9f-2c8c50887773 on n-h2-858384-17 Oct 31 15:56:19.569774 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-79dd7bc8-8315-475f-97fc-4c511ca51568 req-2b4e154e-496f-4217-8b2a-f7bea4a11a47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072027 Oct 31 15:56:19.570936 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3168/6196] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:56:19.682430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:19.711321 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-850417bb-5c2c-40a4-b19e-50b0f96c1e03 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1312 microversion: 2.1 time: 0.573255 Oct 31 15:56:19.716869 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3029/6197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:19 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1312 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:20.740625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:20.741369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:20.758586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:20.759580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:20.761420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:20.767479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:20.768802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:20.772356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:21.108895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:21.118181 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dcb363ce-2ff3-424b-af18-7b37a4b5e687 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1312 microversion: 2.1 time: 0.381768 Oct 31 15:56:21.119519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3169/6198] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:20 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1312 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:22.150268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:22.151513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:22.162449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:22.163136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:22.163726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:22.166260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:22.166754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:22.174851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:22.602950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:22.611340 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a74e8ca-4a20-4937-9b47-997f659bc8e9 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1312 microversion: 2.1 time: 0.468363 Oct 31 15:56:22.619072 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3030/6199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:22 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1312 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:23.635290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:23.636599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:23.639655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:23.640547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:23.647308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:23.648034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:23.648631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:23.651247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:23.651882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:23.652488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:24.259399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:24.268917 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b2dd2785-098e-4431-a4bb-e3f382409fba tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1312 microversion: 2.1 time: 0.637399 Oct 31 15:56:24.269939 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3170/6200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:23 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1312 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:25.295736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:25.297068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:25.303318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:25.308149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:25.308704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:25.311167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:25.312046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:25.314302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:25.314799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:25.539245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5b5b9e30-e36b-4b81-9e48-6c71aed5ee0f req-7016029b-1d44-4a97-aa18-790394616547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534f8bae-26c1-4961-9c9f-2c8c50887773", "name": "network-vif-plugged", "status": "completed", "tag": "8be0b180-5874-46c1-9834-e49d9f790397"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:25.575640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5b5b9e30-e36b-4b81-9e48-6c71aed5ee0f req-7016029b-1d44-4a97-aa18-790394616547 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:25.577087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5b5b9e30-e36b-4b81-9e48-6c71aed5ee0f req-7016029b-1d44-4a97-aa18-790394616547 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:25.582417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5b5b9e30-e36b-4b81-9e48-6c71aed5ee0f req-7016029b-1d44-4a97-aa18-790394616547 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:25.635806 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5b5b9e30-e36b-4b81-9e48-6c71aed5ee0f req-7016029b-1d44-4a97-aa18-790394616547 service nova] Creating event network-vif-plugged:8be0b180-5874-46c1-9834-e49d9f790397 for instance 534f8bae-26c1-4961-9c9f-2c8c50887773 on n-h2-858384-17 Oct 31 15:56:25.663448 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5b5b9e30-e36b-4b81-9e48-6c71aed5ee0f req-7016029b-1d44-4a97-aa18-790394616547 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125327 Oct 31 15:56:25.664950 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3171/6201] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:25.705420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:25.735541 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ac6bed8-8b05-4321-abb8-f70f0a041bc8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1312 microversion: 2.1 time: 0.444887 Oct 31 15:56:25.740323 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3031/6202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:25 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1312 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:26.767137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:26.767872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:26.780310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:26.785917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:26.786645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:26.787401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:26.787866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:26.788305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:27.067868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:27.081031 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ab7fb66e-cea4-4d6c-8806-7aab8affc3b8 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1312 microversion: 2.1 time: 0.319728 Oct 31 15:56:27.098931 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3172/6203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:26 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1312 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:27.914851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f26a8477-04c4-4a5b-a4c4-87406c433993 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Action: 'create', calling method: .version_select at 0x7f16e0156c10>, body: {"keypair": {"name": "tempest-TestServerBasicOps-78686923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkPpaivy7hdHzng75GenCeVA/+zZhaqHQn9c8dACP71t8GETYNS3Abj+cinLad/c4V33qt/SoRd40h3qtM/6xS8Gpu3RXXaCYmntaKcLynOTbwneAdidKUZgTt+9DDOYQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:27.940990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f26a8477-04c4-4a5b-a4c4-87406c433993 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Getting quotas for project 7be0dbc5a63c4b84b43b2df9960317b7. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:56:27.947652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f26a8477-04c4-4a5b-a4c4-87406c433993 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Getting quotas for user c2848ad271544303ba2e2d81fa3e6d82 and project 7be0dbc5a63c4b84b43b2df9960317b7. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:56:27.988054 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f26a8477-04c4-4a5b-a4c4-87406c433993 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.281440 Oct 31 15:56:27.988793 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3032/6204] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:56:27 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:28.105872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:28.106487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:28.116205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:28.116697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:28.117593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:28.119788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:28.120421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:28.121076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:28.352373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:28.363891 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cf8faf01-51f7-4fd0-9f8e-64df838041f5 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1461 microversion: 2.1 time: 0.261841 Oct 31 15:56:28.369299 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3173/6205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:28 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1461 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:28.388329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fca3bf86-9079-42ef-a2d7-889e5749ec48 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b50af646-3cf4-46f9-b7f9-6dae34bead0c", "device": "/dev/sdb"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:28.391723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fca3bf86-9079-42ef-a2d7-889e5749ec48 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:28.398636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fca3bf86-9079-42ef-a2d7-889e5749ec48 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:28.399130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fca3bf86-9079-42ef-a2d7-889e5749ec48 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:28.399576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fca3bf86-9079-42ef-a2d7-889e5749ec48 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:28.400280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fca3bf86-9079-42ef-a2d7-889e5749ec48 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:28.400849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fca3bf86-9079-42ef-a2d7-889e5749ec48 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:28.401671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fca3bf86-9079-42ef-a2d7-889e5749ec48 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:28.714534 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fca3bf86-9079-42ef-a2d7-889e5749ec48 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "POST /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329700 Oct 31 15:56:28.715655 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3033/6206] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:56:28 2022] POST /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:29.550792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1080408795", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-78686923", "security_groups": [{"name": "tempest-secgroup-smoke-1271352539"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "70771e65-7974-4eb4-bf1b-331a1a8effdb"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:29.752085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] validate_networks() for [('70771e65-7974-4eb4-bf1b-331a1a8effdb', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:56:30.285101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Getting quotas for project 7be0dbc5a63c4b84b43b2df9960317b7. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:56:30.290813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Getting quotas for user c2848ad271544303ba2e2d81fa3e6d82 and project 7be0dbc5a63c4b84b43b2df9960317b7. Resources: dict_keys(['metadata_items']) {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:56:30.306865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:56:30.307419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:56:30.307956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:56:30.308371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:56:30.308823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:56:30.320718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:30.321262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:30.322381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:30.323187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:30.323918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:30.324382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:30.342584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Getting quotas for project 7be0dbc5a63c4b84b43b2df9960317b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:56:30.348946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Getting quotas for user c2848ad271544303ba2e2d81fa3e6d82 and project 7be0dbc5a63c4b84b43b2df9960317b7. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:56:30.363809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:56:30.366873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:56:30.442104 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c665e76-e770-4582-a64e-7ee52a275963 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891131 Oct 31 15:56:30.448725 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3174/6207] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:56:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:56:30.455610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-907bac42-f936-4118-9cf7-98cabb840ddd tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:30.456322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-907bac42-f936-4118-9cf7-98cabb840ddd tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:30.558298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-907bac42-f936-4118-9cf7-98cabb840ddd tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:30.569155 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-907bac42-f936-4118-9cf7-98cabb840ddd tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1301 microversion: 2.1 time: 0.115595 Oct 31 15:56:30.570607 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3034/6208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:30 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:31.596765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:31.598337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:31.610906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:31.612294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:31.613158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:31.614214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:31.615087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:31.626509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:31.744657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:31.817380 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f479821-4a7e-420b-9483-4bc2fe7a95ad tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1353 microversion: 2.1 time: 0.227314 Oct 31 15:56:31.822506 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3175/6209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:31 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1353 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:32.847949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:32.848557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:32.857200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:32.858001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:32.858603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:32.859872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:32.860681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:32.861302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:32.939803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:32.949076 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c63e87c-9bf0-42b1-ae9e-caf6633ba6ce tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1359 microversion: 2.1 time: 0.105683 Oct 31 15:56:32.949912 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3035/6210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:32 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1359 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:33.972791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:33.973483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:33.981883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:33.982588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:33.983212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:33.984432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:33.985238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:33.985917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:34.236859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:34.250566 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-153952ff-95a9-441a-808b-15abb5504c38 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1427 microversion: 2.1 time: 0.282270 Oct 31 15:56:34.265987 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3176/6211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:33 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1427 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:34.481104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f981f340-7552-48fa-a143-8bad2a09cf86 req-1e81b5c5-ea9a-4b20-8b07-999cd837a382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7fc5f4-a888-46dc-b891-5daff299cb0d", "tag": "10b9c465-9c22-40c5-98fb-eada891d8d34"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:34.510201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f981f340-7552-48fa-a143-8bad2a09cf86 req-1e81b5c5-ea9a-4b20-8b07-999cd837a382 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:34.510721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f981f340-7552-48fa-a143-8bad2a09cf86 req-1e81b5c5-ea9a-4b20-8b07-999cd837a382 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:34.511251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f981f340-7552-48fa-a143-8bad2a09cf86 req-1e81b5c5-ea9a-4b20-8b07-999cd837a382 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:34.527327 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f981f340-7552-48fa-a143-8bad2a09cf86 req-1e81b5c5-ea9a-4b20-8b07-999cd837a382 service nova] Creating event network-changed:10b9c465-9c22-40c5-98fb-eada891d8d34 for instance be7fc5f4-a888-46dc-b891-5daff299cb0d on n-h1-858384-17 Oct 31 15:56:34.534112 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f981f340-7552-48fa-a143-8bad2a09cf86 req-1e81b5c5-ea9a-4b20-8b07-999cd837a382 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061207 Oct 31 15:56:34.535121 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3036/6212] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:35.276326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:35.277172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:35.284362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:35.284887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:35.285356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:35.286053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:35.286719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:35.287153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:35.429841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:35.438798 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b487941f-2745-429a-9c3a-950e900ca683 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1427 microversion: 2.1 time: 0.166968 Oct 31 15:56:35.439514 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3177/6213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:35 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1427 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:36.463846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:36.464483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:36.472297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:36.473067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:36.473528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:36.474243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:36.474867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:36.475316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:36.641909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:36.650100 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bcc02d29-4049-4cdd-9e64-7430c6e7e06e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1427 microversion: 2.1 time: 0.191656 Oct 31 15:56:36.650898 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3037/6214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:36 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1427 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:37.673957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:37.675471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:37.678534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:37.684275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:37.684770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:37.685227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:37.685954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:37.686417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:37.686864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:37.693202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:37.839755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:37.848344 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f60ee2d-2870-4859-ab25-7122248e675f tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1427 microversion: 2.1 time: 0.178511 Oct 31 15:56:37.861495 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3178/6215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:37 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:38.822866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-dca159fc-1230-4702-a40d-bcfbe28a0964 req-b81fa4c2-aaeb-4a4d-b602-2984f201aff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7fc5f4-a888-46dc-b891-5daff299cb0d", "name": "network-vif-plugged", "status": "completed", "tag": "10b9c465-9c22-40c5-98fb-eada891d8d34"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:38.830036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:38.836074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dca159fc-1230-4702-a40d-bcfbe28a0964 req-b81fa4c2-aaeb-4a4d-b602-2984f201aff5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:38.836560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dca159fc-1230-4702-a40d-bcfbe28a0964 req-b81fa4c2-aaeb-4a4d-b602-2984f201aff5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:38.836991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dca159fc-1230-4702-a40d-bcfbe28a0964 req-b81fa4c2-aaeb-4a4d-b602-2984f201aff5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:38.841513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:38.850371 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-dca159fc-1230-4702-a40d-bcfbe28a0964 req-b81fa4c2-aaeb-4a4d-b602-2984f201aff5 service nova] Creating event network-vif-plugged:10b9c465-9c22-40c5-98fb-eada891d8d34 for instance be7fc5f4-a888-46dc-b891-5daff299cb0d on n-h1-858384-17 Oct 31 15:56:38.855830 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-dca159fc-1230-4702-a40d-bcfbe28a0964 req-b81fa4c2-aaeb-4a4d-b602-2984f201aff5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036837 Oct 31 15:56:38.856532 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3038/6216] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:38.873276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:38.874840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:38.882516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:38.882716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:38.883065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:38.884165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:38.884850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:38.885495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:39.083976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:39.091874 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd5b0720-36fb-4042-b0fa-e7a3fbd9b24e tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1427 microversion: 2.1 time: 0.222718 Oct 31 15:56:39.092466 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3179/6217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:38 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1427 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:40.116854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:40.118690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:40.127808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:40.128348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:40.128827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:40.129571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:40.130034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:40.130463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:40.269656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:40.284390 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c295615a-2653-4fc4-9d1a-c4577ca553ed tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1608 microversion: 2.1 time: 0.173112 Oct 31 15:56:40.285017 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3039/6218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:40 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1608 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:40.309510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:40.310128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:40.317604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:40.318101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:40.318543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:40.319284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:40.319745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:40.320207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:40.335323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:40.358083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:40.494293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:40.502126 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a56e6a0-6140-4670-99ed-4202c8cf41fa tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1608 microversion: 2.1 time: 0.196594 Oct 31 15:56:40.502708 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3180/6219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:40 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1608 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:40.525325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:40.525928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:40.533089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:40.533642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:40.534080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:40.534769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:40.535226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:40.535652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:40.566450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:56:40.685313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:40.694383 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71f935de-6b57-4124-8941-9b3badaa8b5d tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1608 microversion: 2.1 time: 0.173143 Oct 31 15:56:40.694971 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3040/6220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:40 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1608 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:42.579001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-621ed02b-3414-40b9-b3fb-038e6c17b5b9 req-a47b75c4-c4fb-4fd2-95f4-b6793dc28d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7fc5f4-a888-46dc-b891-5daff299cb0d", "tag": "10b9c465-9c22-40c5-98fb-eada891d8d34"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:42.591683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-621ed02b-3414-40b9-b3fb-038e6c17b5b9 req-a47b75c4-c4fb-4fd2-95f4-b6793dc28d2f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:42.592280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-621ed02b-3414-40b9-b3fb-038e6c17b5b9 req-a47b75c4-c4fb-4fd2-95f4-b6793dc28d2f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:42.593571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-621ed02b-3414-40b9-b3fb-038e6c17b5b9 req-a47b75c4-c4fb-4fd2-95f4-b6793dc28d2f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:42.610284 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-621ed02b-3414-40b9-b3fb-038e6c17b5b9 req-a47b75c4-c4fb-4fd2-95f4-b6793dc28d2f service nova] Creating event network-changed:10b9c465-9c22-40c5-98fb-eada891d8d34 for instance be7fc5f4-a888-46dc-b891-5daff299cb0d on n-h1-858384-17 Oct 31 15:56:42.616352 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-621ed02b-3414-40b9-b3fb-038e6c17b5b9 req-a47b75c4-c4fb-4fd2-95f4-b6793dc28d2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041282 Oct 31 15:56:42.620758 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3181/6221] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:56:43.509495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:43.510072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:43.518337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:43.518840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:43.519494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:43.520237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:43.520709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:43.521192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:43.618104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lazy-loading 'services' on Instance uuid 3022bbcb-d416-4bd7-af57-4b7f3efb705d {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:56:43.697311 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-04eaf32f-1c0e-406a-8037-95eaacd7920a tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d/os-volume_attachments/c61254d7-050b-49fa-861a-f568e3814cab" status: 202 len: 0 microversion: 2.1 time: 0.191711 Oct 31 15:56:43.698520 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3041/6222] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:56:43 2022] DELETE /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d/os-volume_attachments/c61254d7-050b-49fa-861a-f568e3814cab => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:56:49.163458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:49.164028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:49.172391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:49.172974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:49.173471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:49.174161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:49.174634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:49.175051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:49.203429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:56:49.294848 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-922eb45d-b4e4-4756-9900-4be56e2fc34f tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 204 len: 0 microversion: 2.1 time: 0.135235 Oct 31 15:56:49.296716 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3182/6223] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:56:49 2022] DELETE /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 15:56:49.306865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:49.307495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:49.314451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:49.314936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:49.315398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:49.316091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:49.316547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:49.316970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:49.460853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:49.470235 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9193245-de75-4a87-ad6e-9a0aae948ec6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1514 microversion: 2.1 time: 0.168741 Oct 31 15:56:49.485520 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3042/6224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:49 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:50.494229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:50.494936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:50.502345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:50.502834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:50.503273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:50.504043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:50.504527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:50.504963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:50.657914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:50.667065 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d12d75f-a4f7-463b-bff8-10c41e51d2b7 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1514 microversion: 2.1 time: 0.177009 Oct 31 15:56:50.669195 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3183/6225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:50 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:51.273331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-de204267-67c6-4c76-a031-f09185901b25 req-7590b8bf-2740-4b4c-89a9-61aaf2cef5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3022bbcb-d416-4bd7-af57-4b7f3efb705d", "name": "network-vif-deleted", "tag": "9e9dd32e-fdc6-4d13-9e02-79614167f45f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:51.287053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-de204267-67c6-4c76-a031-f09185901b25 req-7590b8bf-2740-4b4c-89a9-61aaf2cef5b9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:51.287558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-de204267-67c6-4c76-a031-f09185901b25 req-7590b8bf-2740-4b4c-89a9-61aaf2cef5b9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:51.287994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-de204267-67c6-4c76-a031-f09185901b25 req-7590b8bf-2740-4b4c-89a9-61aaf2cef5b9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:51.300738 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-de204267-67c6-4c76-a031-f09185901b25 req-7590b8bf-2740-4b4c-89a9-61aaf2cef5b9 service nova] Creating event network-vif-deleted:9e9dd32e-fdc6-4d13-9e02-79614167f45f for instance 3022bbcb-d416-4bd7-af57-4b7f3efb705d on n-h1-858384-17 Oct 31 15:56:51.306099 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-de204267-67c6-4c76-a031-f09185901b25 req-7590b8bf-2740-4b4c-89a9-61aaf2cef5b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036580 Oct 31 15:56:51.306924 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3043/6226] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:56:51.692506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:51.693308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:51.700264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:51.700825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:51.701380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:51.703246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:51.703772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:51.704263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:51.741784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:51.742272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:51.742713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:51.743271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lazy-loading 'fault' on Instance uuid 3022bbcb-d416-4bd7-af57-4b7f3efb705d {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:56:51.800449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:56:51.809925 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-307aeeb9-2f13-4e00-84c0-4f9d8a58b908 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 200 len: 1308 microversion: 2.1 time: 0.121231 Oct 31 15:56:51.810525 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3184/6227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:51 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:56:52.836863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:56:52.837585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 3022bbcb-d416-4bd7-af57-4b7f3efb705d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:56:52.844582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:52.845266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:52.845816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:52.846662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:56:52.847424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:56:52.847968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:56:52.863472 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] HTTP exception thrown: Instance 3022bbcb-d416-4bd7-af57-4b7f3efb705d could not be found. Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Request method failure captured: Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d HTTP/1.1 Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX--w6fKCjkKegEC7IttoDRe87xCjZ-5-OO40bFQQFsAI6O4EI9_SxM-qJ9J2Hz2vANlIn1udG8N-twQymMscJei4tzSnbuyWvE592ZJ5STWTprlsNSdeUbWtuZobKFBneNTIDRXqHNzNLAVwSgw57E_tWy4IFL1cntAp256dnRtBNts Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: e8ae467501884cc084d306dba1266447 Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1784723470 Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e8ae467501884cc084d306dba1266447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e8ae467501884cc084d306dba1266447", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e8ae467501884cc084d306dba1266447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e8ae467501884cc084d306dba1266447"}]}] Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-VolumesSnapshotTestJSON-1784723470 Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: e8ae467501884cc084d306dba1266447 Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1784723470 Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-VolumesSnapshotTestJSON-1784723470-project Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 2e09bf3d04534af69a487be8ad5d2b5c Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-VolumesSnapshotTestJSON-1784723470-project Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 3022bbcb-d416-4bd7-af57-4b7f3efb705d could not be found. Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '3022bbcb-d416-4bd7-af57-4b7f3efb705d'} Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3022bbcb-d416-4bd7-af57-4b7f3efb705d could not be found. Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3022bbcb-d416-4bd7-af57-4b7f3efb705d could not be found. Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:56:52.865165 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3022bbcb-d416-4bd7-af57-4b7f3efb705d could not be found. Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Returning 404 to user: Instance 3022bbcb-d416-4bd7-af57-4b7f3efb705d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d08cae82-ef0f-45bb-9aa4-130f3b85ef10 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d" status: 404 len: 111 microversion: 2.1 time: 0.034856 Oct 31 15:56:52.869468 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3044/6228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:56:52 2022] GET /compute/v2.1/servers/3022bbcb-d416-4bd7-af57-4b7f3efb705d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 15:56:59.725827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1095201314", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "869405ec-2a69-4494-9c77-e064fa875558"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:56:59.790054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] validate_networks() for [('869405ec-2a69-4494-9c77-e064fa875558', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:57:00.490737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:57:00.491155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:57:00.491695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:57:00.492129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:57:00.492554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:57:00.502395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:00.503065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:00.503558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:00.504277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:00.504729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:00.505172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:00.522278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Getting quotas for project e8ae467501884cc084d306dba1266447. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:57:00.527551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Getting quotas for user 2e09bf3d04534af69a487be8ad5d2b5c and project e8ae467501884cc084d306dba1266447. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:57:00.540428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:57:00.542982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:57:00.593439 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4b198adc-f495-478c-9af0-65847eab36ee tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871727 Oct 31 15:57:00.600156 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3185/6229] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:56:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:57:00.605809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2bcdcdbe-4782-4009-8f1d-f2bb6fc70130 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:00.606809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2bcdcdbe-4782-4009-8f1d-f2bb6fc70130 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:00.668083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2bcdcdbe-4782-4009-8f1d-f2bb6fc70130 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:00.676191 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2bcdcdbe-4782-4009-8f1d-f2bb6fc70130 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1219 microversion: 2.1 time: 0.074725 Oct 31 15:57:00.676764 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3045/6230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:00 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:01.700271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:01.701556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:01.709314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:01.710064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:01.710905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:01.711435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:01.712043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:01.712793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:01.814842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:01.830578 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac4af639-d5db-4633-8c83-d3757215caac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1279 microversion: 2.1 time: 0.134977 Oct 31 15:57:01.831205 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3186/6231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:01 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1279 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:02.859999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:02.860660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:02.863886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:02.873961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:02.874720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:02.875188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:02.875930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:02.876380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:02.876810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:03.110919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:03.118984 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc30d46c-eda8-40a1-aabd-a4888a0282d0 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1319 microversion: 2.1 time: 0.263982 Oct 31 15:57:03.119576 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3046/6232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:02 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:03.272127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9b0246aa-02c0-4b60-948d-41b85449b9dd req-72d9306f-7058-4114-8eb5-0894d3264c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4249b272-a2ce-4a8b-b8ab-c1dcc04edba4", "tag": "5cc128e4-4d66-4739-9999-bc5c0f1eff04"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:03.288276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b0246aa-02c0-4b60-948d-41b85449b9dd req-72d9306f-7058-4114-8eb5-0894d3264c1e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:03.288779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b0246aa-02c0-4b60-948d-41b85449b9dd req-72d9306f-7058-4114-8eb5-0894d3264c1e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:03.300101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b0246aa-02c0-4b60-948d-41b85449b9dd req-72d9306f-7058-4114-8eb5-0894d3264c1e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:03.334754 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9b0246aa-02c0-4b60-948d-41b85449b9dd req-72d9306f-7058-4114-8eb5-0894d3264c1e service nova] Creating event network-changed:5cc128e4-4d66-4739-9999-bc5c0f1eff04 for instance 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 on n-h2-858384-17 Oct 31 15:57:03.341576 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9b0246aa-02c0-4b60-948d-41b85449b9dd req-72d9306f-7058-4114-8eb5-0894d3264c1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079175 Oct 31 15:57:03.343161 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3187/6233] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:04.159431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:04.160433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:04.168046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:04.168705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:04.169176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:04.170570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:04.171143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:04.171666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:04.310840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:04.318569 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fcff08f6-68cf-4d29-b5c5-2318810467e6 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1319 microversion: 2.1 time: 0.165341 Oct 31 15:57:04.319176 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3047/6234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:04 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:05.343651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:05.344526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:05.351255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:05.351859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:05.352409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:05.353244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:05.353810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:05.354352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:05.507551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:05.517387 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9715744b-702f-493d-95a3-e7319ed6b603 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1319 microversion: 2.1 time: 0.179004 Oct 31 15:57:05.517996 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3188/6235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:05 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:06.548717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:06.549977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:06.561650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:06.563428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:06.564419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:06.565467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:06.566175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:06.566678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:06.709577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:06.717984 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b29924c-9c1d-4971-8e1d-5e6eeb53d982 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1319 microversion: 2.1 time: 0.178737 Oct 31 15:57:06.719120 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3048/6236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:06 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:07.424176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9e8daa27-e482-4ffb-a4e7-e927c6319b01 req-08deaad8-17c2-463e-ada3-b823ff1a0ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4249b272-a2ce-4a8b-b8ab-c1dcc04edba4", "name": "network-vif-plugged", "status": "completed", "tag": "5cc128e4-4d66-4739-9999-bc5c0f1eff04"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:07.436824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9e8daa27-e482-4ffb-a4e7-e927c6319b01 req-08deaad8-17c2-463e-ada3-b823ff1a0ff4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:07.437446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9e8daa27-e482-4ffb-a4e7-e927c6319b01 req-08deaad8-17c2-463e-ada3-b823ff1a0ff4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:07.437882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9e8daa27-e482-4ffb-a4e7-e927c6319b01 req-08deaad8-17c2-463e-ada3-b823ff1a0ff4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:07.449231 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9e8daa27-e482-4ffb-a4e7-e927c6319b01 req-08deaad8-17c2-463e-ada3-b823ff1a0ff4 service nova] Creating event network-vif-plugged:5cc128e4-4d66-4739-9999-bc5c0f1eff04 for instance 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 on n-h2-858384-17 Oct 31 15:57:07.454912 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9e8daa27-e482-4ffb-a4e7-e927c6319b01 req-08deaad8-17c2-463e-ada3-b823ff1a0ff4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034509 Oct 31 15:57:07.455531 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3189/6237] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:07.741706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:07.742422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:07.749861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:07.750351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:07.751128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:07.751541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:07.752004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:07.752434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:07.895505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:07.903250 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a82cb994-2a26-43d7-ac4e-bcf42f4adb22 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1319 microversion: 2.1 time: 0.165456 Oct 31 15:57:07.904716 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3049/6238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:07 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:08.929249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:08.930152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:08.932153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:08.939352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:08.939900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:08.940329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:08.941025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:08.941508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:08.941926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:08.945107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:09.087329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:09.095836 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ae163ad-04a2-4440-9909-47bc60fcefac tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1508 microversion: 2.1 time: 0.171668 Oct 31 15:57:09.096436 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3190/6239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:08 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:09.121745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8f1b902-540b-42ea-a4ef-43261b09d576 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fcd3ca4-f2df-4978-a508-ca3e38b8b181", "device": "/dev/sdb"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:09.124429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f8f1b902-540b-42ea-a4ef-43261b09d576 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:09.131698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8f1b902-540b-42ea-a4ef-43261b09d576 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:09.132211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8f1b902-540b-42ea-a4ef-43261b09d576 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:09.132656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8f1b902-540b-42ea-a4ef-43261b09d576 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:09.133413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8f1b902-540b-42ea-a4ef-43261b09d576 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:09.133880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8f1b902-540b-42ea-a4ef-43261b09d576 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:09.134315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8f1b902-540b-42ea-a4ef-43261b09d576 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:09.395495 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8f1b902-540b-42ea-a4ef-43261b09d576 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "POST /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277634 Oct 31 15:57:09.396125 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3050/6240] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 15:57:09 2022] POST /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:18.628012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20450478-7bea-47ff-b312-a0d7dd498fa7 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:18.628538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-20450478-7bea-47ff-b312-a0d7dd498fa7 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:18.631325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:18.631995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:18.638940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20450478-7bea-47ff-b312-a0d7dd498fa7 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:18.639446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20450478-7bea-47ff-b312-a0d7dd498fa7 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:18.639884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20450478-7bea-47ff-b312-a0d7dd498fa7 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:18.640582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20450478-7bea-47ff-b312-a0d7dd498fa7 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:18.641035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20450478-7bea-47ff-b312-a0d7dd498fa7 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:18.641486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20450478-7bea-47ff-b312-a0d7dd498fa7 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:18.666596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-20450478-7bea-47ff-b312-a0d7dd498fa7 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042578 Oct 31 15:57:18.667371 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3191/6241] 10.222.0.20 () {58 vars in 1293 bytes} [Mon Oct 31 15:57:18 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:31.010975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:31.012404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=27 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:31.013275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:31.017655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:31.018271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:31.026874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:31.027367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:31.028559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:31.029489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:31.030061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:31.030501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:31.112805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lazy-loading 'services' on Instance uuid 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:57:31.184710 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76cc064e-fd98-4eac-9a68-c07dcf6b106b tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4/os-volume_attachments/5fcd3ca4-f2df-4978-a508-ca3e38b8b181" status: 202 len: 0 microversion: 2.1 time: 0.174808 Oct 31 15:57:31.185868 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3051/6242] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:57:31 2022] DELETE /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4/os-volume_attachments/5fcd3ca4-f2df-4978-a508-ca3e38b8b181 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:57:34.935507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:34.936066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:34.938372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:34.939291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=9 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:57:34.945657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:34.946149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:34.946582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:34.947279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:34.947732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:34.948157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:35.032731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lazy-loading 'services' on Instance uuid 534f8bae-26c1-4961-9c9f-2c8c50887773 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:57:35.104796 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cfb85968-fa71-4cbf-ba11-c75405176489 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "DELETE /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773/os-volume_attachments/b50af646-3cf4-46f9-b7f9-6dae34bead0c" status: 202 len: 0 microversion: 2.1 time: 0.173396 Oct 31 15:57:35.106123 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3192/6243] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 15:57:34 2022] DELETE /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773/os-volume_attachments/b50af646-3cf4-46f9-b7f9-6dae34bead0c => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 15:57:36.642437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:36.642967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:36.649231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:36.649720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:36.650155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:36.650848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:36.651312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:36.651731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:36.681109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:57:36.759057 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-266cf2f8-b8e2-42ad-94a3-79c913c1e587 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 204 len: 0 microversion: 2.1 time: 0.121737 Oct 31 15:57:36.759910 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3052/6244] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:57:36 2022] DELETE /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:57:36.769267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:36.769967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:36.778259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:36.778866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:36.779306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:36.780007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:36.780466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:36.780893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:36.913800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:36.921995 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8e2490b2-f63e-4fed-9404-10a3d07384d8 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1514 microversion: 2.1 time: 0.157074 Oct 31 15:57:36.922574 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3193/6245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:36 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:37.946304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:37.947016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:37.954807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:37.955299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:37.955732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:37.956436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:37.956888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:37.957443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:38.115269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:38.129862 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91c9c3fb-04bc-4e8b-ac9e-25b796ffc719 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1514 microversion: 2.1 time: 0.188046 Oct 31 15:57:38.130485 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3053/6246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:37 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:38.986250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b2876094-be91-49c8-aaaf-198ad531c7dc req-69aa36c6-91f0-492d-a85d-9bb89b709216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4249b272-a2ce-4a8b-b8ab-c1dcc04edba4", "name": "network-vif-deleted", "tag": "5cc128e4-4d66-4739-9999-bc5c0f1eff04"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:38.998409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b2876094-be91-49c8-aaaf-198ad531c7dc req-69aa36c6-91f0-492d-a85d-9bb89b709216 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:38.999253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b2876094-be91-49c8-aaaf-198ad531c7dc req-69aa36c6-91f0-492d-a85d-9bb89b709216 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:38.999982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b2876094-be91-49c8-aaaf-198ad531c7dc req-69aa36c6-91f0-492d-a85d-9bb89b709216 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:39.019170 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b2876094-be91-49c8-aaaf-198ad531c7dc req-69aa36c6-91f0-492d-a85d-9bb89b709216 service nova] Creating event network-vif-deleted:5cc128e4-4d66-4739-9999-bc5c0f1eff04 for instance 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 on n-h2-858384-17 Oct 31 15:57:39.025840 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b2876094-be91-49c8-aaaf-198ad531c7dc req-69aa36c6-91f0-492d-a85d-9bb89b709216 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043621 Oct 31 15:57:39.026459 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3194/6247] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:39.154933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:39.155550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:39.163301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:39.163792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:39.164224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:39.165355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:39.165807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:39.167022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:39.212870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:39.213460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:39.213895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:39.214336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lazy-loading 'fault' on Instance uuid 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:57:39.260017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e09bf3d04534af69a487be8ad5d2b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8ae467501884cc084d306dba1266447', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:39.267816 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4bbb7fb-bf90-4add-91e9-befaf2169b3d tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 200 len: 1309 microversion: 2.1 time: 0.117017 Oct 31 15:57:39.268406 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3054/6248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:39 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:40.292299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:40.293401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] [instance: 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:40.300577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:40.301066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:40.301527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:40.302230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:40.302685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:40.303110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:40.317704 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] HTTP exception thrown: Instance 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 could not be found. Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Request method failure captured: Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 HTTP/1.1 Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX--w6fKCjkKegEC7IttoDRe87xCjZ-5-OO40bFQQFsAI6O4EI9_SxM-qJ9J2Hz2vANlIn1udG8N-twQymMscJei4tzSnbuyWvE592ZJ5STWTprlsNSdeUbWtuZobKFBneNTIDRXqHNzNLAVwSgw57E_tWy4IFL1cntAp256dnRtBNts Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: e8ae467501884cc084d306dba1266447 Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1784723470 Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e8ae467501884cc084d306dba1266447"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e8ae467501884cc084d306dba1266447", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e8ae467501884cc084d306dba1266447"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e8ae467501884cc084d306dba1266447"}]}] Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesSnapshotTestJSON-1784723470 Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: e8ae467501884cc084d306dba1266447 Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1784723470 Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesSnapshotTestJSON-1784723470-project Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 2e09bf3d04534af69a487be8ad5d2b5c Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesSnapshotTestJSON-1784723470-project Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 could not be found. Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '4249b272-a2ce-4a8b-b8ab-c1dcc04edba4'} Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 could not be found. Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 could not be found. Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:40.319356 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 could not be found. Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] Returning 404 to user: Instance 4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8381b705-f091-4e36-9e1a-40d7f0829cd2 tempest-VolumesSnapshotTestJSON-1784723470 tempest-VolumesSnapshotTestJSON-1784723470-project] 10.222.0.20 "GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4" status: 404 len: 111 microversion: 2.1 time: 0.033038 Oct 31 15:57:40.324779 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3195/6249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:40 2022] GET /compute/v2.1/servers/4249b272-a2ce-4a8b-b8ab-c1dcc04edba4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:57:40.747829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:40.748344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:40.755305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:40.755794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:40.756229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:40.756924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:40.757422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:40.757848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:40.783363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 15:57:40.864592 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89480efe-9f51-4229-9093-13b6dad14661 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "DELETE /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 204 len: 0 microversion: 2.1 time: 0.121211 Oct 31 15:57:40.865553 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3055/6250] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 15:57:40 2022] DELETE /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 15:57:40.876660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:40.877425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:40.883875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:40.884395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:40.884837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:40.885571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:40.886033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:40.886593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:41.019734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:41.028940 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e0bd0d4-96bd-43a2-82d7-98a18c5a1588 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1467 microversion: 2.1 time: 0.158399 Oct 31 15:57:41.029565 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3196/6251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:40 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1467 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:42.053823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:42.054516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:42.062138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:42.062630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:42.063091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:42.063780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:42.064236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:42.064655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:42.198062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:42.206073 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-11abd3a3-c8b4-4b39-bb72-20cbf0a4ab6e tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1467 microversion: 2.1 time: 0.156789 Oct 31 15:57:42.206686 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3056/6252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:42 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1467 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:57:43.060217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3e85bb85-3a49-4754-af87-ef073656005f req-6230679b-5a27-450c-bfb4-ce55e8bcccea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "534f8bae-26c1-4961-9c9f-2c8c50887773", "name": "network-vif-deleted", "tag": "8be0b180-5874-46c1-9834-e49d9f790397"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:57:43.090806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e85bb85-3a49-4754-af87-ef073656005f req-6230679b-5a27-450c-bfb4-ce55e8bcccea service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:43.091904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e85bb85-3a49-4754-af87-ef073656005f req-6230679b-5a27-450c-bfb4-ce55e8bcccea service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:43.092584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e85bb85-3a49-4754-af87-ef073656005f req-6230679b-5a27-450c-bfb4-ce55e8bcccea service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:43.114809 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3e85bb85-3a49-4754-af87-ef073656005f req-6230679b-5a27-450c-bfb4-ce55e8bcccea service nova] Creating event network-vif-deleted:8be0b180-5874-46c1-9834-e49d9f790397 for instance 534f8bae-26c1-4961-9c9f-2c8c50887773 on n-h2-858384-17 Oct 31 15:57:43.123663 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3e85bb85-3a49-4754-af87-ef073656005f req-6230679b-5a27-450c-bfb4-ce55e8bcccea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067236 Oct 31 15:57:43.124853 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3197/6253] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:57:43.228709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:43.229295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:43.237439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:43.238059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:43.238851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:43.239530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:43.239998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:43.240428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:43.284134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:43.284818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:43.285543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:43.286094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lazy-loading 'fault' on Instance uuid 534f8bae-26c1-4961-9c9f-2c8c50887773 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 15:57:43.330034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '041dd4daa75d4aed8b149fbcf4903195', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708799f868de4675b3e5af3f38bf2949', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:57:43.340185 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdca7e2e-209b-46d7-a078-fb73f568872b tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 200 len: 1302 microversion: 2.1 time: 0.114754 Oct 31 15:57:43.341712 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3057/6254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:43 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 1302 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:57:44.366273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:57:44.367082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] [instance: 534f8bae-26c1-4961-9c9f-2c8c50887773] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:57:44.375079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:44.375691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:44.376198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:44.376982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:57:44.377539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:57:44.378037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:57:44.395948 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] HTTP exception thrown: Instance 534f8bae-26c1-4961-9c9f-2c8c50887773 could not be found. Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Request method failure captured: Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 HTTP/1.1 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_AYlJYzcmT3n29o1bxH9Cyfd49BHxPtf4nCP8DsotxgsXOKz3EYUp6goq5clbcbdYZD7N_MEOrFlOmVCDrxCYrDeT8q01tawTfnI0wLtAGVHHlKHnsgznC5EbxVI_c9WzVj8ARQEF1kIOyxySjC0K6WWLHpxLhKvnMqLqhAxAe4p_w Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 708799f868de4675b3e5af3f38bf2949 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesBackupsTest-237535244 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/708799f868de4675b3e5af3f38bf2949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_708799f868de4675b3e5af3f38bf2949", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/708799f868de4675b3e5af3f38bf2949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/708799f868de4675b3e5af3f38bf2949"}]}] Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesBackupsTest-237535244 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 708799f868de4675b3e5af3f38bf2949 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesBackupsTest-237535244 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesBackupsTest-237535244-project Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 041dd4daa75d4aed8b149fbcf4903195 Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesBackupsTest-237535244-project Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 534f8bae-26c1-4961-9c9f-2c8c50887773 could not be found. Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '534f8bae-26c1-4961-9c9f-2c8c50887773'} Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 534f8bae-26c1-4961-9c9f-2c8c50887773 could not be found. Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 534f8bae-26c1-4961-9c9f-2c8c50887773 could not be found. Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 15:57:44.397828 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:44.402661 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 15:57:44.402661 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 15:57:44.402661 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 15:57:44.402661 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 15:57:44.402661 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 15:57:44.402661 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 534f8bae-26c1-4961-9c9f-2c8c50887773 could not be found. Oct 31 15:57:44.402661 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 15:57:44.402661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] Returning 404 to user: Instance 534f8bae-26c1-4961-9c9f-2c8c50887773 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 15:57:44.402661 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-27b80f34-27aa-44f0-9206-4f7448fa3800 tempest-VolumesBackupsTest-237535244 tempest-VolumesBackupsTest-237535244-project] 10.222.0.20 "GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773" status: 404 len: 111 microversion: 2.1 time: 0.039843 Oct 31 15:57:44.404189 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3198/6255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:57:44 2022] GET /compute/v2.1/servers/534f8bae-26c1-4961-9c9f-2c8c50887773 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 15:58:39.816114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:39.817997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:39.826155 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 31 15:58:39.831302 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:58:39.832752 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 15:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.20) !!! Oct 31 15:58:40.010513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-edc996cf-f245-4f89-be51-23ce44eb0242 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1180627677", "availability_zone": "foo_zone"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:40.014664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.aggregate [None req-edc996cf-f245-4f89-be51-23ce44eb0242 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Generated uuid 45f17e11-3009-4561-b3e5-5230642a30c3 for aggregate {{(pid=120588) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 31 15:58:40.060474 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-edc996cf-f245-4f89-be51-23ce44eb0242 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.267408 Oct 31 15:58:40.064296 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3058/6256] 10.222.0.20 () {60 vars in 1164 bytes} [Mon Oct 31 15:58:39 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:40.077909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-731902c7-0629-4ac3-85f2-82265c115786 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:40.083089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=14 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:40.083927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:40.085426 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 15:58:40.085729 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 15:58:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates/19/action (ip 10.222.0.20) !!! Oct 31 15:58:40.125559 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-731902c7-0629-4ac3-85f2-82265c115786 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.053468 Oct 31 15:58:40.134962 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3199/6257] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:58:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:40.139463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-282c3bf7-1b1c-4e49-9ea2-5d32780d8839 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:40.143505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-282c3bf7-1b1c-4e49-9ea2-5d32780d8839 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:40.144254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-282c3bf7-1b1c-4e49-9ea2-5d32780d8839 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:40.144947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-282c3bf7-1b1c-4e49-9ea2-5d32780d8839 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:40.145948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-282c3bf7-1b1c-4e49-9ea2-5d32780d8839 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:40.146650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-282c3bf7-1b1c-4e49-9ea2-5d32780d8839 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:40.147324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-282c3bf7-1b1c-4e49-9ea2-5d32780d8839 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:40.179581 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-282c3bf7-1b1c-4e49-9ea2-5d32780d8839 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.043805 Oct 31 15:58:40.180932 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3059/6258] 10.222.0.20 () {58 vars in 1176 bytes} [Mon Oct 31 15:58:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:58:40.193541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1f59b806-0411-4687-ae9d-e1b3f6d38b5e tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:40.203720 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1f59b806-0411-4687-ae9d-e1b3f6d38b5e tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.013940 Oct 31 15:58:40.214793 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3200/6259] 10.222.0.20 () {58 vars in 1143 bytes} [Mon Oct 31 15:58:40 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:40.227069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc03055c-235b-464b-8515-e54a469e72e6 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-858384-17"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:40.241730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc03055c-235b-464b-8515-e54a469e72e6 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:40.242431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc03055c-235b-464b-8515-e54a469e72e6 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:40.243788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc03055c-235b-464b-8515-e54a469e72e6 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:40.591746 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc03055c-235b-464b-8515-e54a469e72e6 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.369872 Oct 31 15:58:40.592692 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3060/6260] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:58:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:40.604488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bf7f659d-6226-4c88-b7c7-99b83f9df550 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:40.612696 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bf7f659d-6226-4c88-b7c7-99b83f9df550 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.012470 Oct 31 15:58:40.613561 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3201/6261] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:58:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:40.630631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f4c64f7-d123-4f09-8cff-d91b18e1e0dc tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-533690713", "availability_zone": "foo_zone"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:40.705328 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f4c64f7-d123-4f09-8cff-d91b18e1e0dc tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.080055 Oct 31 15:58:40.706061 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3061/6262] 10.222.0.20 () {60 vars in 1173 bytes} [Mon Oct 31 15:58:40 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:40.717393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-56eb336f-1af2-4586-9fd2-1bdc9bfbd9a4 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:40.742530 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-56eb336f-1af2-4586-9fd2-1bdc9bfbd9a4 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.028993 Oct 31 15:58:40.744562 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3202/6263] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:58:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:58:40.757231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec2ec0bd-84d3-411e-8a0c-24783861d55e tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:40.766530 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec2ec0bd-84d3-411e-8a0c-24783861d55e tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.013508 Oct 31 15:58:40.767278 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3062/6264] 10.222.0.20 () {58 vars in 1152 bytes} [Mon Oct 31 15:58:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:40.778774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c5573caf-7fc3-49e1-b2dd-a31a94132ad1 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-858384-17"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:40.791801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5573caf-7fc3-49e1-b2dd-a31a94132ad1 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:40.792324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5573caf-7fc3-49e1-b2dd-a31a94132ad1 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:40.792887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c5573caf-7fc3-49e1-b2dd-a31a94132ad1 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:40.983693 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c5573caf-7fc3-49e1-b2dd-a31a94132ad1 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.208548 Oct 31 15:58:40.984438 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3203/6265] 10.222.0.20 () {60 vars in 1194 bytes} [Mon Oct 31 15:58:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:58:40.995970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7e57cd5-4869-4f63-891f-aaed2b6f3936 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:41.021459 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b7e57cd5-4869-4f63-891f-aaed2b6f3936 tempest-TestAggregatesBasicOps-866348244 tempest-TestAggregatesBasicOps-866348244-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.029323 Oct 31 15:58:41.022056 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3063/6266] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Oct 31 15:58:40 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 31 15:58:51.674433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:51.675280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:51.842848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3fcaf587-6fcf-41bc-88b4-7fed693bcaf6 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Action: 'create', calling method: .version_select at 0x7f16e55d3310>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-803390159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNH+5wTRLEiySc7OJFtlvc9IV0XwgkD+lnwKhuywCK5V/f6A9tin14kedNBRTyYTJgjKkAUJ07URttwPEj/EyW3hWjnM4op1oDD7jn/kKWzqswKHE78sz6zL4Zy5o8XNg=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:51.862150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-3fcaf587-6fcf-41bc-88b4-7fed693bcaf6 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Getting quotas for project 0b6e963eeebd43b0a5d2d3ace114c13e. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:58:51.867943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-3fcaf587-6fcf-41bc-88b4-7fed693bcaf6 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Getting quotas for user 41339672843d46069fba358a773956bb and project 0b6e963eeebd43b0a5d2d3ace114c13e. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:58:51.892822 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3fcaf587-6fcf-41bc-88b4-7fed693bcaf6 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.220312 Oct 31 15:58:51.893673 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3204/6267] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 15:58:51 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:58:57.937724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:57.939693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:57.940372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:58:57.944728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1240292544-access_point-253803807", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "961bd515-c74a-4114-aad3-311dd5031bd3"}], "key_name": "tempest-TestSecurityGroupsBasicOps-803390159", "security_groups": [{"name": "tempest-secgroup_access--2097525130"}, {"name": "tempest-secgroup_general--1760041011"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:58:58.129379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] validate_networks() for [('961bd515-c74a-4114-aad3-311dd5031bd3', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:58:58.568516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:58:58.568516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:58:58.568516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:58:58.568516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:58:58.568516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:58:58.581541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:58.582410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:58.583053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:58.584559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:58:58.585507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:58:58.585724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:58:58.612622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Getting quotas for project 0b6e963eeebd43b0a5d2d3ace114c13e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:58:58.620110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Getting quotas for user 41339672843d46069fba358a773956bb and project 0b6e963eeebd43b0a5d2d3ace114c13e. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:58:58.634379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:58:58.636432 n-d-858384-17 devstack@n-api.service[120588]: WARNING nova.utils [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1240292544-access_point-253803807 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1240292544-ac Oct 31 15:58:58.637394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:58:58.698160 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-76cbcefa-5fbe-48d0-8f97-dc9294246005 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.762758 Oct 31 15:58:58.699364 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3064/6268] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:58:57 2022] POST /compute/v2.1/servers => generated 458 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 15:58:58.711198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8ab0f966-8706-41f4-a8e4-b39c8ec115d6 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:58.711819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8ab0f966-8706-41f4-a8e4-b39c8ec115d6 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:58.791101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8ab0f966-8706-41f4-a8e4-b39c8ec115d6 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:58.799270 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8ab0f966-8706-41f4-a8e4-b39c8ec115d6 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1293 microversion: 2.1 time: 0.092069 Oct 31 15:58:58.800097 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3205/6269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:58 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:58:59.827994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-770a7cbf-161a-4349-8839-82ec68aac473 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:58:59.828625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-770a7cbf-161a-4349-8839-82ec68aac473 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:58:59.911046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-770a7cbf-161a-4349-8839-82ec68aac473 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:58:59.933195 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-770a7cbf-161a-4349-8839-82ec68aac473 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1293 microversion: 2.1 time: 0.113580 Oct 31 15:58:59.934562 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3065/6270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:58:59 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:00.957499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-648923cf-84fa-428d-b959-879a07f2e108 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:00.958320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-648923cf-84fa-428d-b959-879a07f2e108 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:01.032572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-648923cf-84fa-428d-b959-879a07f2e108 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:01.041885 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-648923cf-84fa-428d-b959-879a07f2e108 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1293 microversion: 2.1 time: 0.088277 Oct 31 15:59:01.044474 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3206/6271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:00 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:02.065980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c05e2f2a-d240-45e4-955f-da23e037a650 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:02.067365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c05e2f2a-d240-45e4-955f-da23e037a650 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:02.127180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c05e2f2a-d240-45e4-955f-da23e037a650 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:02.135816 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c05e2f2a-d240-45e4-955f-da23e037a650 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1293 microversion: 2.1 time: 0.073933 Oct 31 15:59:02.136950 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3066/6272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:02 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1293 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:03.159204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:03.159797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:03.167210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:03.167702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:03.168144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:03.168845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:03.169334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:03.169764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:03.232825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:03.241040 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d93ca4eb-bda8-4f07-afbc-7d5663f787b5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1297 microversion: 2.1 time: 0.086086 Oct 31 15:59:03.244826 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3207/6273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:03 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:04.264466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:04.265082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:04.273272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:04.273710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:04.274153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:04.274862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:04.275334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:04.275755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:04.693942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:04.702581 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e6fe2da8-dac1-4209-b116-fd0e22f9d4fe tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1351 microversion: 2.1 time: 0.442193 Oct 31 15:59:04.716180 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3067/6274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:04 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1351 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:05.728192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:05.729080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:05.736180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:05.737095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:05.737795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:05.738762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:05.739787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:05.740447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:05.866309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-0efd5321-9b18-46b6-93af-81e6a4133b78 req-0e6ff316-395b-494d-9311-c5030bcdd437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bd3170-70d7-4ae5-9533-57bddd490fde", "tag": "063375f5-7bd6-487d-bd09-36b2a93d586e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:05.879651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0efd5321-9b18-46b6-93af-81e6a4133b78 req-0e6ff316-395b-494d-9311-c5030bcdd437 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:05.880397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0efd5321-9b18-46b6-93af-81e6a4133b78 req-0e6ff316-395b-494d-9311-c5030bcdd437 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:05.881033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-0efd5321-9b18-46b6-93af-81e6a4133b78 req-0e6ff316-395b-494d-9311-c5030bcdd437 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:05.896963 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-0efd5321-9b18-46b6-93af-81e6a4133b78 req-0e6ff316-395b-494d-9311-c5030bcdd437 service nova] Creating event network-changed:063375f5-7bd6-487d-bd09-36b2a93d586e for instance 31bd3170-70d7-4ae5-9533-57bddd490fde on n-h2-858384-17 Oct 31 15:59:05.904267 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-0efd5321-9b18-46b6-93af-81e6a4133b78 req-0e6ff316-395b-494d-9311-c5030bcdd437 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044168 Oct 31 15:59:05.905465 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3068/6275] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 15:59:05.912660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:05.923819 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89f6654d-44f1-430c-bc10-28cf4bfbb87f tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1471 microversion: 2.1 time: 0.200159 Oct 31 15:59:05.924947 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3208/6276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:05 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:06.951212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:06.951924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:06.958558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:06.959213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:06.959751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:06.961746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:06.962306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:06.962927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:07.124967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:07.135143 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2587cd21-899f-4652-9c99-aca12de72d42 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1471 microversion: 2.1 time: 0.188968 Oct 31 15:59:07.136290 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3069/6277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:06 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:08.159944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:08.160767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:08.168978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:08.169493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:08.169924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:08.170630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:08.171083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:08.171502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:08.321033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:08.329017 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-103c11ad-c008-4978-a81c-112458a3f870 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1471 microversion: 2.1 time: 0.173668 Oct 31 15:59:08.329640 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3209/6278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:08 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:09.352295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:09.352917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:09.355730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:09.366640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:09.366640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:09.366640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:09.366640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:09.366640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:09.366640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:09.508820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:09.516632 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e048b158-986e-4c0c-9bee-2c4ee60dbade tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1471 microversion: 2.1 time: 0.168622 Oct 31 15:59:09.517234 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3070/6279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:09 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:10.024454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-cc8a8786-9dec-498b-a7cd-016294e3226d req-790e2514-5b1c-45bd-984d-24681b7bbbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bd3170-70d7-4ae5-9533-57bddd490fde", "name": "network-vif-plugged", "status": "completed", "tag": "063375f5-7bd6-487d-bd09-36b2a93d586e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:10.034554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cc8a8786-9dec-498b-a7cd-016294e3226d req-790e2514-5b1c-45bd-984d-24681b7bbbf3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:10.035034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cc8a8786-9dec-498b-a7cd-016294e3226d req-790e2514-5b1c-45bd-984d-24681b7bbbf3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:10.035469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cc8a8786-9dec-498b-a7cd-016294e3226d req-790e2514-5b1c-45bd-984d-24681b7bbbf3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:10.047396 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cc8a8786-9dec-498b-a7cd-016294e3226d req-790e2514-5b1c-45bd-984d-24681b7bbbf3 service nova] Creating event network-vif-plugged:063375f5-7bd6-487d-bd09-36b2a93d586e for instance 31bd3170-70d7-4ae5-9533-57bddd490fde on n-h2-858384-17 Oct 31 15:59:10.052471 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-cc8a8786-9dec-498b-a7cd-016294e3226d req-790e2514-5b1c-45bd-984d-24681b7bbbf3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103802 Oct 31 15:59:10.053115 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3210/6280] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:10.540374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:10.540994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:10.547912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:10.548400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:10.548839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:10.549561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:10.550022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:10.550452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:10.698438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:10.706879 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d469410b-a2be-45c3-832b-5390c620b38a tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1471 microversion: 2.1 time: 0.170871 Oct 31 15:59:10.707747 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3071/6281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:10 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:11.729057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=8 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:11.733969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:11.735274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:11.743989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:11.744488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:11.744925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:11.745661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:11.746124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:11.746553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:11.901501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:11.909595 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0144c263-aef0-42b8-8f6c-a9ad6afd6076 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1643 microversion: 2.1 time: 0.182283 Oct 31 15:59:11.910362 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3211/6282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:11 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1643 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 15:59:11.933389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:11.933996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:11.940863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:11.941375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:11.941812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:11.942512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:11.942968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:11.943391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:12.092549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:12.100898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4abd151c-5c27-4022-b860-40975635ada7 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1643 microversion: 2.1 time: 0.170862 Oct 31 15:59:12.101514 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3072/6283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:11 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1643 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:12.124351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-297bcbdb-7438-4faa-a60b-be93f53f6b23 tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:12.124944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-297bcbdb-7438-4faa-a60b-be93f53f6b23 tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:12.131125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-297bcbdb-7438-4faa-a60b-be93f53f6b23 tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:12.131617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-297bcbdb-7438-4faa-a60b-be93f53f6b23 tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:12.132067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-297bcbdb-7438-4faa-a60b-be93f53f6b23 tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:12.132758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-297bcbdb-7438-4faa-a60b-be93f53f6b23 tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:12.133253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-297bcbdb-7438-4faa-a60b-be93f53f6b23 tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:12.133680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-297bcbdb-7438-4faa-a60b-be93f53f6b23 tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:12.390873 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-297bcbdb-7438-4faa-a60b-be93f53f6b23 tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1796 microversion: 2.1 time: 0.270334 Oct 31 15:59:12.392300 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3212/6284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:12 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1796 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:14.088416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-529b8191-693b-4349-96e7-a7c48e2fa042 req-52520c75-165f-442f-b569-c1418a5cca2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bd3170-70d7-4ae5-9533-57bddd490fde", "tag": "063375f5-7bd6-487d-bd09-36b2a93d586e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:14.095479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:14.103289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-529b8191-693b-4349-96e7-a7c48e2fa042 req-52520c75-165f-442f-b569-c1418a5cca2c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:14.104055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-529b8191-693b-4349-96e7-a7c48e2fa042 req-52520c75-165f-442f-b569-c1418a5cca2c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:14.104670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-529b8191-693b-4349-96e7-a7c48e2fa042 req-52520c75-165f-442f-b569-c1418a5cca2c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:14.119485 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-529b8191-693b-4349-96e7-a7c48e2fa042 req-52520c75-165f-442f-b569-c1418a5cca2c service nova] Creating event network-changed:063375f5-7bd6-487d-bd09-36b2a93d586e for instance 31bd3170-70d7-4ae5-9533-57bddd490fde on n-h2-858384-17 Oct 31 15:59:14.125431 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-529b8191-693b-4349-96e7-a7c48e2fa042 req-52520c75-165f-442f-b569-c1418a5cca2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041585 Oct 31 15:59:14.126231 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3073/6285] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:55.519113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1243016764", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "ec7f6661-e166-4ab1-aa53-93e3c16f0922"}], "key_name": "tempest-TestSecurityGroupsBasicOps-803390159", "security_groups": []}, "os:scheduler_hints": {"different_host": ["31bd3170-70d7-4ae5-9533-57bddd490fde"]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:55.539200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:55.540523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=32 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:55.589756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] validate_networks() for [('ec7f6661-e166-4ab1-aa53-93e3c16f0922', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 15:59:56.133494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 15:59:56.134228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 15:59:56.134784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 15:59:56.135200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 15:59:56.135861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 15:59:56.156898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:56.157529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:56.158373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:56.159213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:56.160157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:56.160668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:56.189936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Getting quotas for project 0b6e963eeebd43b0a5d2d3ace114c13e. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 15:59:56.197863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Getting quotas for user 41339672843d46069fba358a773956bb and project 0b6e963eeebd43b0a5d2d3ace114c13e. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 15:59:56.216649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 15:59:56.220249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 15:59:56.295535 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aab2dc51-2f87-4501-b0bf-7ab6cb2da223 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.780810 Oct 31 15:59:56.297061 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3213/6286] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 15:59:55 2022] POST /compute/v2.1/servers => generated 361 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 15:59:56.319257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96858dcb-0411-444e-a334-b4ad4ba077cd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:56.321584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96858dcb-0411-444e-a334-b4ad4ba077cd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:56.324996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:56.326557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=36 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 15:59:56.419652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-96858dcb-0411-444e-a334-b4ad4ba077cd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:56.431421 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96858dcb-0411-444e-a334-b4ad4ba077cd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1241 microversion: 2.1 time: 0.117041 Oct 31 15:59:56.446707 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3074/6287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:56 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:57.456843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:57.457710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:57.467219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:57.467718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:57.468913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:57.469936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:57.470602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:57.471041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:57.582186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:57.592790 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-877773bf-adaf-48ba-83ed-334d3340f9fd tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1301 microversion: 2.1 time: 0.140558 Oct 31 15:59:57.609824 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3214/6288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:57 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1301 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:58.618478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:58.619092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:58.640293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:58.645272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:58.645737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:58.646496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:58.646962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:58.647393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:58.747662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:58.756646 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1bca96e-f5d7-467c-bfec-8b2bdd395592 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1299 microversion: 2.1 time: 0.142138 Oct 31 15:59:58.757963 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3075/6289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:58 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1299 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 15:59:59.207337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7ceced37-31fa-4eba-a1d7-7db61db5b3c9 req-e86ebb24-ade6-4e02-9c89-7b776bc0daff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eacc18e-dda7-4a74-ae60-521db83daecf", "tag": "1bbc4c2b-a809-449f-865b-69c90de2435e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 15:59:59.221057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7ceced37-31fa-4eba-a1d7-7db61db5b3c9 req-e86ebb24-ade6-4e02-9c89-7b776bc0daff service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:59.221689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7ceced37-31fa-4eba-a1d7-7db61db5b3c9 req-e86ebb24-ade6-4e02-9c89-7b776bc0daff service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:59.222220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7ceced37-31fa-4eba-a1d7-7db61db5b3c9 req-e86ebb24-ade6-4e02-9c89-7b776bc0daff service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:59.234684 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7ceced37-31fa-4eba-a1d7-7db61db5b3c9 req-e86ebb24-ade6-4e02-9c89-7b776bc0daff service nova] Creating event network-changed:1bbc4c2b-a809-449f-865b-69c90de2435e for instance 4eacc18e-dda7-4a74-ae60-521db83daecf on n-h1-858384-17 Oct 31 15:59:59.240705 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7ceced37-31fa-4eba-a1d7-7db61db5b3c9 req-e86ebb24-ade6-4e02-9c89-7b776bc0daff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110494 Oct 31 15:59:59.241441 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3215/6290] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 15:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 15:59:59.780168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 15:59:59.780897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 15:59:59.788418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:59.789040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:59.789566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:59.790448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 15:59:59.790972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 15:59:59.791471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 15:59:59.881977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 15:59:59.891319 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf51d6bc-3a38-40ec-a7b4-b2a5ad9280e9 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1299 microversion: 2.1 time: 0.114974 Oct 31 15:59:59.892457 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3076/6291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 15:59:59 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:00.916953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:00.917886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:00.924838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:00.925471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:00.926016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:00.926851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:00.927421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:00.927982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:01.044861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:01.052943 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f465912d-90e9-426d-9968-966a8aa3b374 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1299 microversion: 2.1 time: 0.141422 Oct 31 16:00:01.053790 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3216/6292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:00 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:02.077536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:02.078129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:02.084550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:02.085046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:02.085516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:02.086246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:02.086710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:02.087126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:02.172902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:02.181289 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-51378bdd-2d13-4785-9202-add64b4f031d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1299 microversion: 2.1 time: 0.107544 Oct 31 16:00:02.181873 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3077/6293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:02 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:03.205288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:03.205998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:03.213496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:03.213975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:03.214406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:03.215097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:03.215552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:03.216083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:03.299609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:03.308565 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd891946-9d48-41cb-beab-1c17ea94ea0e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1299 microversion: 2.1 time: 0.107165 Oct 31 16:00:03.309522 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3217/6294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:03 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:03.848186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1598c4b1-e0ea-4be3-9c92-756c8c700167 req-295be4cc-682a-4dc6-b52f-7f2c714e3c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eacc18e-dda7-4a74-ae60-521db83daecf", "name": "network-vif-plugged", "status": "completed", "tag": "1bbc4c2b-a809-449f-865b-69c90de2435e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:03.861647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1598c4b1-e0ea-4be3-9c92-756c8c700167 req-295be4cc-682a-4dc6-b52f-7f2c714e3c3a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:03.862218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1598c4b1-e0ea-4be3-9c92-756c8c700167 req-295be4cc-682a-4dc6-b52f-7f2c714e3c3a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:03.862666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1598c4b1-e0ea-4be3-9c92-756c8c700167 req-295be4cc-682a-4dc6-b52f-7f2c714e3c3a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:03.876517 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1598c4b1-e0ea-4be3-9c92-756c8c700167 req-295be4cc-682a-4dc6-b52f-7f2c714e3c3a service nova] Creating event network-vif-plugged:1bbc4c2b-a809-449f-865b-69c90de2435e for instance 4eacc18e-dda7-4a74-ae60-521db83daecf on n-h1-858384-17 Oct 31 16:00:03.882380 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1598c4b1-e0ea-4be3-9c92-756c8c700167 req-295be4cc-682a-4dc6-b52f-7f2c714e3c3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037739 Oct 31 16:00:03.883014 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3078/6295] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:00:04.332546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:04.333184 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:04.341002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:04.341541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:04.341980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:04.342705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:04.343163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:04.343589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:04.435475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:04.443422 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc4dbf59-793c-407f-89e7-bec6e998bea5 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1299 microversion: 2.1 time: 0.114821 Oct 31 16:00:04.444010 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3218/6296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:04 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:05.469227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:05.469930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:05.476251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.476733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.477194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:05.477888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.478370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.478792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:05.562463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:05.571776 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a64a1032-7f2c-4e8f-86b7-bba288727694 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1471 microversion: 2.1 time: 0.107425 Oct 31 16:00:05.572738 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3079/6297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:05 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1471 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:05.596783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:05.597417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:05.606026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.606658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.607120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:05.607845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.608297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.608853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:05.696214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:05.704043 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e5d3998a-90ea-4adc-8a8f-c22fd57cd43e tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1471 microversion: 2.1 time: 0.111265 Oct 31 16:00:05.704624 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3219/6298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:05 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1471 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:05.726683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9016cfb1-5deb-4d6c-9f35-fc45cc43b10a tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:05.727301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9016cfb1-5deb-4d6c-9f35-fc45cc43b10a tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:05.733591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9016cfb1-5deb-4d6c-9f35-fc45cc43b10a tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.734676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9016cfb1-5deb-4d6c-9f35-fc45cc43b10a tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.735124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9016cfb1-5deb-4d6c-9f35-fc45cc43b10a tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:05.735821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9016cfb1-5deb-4d6c-9f35-fc45cc43b10a tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.736275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9016cfb1-5deb-4d6c-9f35-fc45cc43b10a tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.736704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9016cfb1-5deb-4d6c-9f35-fc45cc43b10a tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:05.821568 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9016cfb1-5deb-4d6c-9f35-fc45cc43b10a tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1624 microversion: 2.1 time: 0.099132 Oct 31 16:00:05.822163 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3080/6299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:05 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1624 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:00:05.843910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4d406f60-02e1-465b-b181-51cb8470ad3d tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:05.844517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4d406f60-02e1-465b-b181-51cb8470ad3d tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:05.860906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d406f60-02e1-465b-b181-51cb8470ad3d tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.861339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d406f60-02e1-465b-b181-51cb8470ad3d tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.861786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d406f60-02e1-465b-b181-51cb8470ad3d tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:05.862517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d406f60-02e1-465b-b181-51cb8470ad3d tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:05.863125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d406f60-02e1-465b-b181-51cb8470ad3d tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:05.863584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4d406f60-02e1-465b-b181-51cb8470ad3d tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:06.004375 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4d406f60-02e1-465b-b181-51cb8470ad3d tempest-TestSecurityGroupsBasicOps-550003286 tempest-TestSecurityGroupsBasicOps-550003286-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1915 microversion: 2.1 time: 0.164082 Oct 31 16:00:06.004959 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3220/6300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:05 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1915 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:06.071181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:06.071686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:06.077848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:06.078343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:06.078785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:06.079493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:06.079956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:06.080895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:06.108727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:00:06.193871 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-694182ff-cbc6-4b13-a739-e9fdab09683d tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 204 len: 0 microversion: 2.1 time: 0.126875 Oct 31 16:00:06.194731 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3081/6301] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:00:06 2022] DELETE /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:00:06.203839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:06.204482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:06.206646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:06.207384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:06.214038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:06.214532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:06.214997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:06.215704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:06.216166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:06.216593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:06.304048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:06.312517 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-104b9fb0-53a8-4e9a-abe8-a1488e691364 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1477 microversion: 2.1 time: 0.112726 Oct 31 16:00:06.313206 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3221/6302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:06 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1477 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:00:07.337418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:07.338476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:07.342198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:00:07.347169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:07.347651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:07.348125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:07.348834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:07.349318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:07.349949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:07.462518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:07.473155 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e4dba84d-a911-49a1-a33d-9aac6c69fc36 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1477 microversion: 2.1 time: 0.140845 Oct 31 16:00:07.486109 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3082/6303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:07 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:08.109671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-859ead1f-2d9a-402e-9e10-50485aba1a8a req-112f8f14-c4c9-4f44-81a8-f4df0e85564b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eacc18e-dda7-4a74-ae60-521db83daecf", "name": "network-vif-deleted", "tag": "1bbc4c2b-a809-449f-865b-69c90de2435e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:08.123892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-859ead1f-2d9a-402e-9e10-50485aba1a8a req-112f8f14-c4c9-4f44-81a8-f4df0e85564b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:08.124733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-859ead1f-2d9a-402e-9e10-50485aba1a8a req-112f8f14-c4c9-4f44-81a8-f4df0e85564b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:08.125468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-859ead1f-2d9a-402e-9e10-50485aba1a8a req-112f8f14-c4c9-4f44-81a8-f4df0e85564b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:08.138932 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-859ead1f-2d9a-402e-9e10-50485aba1a8a req-112f8f14-c4c9-4f44-81a8-f4df0e85564b service nova] Creating event network-vif-deleted:1bbc4c2b-a809-449f-865b-69c90de2435e for instance 4eacc18e-dda7-4a74-ae60-521db83daecf on n-h1-858384-17 Oct 31 16:00:08.143995 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-859ead1f-2d9a-402e-9e10-50485aba1a8a req-112f8f14-c4c9-4f44-81a8-f4df0e85564b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038026 Oct 31 16:00:08.144928 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3222/6304] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:00:08.498372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:08.498989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:08.505873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:08.506368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:08.506813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:08.507520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:08.507984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:08.508418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:08.545797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:08.546294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:08.546739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:08.547202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lazy-loading 'fault' on Instance uuid 4eacc18e-dda7-4a74-ae60-521db83daecf {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:00:08.589050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:08.597367 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1f3ee008-061e-4afd-8e0b-59707989f2c0 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 200 len: 1331 microversion: 2.1 time: 0.102832 Oct 31 16:00:08.597956 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3083/6305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:08 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:09.623526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:09.624231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 4eacc18e-dda7-4a74-ae60-521db83daecf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:09.630518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:09.631006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:09.631445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:09.632904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:09.633569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:09.634006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:09.647451 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] HTTP exception thrown: Instance 4eacc18e-dda7-4a74-ae60-521db83daecf could not be found. Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Request method failure captured: Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf HTTP/1.1 Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_C6CGQcdK5mpP9f3-iRcUP_dKpRQpEbZSlnakmZFPjJgAwUAShUzBQmH288W7bfcj9eTd9LRX6zibN_Kd5K2n47mp_qy_GYxsYGXSUAizT3JHNHzEvquxF8fvxc4JKqEPPog59QYHC0TSmpaOqT4DlWHGGTURESez3kK_0XcsSgX4w Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 0b6e963eeebd43b0a5d2d3ace114c13e Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1240292544 Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b6e963eeebd43b0a5d2d3ace114c13e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b6e963eeebd43b0a5d2d3ace114c13e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b6e963eeebd43b0a5d2d3ace114c13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b6e963eeebd43b0a5d2d3ace114c13e"}]}] Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1240292544 Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 0b6e963eeebd43b0a5d2d3ace114c13e Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1240292544 Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestSecurityGroupsBasicOps-1240292544-project Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 41339672843d46069fba358a773956bb Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1240292544-project Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 4eacc18e-dda7-4a74-ae60-521db83daecf could not be found. Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '4eacc18e-dda7-4a74-ae60-521db83daecf'} Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eacc18e-dda7-4a74-ae60-521db83daecf could not be found. Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eacc18e-dda7-4a74-ae60-521db83daecf could not be found. Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:09.649532 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eacc18e-dda7-4a74-ae60-521db83daecf could not be found. Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Returning 404 to user: Instance 4eacc18e-dda7-4a74-ae60-521db83daecf could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2d21d13-bc62-423c-b416-56ec225d4cb3 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf" status: 404 len: 111 microversion: 2.1 time: 0.032524 Oct 31 16:00:09.654363 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3223/6306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:09 2022] GET /compute/v2.1/servers/4eacc18e-dda7-4a74-ae60-521db83daecf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:00:14.155423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:14.156062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:14.159314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-85689b46-2247-458d-aae7-9ed7074c7bfb req-dc557a39-99d3-4ebb-980f-1e8ecc61f9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31bd3170-70d7-4ae5-9533-57bddd490fde", "tag": "063375f5-7bd6-487d-bd09-36b2a93d586e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:14.165084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:14.166045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:14.166517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:14.167317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:14.167783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:14.168403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:14.175049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-85689b46-2247-458d-aae7-9ed7074c7bfb req-dc557a39-99d3-4ebb-980f-1e8ecc61f9c7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:14.175656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-85689b46-2247-458d-aae7-9ed7074c7bfb req-dc557a39-99d3-4ebb-980f-1e8ecc61f9c7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:14.176170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-85689b46-2247-458d-aae7-9ed7074c7bfb req-dc557a39-99d3-4ebb-980f-1e8ecc61f9c7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:14.195443 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-85689b46-2247-458d-aae7-9ed7074c7bfb req-dc557a39-99d3-4ebb-980f-1e8ecc61f9c7 service nova] Creating event network-changed:063375f5-7bd6-487d-bd09-36b2a93d586e for instance 31bd3170-70d7-4ae5-9533-57bddd490fde on n-h2-858384-17 Oct 31 16:00:14.200168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:00:14.201739 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-85689b46-2247-458d-aae7-9ed7074c7bfb req-dc557a39-99d3-4ebb-980f-1e8ecc61f9c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046827 Oct 31 16:00:14.202588 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3224/6307] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:00:14.297182 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ffc998f0-4faf-4438-be03-77892f4c6d04 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 204 len: 0 microversion: 2.1 time: 0.144084 Oct 31 16:00:14.298632 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3084/6308] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:00:14 2022] DELETE /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:00:14.308727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:14.309890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:14.316774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:14.317310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:14.317751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:14.318643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:14.319110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:14.319809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:14.481876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:14.491021 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-403ef2c0-4d26-4ece-86b6-a818bc2a1830 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1768 microversion: 2.1 time: 0.187909 Oct 31 16:00:14.492031 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3225/6309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:14 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1768 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:15.516564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:15.517510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:15.525692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:15.526193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:15.526627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:15.527505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:15.528455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:15.529814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:15.711163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:15.733364 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5a1d91d0-5262-4986-8c27-dffd0032a82b tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1768 microversion: 2.1 time: 0.221024 Oct 31 16:00:15.733975 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3085/6310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:15 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1768 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:16.332282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-feddb288-4e04-4971-9079-743289473d52 req-45e2aacc-de5c-4eb7-80cb-70d7b3a29dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31bd3170-70d7-4ae5-9533-57bddd490fde", "name": "network-vif-deleted", "tag": "063375f5-7bd6-487d-bd09-36b2a93d586e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:00:16.343972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-feddb288-4e04-4971-9079-743289473d52 req-45e2aacc-de5c-4eb7-80cb-70d7b3a29dc1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:16.344449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-feddb288-4e04-4971-9079-743289473d52 req-45e2aacc-de5c-4eb7-80cb-70d7b3a29dc1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:16.344876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-feddb288-4e04-4971-9079-743289473d52 req-45e2aacc-de5c-4eb7-80cb-70d7b3a29dc1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:16.358170 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-feddb288-4e04-4971-9079-743289473d52 req-45e2aacc-de5c-4eb7-80cb-70d7b3a29dc1 service nova] Creating event network-vif-deleted:063375f5-7bd6-487d-bd09-36b2a93d586e for instance 31bd3170-70d7-4ae5-9533-57bddd490fde on n-h2-858384-17 Oct 31 16:00:16.363588 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-feddb288-4e04-4971-9079-743289473d52 req-45e2aacc-de5c-4eb7-80cb-70d7b3a29dc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035387 Oct 31 16:00:16.364724 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3226/6311] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:00:16.758246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:16.758832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:16.765933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:16.766422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:16.766868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:16.767568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:16.768024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:16.768706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:16.810430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:16.810925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:16.811362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:16.811815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lazy-loading 'fault' on Instance uuid 31bd3170-70d7-4ae5-9533-57bddd490fde {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:00:16.861471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41339672843d46069fba358a773956bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6e963eeebd43b0a5d2d3ace114c13e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:00:16.872333 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-878f7711-c122-490e-8be1-d6a041d379af tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 200 len: 1383 microversion: 2.1 time: 0.118806 Oct 31 16:00:16.872954 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3086/6312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:16 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 1383 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:00:17.898673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:17.899468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] [instance: 31bd3170-70d7-4ae5-9533-57bddd490fde] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:00:17.906887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:17.907381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:17.907824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:17.908925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:00:17.909270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:00:17.909703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:00:17.924215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] HTTP exception thrown: Instance 31bd3170-70d7-4ae5-9533-57bddd490fde could not be found. Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Request method failure captured: Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde HTTP/1.1 Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_C6CGQcdK5mpP9f3-iRcUP_dKpRQpEbZSlnakmZFPjJgAwUAShUzBQmH288W7bfcj9eTd9LRX6zibN_Kd5K2n47mp_qy_GYxsYGXSUAizT3JHNHzEvquxF8fvxc4JKqEPPog59QYHC0TSmpaOqT4DlWHGGTURESez3kK_0XcsSgX4w Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 0b6e963eeebd43b0a5d2d3ace114c13e Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1240292544 Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b6e963eeebd43b0a5d2d3ace114c13e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0b6e963eeebd43b0a5d2d3ace114c13e", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0b6e963eeebd43b0a5d2d3ace114c13e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0b6e963eeebd43b0a5d2d3ace114c13e"}]}] Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1240292544 Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 0b6e963eeebd43b0a5d2d3ace114c13e Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1240292544 Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestSecurityGroupsBasicOps-1240292544-project Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 41339672843d46069fba358a773956bb Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1240292544-project Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 31bd3170-70d7-4ae5-9533-57bddd490fde could not be found. Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '31bd3170-70d7-4ae5-9533-57bddd490fde'} Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31bd3170-70d7-4ae5-9533-57bddd490fde could not be found. Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31bd3170-70d7-4ae5-9533-57bddd490fde could not be found. Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:17.925927 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31bd3170-70d7-4ae5-9533-57bddd490fde could not be found. Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Returning 404 to user: Instance 31bd3170-70d7-4ae5-9533-57bddd490fde could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-27deffb4-8234-4d14-9560-e4987cc8d969 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde" status: 404 len: 111 microversion: 2.1 time: 0.033503 Oct 31 16:00:17.931701 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3227/6313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:00:17 2022] GET /compute/v2.1/servers/31bd3170-70d7-4ae5-9533-57bddd490fde => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:00:21.707700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0896aa06-2ab2-46e2-8a78-5e14e54f6369 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] Calling method '.version_select at 0x7f16e0f12700>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:00:21.732426 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0896aa06-2ab2-46e2-8a78-5e14e54f6369 tempest-TestSecurityGroupsBasicOps-1240292544 tempest-TestSecurityGroupsBasicOps-1240292544-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-803390159" status: 202 len: 0 microversion: 2.1 time: 0.028427 Oct 31 16:00:21.733064 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3087/6314] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 16:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-803390159 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:01:22.081086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:22.081965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=62 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:22.086267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:22.086972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:22.094929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:22.095468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:22.095901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:22.096622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:22.097077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:22.097534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:22.127324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:01:22.208687 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-387e1450-4479-4166-8fec-5d718d954d6c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 204 len: 0 microversion: 2.1 time: 0.130433 Oct 31 16:01:22.213082 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3228/6315] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:01:22 2022] DELETE /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:01:22.216736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:22.218062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:01:22.222451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:22.224154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:22.232650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:22.233305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:22.233956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:22.234811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:22.235406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:22.235868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:22.551174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:22.559450 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b85f3875-319b-4a60-b37b-87e0f8e6593b tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1733 microversion: 2.1 time: 0.344678 Oct 31 16:01:22.560057 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3088/6316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:22 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1733 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:23.586981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:23.591189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:23.603809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:23.604487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:23.605016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:23.605866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:23.608221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:23.608936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:24.341640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:24.349795 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a19cdbdf-dc3f-4532-8d04-90fe59a0e165 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1733 microversion: 2.1 time: 0.767095 Oct 31 16:01:24.350398 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3229/6317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:23 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1733 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:24.834571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3b86e575-eb3d-4ccf-989c-1e122102d668 req-e09098d3-1c32-439a-a9fe-492a76828435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7fc5f4-a888-46dc-b891-5daff299cb0d", "name": "network-vif-deleted", "tag": "10b9c465-9c22-40c5-98fb-eada891d8d34"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:01:24.848966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b86e575-eb3d-4ccf-989c-1e122102d668 req-e09098d3-1c32-439a-a9fe-492a76828435 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:24.849710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b86e575-eb3d-4ccf-989c-1e122102d668 req-e09098d3-1c32-439a-a9fe-492a76828435 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:24.850336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3b86e575-eb3d-4ccf-989c-1e122102d668 req-e09098d3-1c32-439a-a9fe-492a76828435 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:24.872591 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3b86e575-eb3d-4ccf-989c-1e122102d668 req-e09098d3-1c32-439a-a9fe-492a76828435 service nova] Creating event network-vif-deleted:10b9c465-9c22-40c5-98fb-eada891d8d34 for instance be7fc5f4-a888-46dc-b891-5daff299cb0d on n-h1-858384-17 Oct 31 16:01:24.886008 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3b86e575-eb3d-4ccf-989c-1e122102d668 req-e09098d3-1c32-439a-a9fe-492a76828435 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055363 Oct 31 16:01:24.887286 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3089/6318] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:01:25.380080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:25.380787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:25.391166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:25.392085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:25.392792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:25.393795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:25.394486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:25.395246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:25.438038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:25.438849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:25.440431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:25.440994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lazy-loading 'fault' on Instance uuid be7fc5f4-a888-46dc-b891-5daff299cb0d {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:01:25.491997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2848ad271544303ba2e2d81fa3e6d82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be0dbc5a63c4b84b43b2df9960317b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:01:25.507734 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09060bf1-f765-41cd-b18d-50cafc937786 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 200 len: 1387 microversion: 2.1 time: 0.131541 Oct 31 16:01:25.509076 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3230/6319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:25 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 1387 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:01:26.533102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:26.533834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:26.539984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:26.541074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:26.541537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:26.542236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:26.542698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:26.543125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:26.556452 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] HTTP exception thrown: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Request method failure captured: Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d HTTP/1.1 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_AlbAPcZDg2GzMpnt2Rxaav1BjJGA-j5pExJ2zYZwqFfiI247c0zA0_-Z5Yi_5aHaNC8zJULDvUPM9R2yiyrxu0N-ocZUqX0M_FXgYIETvMsCq2zbqKrq_o_bzk36Sh2WcueblFIgabe0ksfS-kKNPaa6nOmSRtqT4l6BBQZTD-_bQ Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7be0dbc5a63c4b84b43b2df9960317b7 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestServerBasicOps-86528348 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7be0dbc5a63c4b84b43b2df9960317b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7be0dbc5a63c4b84b43b2df9960317b7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7be0dbc5a63c4b84b43b2df9960317b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7be0dbc5a63c4b84b43b2df9960317b7"}]}] Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestServerBasicOps-86528348 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7be0dbc5a63c4b84b43b2df9960317b7 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestServerBasicOps-86528348 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestServerBasicOps-86528348-project Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c2848ad271544303ba2e2d81fa3e6d82 Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestServerBasicOps-86528348-project Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'be7fc5f4-a888-46dc-b891-5daff299cb0d'} Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:01:26.558117 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Returning 404 to user: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-437ba1d6-e9db-4415-a7d5-66ddb5a6d41c tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 404 len: 111 microversion: 2.1 time: 0.031820 Oct 31 16:01:26.564885 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3090/6320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:26 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:01:27.023307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:27.023808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:27.033340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:27.033883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:27.034370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:27.035085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:27.035581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:27.036008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:27.050074 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] HTTP exception thrown: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Request method failure captured: Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d HTTP/1.1 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_AlbAPcZDg2GzMpnt2Rxaav1BjJGA-j5pExJ2zYZwqFfiI247c0zA0_-Z5Yi_5aHaNC8zJULDvUPM9R2yiyrxu0N-ocZUqX0M_FXgYIETvMsCq2zbqKrq_o_bzk36Sh2WcueblFIgabe0ksfS-kKNPaa6nOmSRtqT4l6BBQZTD-_bQ Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7be0dbc5a63c4b84b43b2df9960317b7 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestServerBasicOps-86528348 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7be0dbc5a63c4b84b43b2df9960317b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7be0dbc5a63c4b84b43b2df9960317b7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7be0dbc5a63c4b84b43b2df9960317b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7be0dbc5a63c4b84b43b2df9960317b7"}]}] Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestServerBasicOps-86528348 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7be0dbc5a63c4b84b43b2df9960317b7 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestServerBasicOps-86528348 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestServerBasicOps-86528348-project Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c2848ad271544303ba2e2d81fa3e6d82 Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestServerBasicOps-86528348-project Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'be7fc5f4-a888-46dc-b891-5daff299cb0d'} Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:01:27.051766 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Returning 404 to user: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c62506fb-f956-4700-bb1d-24dd642038b6 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 404 len: 111 microversion: 2.1 time: 0.034571 Oct 31 16:01:27.057167 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3231/6321] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:01:27 2022] DELETE /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:01:27.062062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:27.062680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] [instance: be7fc5f4-a888-46dc-b891-5daff299cb0d] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:01:27.068683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:27.069207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:27.069658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:27.070362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:01:27.070824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:01:27.071769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:01:27.090564 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] HTTP exception thrown: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Request method failure captured: Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d HTTP/1.1 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_AlbAPcZDg2GzMpnt2Rxaav1BjJGA-j5pExJ2zYZwqFfiI247c0zA0_-Z5Yi_5aHaNC8zJULDvUPM9R2yiyrxu0N-ocZUqX0M_FXgYIETvMsCq2zbqKrq_o_bzk36Sh2WcueblFIgabe0ksfS-kKNPaa6nOmSRtqT4l6BBQZTD-_bQ Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7be0dbc5a63c4b84b43b2df9960317b7 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestServerBasicOps-86528348 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7be0dbc5a63c4b84b43b2df9960317b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7be0dbc5a63c4b84b43b2df9960317b7", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7be0dbc5a63c4b84b43b2df9960317b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7be0dbc5a63c4b84b43b2df9960317b7"}]}] Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestServerBasicOps-86528348 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7be0dbc5a63c4b84b43b2df9960317b7 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestServerBasicOps-86528348 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestServerBasicOps-86528348-project Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c2848ad271544303ba2e2d81fa3e6d82 Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestServerBasicOps-86528348-project Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'be7fc5f4-a888-46dc-b891-5daff299cb0d'} Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:01:27.093056 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Returning 404 to user: Instance be7fc5f4-a888-46dc-b891-5daff299cb0d could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-74191203-c251-4b8e-857c-4f45bb8145da tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d" status: 404 len: 111 microversion: 2.1 time: 0.038269 Oct 31 16:01:27.098775 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3091/6322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:01:27 2022] GET /compute/v2.1/servers/be7fc5f4-a888-46dc-b891-5daff299cb0d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:01:27.267394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-518d84f5-1932-4eaa-a437-7c53967fd9e4 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] Calling method '.version_select at 0x7f16e0cd4160>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:01:27.304307 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-518d84f5-1932-4eaa-a437-7c53967fd9e4 tempest-TestServerBasicOps-86528348 tempest-TestServerBasicOps-86528348-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-78686923" status: 202 len: 0 microversion: 2.1 time: 0.040589 Oct 31 16:01:27.305248 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3232/6323] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Oct 31 16:01:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-78686923 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:02:05.935284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-407770761", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:05.942473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:05.943122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:05.944795 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:02:05.944942 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:02:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 31 16:02:05.996707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:02:06.518764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:02:06.519191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:02:06.519670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:02:06.520083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:02:06.520529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:02:06.530089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:06.530580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:06.531024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:06.531759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:06.532226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:06.532658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:06.550660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Getting quotas for project d6eea54910194cfebdeeb84b3df9dc85. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:02:06.556890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Getting quotas for user 1263b14c7a0b4171929b9cc8d4c95d25 and project d6eea54910194cfebdeeb84b3df9dc85. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:02:06.569742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:02:06.572096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:02:06.618467 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-88c1b773-9838-4f17-bff3-83978c572345 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687371 Oct 31 16:02:06.619322 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3092/6324] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:02:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:02:06.628618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:06.629469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:06.634055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3dececbd-78ff-4fbe-9d62-1cea14b97e72 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:06.634674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3dececbd-78ff-4fbe-9d62-1cea14b97e72 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:06.709304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3dececbd-78ff-4fbe-9d62-1cea14b97e72 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:06.716691 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3dececbd-78ff-4fbe-9d62-1cea14b97e72 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1214 microversion: 2.1 time: 0.089978 Oct 31 16:02:06.717310 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3233/6325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:06 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:07.740425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:07.741614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:07.748561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:07.749066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:07.749531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:07.750256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:07.750721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:07.751154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:07.825355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:07.833529 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7209ccc7-4b2e-4b26-9ab3-a03be286a902 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1266 microversion: 2.1 time: 0.097936 Oct 31 16:02:07.834355 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3093/6326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:07 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:08.857645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:08.858358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:08.866814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:08.867389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:08.867839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:08.868639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:08.869118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:08.869575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:09.482728 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:09.490682 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8359a6cc-e3cb-44a2-a5f3-5e7376764fc0 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1314 microversion: 2.1 time: 0.637320 Oct 31 16:02:09.491317 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3234/6327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:08 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:09.903588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a7252494-5094-4496-b2da-7a11caaf99e6 req-bf68615c-8a62-404b-adcd-89112849c7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f50cf0-a539-40b2-9f08-227706f2f864", "tag": "4c7fb3db-3c1a-4cd3-91e0-8a98950f2206"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:09.922150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7252494-5094-4496-b2da-7a11caaf99e6 req-bf68615c-8a62-404b-adcd-89112849c7a1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:09.924442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7252494-5094-4496-b2da-7a11caaf99e6 req-bf68615c-8a62-404b-adcd-89112849c7a1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:09.925310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7252494-5094-4496-b2da-7a11caaf99e6 req-bf68615c-8a62-404b-adcd-89112849c7a1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:09.945545 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a7252494-5094-4496-b2da-7a11caaf99e6 req-bf68615c-8a62-404b-adcd-89112849c7a1 service nova] Creating event network-changed:4c7fb3db-3c1a-4cd3-91e0-8a98950f2206 for instance 39f50cf0-a539-40b2-9f08-227706f2f864 on n-h2-858384-17 Oct 31 16:02:09.951657 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a7252494-5094-4496-b2da-7a11caaf99e6 req-bf68615c-8a62-404b-adcd-89112849c7a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057596 Oct 31 16:02:09.953255 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3094/6328] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:10.513834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:10.514359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:10.521859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:10.523272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:10.523740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:10.524453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:10.524908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:10.525358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:10.673847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:10.683616 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc94d83b-c150-4936-84fe-7c72ebd13844 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1314 microversion: 2.1 time: 0.173694 Oct 31 16:02:10.684197 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3235/6329] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:10 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:11.708327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:11.710043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:11.716732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:11.717659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:11.718455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:11.719778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:11.720632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:11.721474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:11.881180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:11.889752 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c7b9a53-9e80-4eac-b74b-02de3439c4fc tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1314 microversion: 2.1 time: 0.186668 Oct 31 16:02:11.890372 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3095/6330] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:11 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:12.912278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:12.913884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:12.922289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:12.922778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:12.923214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:12.923944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:12.924533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:12.924962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:13.062515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:13.070952 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66220404-880a-4323-8860-8a2abe439e4e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1314 microversion: 2.1 time: 0.162927 Oct 31 16:02:13.071478 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3236/6331] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:12 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:14.093574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:14.094144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:14.101718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:14.102113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:14.102562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:14.103269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:14.103738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:14.104172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:14.234480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:14.243278 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aceac4bb-143e-4ac0-aff0-7f5dd2484bc5 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1314 microversion: 2.1 time: 0.153720 Oct 31 16:02:14.243896 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3096/6332] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:14 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:15.265983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:15.266598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:15.274001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:15.274481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:15.274914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:15.275595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:15.276049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:15.276478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:15.406101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:15.414315 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f17ffc1e-80a9-4770-b13f-5b99fad6957e tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1314 microversion: 2.1 time: 0.152237 Oct 31 16:02:15.414892 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3237/6333] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:15 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:16.437739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:16.438362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:16.445765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:16.446257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:16.446705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:16.447412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:16.447879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:16.448320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:16.541363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:16.564164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:16.583450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:16.591784 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6075aa9e-252e-4105-a7a2-b14ed99298b8 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1314 microversion: 2.1 time: 0.158278 Oct 31 16:02:16.592375 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3097/6334] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:16 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:16.847444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d051afc4-7732-4401-ae53-26e0c251f150 req-de9c727b-ef9d-466b-a3ac-5f60f0a02262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f50cf0-a539-40b2-9f08-227706f2f864", "name": "network-vif-plugged", "status": "completed", "tag": "4c7fb3db-3c1a-4cd3-91e0-8a98950f2206"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:16.856583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:16.862266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d051afc4-7732-4401-ae53-26e0c251f150 req-de9c727b-ef9d-466b-a3ac-5f60f0a02262 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:16.863055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d051afc4-7732-4401-ae53-26e0c251f150 req-de9c727b-ef9d-466b-a3ac-5f60f0a02262 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:16.863706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d051afc4-7732-4401-ae53-26e0c251f150 req-de9c727b-ef9d-466b-a3ac-5f60f0a02262 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:16.876239 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d051afc4-7732-4401-ae53-26e0c251f150 req-de9c727b-ef9d-466b-a3ac-5f60f0a02262 service nova] Creating event network-vif-plugged:4c7fb3db-3c1a-4cd3-91e0-8a98950f2206 for instance 39f50cf0-a539-40b2-9f08-227706f2f864 on n-h2-858384-17 Oct 31 16:02:16.882295 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d051afc4-7732-4401-ae53-26e0c251f150 req-de9c727b-ef9d-466b-a3ac-5f60f0a02262 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038972 Oct 31 16:02:16.883454 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3238/6335] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:17.614569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:17.615215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:17.622676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:17.623166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:17.623623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:17.624303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:17.624763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:17.625218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:17.755354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:17.763044 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc59e7e2-0fd0-4740-b9b3-23faeb06beea tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1314 microversion: 2.1 time: 0.152418 Oct 31 16:02:17.763623 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3098/6336] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:17 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:18.787544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:18.788321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:18.795636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:18.796128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:18.796568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:18.797297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:18.797759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:18.798220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:18.933678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:18.941764 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e47d1fa-3f84-4edc-a6fb-12f34874b5b1 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1463 microversion: 2.1 time: 0.158535 Oct 31 16:02:18.942568 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3239/6337] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:18 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:18.990623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:18.991105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:18.998500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:18.999079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:18.999613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:19.000390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:19.000928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:19.001733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:19.032127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:02:19.110764 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8a078d4-26d2-45a7-a930-fb644105790f tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 204 len: 0 microversion: 2.1 time: 0.124166 Oct 31 16:02:19.111285 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3099/6338] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:02:18 2022] DELETE /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:02:19.120399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:19.121107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:19.127285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:19.127774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:19.128214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:19.128913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:19.129409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:19.129842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:19.259969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:19.267863 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e57f8d37-b0fe-4d03-bd40-56d269aea969 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1469 microversion: 2.1 time: 0.152205 Oct 31 16:02:19.268450 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3240/6339] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:19 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:20.292819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:20.293549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:20.300003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:20.300492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:20.300933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:20.301733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:20.302199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:20.302624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:20.443229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:20.451775 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-288ecd88-2346-4392-b586-5058cf9cd396 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1469 microversion: 2.1 time: 0.164001 Oct 31 16:02:20.452368 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3100/6340] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:20 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:20.937188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-220fb2c0-dd9e-42d6-a1da-b073648299b8 req-271bff4f-6494-44b3-b70e-18434fdf784a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f50cf0-a539-40b2-9f08-227706f2f864", "name": "network-vif-deleted", "tag": "4c7fb3db-3c1a-4cd3-91e0-8a98950f2206"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:20.950991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-220fb2c0-dd9e-42d6-a1da-b073648299b8 req-271bff4f-6494-44b3-b70e-18434fdf784a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:20.951471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-220fb2c0-dd9e-42d6-a1da-b073648299b8 req-271bff4f-6494-44b3-b70e-18434fdf784a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:20.951902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-220fb2c0-dd9e-42d6-a1da-b073648299b8 req-271bff4f-6494-44b3-b70e-18434fdf784a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:20.967030 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-220fb2c0-dd9e-42d6-a1da-b073648299b8 req-271bff4f-6494-44b3-b70e-18434fdf784a service nova] Creating event network-vif-deleted:4c7fb3db-3c1a-4cd3-91e0-8a98950f2206 for instance 39f50cf0-a539-40b2-9f08-227706f2f864 on n-h2-858384-17 Oct 31 16:02:20.973651 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-220fb2c0-dd9e-42d6-a1da-b073648299b8 req-271bff4f-6494-44b3-b70e-18434fdf784a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039850 Oct 31 16:02:20.974306 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3241/6341] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:21.475439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:21.476039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:21.483250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:21.483735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:21.484233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:21.484961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:21.485437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:21.485864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:21.519781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:21.520262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:21.520699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:21.521163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lazy-loading 'fault' on Instance uuid 39f50cf0-a539-40b2-9f08-227706f2f864 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:02:21.575150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1263b14c7a0b4171929b9cc8d4c95d25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6eea54910194cfebdeeb84b3df9dc85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:21.584974 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-47df432b-bba7-43e8-afb1-e70edab93918 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 200 len: 1304 microversion: 2.1 time: 0.113604 Oct 31 16:02:21.585593 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3101/6342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:21 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:22.608630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:22.609449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] [instance: 39f50cf0-a539-40b2-9f08-227706f2f864] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:22.616400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:22.617430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:22.617999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:22.618693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:22.619165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:22.619589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:22.633460 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] HTTP exception thrown: Instance 39f50cf0-a539-40b2-9f08-227706f2f864 could not be found. Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Request method failure captured: Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 HTTP/1.1 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_F8GXGnCP0XolIN_7_iyowTlvFLBItCEJLP3kV3G3AHktI3S2EwjpB0ax15KCBX5gO93-USeHXJUKDCqZGJ32IJmD4VG4HEPCJtw3NFAqoYQWgZ3OzavVMVHTmAQxj2-PtuvFbzWVObcYTYXwWpSzMeAZzfJOcIKtomILncBGdvEbg Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d6eea54910194cfebdeeb84b3df9dc85 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-VolumesNegativeTest-1473576107 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d6eea54910194cfebdeeb84b3df9dc85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d6eea54910194cfebdeeb84b3df9dc85", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d6eea54910194cfebdeeb84b3df9dc85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d6eea54910194cfebdeeb84b3df9dc85"}]}] Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-VolumesNegativeTest-1473576107 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d6eea54910194cfebdeeb84b3df9dc85 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-VolumesNegativeTest-1473576107 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-VolumesNegativeTest-1473576107-project Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1263b14c7a0b4171929b9cc8d4c95d25 Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-VolumesNegativeTest-1473576107-project Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 39f50cf0-a539-40b2-9f08-227706f2f864 could not be found. Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '39f50cf0-a539-40b2-9f08-227706f2f864'} Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39f50cf0-a539-40b2-9f08-227706f2f864 could not be found. Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39f50cf0-a539-40b2-9f08-227706f2f864 could not be found. Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:02:22.635089 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:02:22.639904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:02:22.639904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:02:22.639904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:02:22.639904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:02:22.639904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:02:22.639904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39f50cf0-a539-40b2-9f08-227706f2f864 could not be found. Oct 31 16:02:22.639904 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:02:22.639904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] Returning 404 to user: Instance 39f50cf0-a539-40b2-9f08-227706f2f864 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:02:22.639904 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df38c147-07bd-438f-8468-d7741732dda3 tempest-VolumesNegativeTest-1473576107 tempest-VolumesNegativeTest-1473576107-project] 10.222.0.20 "GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864" status: 404 len: 111 microversion: 2.1 time: 0.032142 Oct 31 16:02:22.641481 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3242/6343] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:22 2022] GET /compute/v2.1/servers/39f50cf0-a539-40b2-9f08-227706f2f864 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:02:52.687847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1986795202", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c766fb6e-5a4c-486c-800c-04fc8f162f4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "753da163-19cf-496b-b365-4c501547e977"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:52.714201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:52.716963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:52.779159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] validate_networks() for [('753da163-19cf-496b-b365-4c501547e977', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:02:53.302329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:02:53.304459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:02:53.305038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:02:53.305748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:02:53.306253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:02:53.317274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:53.317792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:53.318783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:53.319694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:53.320224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:53.320739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:53.343750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:02:53.349390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for user e27f6a45a29a4a6e89fdd36c0beac7c3 and project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:02:53.414950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:02:53.417088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c766fb6e-5a4c-486c-800c-04fc8f162f4c',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:02:53.568100 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0cf581c-ab71-4629-9490-8e1eb55c39de tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884832 Oct 31 16:02:53.569302 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3102/6344] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:02:53.601366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2782a210-d913-418c-8dad-b0b7e8c7ac15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:53.601975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2782a210-d913-418c-8dad-b0b7e8c7ac15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:53.610004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=22 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:53.613903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=42 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:02:53.695390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2782a210-d913-418c-8dad-b0b7e8c7ac15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:53.704542 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2782a210-d913-418c-8dad-b0b7e8c7ac15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1057 microversion: 2.1 time: 0.117801 Oct 31 16:02:53.705721 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3243/6345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:53 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1057 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:54.729300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:54.730101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:54.738553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:54.739198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:54.739738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:54.740625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:54.741328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:54.742345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:54.815564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:54.824868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-865ebdd2-c16c-4c80-a5e3-7f34eab57e55 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1155 microversion: 2.1 time: 0.100065 Oct 31 16:02:54.830475 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3103/6346] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:54 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1155 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:55.860621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:55.864215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:55.874255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:55.875165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:55.875837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:55.876817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:55.877930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:55.879351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:56.233673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:56.249692 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f169deb1-46b8-431f-a891-88f89f3cc40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1215 microversion: 2.1 time: 0.398532 Oct 31 16:02:56.250311 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3244/6347] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:55 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1215 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:56.774105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e7b613e9-ad5b-46c0-bd40-7eb2da82c20a req-68afbed9-89b9-423a-a96d-389242c3d269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab91691-d3e6-4db8-ae6c-1108e0484f37", "tag": "9c7655d4-2561-430d-a600-65664f2a397c"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:02:56.819779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e7b613e9-ad5b-46c0-bd40-7eb2da82c20a req-68afbed9-89b9-423a-a96d-389242c3d269 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:56.822340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e7b613e9-ad5b-46c0-bd40-7eb2da82c20a req-68afbed9-89b9-423a-a96d-389242c3d269 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:56.823093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e7b613e9-ad5b-46c0-bd40-7eb2da82c20a req-68afbed9-89b9-423a-a96d-389242c3d269 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:56.843727 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e7b613e9-ad5b-46c0-bd40-7eb2da82c20a req-68afbed9-89b9-423a-a96d-389242c3d269 service nova] Creating event network-changed:9c7655d4-2561-430d-a600-65664f2a397c for instance 2ab91691-d3e6-4db8-ae6c-1108e0484f37 on n-h2-858384-17 Oct 31 16:02:56.849928 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e7b613e9-ad5b-46c0-bd40-7eb2da82c20a req-68afbed9-89b9-423a-a96d-389242c3d269 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091038 Oct 31 16:02:56.851272 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3104/6348] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:02:57.277853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:57.279385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:57.288786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:57.289467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:57.290279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:57.291010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:57.291542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:57.292171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:57.534910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:57.549401 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d79b7875-8f4d-41cb-817d-3ca19a3ebef7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1215 microversion: 2.1 time: 0.275377 Oct 31 16:02:57.550719 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3245/6349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:57 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1215 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:02:58.577653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:58.579076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:58.588085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:58.588746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:58.589337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:58.590187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:58.590756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:58.591292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:58.743259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:58.752057 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5ecb3e91-ac25-437b-b2fa-0904eb232027 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1215 microversion: 2.1 time: 0.183559 Oct 31 16:02:58.752781 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3105/6350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:58 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1215 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:02:59.776935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:02:59.778832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:02:59.785895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:59.786471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:59.787091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:59.788244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:02:59.788808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:02:59.789503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:02:59.932238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:02:59.940500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a881206a-676f-41a7-a7dc-b43bef6dd82e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1215 microversion: 2.1 time: 0.167403 Oct 31 16:02:59.941236 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3246/6351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:02:59 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:00.971256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:00.971860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:00.979250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:00.979727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:00.980157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:00.980839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:00.981323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:00.981741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:01.113951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:01.122414 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-504712bb-5f51-4ad7-b3f7-9e8cd0fe37bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.155278 Oct 31 16:03:01.122995 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3106/6352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:00 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:02.146189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:02.146876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:02.149795 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:03:02.149939 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:03:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 (ip 10.222.0.20) !!! Oct 31 16:03:02.156816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:02.157333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:02.157771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:02.158471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:02.158931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:02.159359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:02.291671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:02.299515 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b649fb12-cff9-4b5c-9a14-81b70930308f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.157676 Oct 31 16:03:02.300175 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3247/6353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:02 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:03.322986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:03.323601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:03.330483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:03.330977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:03.331415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:03.332145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:03.332605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:03.333037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:03.333688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:03.356339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:03.480979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:03.489845 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e96ec65-4548-4274-91f0-74f8100e0957 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.170664 Oct 31 16:03:03.490529 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3107/6354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:03 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:04.513028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:04.514241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:04.520709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:04.523480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:04.524070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:04.524624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:04.525629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:04.526116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:04.526544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:04.661239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:04.669408 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-028f087c-8428-4570-9fca-8d167248f0a5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.160193 Oct 31 16:03:04.670080 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3248/6355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:04 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:05.692001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:05.692615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:05.699834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:05.700319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:05.700755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:05.701469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:05.701950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:05.702368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:05.837313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:05.845039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49148956-726b-4560-b051-7959e586b5d1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.157045 Oct 31 16:03:05.845651 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3108/6356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:05 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:06.868060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:06.868608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:06.875551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:06.876066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:06.876486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:06.877202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:06.877665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:06.878090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:07.010650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:07.019351 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f08bdc4-e597-4b25-8e3f-add57b0b73a6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.155374 Oct 31 16:03:07.020029 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3249/6357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:06 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:08.043747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:08.044608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:08.053062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:08.053708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:08.054155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:08.054903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:08.055524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:08.055957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:08.197938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:08.205731 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-46973978-f382-4a35-a8dc-fed55cc8f5a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.166122 Oct 31 16:03:08.206324 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3109/6358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:08 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:09.229906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:09.230516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:09.237419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:09.237900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:09.238338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:09.239026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:09.239479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:09.239902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:09.378500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:09.386307 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c92a394-fe1c-4036-b6dc-330cdf7c763a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.161058 Oct 31 16:03:09.401155 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3250/6359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:09 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:10.410754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:10.411373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:10.419117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:10.419615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:10.420059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:10.420774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:10.421262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:10.421728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:10.556164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:10.564025 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89d0f1c3-e255-405a-9211-f08b59c9c854 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.157248 Oct 31 16:03:10.577149 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3110/6360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:10 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:11.074920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-359fed6b-992c-4035-bf11-fe054ee105ad req-57cecc71-6965-4f85-b1f1-31d8cbb40897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab91691-d3e6-4db8-ae6c-1108e0484f37", "name": "network-vif-plugged", "status": "completed", "tag": "9c7655d4-2561-430d-a600-65664f2a397c"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:11.085991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-359fed6b-992c-4035-bf11-fe054ee105ad req-57cecc71-6965-4f85-b1f1-31d8cbb40897 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:11.086661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-359fed6b-992c-4035-bf11-fe054ee105ad req-57cecc71-6965-4f85-b1f1-31d8cbb40897 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:11.086911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-359fed6b-992c-4035-bf11-fe054ee105ad req-57cecc71-6965-4f85-b1f1-31d8cbb40897 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:11.099006 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-359fed6b-992c-4035-bf11-fe054ee105ad req-57cecc71-6965-4f85-b1f1-31d8cbb40897 service nova] Creating event network-vif-plugged:9c7655d4-2561-430d-a600-65664f2a397c for instance 2ab91691-d3e6-4db8-ae6c-1108e0484f37 on n-h2-858384-17 Oct 31 16:03:11.103964 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-359fed6b-992c-4035-bf11-fe054ee105ad req-57cecc71-6965-4f85-b1f1-31d8cbb40897 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032736 Oct 31 16:03:11.105349 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3251/6361] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:11.588725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:11.589478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:11.596368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:11.596844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:11.597313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:11.597992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:11.598442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:11.598865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:11.737910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:11.746103 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0bdf806a-96d0-4299-8135-2d2d88f37493 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1203 microversion: 2.1 time: 0.162009 Oct 31 16:03:11.746845 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3111/6362] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:11 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:12.773582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:12.774308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:12.780752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:12.781350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:12.781790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:12.782511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:12.782975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:12.783403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:12.918913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:12.927309 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d73e6078-789b-43e8-b61e-59a41ac82212 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1389 microversion: 2.1 time: 0.159298 Oct 31 16:03:12.927894 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3252/6363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:12 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:12.949399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:12.950036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:12.957068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:12.957532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:12.957969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:12.958685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:12.959143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:12.960192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:13.096474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:13.104402 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e28a3ade-207c-4019-8328-b4715280fc9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1389 microversion: 2.1 time: 0.158973 Oct 31 16:03:13.104986 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3112/6364] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:12 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:03:13.126803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:13.127410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:13.134415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:13.134912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:13.135351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:13.136046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:13.136503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:13.136931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:13.278100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:13.286136 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-33314240-c893-4a1b-a423-f6efad360c05 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1389 microversion: 2.1 time: 0.163124 Oct 31 16:03:13.292466 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3253/6365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:13 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:13.313939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:13.314397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:13.320959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:13.321467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:13.321904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:13.322594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:13.323053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:13.323479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:13.348750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:03:13.429263 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-36708980-52e2-4300-bd82-906456475e7e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 204 len: 0 microversion: 2.1 time: 0.118729 Oct 31 16:03:13.429916 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3113/6366] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:03:13 2022] DELETE /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:03:13.439587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:13.440372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:13.447352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:13.447445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:13.447817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:13.448594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:13.449121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:13.449642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:13.582533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:13.590988 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16c040ba-630d-4ce6-81c6-989017036ce0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1395 microversion: 2.1 time: 0.156433 Oct 31 16:03:13.591620 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3254/6367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:13 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:14.614752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:14.615460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:14.622877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:14.623366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:14.623804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:14.624495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:14.624955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:14.625423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:14.758094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:14.766051 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9acc1c4b-5cf4-4125-9d70-fbe8a3b0890e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1395 microversion: 2.1 time: 0.155620 Oct 31 16:03:14.781149 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3114/6368] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:14 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1395 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:15.499771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6382478c-8ca1-468d-82e7-9b3a20db9931 req-5c053a30-f8aa-44b0-9444-34a5e21559b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab91691-d3e6-4db8-ae6c-1108e0484f37", "name": "network-vif-deleted", "tag": "9c7655d4-2561-430d-a600-65664f2a397c"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:15.512072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6382478c-8ca1-468d-82e7-9b3a20db9931 req-5c053a30-f8aa-44b0-9444-34a5e21559b0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:15.512691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6382478c-8ca1-468d-82e7-9b3a20db9931 req-5c053a30-f8aa-44b0-9444-34a5e21559b0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:15.513116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6382478c-8ca1-468d-82e7-9b3a20db9931 req-5c053a30-f8aa-44b0-9444-34a5e21559b0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:15.530280 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6382478c-8ca1-468d-82e7-9b3a20db9931 req-5c053a30-f8aa-44b0-9444-34a5e21559b0 service nova] Creating event network-vif-deleted:9c7655d4-2561-430d-a600-65664f2a397c for instance 2ab91691-d3e6-4db8-ae6c-1108e0484f37 on n-h2-858384-17 Oct 31 16:03:15.542150 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6382478c-8ca1-468d-82e7-9b3a20db9931 req-5c053a30-f8aa-44b0-9444-34a5e21559b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045969 Oct 31 16:03:15.543080 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3255/6369] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:15.790586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:15.791327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:15.798657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:15.799156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:15.799629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:15.800356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:15.800822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:15.801280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:15.869654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:15.877900 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d1141f1d-19b8-4885-bf41-d3abc22ebb27 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1188 microversion: 2.1 time: 0.092380 Oct 31 16:03:15.878483 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3115/6370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:15 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:16.900711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:16.901441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:16.908693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:16.909204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:16.909641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:16.910340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:16.910790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:16.911210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:16.973995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:16.982431 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d546785-7395-460f-9e46-0f3899578d67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1188 microversion: 2.1 time: 0.086033 Oct 31 16:03:16.983192 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3256/6371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:16 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:18.005880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:18.007614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:18.014722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:18.015218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:18.015661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:18.016361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:18.016999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:18.017469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:18.098408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:18.107380 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a57249bf-22f6-414d-8add-82e3fbd37c9a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1188 microversion: 2.1 time: 0.105357 Oct 31 16:03:18.107971 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3116/6372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:18 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:19.130058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:19.130667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:19.138837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:19.139499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:19.140163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:19.141120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:19.142127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:19.142711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:19.210888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:19.218947 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae0e8ba0-d1fd-40f3-950c-37d14fed4cdd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1188 microversion: 2.1 time: 0.092707 Oct 31 16:03:19.219623 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3257/6373] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:19 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:20.246912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:20.247520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:20.254049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:20.254548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:20.254960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:20.255646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:20.256926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:20.257458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:20.324742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:20.333031 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-10818d37-2862-4dec-bc64-0d639a245a09 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1188 microversion: 2.1 time: 0.090233 Oct 31 16:03:20.333655 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3117/6374] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:20 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:21.357542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:21.358161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:21.366256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:21.366881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:21.367309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:21.368020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:21.368478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:21.368911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:21.433991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:21.442748 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ded8b252-027a-455d-bd3c-cd54163b80c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 200 len: 1188 microversion: 2.1 time: 0.089430 Oct 31 16:03:21.443770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3258/6375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:21 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:22.466405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:22.467100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 2ab91691-d3e6-4db8-ae6c-1108e0484f37] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:22.473777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:22.474256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:22.475331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:22.476023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:22.476473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:22.476891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:22.481211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:22.491391 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 2ab91691-d3e6-4db8-ae6c-1108e0484f37 could not be found. Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 HTTP/1.1 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 2ab91691-d3e6-4db8-ae6c-1108e0484f37 could not be found. Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '2ab91691-d3e6-4db8-ae6c-1108e0484f37'} Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ab91691-d3e6-4db8-ae6c-1108e0484f37 could not be found. Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ab91691-d3e6-4db8-ae6c-1108e0484f37 could not be found. Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:03:22.493020 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.496207 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:03:22.496207 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:03:22.496207 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:03:22.496207 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:03:22.496207 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:03:22.496207 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ab91691-d3e6-4db8-ae6c-1108e0484f37 could not be found. Oct 31 16:03:22.496207 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:03:22.496207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 2ab91691-d3e6-4db8-ae6c-1108e0484f37 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:03:22.496207 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3331a1c9-7321-4d55-bd6f-a0c859643d30 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37" status: 404 len: 111 microversion: 2.1 time: 0.031982 Oct 31 16:03:22.498290 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3118/6376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:22 2022] GET /compute/v2.1/servers/2ab91691-d3e6-4db8-ae6c-1108e0484f37 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:03:28.504394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-101810609", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a182a710-16e3-46d7-a303-94d569243b9b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "753da163-19cf-496b-b365-4c501547e977"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:28.517150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=35 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:28.588296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] validate_networks() for [('753da163-19cf-496b-b365-4c501547e977', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:03:29.036186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:03:29.036641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:03:29.037811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:03:29.038264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:03:29.038712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:03:29.048103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:29.048613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:29.049040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:29.049825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:29.050446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:29.050874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:29.058596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=83 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:29.071189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:03:29.076521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for user e27f6a45a29a4a6e89fdd36c0beac7c3 and project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:03:29.142119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:03:29.144157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a182a710-16e3-46d7-a303-94d569243b9b',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:03:29.287031 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-581c6ffd-4b44-45a8-9802-ee44fe6749bd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786337 Oct 31 16:03:29.288079 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3259/6377] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:03:29.299539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-644d1719-c4a0-44b6-9d4c-94bff0b8b70e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:29.300156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-644d1719-c4a0-44b6-9d4c-94bff0b8b70e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:29.303804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:29.372692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-644d1719-c4a0-44b6-9d4c-94bff0b8b70e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:29.382298 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-644d1719-c4a0-44b6-9d4c-94bff0b8b70e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1056 microversion: 2.1 time: 0.086877 Oct 31 16:03:29.382881 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3119/6378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:29 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1056 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:30.406416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:30.407124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:30.415092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:30.415583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:30.416019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:30.416722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:30.417202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:30.417622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:30.527953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:30.536420 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-95d8c95a-eb5e-4757-8a85-75e4c1863a99 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1162 microversion: 2.1 time: 0.135136 Oct 31 16:03:30.537728 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3260/6379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:30 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1162 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:31.561013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:31.562253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:31.572354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:31.573263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:31.573934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:31.574866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:31.575534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:31.576167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:31.794574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:31.803516 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb528514-1aa3-4209-beb7-50f476cf307e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1214 microversion: 2.1 time: 0.247185 Oct 31 16:03:31.805493 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3120/6380] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:31 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:32.420066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-0197a0d7-4fef-4ab2-8719-a3f159cc705e req-2a616538-a50b-4471-bbcb-bf9f194c9396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730b8938-df3f-4ea0-a18d-614e83b2b456", "tag": "7f9e7238-ba45-4fd0-ae41-168db457e8a1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:32.455685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0197a0d7-4fef-4ab2-8719-a3f159cc705e req-2a616538-a50b-4471-bbcb-bf9f194c9396 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:32.456361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0197a0d7-4fef-4ab2-8719-a3f159cc705e req-2a616538-a50b-4471-bbcb-bf9f194c9396 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:32.457483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-0197a0d7-4fef-4ab2-8719-a3f159cc705e req-2a616538-a50b-4471-bbcb-bf9f194c9396 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:32.478321 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-0197a0d7-4fef-4ab2-8719-a3f159cc705e req-2a616538-a50b-4471-bbcb-bf9f194c9396 service nova] Creating event network-changed:7f9e7238-ba45-4fd0-ae41-168db457e8a1 for instance 730b8938-df3f-4ea0-a18d-614e83b2b456 on n-h2-858384-17 Oct 31 16:03:32.486280 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-0197a0d7-4fef-4ab2-8719-a3f159cc705e req-2a616538-a50b-4471-bbcb-bf9f194c9396 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071526 Oct 31 16:03:32.487240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3261/6381] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:03:32.827799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:32.828586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:32.838034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:32.838836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:32.839583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:32.840730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:32.842089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:32.842736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:33.011772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:33.021751 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bc18f2d5-b684-44eb-a6bc-810d030eed61 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1214 microversion: 2.1 time: 0.197702 Oct 31 16:03:33.023205 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3121/6382] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:32 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:34.047171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:34.047864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:34.055777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:34.056493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:34.057023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:34.057805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:34.058573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:34.059032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:34.235196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:34.243602 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc49c366-14fd-4edc-b71e-99d3810e351f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1214 microversion: 2.1 time: 0.201989 Oct 31 16:03:34.244196 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3262/6383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:34 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:35.272269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:35.272269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:35.279076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:35.279076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:35.279076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:35.279076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:35.279076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:35.279076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:35.418026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:35.425872 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-49d1efe2-8db9-40cb-a921-58533c05dd2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1214 microversion: 2.1 time: 0.163660 Oct 31 16:03:35.432358 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3122/6384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:35 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:36.450981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:36.452217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:36.462293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:36.462867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:36.463300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:36.464007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:36.464466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:36.464891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:36.616945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:36.625359 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3211b2b7-266f-4f06-afc2-16ef35eaa34f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.179310 Oct 31 16:03:36.625947 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3263/6385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:36 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:37.648391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:37.649010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:37.656910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:37.657117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:37.657593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:37.658567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:37.658763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:37.659188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:37.800910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:37.810117 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1095c2b6-e4d0-47f9-947b-3e6b2276cffc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.165911 Oct 31 16:03:37.810790 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3123/6386] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:37 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:38.834226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:38.834853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:38.841833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:38.842388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:38.842827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:38.843543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:38.844000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:38.844426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:38.994418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:39.003388 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bdaa47e2-6c59-4d9f-940b-a72b9761dae9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.173458 Oct 31 16:03:39.003991 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3264/6387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:38 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:03:40.028614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:40.029442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:40.032449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:40.038339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:40.038838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:40.039316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:40.040023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:40.040487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:40.040919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:40.176903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:40.185441 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de59572c-6c1c-4236-bb0a-025b69d2c2f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.161314 Oct 31 16:03:40.186066 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3124/6388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:40 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:41.209776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:41.210312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:41.212285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:41.213159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:41.220249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:41.220739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:41.221201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:41.221904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:41.222374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:41.222782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:41.353142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:41.361094 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e5bc9f5-4879-40a3-a8cd-ba4f3acd475a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.155864 Oct 31 16:03:41.373153 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3265/6389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:41 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:42.384486 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:42.385105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:42.392273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:42.392757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:42.393220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:42.393942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:42.394405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:42.394836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:42.540696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:42.548588 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb7adf57-0786-496a-8639-7011585d12e4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.168435 Oct 31 16:03:42.549213 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3125/6390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:42 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:43.571408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:43.572030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:43.579150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:43.579884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:43.580286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:43.581063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:43.581601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:43.582148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:43.715577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:43.723493 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9bf0968e-37a0-4d6f-907b-facc4e9fdde2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.156205 Oct 31 16:03:43.724098 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3266/6391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:43 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:44.746425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:44.747041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:44.753989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:44.754475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:44.754959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:44.755657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:44.756114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:44.756543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:44.897724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:44.905946 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-897df0b6-13ed-4e8d-ab62-e204568c8ec3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.163498 Oct 31 16:03:44.906556 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3126/6392] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:44 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:03:45.929810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:45.930357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:45.937537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:45.938039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:45.938510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:45.939224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:45.939689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:45.940125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:46.086020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:46.095912 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4566e549-098b-41ad-a35b-8ff971306293 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.171759 Oct 31 16:03:46.096502 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3267/6393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:45 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:46.274444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-12bbe7bd-a66f-4c90-9b1e-4963875b9338 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Action: 'create', calling method: .version_select at 0x7f16e5604af0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-732486332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtmV8m9wIMPaTrpiGS1vFOi4U477bFyPrShwUDaEZBgVWw96kPq9RkZyqLAkCfyJGfvpAJ59odkid/IMe1vRpQBFN5v5VbgEJBNcLyOhWEwnKWpLcXyGWMqERblC76JrQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:46.280926 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:03:46.281068 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 31 16:03:46.297835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-12bbe7bd-a66f-4c90-9b1e-4963875b9338 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Getting quotas for project 615017926ddf4de9a0a85542e41989ff. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:03:46.303029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-12bbe7bd-a66f-4c90-9b1e-4963875b9338 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Getting quotas for user 6e743c22b797499ca45def5349072bc5 and project 615017926ddf4de9a0a85542e41989ff. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:03:46.331006 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-12bbe7bd-a66f-4c90-9b1e-4963875b9338 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.061177 Oct 31 16:03:46.331636 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3127/6394] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:03:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:47.120882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:47.121606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:47.128667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:47.129195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:47.130252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:47.130969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:47.131537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:47.131866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:47.211964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a7b49c93-d6a8-44c1-923e-399893a59071 req-608cb52c-2c82-48f2-b78b-71623c32ee03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730b8938-df3f-4ea0-a18d-614e83b2b456", "name": "network-vif-plugged", "status": "completed", "tag": "7f9e7238-ba45-4fd0-ae41-168db457e8a1"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:47.222555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7b49c93-d6a8-44c1-923e-399893a59071 req-608cb52c-2c82-48f2-b78b-71623c32ee03 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:47.223108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7b49c93-d6a8-44c1-923e-399893a59071 req-608cb52c-2c82-48f2-b78b-71623c32ee03 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:47.223596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a7b49c93-d6a8-44c1-923e-399893a59071 req-608cb52c-2c82-48f2-b78b-71623c32ee03 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:47.236908 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a7b49c93-d6a8-44c1-923e-399893a59071 req-608cb52c-2c82-48f2-b78b-71623c32ee03 service nova] Creating event network-vif-plugged:7f9e7238-ba45-4fd0-ae41-168db457e8a1 for instance 730b8938-df3f-4ea0-a18d-614e83b2b456 on n-h2-858384-17 Oct 31 16:03:47.243686 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a7b49c93-d6a8-44c1-923e-399893a59071 req-608cb52c-2c82-48f2-b78b-71623c32ee03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036041 Oct 31 16:03:47.244304 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3128/6395] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:03:47.303506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:47.312875 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85efb650-5419-46d9-8cc0-3d1a8a25f611 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.196073 Oct 31 16:03:47.313505 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3268/6396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:47 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:47.404558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1647904285", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "937befa6-b93b-4f4f-ba0d-20fba5fcc61a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-732486332", "security_groups": [{"name": "tempest-secgroup-smoke-1270426699"}], "networks": [{"uuid": "fc13b61e-f0ee-4b4a-96bd-ce15458c9ddc"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:47.518816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] validate_networks() for [('fc13b61e-f0ee-4b4a-96bd-ce15458c9ddc', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:03:47.890795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:03:47.891220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:03:47.891697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:03:47.892109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:03:47.892550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:03:47.902266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:47.902755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:47.903193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:47.903944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:47.904405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:47.904838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:47.922035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Getting quotas for project 615017926ddf4de9a0a85542e41989ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:03:47.927710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Getting quotas for user 6e743c22b797499ca45def5349072bc5 and project 615017926ddf4de9a0a85542e41989ff. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:03:47.987227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:03:47.989548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='937befa6-b93b-4f4f-ba0d-20fba5fcc61a',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:03:48.119036 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-165400b0-01ad-4769-a323-d1afdb34d8ae tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.719856 Oct 31 16:03:48.119757 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3129/6397] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:03:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:03:48.131546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d47b96f3-79fa-48d2-a6d4-75cb1da89481 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:48.132159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d47b96f3-79fa-48d2-a6d4-75cb1da89481 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:48.188241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d47b96f3-79fa-48d2-a6d4-75cb1da89481 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:48.197095 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d47b96f3-79fa-48d2-a6d4-75cb1da89481 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1098 microversion: 2.1 time: 0.069910 Oct 31 16:03:48.198031 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3269/6398] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:48 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1098 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:48.339599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:48.340304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:48.346755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:48.347255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:48.347704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:48.348536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:48.349020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:48.349565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:48.494949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:48.503083 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8ef0bb3-9530-4648-87e7-aa630085ec97 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1202 microversion: 2.1 time: 0.167644 Oct 31 16:03:48.503871 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3130/6399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:48 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:49.220159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:49.226149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:49.234733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:49.234856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:49.235292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:49.235992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:49.236611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:49.237051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:49.312450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:49.321906 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55a28324-84ab-488f-ad31-8c3204788ca1 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1214 microversion: 2.1 time: 0.105823 Oct 31 16:03:49.322513 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3270/6400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:49 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:03:49.527731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:49.528522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:49.537387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:49.537965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:49.538482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:49.539259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:49.539784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:49.540416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:49.686365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:49.695367 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1e0fa6f4-82f0-4090-a07f-7b52ed84c7f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1388 microversion: 2.1 time: 0.171800 Oct 31 16:03:49.696184 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3131/6401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:49 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1388 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:49.718687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:49.719593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:49.725994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:49.726753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:49.727254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:49.728021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:49.728675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:49.729199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:49.924377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:49.934202 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11313f0f-1dd0-472a-a948-eb5549a3e587 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1388 microversion: 2.1 time: 0.219496 Oct 31 16:03:49.934730 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3271/6402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:49 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1388 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:49.960390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:49.961440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:49.970083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:49.970582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:49.971272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:49.972011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:49.973017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:49.973632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:50.152153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:50.161864 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f4196d64-f468-4163-b8de-a2bd9a4dce78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1388 microversion: 2.1 time: 0.205384 Oct 31 16:03:50.190097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:50.190944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:50.194008 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3132/6403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:49 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1388 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:50.199338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:50.199816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:50.200425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:50.201706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:50.202298 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:50.202886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:50.234093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:03:50.333942 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-406f359f-4eff-4ec2-af9f-63f0117bd4b4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 204 len: 0 microversion: 2.1 time: 0.150694 Oct 31 16:03:50.334859 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3272/6404] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:03:50 2022] DELETE /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:03:50.345990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:50.346609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:50.346811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:50.349759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:50.355707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:50.356205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:50.356646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:50.358099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:50.358099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:50.358527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:50.358816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:50.359314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:50.373275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:50.374206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:50.374710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:50.375155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:50.508329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:50.516964 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f1f99d14-2275-4fb4-8f86-277a51d24510 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1394 microversion: 2.1 time: 0.177881 Oct 31 16:03:50.518004 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3133/6405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:50 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1394 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:50.597070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:50.606057 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4f47d43-6a51-49ca-a7f5-db4cf83c1ed8 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1282 microversion: 2.1 time: 0.264223 Oct 31 16:03:50.606999 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3273/6406] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:50 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1282 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:03:50.860003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-cb3309cf-26ec-483c-9895-916e9b439cbb req-e0e830da-b284-4037-b956-e0d80a379069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96880553-6bab-49ab-8895-d404ad2f4758", "tag": "c6806c69-ce89-4891-bdcf-f2b7f8bbfca5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:50.880634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cb3309cf-26ec-483c-9895-916e9b439cbb req-e0e830da-b284-4037-b956-e0d80a379069 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:50.881654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cb3309cf-26ec-483c-9895-916e9b439cbb req-e0e830da-b284-4037-b956-e0d80a379069 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:50.882571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cb3309cf-26ec-483c-9895-916e9b439cbb req-e0e830da-b284-4037-b956-e0d80a379069 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:50.899989 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-cb3309cf-26ec-483c-9895-916e9b439cbb req-e0e830da-b284-4037-b956-e0d80a379069 service nova] Creating event network-changed:c6806c69-ce89-4891-bdcf-f2b7f8bbfca5 for instance 96880553-6bab-49ab-8895-d404ad2f4758 on n-h1-858384-17 Oct 31 16:03:50.906107 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-cb3309cf-26ec-483c-9895-916e9b439cbb req-e0e830da-b284-4037-b956-e0d80a379069 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053540 Oct 31 16:03:50.907242 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3134/6407] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:51.540708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:51.541372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:51.548726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:51.549251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:51.549687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:51.550384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:51.550837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:51.552099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:51.631850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:51.632551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:51.639085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:51.639576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:51.640912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:51.640912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:51.641171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:51.641597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:51.803127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:51.807039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:51.811546 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c6f80b7e-c281-4e80-bdda-01154e865cc2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1282 microversion: 2.1 time: 0.185199 Oct 31 16:03:51.812351 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3135/6408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:51 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:51.815468 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-225f52cc-9d7c-46d0-b97e-0be45af39554 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1394 microversion: 2.1 time: 0.278758 Oct 31 16:03:51.816057 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3274/6409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:51 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1394 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:52.834753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:52.835595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:52.840585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:52.841571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:52.842804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:52.843365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:52.843889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:52.844708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:52.845716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:52.845843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:52.849647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:52.850212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:52.850726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:52.851561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:52.852137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:52.852675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:52.916470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:52.927795 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae43a129-ddaf-4b68-92bb-3e9a073026f8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1187 microversion: 2.1 time: 0.090663 Oct 31 16:03:52.937238 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3275/6410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:52 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:03:52.937238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b55fb850-9c99-4ea8-9a61-a468ec642a0b req-25184be9-f01e-49b6-a81c-f52259cb5d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730b8938-df3f-4ea0-a18d-614e83b2b456", "name": "network-vif-deleted", "tag": "7f9e7238-ba45-4fd0-ae41-168db457e8a1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:03:52.946156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b55fb850-9c99-4ea8-9a61-a468ec642a0b req-25184be9-f01e-49b6-a81c-f52259cb5d32 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:52.946841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b55fb850-9c99-4ea8-9a61-a468ec642a0b req-25184be9-f01e-49b6-a81c-f52259cb5d32 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:52.947380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b55fb850-9c99-4ea8-9a61-a468ec642a0b req-25184be9-f01e-49b6-a81c-f52259cb5d32 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:52.959753 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b55fb850-9c99-4ea8-9a61-a468ec642a0b req-25184be9-f01e-49b6-a81c-f52259cb5d32 service nova] Creating event network-vif-deleted:7f9e7238-ba45-4fd0-ae41-168db457e8a1 for instance 730b8938-df3f-4ea0-a18d-614e83b2b456 on n-h2-858384-17 Oct 31 16:03:52.965147 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b55fb850-9c99-4ea8-9a61-a468ec642a0b req-25184be9-f01e-49b6-a81c-f52259cb5d32 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034988 Oct 31 16:03:52.965996 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3276/6411] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:03:52.997164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:53.005274 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b30f2d50-542c-4219-a19b-869f3976c1f5 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1282 microversion: 2.1 time: 0.174470 Oct 31 16:03:53.005856 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3136/6412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:52 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:53.952654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:53.953531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:53.960406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:53.960895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:53.961365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:53.962065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:53.962528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:53.962956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:53.965724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:54.028132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:54.028740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:54.035112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:54.036650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:54.037266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:54.037702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:54.038411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:54.038866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:54.039291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:54.043935 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f6b9e8f9-9a0b-42ee-afa8-4492cd8e56ff tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1187 microversion: 2.1 time: 0.096453 Oct 31 16:03:54.044525 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3277/6413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:53 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:54.177752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:54.186219 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b1ab2273-8219-4e96-be7b-50e4b9e998f9 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1282 microversion: 2.1 time: 0.162228 Oct 31 16:03:54.186815 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3137/6414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:54 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:03:55.066614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:55.067404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:55.074209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:55.074694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:55.075129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:55.075821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:55.076274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:55.076699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:55.139659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:55.147809 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6664c652-d5b6-4e94-91cc-eaa246c60ea1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1187 microversion: 2.1 time: 0.085130 Oct 31 16:03:55.148484 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3278/6415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:55 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:55.209647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:55.210182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:55.216956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:55.217468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:55.217900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:55.218586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:55.219038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:55.219461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:55.356116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:55.364745 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13d51088-4465-4198-a1d7-5b632e54e6b7 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1282 microversion: 2.1 time: 0.159587 Oct 31 16:03:55.365362 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3138/6416] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:55 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:56.171869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:56.172447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:56.179389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:56.179876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:56.180318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:56.181015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:56.181508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:56.181935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:56.244914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:56.252858 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4cd624da-0ee0-40ab-bd29-f8a1c707d4c1 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 200 len: 1187 microversion: 2.1 time: 0.085012 Oct 31 16:03:56.253481 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3279/6417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:56 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:56.387946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:56.388552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:56.396464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:56.396949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:56.397414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:56.398111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:56.398574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:56.399013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:56.417537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:56.537729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:56.546090 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d4ee9407-39d2-4f7d-86ff-3935d1c704bb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1282 microversion: 2.1 time: 0.161974 Oct 31 16:03:56.546710 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3139/6418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:56 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:57.276274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:57.276941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 730b8938-df3f-4ea0-a18d-614e83b2b456] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:57.283950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:57.284448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:57.284883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:57.286219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:57.286672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:57.287101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:57.302982 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 730b8938-df3f-4ea0-a18d-614e83b2b456 could not be found. Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 HTTP/1.1 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 730b8938-df3f-4ea0-a18d-614e83b2b456 could not be found. Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '730b8938-df3f-4ea0-a18d-614e83b2b456'} Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730b8938-df3f-4ea0-a18d-614e83b2b456 could not be found. Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730b8938-df3f-4ea0-a18d-614e83b2b456 could not be found. Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:03:57.304580 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730b8938-df3f-4ea0-a18d-614e83b2b456 could not be found. Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 730b8938-df3f-4ea0-a18d-614e83b2b456 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-81c410bd-12bf-4300-9ab6-47a3b304ae3c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456" status: 404 len: 111 microversion: 2.1 time: 0.033971 Oct 31 16:03:57.309169 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3280/6419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:57 2022] GET /compute/v2.1/servers/730b8938-df3f-4ea0-a18d-614e83b2b456 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:03:57.572940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:57.573667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:57.581035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:57.581563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:57.582004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:57.582709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:57.583165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:57.583592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:57.723593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:57.731356 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03c1cad3-e368-4ab0-bcb5-78086ae07b95 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1282 microversion: 2.1 time: 0.162398 Oct 31 16:03:57.731942 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3140/6420] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:57 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:58.755630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:58.756404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:58.758401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:58.760291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:58.767536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:58.768032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:58.768475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:58.769375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:58.770538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:58.770975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:58.914533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:03:58.922918 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c73d094-8050-442d-80e8-d2021369ab37 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1270 microversion: 2.1 time: 0.171750 Oct 31 16:03:58.923515 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3281/6421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:58 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:03:59.947214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:03:59.947758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:03:59.950740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:59.951402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:59.953072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:03:59.958647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:59.959178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:59.959622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:03:59.960322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:03:59.960782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:03:59.961242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:00.108269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:00.117616 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a6b7d0c5-d86f-4147-9a23-dda4060fd7a3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1270 microversion: 2.1 time: 0.174358 Oct 31 16:04:00.118167 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3141/6422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:03:59 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:04:01.140616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:01.141150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:01.148508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:01.148991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:01.149457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:01.150415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:01.150861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:01.151279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:01.287348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:01.295351 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eeab4664-23e5-4601-a2b8-805e8c3f786f tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1270 microversion: 2.1 time: 0.158704 Oct 31 16:04:01.295964 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3282/6423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:01 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:02.319161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:02.319863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:02.326620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:02.327182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:02.327681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:02.328464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:02.328983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:02.329458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:02.499194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:02.507703 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-febc1aa4-7c84-4e42-9831-bc76cd11ee3a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1270 microversion: 2.1 time: 0.193357 Oct 31 16:04:02.508391 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3142/6424] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:02 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:03.531097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:03.531706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:03.539959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:03.540455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:03.540891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:03.541621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:03.542079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:03.542502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:03.679454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:03.687838 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b10ce768-4f93-4803-ac60-4914559c2359 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1270 microversion: 2.1 time: 0.160551 Oct 31 16:04:03.688676 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3283/6425] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:03 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:04.711714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:04.712356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:04.719471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:04.719976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:04.720428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:04.721199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:04.721674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:04.722108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:04.865095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:04.873839 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc28289e-9559-4403-bb95-4b2599a449f0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1270 microversion: 2.1 time: 0.165907 Oct 31 16:04:04.881818 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3143/6426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:04 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:05.897489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:05.898054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:05.905567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:05.906248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:05.906890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:05.907599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:05.908218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:05.908650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:06.051740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:06.059722 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bca81595-b34c-446f-9b34-8a85dd7143d3 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1270 microversion: 2.1 time: 0.166303 Oct 31 16:04:06.060314 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3284/6427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:05 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:07.048202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-82995045-1b5e-4873-a8cd-60e25a965426 req-03fc86c4-3c9d-4603-b943-5a5fceaa6642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96880553-6bab-49ab-8895-d404ad2f4758", "name": "network-vif-plugged", "status": "completed", "tag": "c6806c69-ce89-4891-bdcf-f2b7f8bbfca5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:07.060773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-82995045-1b5e-4873-a8cd-60e25a965426 req-03fc86c4-3c9d-4603-b943-5a5fceaa6642 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:07.061295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-82995045-1b5e-4873-a8cd-60e25a965426 req-03fc86c4-3c9d-4603-b943-5a5fceaa6642 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:07.061730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-82995045-1b5e-4873-a8cd-60e25a965426 req-03fc86c4-3c9d-4603-b943-5a5fceaa6642 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:07.077254 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-82995045-1b5e-4873-a8cd-60e25a965426 req-03fc86c4-3c9d-4603-b943-5a5fceaa6642 service nova] Creating event network-vif-plugged:c6806c69-ce89-4891-bdcf-f2b7f8bbfca5 for instance 96880553-6bab-49ab-8895-d404ad2f4758 on n-h1-858384-17 Oct 31 16:04:07.083934 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-82995045-1b5e-4873-a8cd-60e25a965426 req-03fc86c4-3c9d-4603-b943-5a5fceaa6642 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039845 Oct 31 16:04:07.085162 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3144/6428] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:07.085702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:07.086329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:07.094722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:07.095940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:07.096866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:07.097886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:07.098527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:07.099136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:07.318425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:07.326772 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2d7bdecd-2f9e-4a67-af16-efcae266484e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1270 microversion: 2.1 time: 0.247746 Oct 31 16:04:07.337525 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3285/6429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:07 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1270 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:08.353462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:08.354816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:08.361643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:08.362235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:08.362856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:08.363638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:08.364105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:08.364781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:08.514017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:08.525289 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca12462b-6724-49fd-aca0-0da3c5de4dcf tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1459 microversion: 2.1 time: 0.177791 Oct 31 16:04:08.525896 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3145/6430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:08 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1459 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:08.547717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:08.548334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:08.568498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:08.569371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:08.570140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:08.570932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:08.571561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:08.572039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:08.724724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:08.740984 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cdd6daf3-07c6-433c-a3e6-b86de4c33c3b tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1459 microversion: 2.1 time: 0.197076 Oct 31 16:04:08.741917 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3286/6431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:08 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1459 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:10.958680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-cdf2b0ac-019c-4f82-ba51-4eff68acc3bf req-377f092a-150a-43c0-8827-b6380049048f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96880553-6bab-49ab-8895-d404ad2f4758", "tag": "c6806c69-ce89-4891-bdcf-f2b7f8bbfca5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:10.983134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cdf2b0ac-019c-4f82-ba51-4eff68acc3bf req-377f092a-150a-43c0-8827-b6380049048f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:10.984357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cdf2b0ac-019c-4f82-ba51-4eff68acc3bf req-377f092a-150a-43c0-8827-b6380049048f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:10.985630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cdf2b0ac-019c-4f82-ba51-4eff68acc3bf req-377f092a-150a-43c0-8827-b6380049048f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:11.014348 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-cdf2b0ac-019c-4f82-ba51-4eff68acc3bf req-377f092a-150a-43c0-8827-b6380049048f service nova] Creating event network-changed:c6806c69-ce89-4891-bdcf-f2b7f8bbfca5 for instance 96880553-6bab-49ab-8895-d404ad2f4758 on n-h1-858384-17 Oct 31 16:04:11.034090 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-cdf2b0ac-019c-4f82-ba51-4eff68acc3bf req-377f092a-150a-43c0-8827-b6380049048f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086133 Oct 31 16:04:11.038061 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3146/6432] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:12.335862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-612a3815-56e2-49e3-b265-26275208e6ff req-73e9765e-5523-444b-8810-8e040cb5f9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96880553-6bab-49ab-8895-d404ad2f4758", "tag": "c6806c69-ce89-4891-bdcf-f2b7f8bbfca5"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:12.346774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-612a3815-56e2-49e3-b265-26275208e6ff req-73e9765e-5523-444b-8810-8e040cb5f9f2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:12.347717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-612a3815-56e2-49e3-b265-26275208e6ff req-73e9765e-5523-444b-8810-8e040cb5f9f2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:12.348021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-612a3815-56e2-49e3-b265-26275208e6ff req-73e9765e-5523-444b-8810-8e040cb5f9f2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:12.361596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-612a3815-56e2-49e3-b265-26275208e6ff req-73e9765e-5523-444b-8810-8e040cb5f9f2 service nova] Creating event network-changed:c6806c69-ce89-4891-bdcf-f2b7f8bbfca5 for instance 96880553-6bab-49ab-8895-d404ad2f4758 on n-h1-858384-17 Oct 31 16:04:12.382076 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-612a3815-56e2-49e3-b265-26275208e6ff req-73e9765e-5523-444b-8810-8e040cb5f9f2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210987 Oct 31 16:04:12.388432 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3287/6433] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:14.399918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bcd6ae74-190f-4b8f-ac5c-99a860e199ca req-8f4eb7e9-9d80-44d3-aba9-61df749cb9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96880553-6bab-49ab-8895-d404ad2f4758", "tag": "c6806c69-ce89-4891-bdcf-f2b7f8bbfca5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:14.409920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bcd6ae74-190f-4b8f-ac5c-99a860e199ca req-8f4eb7e9-9d80-44d3-aba9-61df749cb9b2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:14.410576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bcd6ae74-190f-4b8f-ac5c-99a860e199ca req-8f4eb7e9-9d80-44d3-aba9-61df749cb9b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:14.411036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bcd6ae74-190f-4b8f-ac5c-99a860e199ca req-8f4eb7e9-9d80-44d3-aba9-61df749cb9b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:14.422211 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bcd6ae74-190f-4b8f-ac5c-99a860e199ca req-8f4eb7e9-9d80-44d3-aba9-61df749cb9b2 service nova] Creating event network-changed:c6806c69-ce89-4891-bdcf-f2b7f8bbfca5 for instance 96880553-6bab-49ab-8895-d404ad2f4758 on n-h1-858384-17 Oct 31 16:04:14.427226 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bcd6ae74-190f-4b8f-ac5c-99a860e199ca req-8f4eb7e9-9d80-44d3-aba9-61df749cb9b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033418 Oct 31 16:04:14.428108 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3147/6434] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:20.738759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-425608112", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b68a324a-9b52-4c20-a396-aa9ead821ced", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "753da163-19cf-496b-b365-4c501547e977"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:20.826862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] validate_networks() for [('753da163-19cf-496b-b365-4c501547e977', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:04:21.194411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:04:21.194860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:04:21.195333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:04:21.195791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:04:21.196203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:04:21.205033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:21.205548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:21.206756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:21.207490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:21.207948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:21.208376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:21.225675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:04:21.230982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for user e27f6a45a29a4a6e89fdd36c0beac7c3 and project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:04:21.243543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:04:21.245720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b68a324a-9b52-4c20-a396-aa9ead821ced',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:04:21.319275 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-875e90d5-1820-418c-82d2-9e488ec903f6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585896 Oct 31 16:04:21.320043 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3288/6435] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:04:21.332985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60f4c0bb-1e3a-4b9e-a8b4-14479ef79987 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:21.333710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60f4c0bb-1e3a-4b9e-a8b4-14479ef79987 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:21.388183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-60f4c0bb-1e3a-4b9e-a8b4-14479ef79987 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:21.395102 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60f4c0bb-1e3a-4b9e-a8b4-14479ef79987 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1056 microversion: 2.1 time: 0.067664 Oct 31 16:04:21.395848 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3148/6436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:21 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1056 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:22.419854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:22.421105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:22.432488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:22.433187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:22.433796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:22.434920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:22.435527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:22.436107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:22.517370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:22.525923 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b8867e23-9881-43a6-8c1f-b6c1d73ff467 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1116 microversion: 2.1 time: 0.111032 Oct 31 16:04:22.537316 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3289/6437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:22 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1116 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:04:23.551798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:23.552540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:23.565122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:23.566464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:23.567338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:23.568224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:23.568876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:23.569436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:23.727691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:23.736479 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b7848203-f077-4d69-b7d2-ed4002d3b375 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.189730 Oct 31 16:04:23.737096 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3149/6438] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:23 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:24.006942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-33ca77b1-594d-46bb-a679-0d35307d5613 req-4f09c1bf-fadf-4c06-9099-9573acf33915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5019af3-45cd-4a93-bf58-2de1e3a142bb", "tag": "426bb40d-f455-40cd-8948-fac46c6a8507"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:24.021570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-33ca77b1-594d-46bb-a679-0d35307d5613 req-4f09c1bf-fadf-4c06-9099-9573acf33915 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:24.022526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-33ca77b1-594d-46bb-a679-0d35307d5613 req-4f09c1bf-fadf-4c06-9099-9573acf33915 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:24.023165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-33ca77b1-594d-46bb-a679-0d35307d5613 req-4f09c1bf-fadf-4c06-9099-9573acf33915 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:24.046432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=66 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:24.049074 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-33ca77b1-594d-46bb-a679-0d35307d5613 req-4f09c1bf-fadf-4c06-9099-9573acf33915 service nova] Creating event network-changed:426bb40d-f455-40cd-8948-fac46c6a8507 for instance e5019af3-45cd-4a93-bf58-2de1e3a142bb on n-h2-858384-17 Oct 31 16:04:24.056676 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-33ca77b1-594d-46bb-a679-0d35307d5613 req-4f09c1bf-fadf-4c06-9099-9573acf33915 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056009 Oct 31 16:04:24.057584 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3290/6439] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:04:24.760160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:24.760984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:24.768294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:24.769450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:24.769976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:24.770754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:24.771326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:24.771829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:24.922608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:24.932514 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b787869c-22cb-4413-9d7f-4b8cbd1ab4bb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.176188 Oct 31 16:04:24.933506 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3150/6440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:24 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:25.965379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:25.966677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:25.974459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:25.975152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:25.975590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:25.976585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:25.977071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:25.977529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:26.155053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:26.167950 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b8ac393a-8cc5-4532-9577-764de53b361c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.214133 Oct 31 16:04:26.168988 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3291/6441] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:25 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:27.201024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:27.201024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:27.211910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:27.212449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:27.212985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:27.214358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:27.214835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:27.215347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:27.219906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=51 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:27.384869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:27.397898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f31e332d-1bb0-497e-85fe-f764d6b7b40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.201529 Oct 31 16:04:27.399000 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3151/6442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:27 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:28.429477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:28.430081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:28.436810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:28.437333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:28.437780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:28.438487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:28.438959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:28.439379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:28.595722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:28.605903 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d52bde41-4e0d-45f1-a508-f29c1f5b5de9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.181731 Oct 31 16:04:28.606495 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3292/6443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:28 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:29.630451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:29.631091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:29.639455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:29.639944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:29.640383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:29.641075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:29.641554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:29.641977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:29.783095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:29.791712 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00bae8a9-ac95-46a1-96f2-2a947e2eb332 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.165272 Oct 31 16:04:29.792643 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3152/6444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:29 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:30.816412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:30.817107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:30.820336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:30.826683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:30.827208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:30.827683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:30.828387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:30.828844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:30.829313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:30.968173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:30.976301 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fff0797c-f95b-4564-959b-0f8ecc740997 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.164356 Oct 31 16:04:30.977002 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3293/6445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:30 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:32.001313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:32.002109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:32.005531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:32.006341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=26 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:32.013385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:32.013979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:32.014490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:32.015185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:32.015648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:32.016224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:32.165181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:32.173306 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f3f6af2a-6b82-449f-93ec-bd3b321704b2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.175891 Oct 31 16:04:32.173927 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3153/6446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:31 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:33.198704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:33.199284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:33.201224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:33.201895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:33.209864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:33.210364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:33.210820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:33.211582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:33.211992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:33.212424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:33.344265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:33.351984 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-035a3def-2c92-4c38-8287-944224ece4d2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.157313 Oct 31 16:04:33.352566 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3294/6447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:33 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:34.376094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:34.376767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:34.386956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:34.387504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:34.387975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:34.389044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:34.389562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:34.390775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:34.553063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:34.576800 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-85026ad9-c1de-4726-b0c6-5a9622148052 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.205195 Oct 31 16:04:34.577923 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3154/6448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:34 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:04:35.600843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:35.601942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:35.609077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:35.610000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:35.610083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:35.610917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:35.611633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:35.613029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:35.766657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:35.777498 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4d49f28-5762-4d47-8d6f-9acd7536d14a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.181475 Oct 31 16:04:35.779053 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3295/6449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:35 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:36.802538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:36.803154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:36.810076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:36.810571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:36.811012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:36.811716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:36.812178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:36.812613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:36.951152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:36.960572 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5607b5e-8b9c-416a-89e7-8cee8fcfb834 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1168 microversion: 2.1 time: 0.162189 Oct 31 16:04:36.961217 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3155/6450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:36 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:37.984350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:37.984872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:37.991769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:37.992255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:37.992693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:37.993416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:37.993879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:37.994307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:38.121516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:38.129099 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e1adaae4-11a8-40ca-8775-48b0e178a1ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.148927 Oct 31 16:04:38.130092 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3296/6451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:37 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:39.153753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:39.154414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:39.161447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:39.161929 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:39.162366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:39.163051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:39.163507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:39.163932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:39.300135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:39.308240 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f445f35-32a8-4765-931e-72ca00401ea0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.158755 Oct 31 16:04:39.308822 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3156/6452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:39 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:40.331209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:40.331814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:40.338738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:40.339227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:40.339660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:40.340349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:40.340803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:40.341255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:40.478235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:40.491183 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9768e80c-0052-4962-942e-b911da0ea43f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.163666 Oct 31 16:04:40.491774 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3297/6453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:40 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:41.516199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:41.516818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:41.524871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:41.525391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:41.525830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:41.526523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:41.526983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:41.527418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:41.658150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:41.665987 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea16094f-159a-4624-ad50-623f35105646 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.153711 Oct 31 16:04:41.666573 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3157/6454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:41 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:42.689549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:42.690156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:42.693439 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:04:42.693622 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:04:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb (ip 10.222.0.20) !!! Oct 31 16:04:42.700251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:42.700739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:42.701194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:42.701901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:42.702354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:42.702777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:42.837261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:42.845159 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ccfdf7b6-091a-466f-85e7-8aa3028bd10c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.159451 Oct 31 16:04:42.845726 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3298/6455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:42 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:43.868962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:43.869617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:43.876822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:43.877362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:43.877807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:43.878503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:43.878966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:43.879398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:44.012872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:44.021019 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4de5d73a-96ff-4668-a7d9-392b3ea9e700 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.156866 Oct 31 16:04:44.021576 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3158/6456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:43 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:45.047072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:45.047683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:45.056591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:45.057081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:45.057812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:45.058742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:45.059264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:45.059699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:45.219532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:45.229158 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b621b3e4-7fcf-4814-892d-438debbf1b8d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.186608 Oct 31 16:04:45.230441 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3299/6457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:45 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:46.256268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:46.257443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:46.265284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:46.266154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:46.266607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:46.267306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:46.267759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:46.268180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:46.495038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:46.503249 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9ac21813-6880-41a4-a44b-afbc6498755d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.250916 Oct 31 16:04:46.503861 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3159/6458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:46 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:46.700420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:46.700898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:46.704185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-30498553-56a3-422e-b4b4-1727875e68e3 req-37f59d15-d1fb-4695-b3bb-df6ea25686ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96880553-6bab-49ab-8895-d404ad2f4758", "tag": "c6806c69-ce89-4891-bdcf-f2b7f8bbfca5"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:46.708262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:46.709119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:46.709851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:46.710625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:46.711313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:46.712256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:46.715668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-30498553-56a3-422e-b4b4-1727875e68e3 req-37f59d15-d1fb-4695-b3bb-df6ea25686ee service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:46.716164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-30498553-56a3-422e-b4b4-1727875e68e3 req-37f59d15-d1fb-4695-b3bb-df6ea25686ee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:46.718009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-30498553-56a3-422e-b4b4-1727875e68e3 req-37f59d15-d1fb-4695-b3bb-df6ea25686ee service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:46.730977 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-30498553-56a3-422e-b4b4-1727875e68e3 req-37f59d15-d1fb-4695-b3bb-df6ea25686ee service nova] Creating event network-changed:c6806c69-ce89-4891-bdcf-f2b7f8bbfca5 for instance 96880553-6bab-49ab-8895-d404ad2f4758 on n-h1-858384-17 Oct 31 16:04:46.736456 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-30498553-56a3-422e-b4b4-1727875e68e3 req-37f59d15-d1fb-4695-b3bb-df6ea25686ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035801 Oct 31 16:04:46.740404 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3160/6459] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:46.741705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:04:46.826478 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-90a32c27-f5b8-4a68-9567-5638b310c5e0 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "DELETE /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 204 len: 0 microversion: 2.1 time: 0.129556 Oct 31 16:04:46.827263 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3300/6460] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:04:46 2022] DELETE /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:04:46.836548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:46.837552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:46.844088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:46.844863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:46.845281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:46.846291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:46.846922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:46.847355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:46.995433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:47.003256 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-94188319-b16a-4d42-b8ea-f0bbc41eebe2 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1582 microversion: 2.1 time: 0.170949 Oct 31 16:04:47.003846 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3161/6461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:46 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1582 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:47.446157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9f4fe924-243d-40f8-ba64-a384ebb72c3a req-d0acd34b-5493-409d-b3d1-8212d4299429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5019af3-45cd-4a93-bf58-2de1e3a142bb", "name": "network-vif-plugged", "status": "completed", "tag": "426bb40d-f455-40cd-8948-fac46c6a8507"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:47.455866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9f4fe924-243d-40f8-ba64-a384ebb72c3a req-d0acd34b-5493-409d-b3d1-8212d4299429 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:47.456346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9f4fe924-243d-40f8-ba64-a384ebb72c3a req-d0acd34b-5493-409d-b3d1-8212d4299429 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:47.456772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9f4fe924-243d-40f8-ba64-a384ebb72c3a req-d0acd34b-5493-409d-b3d1-8212d4299429 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:47.472083 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9f4fe924-243d-40f8-ba64-a384ebb72c3a req-d0acd34b-5493-409d-b3d1-8212d4299429 service nova] Creating event network-vif-plugged:426bb40d-f455-40cd-8948-fac46c6a8507 for instance e5019af3-45cd-4a93-bf58-2de1e3a142bb on n-h2-858384-17 Oct 31 16:04:47.477277 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9f4fe924-243d-40f8-ba64-a384ebb72c3a req-d0acd34b-5493-409d-b3d1-8212d4299429 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113328 Oct 31 16:04:47.477902 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3301/6462] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:04:47.528302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:47.529625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:47.536463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:47.536958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:47.537490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:47.538617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:47.539618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:47.540216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:47.689361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:47.697961 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-31f4c854-43ac-4d92-94b6-c57eee6269eb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.173697 Oct 31 16:04:47.698547 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3162/6463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:47 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:48.029243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:48.029947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:48.036305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:48.036788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:48.037252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:48.038810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:48.039431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:48.039860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:48.507785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:48.517606 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55b26629-1805-45a2-9283-4e3af204a10e tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1582 microversion: 2.1 time: 0.493824 Oct 31 16:04:48.518367 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3302/6464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:48 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1582 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:48.720514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:48.721121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:48.736878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:48.737420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:48.737860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:48.738573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:48.739062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:48.739493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:48.809939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-209e92a6-08d0-4510-aa07-ed8effb126bd req-26119efd-465e-4516-9651-a17a2255e890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96880553-6bab-49ab-8895-d404ad2f4758", "name": "network-vif-deleted", "tag": "c6806c69-ce89-4891-bdcf-f2b7f8bbfca5"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:48.823771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-209e92a6-08d0-4510-aa07-ed8effb126bd req-26119efd-465e-4516-9651-a17a2255e890 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:48.824634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-209e92a6-08d0-4510-aa07-ed8effb126bd req-26119efd-465e-4516-9651-a17a2255e890 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:48.825365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-209e92a6-08d0-4510-aa07-ed8effb126bd req-26119efd-465e-4516-9651-a17a2255e890 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:48.841331 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-209e92a6-08d0-4510-aa07-ed8effb126bd req-26119efd-465e-4516-9651-a17a2255e890 service nova] Creating event network-vif-deleted:c6806c69-ce89-4891-bdcf-f2b7f8bbfca5 for instance 96880553-6bab-49ab-8895-d404ad2f4758 on n-h1-858384-17 Oct 31 16:04:48.847693 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-209e92a6-08d0-4510-aa07-ed8effb126bd req-26119efd-465e-4516-9651-a17a2255e890 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042378 Oct 31 16:04:48.848510 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3303/6465] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:04:48.914983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:48.926318 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-69e37125-d273-49d0-a8fb-25c402f91f2a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1202 microversion: 2.1 time: 0.209627 Oct 31 16:04:48.927118 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3163/6466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:48 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:49.544164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:49.544862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:49.551127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:49.551610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:49.552041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:49.552733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:49.553940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:49.554534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:49.623302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:49.631348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-12cd61df-31d9-47fa-b766-a8caee67a45a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1229 microversion: 2.1 time: 0.092263 Oct 31 16:04:49.631941 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3304/6467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:49 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:49.953178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:49.953835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:49.961168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:49.961657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:49.962093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:49.962782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:49.963240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:49.963693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.096181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:50.104676 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ccb5db0-b133-491b-8088-ed1072c90ad8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1388 microversion: 2.1 time: 0.155584 Oct 31 16:04:50.105287 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3164/6468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:49 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:50.126856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:50.127541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:50.134014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.134687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.135115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.135806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.136258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.136680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.269656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:50.278456 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d25fb173-d8f4-477f-8aeb-3e2d2cc9cf78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1388 microversion: 2.1 time: 0.155475 Oct 31 16:04:50.279126 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3305/6469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:50 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:50.300166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:50.300785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:50.307009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.307523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.307987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.308684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.309159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.309585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.447944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:50.456369 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-24661423-787d-4abe-a800-c94c6ae9e852 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1388 microversion: 2.1 time: 0.159992 Oct 31 16:04:50.457063 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3165/6470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:50 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1388 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:50.542413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:50.543082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:50.550004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.550561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.550930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.551618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.552076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.552496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.581204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:04:50.595935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:50.660181 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3872d8ee-6648-490e-b4b0-90a3a7fb358e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 204 len: 0 microversion: 2.1 time: 0.121294 Oct 31 16:04:50.664204 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3306/6471] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:04:50 2022] DELETE /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 16:04:50.667200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:50.669853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:50.670228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:50.670916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:50.677367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.678450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.678756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.679000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.679444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.679582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.680137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.680497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:50.680648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.681179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.681301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:50.681792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:50.766737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:50.776129 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7a09bd5-bca7-4c14-9777-136ada4f55cb tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1229 microversion: 2.1 time: 0.115777 Oct 31 16:04:50.777376 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3166/6472] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:50 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1229 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:50.850949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:50.859057 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cecb1ace-4b72-4f47-8c60-44978e8f00a4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1394 microversion: 2.1 time: 0.193481 Oct 31 16:04:50.859645 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3307/6473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:50 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1394 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:04:51.799903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:51.800634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:51.808137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:51.808634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:51.809073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:51.809808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:51.810265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:51.810693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:51.876062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:51.884154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:51.884771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:51.892173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:51.892878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:51.893623 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fefbbc42-e913-42f2-8a3c-398d3ab5913a tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1229 microversion: 2.1 time: 0.097203 Oct 31 16:04:51.894256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:51.894610 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3167/6474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:51 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:51.894915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:51.895707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:51.896475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:52.039928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:52.048708 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc8ab71b-8932-43f9-a758-14f4ada31211 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1394 microversion: 2.1 time: 0.169279 Oct 31 16:04:52.049357 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3308/6475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:51 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1394 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:04:52.735311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fcbb7f6f-1f5c-486d-b6b9-035ba46c4b7e req-4d19449e-24a1-45a2-ab93-7e844a157b74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5019af3-45cd-4a93-bf58-2de1e3a142bb", "name": "network-vif-deleted", "tag": "426bb40d-f455-40cd-8948-fac46c6a8507"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:04:52.750524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fcbb7f6f-1f5c-486d-b6b9-035ba46c4b7e req-4d19449e-24a1-45a2-ab93-7e844a157b74 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:52.751256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fcbb7f6f-1f5c-486d-b6b9-035ba46c4b7e req-4d19449e-24a1-45a2-ab93-7e844a157b74 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:52.751854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fcbb7f6f-1f5c-486d-b6b9-035ba46c4b7e req-4d19449e-24a1-45a2-ab93-7e844a157b74 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:52.767844 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fcbb7f6f-1f5c-486d-b6b9-035ba46c4b7e req-4d19449e-24a1-45a2-ab93-7e844a157b74 service nova] Creating event network-vif-deleted:426bb40d-f455-40cd-8948-fac46c6a8507 for instance e5019af3-45cd-4a93-bf58-2de1e3a142bb on n-h2-858384-17 Oct 31 16:04:52.777240 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fcbb7f6f-1f5c-486d-b6b9-035ba46c4b7e req-4d19449e-24a1-45a2-ab93-7e844a157b74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044594 Oct 31 16:04:52.778275 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3168/6476] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:04:52.918090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:52.918713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:52.926042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:52.926545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:52.926989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:52.927760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:52.928240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:52.928905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:53.000956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e743c22b797499ca45def5349072bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615017926ddf4de9a0a85542e41989ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:53.009343 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b330e54d-b6b9-40d7-9120-c51f2554df35 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 200 len: 1229 microversion: 2.1 time: 0.095084 Oct 31 16:04:53.010067 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3309/6477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:52 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:53.072950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:53.073835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:53.081374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:53.085767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:53.086296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:53.087101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:53.087642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:53.088146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:53.093333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=100 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:04:53.160858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:53.169952 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b86c254a-aa78-4111-aeca-20bc16fe600a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1187 microversion: 2.1 time: 0.101655 Oct 31 16:04:53.170577 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3169/6478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:53 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1187 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:54.032883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:54.033532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] [instance: 96880553-6bab-49ab-8895-d404ad2f4758] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:54.040994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:54.041517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:54.041955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:54.042664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:54.043152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:54.043586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:54.058132 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] HTTP exception thrown: Instance 96880553-6bab-49ab-8895-d404ad2f4758 could not be found. Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Request method failure captured: Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 HTTP/1.1 Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_FkrUOs9kgRJ1JrFPI8w9H03RS9wp01rUmvc6FdHSEXibARX5fb8VsjCphCXZK298jCMy2N3iSgKyHMu4icJEA7v6ebab7zQlCuhzX9akrNwGENzgHc2z4Xt0HiPRC5yYAybUgnK2XzEkBOoWeJq-Qfqyq74NeQ5ngV46UGUjBBITM Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 615017926ddf4de9a0a85542e41989ff Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBackupRestore-1281677350 Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/615017926ddf4de9a0a85542e41989ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_615017926ddf4de9a0a85542e41989ff", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/615017926ddf4de9a0a85542e41989ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/615017926ddf4de9a0a85542e41989ff"}]}] Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBackupRestore-1281677350 Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 615017926ddf4de9a0a85542e41989ff Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1281677350 Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestVolumeBackupRestore-1281677350-project Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 6e743c22b797499ca45def5349072bc5 Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBackupRestore-1281677350-project Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 96880553-6bab-49ab-8895-d404ad2f4758 could not be found. Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '96880553-6bab-49ab-8895-d404ad2f4758'} Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96880553-6bab-49ab-8895-d404ad2f4758 could not be found. Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96880553-6bab-49ab-8895-d404ad2f4758 could not be found. Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:04:54.059821 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96880553-6bab-49ab-8895-d404ad2f4758 could not be found. Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Returning 404 to user: Instance 96880553-6bab-49ab-8895-d404ad2f4758 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2788a62a-1854-4c38-aabb-7c78f0250aec tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758" status: 404 len: 111 microversion: 2.1 time: 0.032233 Oct 31 16:04:54.063660 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3310/6479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:54 2022] GET /compute/v2.1/servers/96880553-6bab-49ab-8895-d404ad2f4758 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:04:54.193576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:54.194210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:54.201911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:54.202407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:54.202845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:54.203746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:54.204215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:54.204646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:54.233100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03cb647b-6059-4aec-8ef4-595bc38f7a40 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] Calling method '.version_select at 0x7f16e0b80ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:54.265546 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03cb647b-6059-4aec-8ef4-595bc38f7a40 tempest-TestVolumeBackupRestore-1281677350 tempest-TestVolumeBackupRestore-1281677350-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-732486332" status: 202 len: 0 microversion: 2.1 time: 0.036194 Oct 31 16:04:54.269358 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3311/6480] 10.222.0.20 () {58 vars in 1266 bytes} [Mon Oct 31 16:04:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-732486332 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:04:54.284236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:54.293786 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a246e322-9be1-4816-a62a-57aedd5368cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1187 microversion: 2.1 time: 0.104269 Oct 31 16:04:54.294811 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3170/6481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:54 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1187 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:55.319424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:55.320199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:55.327884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:55.328381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:55.328824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:55.329599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:55.330168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:55.330591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:55.403771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:55.414515 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f109863-c01a-4d90-9821-270a6f94ec0b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1187 microversion: 2.1 time: 0.100641 Oct 31 16:04:55.421515 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3312/6482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:55 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:56.439256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:56.440570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:56.449020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:56.450035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:56.451505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:56.452751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:56.453381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:56.453953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:56.523147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:56.533711 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d537ea96-8514-423b-ba15-53e1ca3a6067 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1187 microversion: 2.1 time: 0.098558 Oct 31 16:04:56.534667 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3171/6483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:56 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:57.556121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:57.556842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:57.564165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:57.564655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:57.565094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:57.565816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:57.566493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:57.566918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:57.600508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:57.601005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:57.601479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:57.601928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lazy-loading 'fault' on Instance uuid e5019af3-45cd-4a93-bf58-2de1e3a142bb {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:04:57.644910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:04:57.655973 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-854aa0fa-e371-426b-b964-6e2e7d39b74e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 200 len: 1192 microversion: 2.1 time: 0.103809 Oct 31 16:04:57.669000 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3313/6484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:57 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:04:58.679077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:04:58.680002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:04:58.688232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:58.688952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:58.689584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:58.690464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:04:58.691084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:04:58.691672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:04:58.707876 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb HTTP/1.1 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'e5019af3-45cd-4a93-bf58-2de1e3a142bb'} Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:04:58.710997 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:04:58.715075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:04:58.715075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:04:58.715075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:04:58.715075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:04:58.715075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:04:58.715075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:04:58.715075 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:04:58.715075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:04:58.715075 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0af3cedc-d7ee-45c6-bcd0-e7c40dbc6ce4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 404 len: 111 microversion: 2.1 time: 0.037368 Oct 31 16:04:58.724996 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3172/6485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:04:58 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:05:02.062429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:02.062947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:02.079503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:02.081007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:02.081594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:02.082027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:02.087836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:02.088850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:02.089486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:02.131401 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb HTTP/1.1 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'e5019af3-45cd-4a93-bf58-2de1e3a142bb'} Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:05:02.137219 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.141106 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.143672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:05:02.145510 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6b7087e2-f9c5-4e08-b8ad-ab4fd9edb7cd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 404 len: 111 microversion: 2.1 time: 0.088946 Oct 31 16:05:02.146786 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3314/6486] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:05:02 2022] DELETE /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:05:02.157966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:02.158585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: e5019af3-45cd-4a93-bf58-2de1e3a142bb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:02.172860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=40 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:02.180333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:02.180835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:02.183121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:02.184088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:02.184593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:02.185012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:02.226562 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb HTTP/1.1 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'e5019af3-45cd-4a93-bf58-2de1e3a142bb'} Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:05:02.228142 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance e5019af3-45cd-4a93-bf58-2de1e3a142bb could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f6943f2f-f3c0-4fd5-afc7-7a2f395c2f42 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb" status: 404 len: 111 microversion: 2.1 time: 0.075972 Oct 31 16:05:02.231634 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3173/6487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:02 2022] GET /compute/v2.1/servers/e5019af3-45cd-4a93-bf58-2de1e3a142bb => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:05:22.312929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-574923405", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f84aa2c3-b0cc-45f1-a311-87bce686de9c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "753da163-19cf-496b-b365-4c501547e977"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:22.323348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:22.375589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] validate_networks() for [('753da163-19cf-496b-b365-4c501547e977', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:05:22.741309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:05:22.741771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:05:22.742250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:05:22.742668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:05:22.743084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:05:22.752244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:22.752749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:22.753234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:22.753976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:22.755062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:22.755595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:22.773367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:05:22.778700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for user e27f6a45a29a4a6e89fdd36c0beac7c3 and project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:05:22.836067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:05:22.838196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f84aa2c3-b0cc-45f1-a311-87bce686de9c',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:05:22.966658 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c805cec-3147-4fec-bb90-d6d043934c59 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658030 Oct 31 16:05:22.967476 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3315/6488] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:05:22.978525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-716fd322-38ef-4d91-a792-9ec37b17d0a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:22.979458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-716fd322-38ef-4d91-a792-9ec37b17d0a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:22.982559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=21 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:22.983201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:23.042344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-716fd322-38ef-4d91-a792-9ec37b17d0a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:23.049262 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-716fd322-38ef-4d91-a792-9ec37b17d0a7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1070 microversion: 2.1 time: 0.074626 Oct 31 16:05:23.049851 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3174/6489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:22 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1070 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:24.073148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:24.073697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:24.079737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:24.080213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:24.080644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:24.081360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:24.081814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:24.082232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:24.149644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:24.157524 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a1e6903-5286-4954-9422-64db34965072 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1168 microversion: 2.1 time: 0.089136 Oct 31 16:05:24.158118 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3316/6490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:24 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1168 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:25.181475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:25.182209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:25.190222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:25.190713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:25.191148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:25.192380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:25.192844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:25.193471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:25.339830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:25.349264 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-22800638-26d6-49ea-9b5b-0dc5020f6310 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1228 microversion: 2.1 time: 0.171605 Oct 31 16:05:25.362487 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3175/6491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:25 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1228 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:25.757895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c2589295-4ac6-40e8-afb1-70d3b28847d3 req-daba96c4-d820-4ded-9488-74d5238643c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4", "tag": "0bcccb7b-e732-4413-9563-85aa5f79b2ab"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:25.768799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c2589295-4ac6-40e8-afb1-70d3b28847d3 req-daba96c4-d820-4ded-9488-74d5238643c5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:25.769594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c2589295-4ac6-40e8-afb1-70d3b28847d3 req-daba96c4-d820-4ded-9488-74d5238643c5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:25.770866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c2589295-4ac6-40e8-afb1-70d3b28847d3 req-daba96c4-d820-4ded-9488-74d5238643c5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:25.783496 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c2589295-4ac6-40e8-afb1-70d3b28847d3 req-daba96c4-d820-4ded-9488-74d5238643c5 service nova] Creating event network-changed:0bcccb7b-e732-4413-9563-85aa5f79b2ab for instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 on n-h2-858384-17 Oct 31 16:05:25.789300 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c2589295-4ac6-40e8-afb1-70d3b28847d3 req-daba96c4-d820-4ded-9488-74d5238643c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192977 Oct 31 16:05:25.790255 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3317/6492] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:26.372646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:26.373448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:26.381808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:26.382306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:26.382750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:26.383602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:26.384071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:26.384502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:26.516647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:26.525682 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7269483-41d0-4877-af1c-60dd22f4fff3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1228 microversion: 2.1 time: 0.156905 Oct 31 16:05:26.526421 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3176/6493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:26 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1228 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:27.551497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:27.552314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:27.558772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:27.559477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:27.559914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:27.560656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:27.561119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:27.561557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:27.695340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:27.703286 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9a8e727b-f4a0-4770-97f2-4f868219a8f7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1228 microversion: 2.1 time: 0.157511 Oct 31 16:05:27.703866 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3318/6494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:27 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1228 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:28.726881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:28.727496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:28.734361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:28.734867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:28.735281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:28.735968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:28.736421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:28.736842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:28.877647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:28.885509 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-154eeb33-d732-4c9d-81d7-36e5495fe1a9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1228 microversion: 2.1 time: 0.162961 Oct 31 16:05:28.886112 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3177/6495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:28 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1228 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:29.909104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:29.909674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:29.917471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:29.917959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:29.918395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:29.919094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:29.919548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:29.919974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:30.050749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:30.059420 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d3ed594-ea7a-4d19-a14f-73c1535ca0c5 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.154325 Oct 31 16:05:30.060020 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3319/6496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:29 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:31.082700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:31.083918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:31.090689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:31.091168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:31.091601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:31.092290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:31.092744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:31.093191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:31.222657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:31.230634 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5a94ab4-c553-4668-af87-e56dccf97b4d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.151899 Oct 31 16:05:31.231209 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3178/6497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:31 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:32.252799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:32.253461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:32.260821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:32.261344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:32.261780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:32.262472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:32.262930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:32.263355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:32.396851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:32.404646 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01fba513-5a93-444b-aae2-71ae4ef9576c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.155803 Oct 31 16:05:32.405243 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3320/6498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:32 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:33.428272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:33.428805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:33.431559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:33.437160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:33.437650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:33.438086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:33.438779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:33.439237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:33.439664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:33.579528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:33.586959 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-443f3eca-fb94-42af-bdef-892b6a3f4cd0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.162993 Oct 31 16:05:33.587532 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3179/6499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:33 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:05:34.609423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:34.610053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:34.612026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:34.612882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:34.620056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:34.620540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:34.620980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:34.621694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:34.622152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:34.622575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:34.750922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:34.759365 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f4a4615-d55a-410a-a755-e7425d4f3e67 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.153927 Oct 31 16:05:34.759950 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3321/6500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:34 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:35.783412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:35.784032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:35.791484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:35.791973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:35.792413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:35.793101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:35.793594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:35.794023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:35.923473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:35.931596 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d4d46af3-a969-4974-99df-c77e0d871844 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.152180 Oct 31 16:05:35.932182 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3180/6501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:35 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:36.955387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:36.955991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:36.962953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:36.963437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:36.963873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:36.964570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:36.965024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:36.965478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:37.096458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:37.104906 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d75f36f-3495-4045-a149-b0600e8ca291 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.153504 Oct 31 16:05:37.105513 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3322/6502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:36 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:38.127653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:38.128183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:38.135966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:38.136451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:38.136889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:38.137632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:38.138091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:38.138517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:38.267489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:38.275775 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-35ce154e-2d98-416a-abd0-bce30495e3d7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.152143 Oct 31 16:05:38.276360 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3181/6503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:38 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:39.299142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:39.299759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:39.306999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:39.307489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:39.307922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:39.308616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:39.309068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:39.309521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:39.446435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:39.454625 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5d362e84-ce32-426e-97a1-47bebb4adbe0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.159403 Oct 31 16:05:39.455228 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3323/6504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:39 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:39.557501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-dbf18dd3-a568-4c32-b43a-a3ba39859b9f req-5a4bfb41-8516-46bb-8846-2ab689cb1c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4", "name": "network-vif-plugged", "status": "completed", "tag": "0bcccb7b-e732-4413-9563-85aa5f79b2ab"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:39.569121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dbf18dd3-a568-4c32-b43a-a3ba39859b9f req-5a4bfb41-8516-46bb-8846-2ab689cb1c20 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:39.569686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dbf18dd3-a568-4c32-b43a-a3ba39859b9f req-5a4bfb41-8516-46bb-8846-2ab689cb1c20 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:39.570149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dbf18dd3-a568-4c32-b43a-a3ba39859b9f req-5a4bfb41-8516-46bb-8846-2ab689cb1c20 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:39.583110 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-dbf18dd3-a568-4c32-b43a-a3ba39859b9f req-5a4bfb41-8516-46bb-8846-2ab689cb1c20 service nova] Creating event network-vif-plugged:0bcccb7b-e732-4413-9563-85aa5f79b2ab for instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 on n-h2-858384-17 Oct 31 16:05:39.588071 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-dbf18dd3-a568-4c32-b43a-a3ba39859b9f req-5a4bfb41-8516-46bb-8846-2ab689cb1c20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035109 Oct 31 16:05:39.588689 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3182/6505] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:40.477044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:40.477687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:40.484623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:40.485102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:40.485562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:40.486248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:40.486698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:40.487119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:40.617029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:40.624825 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe88e862-83b1-459e-bbba-629c96d54911 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1216 microversion: 2.1 time: 0.152334 Oct 31 16:05:40.625441 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3324/6506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:40 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:41.648204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:41.648915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:41.655996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:41.656483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:41.656943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:41.657650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:41.658115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:41.658542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:41.794276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:41.802582 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-53273d90-f3a2-466a-8ca4-021723916b51 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1403 microversion: 2.1 time: 0.158914 Oct 31 16:05:41.803168 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3183/6507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:41 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:41.825375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:41.825924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:41.832785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:41.833309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:41.833745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:41.834459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:41.834915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:41.835341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:41.968143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:41.976563 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bb2f07db-d36b-4f17-8c93-e28445619e7b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1403 microversion: 2.1 time: 0.155203 Oct 31 16:05:41.977150 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3325/6508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:41 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:41.998994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1303628458"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:42.001339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:42.007296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:42.007777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:42.008208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:42.008887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:42.009359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:42.009786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:42.101032 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Attempting to quiesce instance before volume snapshot. Oct 31 16:05:42.155512 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 31 16:05:42.225049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Creating snapshot from volume f84aa2c3-b0cc-45f1-a311-87bce686de9c. {{(pid=120588) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 31 16:05:43.075487 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d34a2996-e7ec-4833-8267-c2f5b56f9126 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4/action" status: 202 len: 0 microversion: 2.1 time: 1.080257 Oct 31 16:05:43.076476 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3184/6509] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:05:41 2022] POST /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4/action => generated 0 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 16:05:44.237534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-404051235", "imageRef": "8dc0a78e-d464-4122-a516-f02b340a88c9", "flavorRef": "452", "networks": [{"uuid": "753da163-19cf-496b-b365-4c501547e977"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:44.294272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] validate_networks() for [('753da163-19cf-496b-b365-4c501547e977', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:05:44.678771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:05:44.679196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:05:44.679668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:05:44.680078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:05:44.680490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:05:44.689648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:44.690135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:44.690571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:44.691323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:44.691781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:44.692379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:44.710749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:05:44.716007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for user e27f6a45a29a4a6e89fdd36c0beac7c3 and project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:05:44.729533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:05:44.732086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b1f9d32f-2261-43c7-8ac1-10c7357d0bf8',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:05:44.809439 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25b10007-557f-430b-841c-99d74a5ddd13 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575769 Oct 31 16:05:44.816076 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3326/6510] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:05:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:05:44.824912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-abc2a47f-8ad1-4e61-8ed2-457e23fdaba8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:44.825777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-abc2a47f-8ad1-4e61-8ed2-457e23fdaba8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:44.893941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-abc2a47f-8ad1-4e61-8ed2-457e23fdaba8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:44.901768 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-abc2a47f-8ad1-4e61-8ed2-457e23fdaba8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1229 microversion: 2.1 time: 0.082249 Oct 31 16:05:44.902478 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3185/6511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:44 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1229 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:45.925340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:45.927478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:45.934059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:45.934557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:45.935256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:45.935989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:45.936873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:45.937654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:46.010511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:46.018699 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b9c1a4a2-3dd3-49b3-9b91-5fb583b86bf2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1299 microversion: 2.1 time: 0.098213 Oct 31 16:05:46.019688 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3327/6512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:45 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:47.043726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:47.045624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:47.054396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:47.055627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:47.056347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:47.057287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:47.057951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:47.058549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:47.354766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:47.363314 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-53ba00cc-45b8-42d9-a965-fe1de0fea2f0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.324541 Oct 31 16:05:47.364548 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3186/6513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:47 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:47.824030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-15ba4dc8-89e3-439f-9ab7-4d8ad8d10366 req-04b6eb3c-e83b-4c15-8e50-635ced7874c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b8324b6-0070-43bd-bf43-abe05d64ff72", "tag": "e82f8637-a668-4adc-8e45-ce71063300e7"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:05:47.839048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-15ba4dc8-89e3-439f-9ab7-4d8ad8d10366 req-04b6eb3c-e83b-4c15-8e50-635ced7874c3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:47.840261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-15ba4dc8-89e3-439f-9ab7-4d8ad8d10366 req-04b6eb3c-e83b-4c15-8e50-635ced7874c3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:47.840960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-15ba4dc8-89e3-439f-9ab7-4d8ad8d10366 req-04b6eb3c-e83b-4c15-8e50-635ced7874c3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:47.857596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-15ba4dc8-89e3-439f-9ab7-4d8ad8d10366 req-04b6eb3c-e83b-4c15-8e50-635ced7874c3 service nova] Creating event network-changed:e82f8637-a668-4adc-8e45-ce71063300e7 for instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 on n-h1-858384-17 Oct 31 16:05:47.863255 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-15ba4dc8-89e3-439f-9ab7-4d8ad8d10366 req-04b6eb3c-e83b-4c15-8e50-635ced7874c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042998 Oct 31 16:05:47.864602 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3328/6514] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:05:48.389985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:48.391249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:48.402735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:48.403590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:48.404210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:48.405167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:48.405666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:48.406113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:48.631478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:48.640051 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b97c0eb9-5a8d-4de0-a54f-c8205ec25bfd tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.255893 Oct 31 16:05:48.640574 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3187/6515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:48 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:49.667910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:49.668963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:49.678201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:49.678689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:49.679128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:49.679823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:49.680276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:49.680893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:49.855527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:49.871585 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f22e0cfd-cd72-49ab-9298-5a80ee029637 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.211113 Oct 31 16:05:49.872342 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3329/6516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:49 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:50.905007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:50.905617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:50.914779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:50.915881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:50.916547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:50.917418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:50.918136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:50.918589 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:51.112850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:51.121878 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1a6c18d6-b59d-4da0-ae44-151c4c3933aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.222325 Oct 31 16:05:51.122460 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3188/6517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:50 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:52.152960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:52.153670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:52.163589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:52.163763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:52.164178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:52.164858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:52.165394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:52.165802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:52.343304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:52.346017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=79 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:52.353788 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e0a85e3-1e80-45d4-b367-deef50795cb6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.205271 Oct 31 16:05:52.354396 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3330/6518] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:52 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:53.377732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:53.378433 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:53.381927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=35 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:53.387535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:53.388058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:53.388510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:53.389276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:53.389775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:53.390458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:53.393219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:53.540499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:53.548609 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5df3a24-75d3-4532-b7ce-397fbdcb0b71 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.174794 Oct 31 16:05:53.549386 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3189/6519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:53 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:54.572699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:54.573265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:54.575973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:54.581451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:54.582417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:54.583049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:54.583919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:54.584385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:54.584815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:54.700387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:54.720252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:54.722513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:54.729003 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-364c90da-9c4d-4e5f-b5c2-56695fffa2c0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.160535 Oct 31 16:05:54.729829 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3331/6520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:54 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:55.751959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:55.752587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:55.756040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:05:55.761250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:55.761755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:55.762205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:55.762915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:55.763395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:55.763937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:55.899969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:55.907763 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca811e76-170d-4d53-b194-ba114e3a2dfb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.159646 Oct 31 16:05:55.908346 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3190/6521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:55 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:56.932596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:56.933193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:56.940919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:56.942163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:56.942603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:56.943303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:56.943755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:56.944175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:57.076120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:57.083828 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b81f76b-2b21-43a7-8240-54171f6cbf0a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.155198 Oct 31 16:05:57.084405 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3332/6522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:56 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:05:58.107510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:58.108168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:58.115280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:58.115786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:58.116258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:58.116957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:58.117477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:58.117920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:58.253075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:58.261268 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0ba5c45-b1f1-4433-8d4f-3199b8c4fdf3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.157695 Oct 31 16:05:58.261883 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3191/6523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:58 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:05:59.285555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:05:59.286295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:05:59.293945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:59.294436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:59.294868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:59.295562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:05:59.296013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:05:59.296431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:05:59.434352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:05:59.443130 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b16101c-905e-4f3c-8df4-3fa355adb97c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1341 microversion: 2.1 time: 0.161537 Oct 31 16:05:59.443712 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3333/6524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:05:59 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:00.467664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:00.468296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:00.475793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:00.476326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:00.476790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:00.477537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:00.478016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:00.478459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:00.620495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:00.628514 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-25fdd864-dfa5-44a9-9fff-cc6cad18a670 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1387 microversion: 2.1 time: 0.164775 Oct 31 16:06:00.630035 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3192/6525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:00 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1387 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:01.652352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:01.652963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:01.659860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:01.660336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:01.660764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:01.662301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:01.662754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:01.663175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:01.792454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:01.800169 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16786b84-209e-4fad-84ac-ae565b581b31 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1375 microversion: 2.1 time: 0.151728 Oct 31 16:06:01.800745 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3334/6526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:01 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:02.824267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:02.824892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:02.832142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:02.832630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:02.833099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:02.833887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:02.834387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:02.834823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:02.976950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:02.984832 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4f5fa1c-dea4-40fb-8601-f640c6920fcf tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1375 microversion: 2.1 time: 0.164844 Oct 31 16:06:02.985500 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3193/6527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:02 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:04.009152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:04.009954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:04.017055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:04.017563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:04.017993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:04.018675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:04.019125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:04.019547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:04.155598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:04.163640 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9e78c4b-8f1b-41d9-b098-466b246e8897 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1375 microversion: 2.1 time: 0.158453 Oct 31 16:06:04.164222 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3335/6528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:04 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:05.188359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:05.188979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:05.195970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:05.196462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:05.196907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:05.197660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:05.198132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:05.198717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:05.334797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:05.342770 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a4e2f5e4-b7e2-43c8-a8d1-a8028240fbbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1375 microversion: 2.1 time: 0.158601 Oct 31 16:06:05.343374 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3194/6529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:05 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:06.366615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:06.367222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:06.375160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:06.375743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:06.376204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:06.376926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:06.377400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:06.377941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:06.515862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:06.524327 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d5ded18-4286-473e-9b14-85de6e0ce193 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1375 microversion: 2.1 time: 0.161990 Oct 31 16:06:06.524912 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3336/6530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:06 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:07.551559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:07.552254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:07.560323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:07.560833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:07.565666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:07.565666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:07.565666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:07.565666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:07.720015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:07.727889 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e403aea7-bea2-49ed-b9a8-04aff0453368 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1375 microversion: 2.1 time: 0.180959 Oct 31 16:06:07.728479 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3195/6531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:07 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:08.752776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:08.753437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:08.760208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:08.760691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:08.761136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:08.761997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:08.762459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:08.762888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:08.908330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:08.916872 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a7d947ea-b059-4db1-95ad-1ebb4bbace70 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1375 microversion: 2.1 time: 0.168075 Oct 31 16:06:08.917534 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3337/6532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:08 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:09.598022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fc9b28b0-deec-4d7a-a727-b7c1c40a29d2 req-68baa224-8391-4c89-bd26-bb6212cf000b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b8324b6-0070-43bd-bf43-abe05d64ff72", "name": "network-vif-plugged", "status": "completed", "tag": "e82f8637-a668-4adc-8e45-ce71063300e7"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:09.608895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fc9b28b0-deec-4d7a-a727-b7c1c40a29d2 req-68baa224-8391-4c89-bd26-bb6212cf000b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.609545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fc9b28b0-deec-4d7a-a727-b7c1c40a29d2 req-68baa224-8391-4c89-bd26-bb6212cf000b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.610048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fc9b28b0-deec-4d7a-a727-b7c1c40a29d2 req-68baa224-8391-4c89-bd26-bb6212cf000b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:09.622795 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fc9b28b0-deec-4d7a-a727-b7c1c40a29d2 req-68baa224-8391-4c89-bd26-bb6212cf000b service nova] Creating event network-vif-plugged:e82f8637-a668-4adc-8e45-ce71063300e7 for instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 on n-h1-858384-17 Oct 31 16:06:09.628083 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fc9b28b0-deec-4d7a-a727-b7c1c40a29d2 req-68baa224-8391-4c89-bd26-bb6212cf000b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Oct 31 16:06:09.629097 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3196/6533] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:06:09.940678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:09.941475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:09.948262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.949576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.950217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:09.950914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:09.951369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:09.951792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:10.080607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:10.088554 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ebdcaab7-b3aa-4b50-a1d4-944aab854df2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1375 microversion: 2.1 time: 0.152228 Oct 31 16:06:10.089871 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3338/6534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:09 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:11.113611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:11.114614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:11.123630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.124177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.124804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.125655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.126312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.126870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.273435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:11.283095 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58dd5ec1-a57f-434b-87a6-1249a0b64627 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1562 microversion: 2.1 time: 0.174868 Oct 31 16:06:11.283947 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3197/6535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:11 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:11.306966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:11.307575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:11.314990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.315482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.315923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.316760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.317342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.317775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.462485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:11.471095 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bed216cc-3cbd-4314-ae4b-46b8bb986c2b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1562 microversion: 2.1 time: 0.168123 Oct 31 16:06:11.471697 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3339/6536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:11 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:11.558675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:11.559402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:11.565960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.566603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.567085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.567804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.568278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.568711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.598608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:06:11.682562 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7bbf5fc3-580a-46fe-8310-0f55c8c6978b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 204 len: 0 microversion: 2.1 time: 0.128269 Oct 31 16:06:11.684933 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3198/6537] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:06:11 2022] DELETE /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:06:11.693582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:11.694370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:11.701504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.702053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.702482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.703262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:11.703748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:11.704161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:11.846469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:11.856747 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da146f99-7cb5-4cdc-89bd-55e249428d25 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1568 microversion: 2.1 time: 0.167053 Oct 31 16:06:11.857585 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3340/6538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:11 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:06:12.883267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:12.883928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:12.892650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:12.893200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:12.893752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:12.894535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:12.895465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:12.895905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:13.044671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:13.053197 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5b7e7cab-84af-400b-a4b6-6388b77163cb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1568 microversion: 2.1 time: 0.174951 Oct 31 16:06:13.053804 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3199/6539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:12 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:13.649720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-776c3d58-a6a9-4d3c-bf77-fdae8f49e8ee req-30140968-ac3e-42bc-862c-f82254263a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b8324b6-0070-43bd-bf43-abe05d64ff72", "name": "network-vif-deleted", "tag": "e82f8637-a668-4adc-8e45-ce71063300e7"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:13.664580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-776c3d58-a6a9-4d3c-bf77-fdae8f49e8ee req-30140968-ac3e-42bc-862c-f82254263a57 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:13.665073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-776c3d58-a6a9-4d3c-bf77-fdae8f49e8ee req-30140968-ac3e-42bc-862c-f82254263a57 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:13.665528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-776c3d58-a6a9-4d3c-bf77-fdae8f49e8ee req-30140968-ac3e-42bc-862c-f82254263a57 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:13.679433 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-776c3d58-a6a9-4d3c-bf77-fdae8f49e8ee req-30140968-ac3e-42bc-862c-f82254263a57 service nova] Creating event network-vif-deleted:e82f8637-a668-4adc-8e45-ce71063300e7 for instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 on n-h1-858384-17 Oct 31 16:06:13.686687 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-776c3d58-a6a9-4d3c-bf77-fdae8f49e8ee req-30140968-ac3e-42bc-862c-f82254263a57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042169 Oct 31 16:06:13.688001 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3341/6540] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:06:14.078396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:14.079047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:14.086402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:14.086946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:14.087400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:14.088117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:14.088758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:14.089147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:14.166367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:14.174477 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a156ba6-3b27-4caa-a741-9d8433a4fec0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1360 microversion: 2.1 time: 0.100971 Oct 31 16:06:14.175066 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3200/6541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:14 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1360 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:15.201234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:15.201937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:15.208781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:15.209359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:15.209795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:15.210529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:15.210996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:15.211420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:15.288361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:15.297798 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65522c91-99cb-40a6-bb9a-65382b42f2c2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1360 microversion: 2.1 time: 0.102406 Oct 31 16:06:15.298424 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3342/6542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:15 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1360 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:16.323301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:16.324753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:16.333278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:16.333991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:16.334648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:16.335654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:16.336139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:16.336590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:16.411670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:16.420632 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8bcb2cf6-dcd8-4c3a-92c5-3ca9af6a508d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1360 microversion: 2.1 time: 0.101906 Oct 31 16:06:16.421512 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3201/6543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:16 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1360 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:17.443721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:17.444232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:17.452342 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:17.452832 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:17.453305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:17.454019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:17.454458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:17.454883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:17.517400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:17.525641 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8febe92a-91c7-4f3d-8f98-a0291ba292a0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 200 len: 1360 microversion: 2.1 time: 0.085949 Oct 31 16:06:17.526412 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3343/6544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:17 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 1360 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:18.548659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:18.549316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:18.556195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.556704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.557175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.557887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:18.558362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:18.558802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:18.573844 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 HTTP/1.1 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '5b8324b6-0070-43bd-bf43-abe05d64ff72'} Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:18.575857 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.580195 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:18.580195 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:18.580195 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:18.580195 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:18.580195 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:18.580195 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:18.580195 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:18.580195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:18.580195 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-77d2afaf-f597-449a-ae26-dc079c41e37b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 404 len: 111 microversion: 2.1 time: 0.033606 Oct 31 16:06:18.582176 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3202/6545] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:18 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:06:22.862618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:22.863150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:22.870430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:22.870905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:22.871337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:22.872550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:22.873226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:22.873574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:22.899641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:06:22.978492 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80ca1045-ce8b-40cf-85af-322e1092ab75 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 204 len: 0 microversion: 2.1 time: 0.119698 Oct 31 16:06:22.979215 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3344/6546] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:06:22 2022] DELETE /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:06:22.988583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:22.989233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:22.995597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:22.996100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:22.996549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:22.998448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:22.998930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:22.999377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:23.301041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:23.308895 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-34749fd7-f60b-4fec-ac76-2a58303d375e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1409 microversion: 2.1 time: 0.324344 Oct 31 16:06:23.310111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3203/6547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:22 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1409 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:06:24.332975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:24.333716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:24.340702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:24.341226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:24.341668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:24.342368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:24.342829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:24.343258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:24.533962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:24.541816 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5ce2be3b-e943-4b1d-8212-0e0a0cdd25aa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1409 microversion: 2.1 time: 0.213098 Oct 31 16:06:24.542355 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3345/6548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:24 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1409 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:25.105590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-05ad80a1-6cc4-4c8d-b8e5-91da91eebeb3 req-c2e427e5-7fb4-47b7-bfee-c7d61bcf4803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4", "name": "network-vif-deleted", "tag": "0bcccb7b-e732-4413-9563-85aa5f79b2ab"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:25.111963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:25.118281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-05ad80a1-6cc4-4c8d-b8e5-91da91eebeb3 req-c2e427e5-7fb4-47b7-bfee-c7d61bcf4803 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:25.118781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-05ad80a1-6cc4-4c8d-b8e5-91da91eebeb3 req-c2e427e5-7fb4-47b7-bfee-c7d61bcf4803 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:25.119228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-05ad80a1-6cc4-4c8d-b8e5-91da91eebeb3 req-c2e427e5-7fb4-47b7-bfee-c7d61bcf4803 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:25.124385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:25.133869 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-05ad80a1-6cc4-4c8d-b8e5-91da91eebeb3 req-c2e427e5-7fb4-47b7-bfee-c7d61bcf4803 service nova] Creating event network-vif-deleted:0bcccb7b-e732-4413-9563-85aa5f79b2ab for instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 on n-h2-858384-17 Oct 31 16:06:25.139865 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-05ad80a1-6cc4-4c8d-b8e5-91da91eebeb3 req-c2e427e5-7fb4-47b7-bfee-c7d61bcf4803 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038210 Oct 31 16:06:25.140674 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3204/6549] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:06:25.565907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:25.566807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:25.569644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:25.575037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:25.576117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:25.577017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:25.577794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:25.578257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:25.578693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:25.582354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:25.647654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:25.655845 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-54d4d033-a71c-4519-87fe-6a25a7b19c57 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1201 microversion: 2.1 time: 0.093899 Oct 31 16:06:25.656436 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3346/6550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:25 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:26.681044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:26.681785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:26.689643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:26.690148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:26.690594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:26.691308 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:26.691775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:26.692211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:26.764246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:26.772266 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7a9823bd-ab3a-47e4-8437-56f0efccba6a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1201 microversion: 2.1 time: 0.097004 Oct 31 16:06:26.772859 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3205/6551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:26 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:27.796797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:27.798366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:27.805500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:27.805981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:27.806571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:27.807276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:27.807759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:27.808175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:27.874876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:27.882745 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c2001464-1f36-4a8d-bdf2-da6bea3c8a8c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1201 microversion: 2.1 time: 0.090729 Oct 31 16:06:27.883341 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3347/6552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:27 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:28.906549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:28.907184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:28.914230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:28.914730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:28.915173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:28.915880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:28.916344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:28.916777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:28.983784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:28.991670 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97abc626-dc26-4ae5-800e-65a4615a1f41 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 200 len: 1201 microversion: 2.1 time: 0.089193 Oct 31 16:06:28.992439 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3206/6553] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:28 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:30.014532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:30.015196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:30.022836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:30.023341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:30.023784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:30.024501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:30.024961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:30.025423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:30.040298 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 HTTP/1.1 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4'} Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:30.042041 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8281aa62-0986-4ff5-bbd9-6430cc684b36 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 404 len: 111 microversion: 2.1 time: 0.032965 Oct 31 16:06:30.046989 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3348/6554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:30 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:06:32.189607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:32.190141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:32.196961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:32.197501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:32.197961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:32.198672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:32.199144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:32.199583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:32.214074 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 HTTP/1.1 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '5b8324b6-0070-43bd-bf43-abe05d64ff72'} Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:32.216647 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c44cd8df-d2cd-48b7-944e-e963fa3c3db6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 404 len: 111 microversion: 2.1 time: 0.032733 Oct 31 16:06:32.219914 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3207/6555] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:06:32 2022] DELETE /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:06:32.227543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:32.228666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 5b8324b6-0070-43bd-bf43-abe05d64ff72] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:32.235672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:32.236149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:32.236577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:32.237469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:32.237921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:32.238337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:32.252349 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 HTTP/1.1 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '5b8324b6-0070-43bd-bf43-abe05d64ff72'} Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:32.253944 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 5b8324b6-0070-43bd-bf43-abe05d64ff72 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-780a9d60-8c3c-4fb7-b710-209796ab2a15 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72" status: 404 len: 111 microversion: 2.1 time: 0.032112 Oct 31 16:06:32.257691 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3349/6556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:32 2022] GET /compute/v2.1/servers/5b8324b6-0070-43bd-bf43-abe05d64ff72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:06:32.623336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:32.623850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:32.629959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:32.630496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:32.630916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:32.631626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:32.632096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:32.632542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:32.647143 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 HTTP/1.1 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4'} Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:32.648748 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d71c26cd-307b-45c5-8910-cc3cb10dc633 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 404 len: 111 microversion: 2.1 time: 0.031717 Oct 31 16:06:32.652429 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3208/6557] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:06:32 2022] DELETE /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:06:32.658969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:32.659593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:32.665624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:32.666054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:32.666495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:32.667185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:32.667649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:32.668076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:32.682885 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 HTTP/1.1 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4'} Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:06:32.684990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d9882d17-4be4-46a2-8160-14480b182fbc tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4" status: 404 len: 111 microversion: 2.1 time: 0.031623 Oct 31 16:06:32.688751 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3350/6558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:32 2022] GET /compute/v2.1/servers/34bd5c4f-cb83-4799-ae3d-9ad7a504b3c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:06:32.759376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6c51fd23-53d0-4fe5-9a32-440ff11fa78a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'create', calling method: .version_select at 0x7f16e55711f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-569374621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLplV3SJn+qf0wteU22vWmDWnHiulwuHlvuFTzTRQkNQWu4IzJ+FfaALKLvVr7xbSM3UEtWAO74brh1BIvmSpcqt3mWAh4Nr3pZ1ZmHi1c/URMyUqsyXdlvXItk5+4z+Ag=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:32.775033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6c51fd23-53d0-4fe5-9a32-440ff11fa78a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for project d887f85c698b44dc8f077b5b129134a0. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:06:32.780480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-6c51fd23-53d0-4fe5-9a32-440ff11fa78a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for user e27f6a45a29a4a6e89fdd36c0beac7c3 and project d887f85c698b44dc8f077b5b129134a0. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:06:32.804009 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6c51fd23-53d0-4fe5-9a32-440ff11fa78a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.048470 Oct 31 16:06:32.804620 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3209/6559] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:06:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:06:49.047597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-70786236", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-569374621", "security_groups": [{"name": "tempest-secgroup-smoke-1828248057"}], "block_device_mapping_v2": [{"uuid": "443d0616-2556-47e2-b462-aa96737ad385", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "753da163-19cf-496b-b365-4c501547e977"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:49.059361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=9 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:49.060013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=17 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:49.168898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] validate_networks() for [('753da163-19cf-496b-b365-4c501547e977', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:06:49.534899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:06:49.535319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:06:49.535791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:06:49.536196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:06:49.536600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:06:49.546349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:49.546838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:49.547302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:49.548023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:49.548480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:49.548906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:49.566316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:06:49.571571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for user e27f6a45a29a4a6e89fdd36c0beac7c3 and project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:06:49.629020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:06:49.631197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='443d0616-2556-47e2-b462-aa96737ad385',volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:06:49.755952 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-44af1be8-5232-4fc7-80d0-994d1998b369 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712297 Oct 31 16:06:49.756592 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3351/6560] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:06:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:06:49.765911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=17 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:49.767132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:49.767792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:06:49.772165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9dc76e67-156c-4c5f-a317-228c56f65f1d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:49.772993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9dc76e67-156c-4c5f-a317-228c56f65f1d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:49.829511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9dc76e67-156c-4c5f-a317-228c56f65f1d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:49.836602 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9dc76e67-156c-4c5f-a317-228c56f65f1d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1092 microversion: 2.1 time: 0.072647 Oct 31 16:06:49.837529 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3210/6561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:49 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1092 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:50.860619 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:50.861329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:50.869453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:50.869920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:50.870358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:50.871940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:50.872406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:50.872837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:50.943638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:50.951702 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c9c4c01d-3efc-490f-b7b9-224a37900517 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1198 microversion: 2.1 time: 0.095079 Oct 31 16:06:50.965522 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3352/6562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:50 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1198 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:51.976091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:51.976771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:51.985021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:51.985773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:51.986394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:51.987155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:51.987794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:51.988400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:52.170716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:52.189661 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f35fd402-948b-449e-b818-409ca19efeb0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1276 microversion: 2.1 time: 0.218894 Oct 31 16:06:52.190277 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3211/6563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:51 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1276 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:52.723633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-02cc5579-30e8-48ba-8ff7-a9539b09cf9a req-f9e8d5a8-1e2a-41d1-8f78-e11d1dfbe347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883da993-2522-4964-be37-1cb2655c2cb4", "tag": "922e9ea4-7dcc-473e-b8d6-10e3929b8d9a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:06:52.744488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-02cc5579-30e8-48ba-8ff7-a9539b09cf9a req-f9e8d5a8-1e2a-41d1-8f78-e11d1dfbe347 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:52.746649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-02cc5579-30e8-48ba-8ff7-a9539b09cf9a req-f9e8d5a8-1e2a-41d1-8f78-e11d1dfbe347 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:52.747685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-02cc5579-30e8-48ba-8ff7-a9539b09cf9a req-f9e8d5a8-1e2a-41d1-8f78-e11d1dfbe347 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:52.760210 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-02cc5579-30e8-48ba-8ff7-a9539b09cf9a req-f9e8d5a8-1e2a-41d1-8f78-e11d1dfbe347 service nova] Creating event network-changed:922e9ea4-7dcc-473e-b8d6-10e3929b8d9a for instance 883da993-2522-4964-be37-1cb2655c2cb4 on n-h2-858384-17 Oct 31 16:06:52.766356 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-02cc5579-30e8-48ba-8ff7-a9539b09cf9a req-f9e8d5a8-1e2a-41d1-8f78-e11d1dfbe347 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046438 Oct 31 16:06:52.767109 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3353/6564] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:06:53.213323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:53.213960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:53.222312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:53.222766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:53.223219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:53.223952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:53.224420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:53.224861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:53.372535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:53.380401 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7a9036b-5f7b-4231-b09e-63f0a8f82a19 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1276 microversion: 2.1 time: 0.171871 Oct 31 16:06:53.381543 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3212/6565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:53 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:54.405901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:54.406505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:54.413697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:54.414186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:54.414635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:54.415364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:54.415825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:54.416287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:54.552975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:54.561101 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-72e16cfb-6ee3-4a37-9f2c-716dd6a9e40d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1276 microversion: 2.1 time: 0.160123 Oct 31 16:06:54.562068 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3354/6566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:54 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:55.584096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:55.584802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:55.592683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:55.593416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:55.593882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:55.594614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:55.595091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:55.595538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:55.735636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:55.743536 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a4b5e045-3829-48d8-9233-b26e659e427f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1276 microversion: 2.1 time: 0.163450 Oct 31 16:06:55.744117 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3213/6567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:55 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:56.767032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:56.767633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:56.774580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:56.775070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:56.775538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:56.776230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:56.776944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:56.777519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:56.914139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:56.922290 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a0b9e3b3-5878-457e-9e06-09d91d949803 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1264 microversion: 2.1 time: 0.159325 Oct 31 16:06:56.922867 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3355/6568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:56 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:57.946031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:57.946613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:57.954314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:57.954828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:57.955283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:57.955998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:57.956476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:57.956921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:58.093763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:58.101511 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f568d7cd-f4a1-43ec-8cb7-dfa5e0e83058 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1264 microversion: 2.1 time: 0.160588 Oct 31 16:06:58.102100 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3214/6569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:57 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:06:59.123968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:06:59.124598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:06:59.131453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:59.131939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:59.132375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:59.133065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:06:59.133567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:06:59.134021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:06:59.267990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:06:59.276015 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f8b68aab-5e62-46c0-b6e6-2deb5d5dd175 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1264 microversion: 2.1 time: 0.156068 Oct 31 16:06:59.276555 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3356/6570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:06:59 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:00.299693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:00.300307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:00.303235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:00.308848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:00.309396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:00.309847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:00.310576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:00.311036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:00.311648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:00.442186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:00.450355 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f64778bd-bce8-49dd-a6f6-ad412f532537 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1264 microversion: 2.1 time: 0.154601 Oct 31 16:07:00.450937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3215/6571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:00 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:01.474212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:01.474831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:01.476791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:01.477485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:07:01.484783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:01.485300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:01.485745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:01.486471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:01.486932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:01.487384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:01.623087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:01.630726 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d5dce215-2ceb-4214-ae02-33de5cc9b3ad tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1264 microversion: 2.1 time: 0.160470 Oct 31 16:07:01.631299 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3357/6572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:01 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:07:02.653889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:02.654511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:02.661365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:02.661857 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:02.662303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:02.663006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:02.663469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:02.663902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:02.799292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:02.807067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2a69611-c4f9-462f-b17e-60ee0b1ca224 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1264 microversion: 2.1 time: 0.157064 Oct 31 16:07:02.807718 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3216/6573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:02 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:03.830648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:03.831260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:03.838106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:03.838595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:03.839086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:03.839785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:03.840236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:03.840669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:03.975565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:03.984148 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7866f2e1-344e-46cd-9f44-3b54963968a8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1264 microversion: 2.1 time: 0.157346 Oct 31 16:07:03.984844 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3358/6574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:03 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:07:05.007686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:05.008309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:05.015699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:05.016208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:05.016656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:05.017387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:05.017861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:05.018568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:05.154467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:05.162181 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dda81d2f-ba5c-46d0-a437-ff12a1ba706f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1264 microversion: 2.1 time: 0.158541 Oct 31 16:07:05.162767 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3217/6575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:05 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:05.966754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d1992f63-d916-4620-9004-4628bffbfdac req-d55c4606-ebe7-4e64-9d81-daab40876f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883da993-2522-4964-be37-1cb2655c2cb4", "name": "network-vif-plugged", "status": "completed", "tag": "922e9ea4-7dcc-473e-b8d6-10e3929b8d9a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:05.977872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d1992f63-d916-4620-9004-4628bffbfdac req-d55c4606-ebe7-4e64-9d81-daab40876f5d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:05.978369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d1992f63-d916-4620-9004-4628bffbfdac req-d55c4606-ebe7-4e64-9d81-daab40876f5d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:05.978795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d1992f63-d916-4620-9004-4628bffbfdac req-d55c4606-ebe7-4e64-9d81-daab40876f5d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:05.990979 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d1992f63-d916-4620-9004-4628bffbfdac req-d55c4606-ebe7-4e64-9d81-daab40876f5d service nova] Creating event network-vif-plugged:922e9ea4-7dcc-473e-b8d6-10e3929b8d9a for instance 883da993-2522-4964-be37-1cb2655c2cb4 on n-h2-858384-17 Oct 31 16:07:05.996972 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d1992f63-d916-4620-9004-4628bffbfdac req-d55c4606-ebe7-4e64-9d81-daab40876f5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033670 Oct 31 16:07:05.997675 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3359/6576] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:07:06.185366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:06.185996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:06.192768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:06.193316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:06.193772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:06.194483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:06.194957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:06.195399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:06.325966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:06.333714 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7344fc43-c34c-4340-ab0c-a88c9d2a616d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1264 microversion: 2.1 time: 0.152445 Oct 31 16:07:06.334317 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3218/6577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:06 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:07.356817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:07.357539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:07.364452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:07.364927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:07.365393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:07.366079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:07.366534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:07.366956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:07.503640 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:07.511663 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67db50a6-3c71-472f-ba83-6aca569af53e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1451 microversion: 2.1 time: 0.159542 Oct 31 16:07:07.512237 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3360/6578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:07 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:07.533890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:07:07.534547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:07:07.536718 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:07:07.536870 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:07:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 (ip 10.222.0.20) !!! Oct 31 16:07:07.544867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:07.545401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:07.545854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:07.546558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:07.547028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:07.547472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:07.684817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:07:07.692607 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-570b5edf-1a4f-4d3c-a184-219c87b54fbb tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1451 microversion: 2.1 time: 0.162626 Oct 31 16:07:07.693209 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3219/6579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:07:07 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:07:09.612313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-98252b74-4a36-4a7b-8e42-b1cdc1b1a120 req-1b118a6e-6383-4d67-b6b8-9b7d70e541db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883da993-2522-4964-be37-1cb2655c2cb4", "tag": "922e9ea4-7dcc-473e-b8d6-10e3929b8d9a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:07:09.623058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-98252b74-4a36-4a7b-8e42-b1cdc1b1a120 req-1b118a6e-6383-4d67-b6b8-9b7d70e541db service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:07:09.623748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-98252b74-4a36-4a7b-8e42-b1cdc1b1a120 req-1b118a6e-6383-4d67-b6b8-9b7d70e541db service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:07:09.624336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-98252b74-4a36-4a7b-8e42-b1cdc1b1a120 req-1b118a6e-6383-4d67-b6b8-9b7d70e541db service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:07:09.637014 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-98252b74-4a36-4a7b-8e42-b1cdc1b1a120 req-1b118a6e-6383-4d67-b6b8-9b7d70e541db service nova] Creating event network-changed:922e9ea4-7dcc-473e-b8d6-10e3929b8d9a for instance 883da993-2522-4964-be37-1cb2655c2cb4 on n-h2-858384-17 Oct 31 16:07:09.642566 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-98252b74-4a36-4a7b-8e42-b1cdc1b1a120 req-1b118a6e-6383-4d67-b6b8-9b7d70e541db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033878 Oct 31 16:07:09.643647 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3361/6580] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:09:06.908139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=22 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:06.909708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=54 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:06.911188 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:09:06.911322 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:09:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 (ip 10.222.0.20) !!! Oct 31 16:09:06.974604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:06.975119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:06.981053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:06.981579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:06.982024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:06.982716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:06.983180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:06.983612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:07.008047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:09:07.083010 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-771a8e80-1543-4e49-ba7a-7f78d80f125a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 204 len: 0 microversion: 2.1 time: 0.176680 Oct 31 16:09:07.083638 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3220/6581] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:09:06 2022] DELETE /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:09:07.090202 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:09:07.091224 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 31 16:09:07.091840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:07.092580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=50 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:07.094063 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:09:07.094220 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:09:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 (ip 10.222.0.20) !!! Oct 31 16:09:07.095212 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:09:07.095348 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:09:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 (ip 10.222.0.20) !!! Oct 31 16:09:07.102564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:07.103263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:07.113049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:07.113570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:07.114011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:07.114712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:07.115170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:07.115596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:07.251934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:07.259664 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2e2dd3cf-fc2b-4fd6-8f85-8b6dbed41d38 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1576 microversion: 2.1 time: 0.171552 Oct 31 16:09:07.260242 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3362/6582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:07 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:08.284255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:08.284961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:08.292527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:08.293018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:08.293494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:08.294189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:08.294663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:08.295096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:08.429450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:08.437206 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-063bde1f-313d-4129-8fca-8ec6d16ebb80 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1576 microversion: 2.1 time: 0.157826 Oct 31 16:09:08.437788 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3221/6583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:08 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:09.460422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:09.461026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:09.473691 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50832. Oct 31 16:09:09.479953 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 50830. Oct 31 16:09:09.484130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:09.485009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:09.485161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:09.485778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:09.486241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:09.487183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:09.561341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:09.570087 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a16a5b02-f50a-4852-9f87-124d4f5b3b1c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1508 microversion: 2.1 time: 0.114045 Oct 31 16:09:09.570704 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3363/6584] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:09 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1508 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:09.742297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fedcbda2-099c-4dfa-b8f8-d3a7ae9bb9ba req-a3b39ad5-c51e-4596-a790-2f67dc78dee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883da993-2522-4964-be37-1cb2655c2cb4", "name": "network-vif-deleted", "tag": "922e9ea4-7dcc-473e-b8d6-10e3929b8d9a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:09:09.753872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fedcbda2-099c-4dfa-b8f8-d3a7ae9bb9ba req-a3b39ad5-c51e-4596-a790-2f67dc78dee5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:09.754479 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fedcbda2-099c-4dfa-b8f8-d3a7ae9bb9ba req-a3b39ad5-c51e-4596-a790-2f67dc78dee5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:09.754967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fedcbda2-099c-4dfa-b8f8-d3a7ae9bb9ba req-a3b39ad5-c51e-4596-a790-2f67dc78dee5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:09.767938 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fedcbda2-099c-4dfa-b8f8-d3a7ae9bb9ba req-a3b39ad5-c51e-4596-a790-2f67dc78dee5 service nova] Creating event network-vif-deleted:922e9ea4-7dcc-473e-b8d6-10e3929b8d9a for instance 883da993-2522-4964-be37-1cb2655c2cb4 on n-h2-858384-17 Oct 31 16:09:09.773484 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fedcbda2-099c-4dfa-b8f8-d3a7ae9bb9ba req-a3b39ad5-c51e-4596-a790-2f67dc78dee5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034811 Oct 31 16:09:09.778357 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3222/6585] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:09:10.594187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:10.594810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:10.603636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:10.604130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:10.604570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:10.605431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:10.605901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:10.606328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:10.673924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:10.682964 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-021e29fb-be4e-4e0c-af1c-7e1b1ac50f47 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1223 microversion: 2.1 time: 0.092712 Oct 31 16:09:10.694068 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3364/6586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:10 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:11.708877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:11.709565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:11.716643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:11.717161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:11.717624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:11.718335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:11.718810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:11.719253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:11.785391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:11.793297 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd896f6d-21a0-4606-9f58-65874b4b9504 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1223 microversion: 2.1 time: 0.089560 Oct 31 16:09:11.793872 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3223/6587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:11 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:12.816406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:12.816928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:12.823882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:12.824365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:12.824797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:12.825536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:12.825993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:12.826418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:12.890629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:12.899214 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1a1dd5c7-a753-4444-bd8f-a7b2acf75d7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1223 microversion: 2.1 time: 0.087200 Oct 31 16:09:12.900009 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3365/6588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:12 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:13.921808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:13.922570 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:13.930156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:13.930742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:13.931254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:13.932030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:13.932574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:13.933020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:14.002928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:14.011225 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da0ef1a3-e25b-412b-8afc-e58ef55652ab tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 200 len: 1223 microversion: 2.1 time: 0.093420 Oct 31 16:09:14.011845 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3224/6589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:13 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:15.034655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:15.035267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:15.042598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:15.043102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:15.043532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:15.044213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:15.044666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:15.045085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:15.058980 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 HTTP/1.1 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '883da993-2522-4964-be37-1cb2655c2cb4'} Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:09:15.060605 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc13c71c-d882-4135-8105-9b1b34f02ec2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 404 len: 111 microversion: 2.1 time: 0.031915 Oct 31 16:09:15.065206 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3366/6590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:15 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:09:15.109076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1452372530", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-569374621", "security_groups": [{"name": "tempest-secgroup-smoke-1828248057"}], "block_device_mapping_v2": [{"uuid": "443d0616-2556-47e2-b462-aa96737ad385", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "753da163-19cf-496b-b365-4c501547e977"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:09:15.224360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] validate_networks() for [('753da163-19cf-496b-b365-4c501547e977', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:09:15.655354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:09:15.655795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:09:15.656311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:09:15.656735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:09:15.657236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:09:15.666191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:15.666684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:15.667132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:15.667870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:15.668343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:15.668787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:15.685239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:09:15.691472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for user e27f6a45a29a4a6e89fdd36c0beac7c3 and project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:09:15.749780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:09:15.752393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='443d0616-2556-47e2-b462-aa96737ad385',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:09:15.880458 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eae0345b-1a20-498c-9700-2538fde12a7d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.775128 Oct 31 16:09:15.881350 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3225/6591] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:09:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:09:15.893387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4c8854e-b73e-4182-986a-d04b171ede2d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:15.894055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4c8854e-b73e-4182-986a-d04b171ede2d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:15.947595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e4c8854e-b73e-4182-986a-d04b171ede2d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:15.954795 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4c8854e-b73e-4182-986a-d04b171ede2d tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1094 microversion: 2.1 time: 0.065893 Oct 31 16:09:15.955528 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3367/6592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:15 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:16.978801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:16.979612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:16.986735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:16.987374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:16.988019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:16.989836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:16.990291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:16.990878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:17.098523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:17.107914 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-60f8b4bd-47c2-493b-bb6a-959d537eacda tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1210 microversion: 2.1 time: 0.133269 Oct 31 16:09:17.108509 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3226/6593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:16 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1210 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:18.131682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:18.132479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:18.141538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:18.142167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:18.142710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:18.143526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:18.144093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:18.145253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:18.294936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:18.306642 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-85fb0f5e-489d-4232-b339-79469ce00b23 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1278 microversion: 2.1 time: 0.179630 Oct 31 16:09:18.307577 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3368/6594] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:18 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:18.425164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7f03686c-3f96-4040-a5b5-5b30905c68e1 req-8b6e2a1a-8ea5-4e42-b903-00d3e0f7a009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228b7d45-41d6-470f-9f10-26245a40ee1e", "tag": "3181752a-4311-4be0-a1e6-409225e30e15"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:09:18.436151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7f03686c-3f96-4040-a5b5-5b30905c68e1 req-8b6e2a1a-8ea5-4e42-b903-00d3e0f7a009 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:18.436654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7f03686c-3f96-4040-a5b5-5b30905c68e1 req-8b6e2a1a-8ea5-4e42-b903-00d3e0f7a009 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:18.437095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7f03686c-3f96-4040-a5b5-5b30905c68e1 req-8b6e2a1a-8ea5-4e42-b903-00d3e0f7a009 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:18.449817 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7f03686c-3f96-4040-a5b5-5b30905c68e1 req-8b6e2a1a-8ea5-4e42-b903-00d3e0f7a009 service nova] Creating event network-changed:3181752a-4311-4be0-a1e6-409225e30e15 for instance 228b7d45-41d6-470f-9f10-26245a40ee1e on n-h1-858384-17 Oct 31 16:09:18.455144 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7f03686c-3f96-4040-a5b5-5b30905c68e1 req-8b6e2a1a-8ea5-4e42-b903-00d3e0f7a009 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108864 Oct 31 16:09:18.456419 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3227/6595] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:09:19.330107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:19.330723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:19.338836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:19.339318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:19.339748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:19.340440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:19.340898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:19.341357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:19.475399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:19.483248 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-182ec8b0-0205-4271-a0e9-00869e09c0e9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1278 microversion: 2.1 time: 0.157061 Oct 31 16:09:19.483830 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3369/6596] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:19 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:20.507837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:20.508564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:20.515107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:20.515613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:20.516072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:20.516779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:20.517301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:20.517746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:20.656079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:20.664981 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-39fc7c29-8805-41ce-b816-82115fa01615 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1278 microversion: 2.1 time: 0.162392 Oct 31 16:09:20.665601 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3228/6597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:20 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:21.688469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:21.689078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:21.696470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:21.696955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:21.697429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:21.698112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:21.698565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:21.698988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:21.852515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:21.861866 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8db6d4b-9f2d-451b-a46e-08b43c43ab2c tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1278 microversion: 2.1 time: 0.177315 Oct 31 16:09:21.862467 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3370/6598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:21 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:22.884755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:22.885424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:22.892396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:22.892897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:22.893385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:22.894091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:22.894562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:22.895003 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:23.025531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:23.033389 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fac9bc73-f29f-494f-bf2a-9401d532b5fa tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.152507 Oct 31 16:09:23.033979 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3229/6599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:22 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:24.057345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:24.057951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:24.064690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:24.065193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:24.065628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:24.066312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:24.066765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:24.067870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:24.198672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:24.206383 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7a02c26-8cd2-4130-a1d3-5d07c8d25b98 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.152951 Oct 31 16:09:24.206965 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3371/6600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:24 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:09:25.229837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:25.230455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:25.237335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:25.237935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:25.238387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:25.239082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:25.239546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:25.239975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:25.377482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:25.385460 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2abc715f-f29b-4200-9a82-18b41b16e200 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.159604 Oct 31 16:09:25.386029 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3230/6601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:25 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:26.408698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:26.409343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:26.412078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:26.418282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:26.418769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:26.419211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:26.419900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:26.420358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:26.420781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:26.550491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:26.559669 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d94f647e-b7bc-4c1c-a96c-272bf916ce84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.154814 Oct 31 16:09:26.560495 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3372/6602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:26 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:27.583260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:27.584700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:27.586705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:27.587386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:27.593968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:27.594468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:27.594918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:27.595626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:27.596098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:27.596566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:27.725982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:27.733759 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a589de82-92c2-41b4-bf31-da1bee2ebf56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.154434 Oct 31 16:09:27.734360 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3231/6603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:27 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:28.757182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:28.757810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:28.764932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:28.765443 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:28.765876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:28.766561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:28.767014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:28.767440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:28.901043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:28.908666 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c82ddb6-2db5-4e5d-906e-a0646f84b422 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.155643 Oct 31 16:09:28.909269 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3373/6604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:28 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:29.932888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:29.933470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:29.940271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:29.940764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:29.941234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:29.941933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:29.942400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:29.942863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:30.078187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:30.086373 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d568ad7b-db4b-4f0b-89b2-cf5ef12dfee4 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.157605 Oct 31 16:09:30.086946 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3232/6605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:29 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:31.109669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:31.110355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:31.117827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:31.118308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:31.118740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:31.119427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:31.119878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:31.120301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:31.249526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:31.257183 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec6e6f94-0c3b-447d-a8d6-a4c4805aed34 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.151352 Oct 31 16:09:31.257767 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3374/6606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:31 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:32.279933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:32.280544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:32.287563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:32.288050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:32.288496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:32.289217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:32.289685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:32.290118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:32.419908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:32.428295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9510ec13-f41f-4ec3-97f7-fcad62771d16 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.152285 Oct 31 16:09:32.428873 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3233/6607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:32 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:32.648620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ca66719d-b4ea-49fd-9def-aab900a83edc req-b5eff7e7-77c5-4ca6-8f99-5da2e55615e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b7d45-41d6-470f-9f10-26245a40ee1e", "name": "network-vif-plugged", "status": "completed", "tag": "3181752a-4311-4be0-a1e6-409225e30e15"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:09:32.659935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ca66719d-b4ea-49fd-9def-aab900a83edc req-b5eff7e7-77c5-4ca6-8f99-5da2e55615e3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:32.660417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ca66719d-b4ea-49fd-9def-aab900a83edc req-b5eff7e7-77c5-4ca6-8f99-5da2e55615e3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:32.661219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ca66719d-b4ea-49fd-9def-aab900a83edc req-b5eff7e7-77c5-4ca6-8f99-5da2e55615e3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:32.672706 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ca66719d-b4ea-49fd-9def-aab900a83edc req-b5eff7e7-77c5-4ca6-8f99-5da2e55615e3 service nova] Creating event network-vif-plugged:3181752a-4311-4be0-a1e6-409225e30e15 for instance 228b7d45-41d6-470f-9f10-26245a40ee1e on n-h1-858384-17 Oct 31 16:09:32.679191 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ca66719d-b4ea-49fd-9def-aab900a83edc req-b5eff7e7-77c5-4ca6-8f99-5da2e55615e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032981 Oct 31 16:09:32.679976 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3375/6608] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:09:33.451845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:33.452469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:33.459964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:33.460459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:33.460907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:33.461638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:33.462108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:33.462544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:33.597620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:33.605755 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d1ab85ae-38f0-4f4d-8940-d4c19f688d49 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1266 microversion: 2.1 time: 0.157812 Oct 31 16:09:33.606346 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3234/6609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:33 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:34.630525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:34.631213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:34.637653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:34.638140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:34.638579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:34.639268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:34.639726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:34.640154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:34.772939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:34.780705 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6a887dd9-99c5-4dbe-8129-6049405142e6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1453 microversion: 2.1 time: 0.155433 Oct 31 16:09:34.781307 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3376/6610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:34 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:34.803281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:09:34.803940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:09:34.810716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:34.811217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:34.811670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:34.812377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:34.812855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:34.813335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:34.944088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:09:34.951935 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e3b21f97-6323-422e-a412-d5df13bbda65 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1453 microversion: 2.1 time: 0.152562 Oct 31 16:09:34.952520 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3235/6611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:09:34 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:09:37.379911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-725da867-1bc0-42fa-b170-8ae3720cfd88 req-81675403-13dc-46a2-8bf5-1d98b083aadb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228b7d45-41d6-470f-9f10-26245a40ee1e", "tag": "3181752a-4311-4be0-a1e6-409225e30e15"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:09:37.386123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=33 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:37.392324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-725da867-1bc0-42fa-b170-8ae3720cfd88 req-81675403-13dc-46a2-8bf5-1d98b083aadb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:09:37.392903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-725da867-1bc0-42fa-b170-8ae3720cfd88 req-81675403-13dc-46a2-8bf5-1d98b083aadb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:09:37.393493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-725da867-1bc0-42fa-b170-8ae3720cfd88 req-81675403-13dc-46a2-8bf5-1d98b083aadb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:09:37.401599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=77 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:09:37.408909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-725da867-1bc0-42fa-b170-8ae3720cfd88 req-81675403-13dc-46a2-8bf5-1d98b083aadb service nova] Creating event network-changed:3181752a-4311-4be0-a1e6-409225e30e15 for instance 228b7d45-41d6-470f-9f10-26245a40ee1e on n-h1-858384-17 Oct 31 16:09:37.415359 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-725da867-1bc0-42fa-b170-8ae3720cfd88 req-81675403-13dc-46a2-8bf5-1d98b083aadb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039193 Oct 31 16:09:37.415987 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3377/6612] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:11:09.894828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:11:09.896262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:11:09.900983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1982203506", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-569374621", "security_groups": [{"name": "tempest-secgroup-smoke-1828248057"}], "block_device_mapping_v2": [{"uuid": "c75bcf85-a5e6-4dcf-bed6-36840e69cd1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "753da163-19cf-496b-b365-4c501547e977"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:11:10.017819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] validate_networks() for [('753da163-19cf-496b-b365-4c501547e977', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:11:10.393405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:11:10.393851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:11:10.394344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:11:10.394775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:11:10.395222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:11:10.404693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:10.405220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:10.405677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:10.406431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:10.406905 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:10.407349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:10.423997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:11:10.429809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Getting quotas for user e27f6a45a29a4a6e89fdd36c0beac7c3 and project d887f85c698b44dc8f077b5b129134a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:11:10.487623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:11:10.490471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c75bcf85-a5e6-4dcf-bed6-36840e69cd1b',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:11:10.641785 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f98f4245-17d4-4b3f-95da-f4b7026d0eb7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.748677 Oct 31 16:11:10.642538 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3236/6613] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:11:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:11:10.652082 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 31 16:11:10.653179 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 31 16:11:10.653759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:11:10.659615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d935dd9c-eee1-467b-9c68-e143a0034cd7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:10.660555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d935dd9c-eee1-467b-9c68-e143a0034cd7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:10.717431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d935dd9c-eee1-467b-9c68-e143a0034cd7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:10.726114 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d935dd9c-eee1-467b-9c68-e143a0034cd7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1094 microversion: 2.1 time: 0.076269 Oct 31 16:11:10.727292 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3378/6614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:10 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:11.751037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:11.751668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:11.759547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:11.760044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:11.760505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:11.761235 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:11.761705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:11.762149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:11.834075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:11.842291 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d1efbfe-2084-4455-b5ae-aa0e33dbd35a tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1200 microversion: 2.1 time: 0.096247 Oct 31 16:11:11.843020 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3237/6615] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:11 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1200 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:12.866516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:12.867630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:12.879617 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51026. Oct 31 16:11:12.889665 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 51028. Oct 31 16:11:12.893803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:12.894511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:12.894957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:12.896175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:12.896791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:12.897450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:13.136313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:13.144651 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51434e9b-ebf9-4e55-b0b1-faeda39d27df tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1278 microversion: 2.1 time: 0.283217 Oct 31 16:11:13.157149 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3379/6616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:12 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1278 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:13.418890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-9c3cbfc3-532d-432e-97f3-932a0459a29d req-5a70c76f-4d12-4934-a840-53c20bd58606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ba5774-3c86-47f4-9635-da24662d90fb", "tag": "2adc1f0c-f310-4221-901a-01d00f1ba879"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:11:13.431874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9c3cbfc3-532d-432e-97f3-932a0459a29d req-5a70c76f-4d12-4934-a840-53c20bd58606 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:13.432447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9c3cbfc3-532d-432e-97f3-932a0459a29d req-5a70c76f-4d12-4934-a840-53c20bd58606 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:13.432964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-9c3cbfc3-532d-432e-97f3-932a0459a29d req-5a70c76f-4d12-4934-a840-53c20bd58606 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:13.446040 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-9c3cbfc3-532d-432e-97f3-932a0459a29d req-5a70c76f-4d12-4934-a840-53c20bd58606 service nova] Creating event network-changed:2adc1f0c-f310-4221-901a-01d00f1ba879 for instance f0ba5774-3c86-47f4-9635-da24662d90fb on n-h2-858384-17 Oct 31 16:11:13.451150 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-9c3cbfc3-532d-432e-97f3-932a0459a29d req-5a70c76f-4d12-4934-a840-53c20bd58606 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111705 Oct 31 16:11:13.451762 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3238/6617] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:11:14.169602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:14.171405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:14.180786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:14.181810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:14.182429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:14.183145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:14.183602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:14.184025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:14.383015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:14.391552 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d51d966e-5cb3-4493-8ec3-0cff49969ee9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1278 microversion: 2.1 time: 0.226556 Oct 31 16:11:14.405199 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3380/6618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:14 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:15.417463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:15.418068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:15.424323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:15.424821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:15.425294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:15.425996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:15.427041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:15.427481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:15.566703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:15.574826 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd6c97d0-50ea-4dbc-9aec-c1264b67e096 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1278 microversion: 2.1 time: 0.162600 Oct 31 16:11:15.575422 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3239/6619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:15 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:16.598109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:16.598750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:16.606023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:16.606515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:16.606950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:16.607656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:16.608109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:16.608537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:16.747918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:16.756364 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ee599a3d-5c2f-42b5-beac-e2b78fa5af77 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1278 microversion: 2.1 time: 0.162246 Oct 31 16:11:16.756941 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3381/6620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:16 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:17.779585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:17.780216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:17.787286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:17.787793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:17.788246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:17.788953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:17.789469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:17.789915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:17.922037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:17.930388 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1085ffd4-69a4-45fd-8717-f0bf2e3eaf84 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.154727 Oct 31 16:11:17.930962 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3240/6621] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:17 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:18.954226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:18.954863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:18.962161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:18.962691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:18.963109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:18.963792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:18.964240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:18.964657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:19.100343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:19.108212 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f67797e-8781-414c-ab0b-233fc773bea3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.157836 Oct 31 16:11:19.108789 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3382/6622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:18 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:20.130657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:20.131294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:20.138198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:20.138694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:20.139178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:20.139888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:20.140356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:20.140792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:20.282922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:20.291310 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5e6031a-bece-45be-934a-595708ebef56 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.164598 Oct 31 16:11:20.291891 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3241/6623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:20 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:21.313706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:21.314317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:21.317038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:11:21.323151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:21.323644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:21.324089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:21.324784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:21.325275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:21.325712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:21.460467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:21.468334 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e86e62e-66f2-450c-be0c-9212400cd4b8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.158529 Oct 31 16:11:21.468987 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3383/6624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:21 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:11:22.492388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:22.493014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:22.495021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:11:22.496083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:11:22.505104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:22.505878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:22.506674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:22.507821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:22.508654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:22.509181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:22.665795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:22.675480 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-91de148a-659c-429e-b1be-7d88c9425f9e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.187769 Oct 31 16:11:22.676472 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3242/6625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:22 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:11:23.700915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:23.701480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:23.708299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:23.708777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:23.709236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:23.709965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:23.710497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:23.710911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:23.849266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:23.857231 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6c90592-5cd3-46af-93b0-3be3adbe7990 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.160256 Oct 31 16:11:23.857826 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3384/6626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:23 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:24.880890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:24.881542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:24.889394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:24.889896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:24.890351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:24.891143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:24.891637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:24.892078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:25.078451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:25.086259 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9552ba82-e10c-4b60-b47f-552f3e7b82d0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.209299 Oct 31 16:11:25.086877 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3243/6627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:24 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:26.109188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:26.109802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:26.116636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:26.117149 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:26.117731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:26.118423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:26.118922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:26.119357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:26.299783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:26.307689 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-098702aa-d4d1-4fae-b66d-d18227903968 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.202450 Oct 31 16:11:26.308304 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3385/6628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:26 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:27.331238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:27.331833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:27.339329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:27.340071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:27.340531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:27.341340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:27.341808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:27.342373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:27.375760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2246de4c-2c58-46a8-897e-53ab2eaf3eba req-c0ac747f-21da-4306-951e-01bfabdfdfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba5774-3c86-47f4-9635-da24662d90fb", "name": "network-vif-plugged", "status": "completed", "tag": "2adc1f0c-f310-4221-901a-01d00f1ba879"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:11:27.395144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2246de4c-2c58-46a8-897e-53ab2eaf3eba req-c0ac747f-21da-4306-951e-01bfabdfdfe6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:27.395645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2246de4c-2c58-46a8-897e-53ab2eaf3eba req-c0ac747f-21da-4306-951e-01bfabdfdfe6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:27.396087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2246de4c-2c58-46a8-897e-53ab2eaf3eba req-c0ac747f-21da-4306-951e-01bfabdfdfe6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:27.407684 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2246de4c-2c58-46a8-897e-53ab2eaf3eba req-c0ac747f-21da-4306-951e-01bfabdfdfe6 service nova] Creating event network-vif-plugged:2adc1f0c-f310-4221-901a-01d00f1ba879 for instance f0ba5774-3c86-47f4-9635-da24662d90fb on n-h2-858384-17 Oct 31 16:11:27.412793 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2246de4c-2c58-46a8-897e-53ab2eaf3eba req-c0ac747f-21da-4306-951e-01bfabdfdfe6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107636 Oct 31 16:11:27.413469 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3244/6629] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:11:27.500217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:27.508957 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e4a67ce2-0b5c-4c05-8dce-a584342929c6 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.180711 Oct 31 16:11:27.509589 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3386/6630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:27 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:11:28.532284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:28.532993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:28.540731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:28.541250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:28.541699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:28.542393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:28.542866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:28.543300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:28.681873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:28.689514 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33cef663-cbc0-4a47-91f1-9eb6d8f53595 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1266 microversion: 2.1 time: 0.161502 Oct 31 16:11:28.690095 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3245/6631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:28 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:29.711903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:29.712503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:29.719332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:29.719818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:29.720244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:29.720926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:29.721397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:29.721819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:29.852535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:29.860178 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-206770cc-71f2-4674-a1ab-1cd6cddcb483 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1453 microversion: 2.1 time: 0.152290 Oct 31 16:11:29.860758 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3387/6632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:29 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:29.883182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:11:29.883860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:11:29.890667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:29.891168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:29.891622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:29.892330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:29.892805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:29.893278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:30.025628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:11:30.033637 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3fcf4a36-164b-4265-adb3-8fd189611ad3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1453 microversion: 2.1 time: 0.154837 Oct 31 16:11:30.034213 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3246/6633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:11:29 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:11:31.950195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c40c5dc4-ed3e-446e-bd61-c5cca67fa402 req-6b4b5982-590c-4d91-ba54-684912d04c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ba5774-3c86-47f4-9635-da24662d90fb", "tag": "2adc1f0c-f310-4221-901a-01d00f1ba879"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:11:31.961526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c40c5dc4-ed3e-446e-bd61-c5cca67fa402 req-6b4b5982-590c-4d91-ba54-684912d04c58 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:11:31.962008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c40c5dc4-ed3e-446e-bd61-c5cca67fa402 req-6b4b5982-590c-4d91-ba54-684912d04c58 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:11:31.962529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c40c5dc4-ed3e-446e-bd61-c5cca67fa402 req-6b4b5982-590c-4d91-ba54-684912d04c58 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:11:31.974656 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c40c5dc4-ed3e-446e-bd61-c5cca67fa402 req-6b4b5982-590c-4d91-ba54-684912d04c58 service nova] Creating event network-changed:2adc1f0c-f310-4221-901a-01d00f1ba879 for instance f0ba5774-3c86-47f4-9635-da24662d90fb on n-h2-858384-17 Oct 31 16:11:31.980914 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c40c5dc4-ed3e-446e-bd61-c5cca67fa402 req-6b4b5982-590c-4d91-ba54-684912d04c58 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034376 Oct 31 16:11:31.981641 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3388/6634] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:13:00.156810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:13:00.157846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=54 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:13:00.159886 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:13:00.160025 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:13:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb (ip 10.222.0.20) !!! Oct 31 16:13:00.163209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=24 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:13:00.164777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:00.165328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:00.165452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=57 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:13:00.166869 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:13:00.166997 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:13:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 31 16:13:00.170739 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:13:00.170867 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:13:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 31 16:13:00.173930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:00.174436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:00.175473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:00.176198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:00.176673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:00.177463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:00.189320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d2cb2382-f6ec-4f70-9b2f-b891a5b5cb84 req-b9651224-3c27-48ca-9793-c647ba69a2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ba5774-3c86-47f4-9635-da24662d90fb", "tag": "2adc1f0c-f310-4221-901a-01d00f1ba879"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:00.200075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2cb2382-f6ec-4f70-9b2f-b891a5b5cb84 req-b9651224-3c27-48ca-9793-c647ba69a2f1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:00.200654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2cb2382-f6ec-4f70-9b2f-b891a5b5cb84 req-b9651224-3c27-48ca-9793-c647ba69a2f1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:00.202906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d2cb2382-f6ec-4f70-9b2f-b891a5b5cb84 req-b9651224-3c27-48ca-9793-c647ba69a2f1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:00.204106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:13:00.216415 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d2cb2382-f6ec-4f70-9b2f-b891a5b5cb84 req-b9651224-3c27-48ca-9793-c647ba69a2f1 service nova] Creating event network-changed:2adc1f0c-f310-4221-901a-01d00f1ba879 for instance f0ba5774-3c86-47f4-9635-da24662d90fb on n-h2-858384-17 Oct 31 16:13:00.225462 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d2cb2382-f6ec-4f70-9b2f-b891a5b5cb84 req-b9651224-3c27-48ca-9793-c647ba69a2f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067681 Oct 31 16:13:00.229387 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3389/6635] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:13:00.295255 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-95a4cbfe-3fc9-4436-ae81-af21438d8949 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 204 len: 0 microversion: 2.1 time: 0.140544 Oct 31 16:13:00.296288 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3247/6636] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:13:00 2022] DELETE /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:13:00.317248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:00.317952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:00.325582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:00.326074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:00.326505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:00.327213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:00.327665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:00.328085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:00.497713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:00.506900 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c06d6596-e7fa-405b-98df-a912d08e9ce3 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1578 microversion: 2.1 time: 0.201307 Oct 31 16:13:00.507623 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3390/6637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:00 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1578 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:13:01.531148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:01.532019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:01.541454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:01.541957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:01.542404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:01.543116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:01.543583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:01.544018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:01.685941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:01.693723 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-74c3f50f-46ae-4109-b1cf-feb801e85953 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1578 microversion: 2.1 time: 0.166944 Oct 31 16:13:01.694298 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3248/6638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:01 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:13:02.591207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d4b2e00c-c9c0-4717-b296-2b53250328f9 req-b6a2a161-7e7c-4bd8-a4ff-662d19cbd5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ba5774-3c86-47f4-9635-da24662d90fb", "name": "network-vif-deleted", "tag": "2adc1f0c-f310-4221-901a-01d00f1ba879"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:02.602274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d4b2e00c-c9c0-4717-b296-2b53250328f9 req-b6a2a161-7e7c-4bd8-a4ff-662d19cbd5a3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:02.602759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d4b2e00c-c9c0-4717-b296-2b53250328f9 req-b6a2a161-7e7c-4bd8-a4ff-662d19cbd5a3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:02.603196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d4b2e00c-c9c0-4717-b296-2b53250328f9 req-b6a2a161-7e7c-4bd8-a4ff-662d19cbd5a3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:02.615628 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d4b2e00c-c9c0-4717-b296-2b53250328f9 req-b6a2a161-7e7c-4bd8-a4ff-662d19cbd5a3 service nova] Creating event network-vif-deleted:2adc1f0c-f310-4221-901a-01d00f1ba879 for instance f0ba5774-3c86-47f4-9635-da24662d90fb on n-h2-858384-17 Oct 31 16:13:02.620407 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d4b2e00c-c9c0-4717-b296-2b53250328f9 req-b6a2a161-7e7c-4bd8-a4ff-662d19cbd5a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032953 Oct 31 16:13:02.621015 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3391/6639] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:13:02.717064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:02.717722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:02.725268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:02.725842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:02.726311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:02.727030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:02.727515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:02.727953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:02.794827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:02.803355 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-deb53198-008b-4f76-bb79-82aff084a590 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1225 microversion: 2.1 time: 0.090157 Oct 31 16:13:02.803955 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3249/6640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:02 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:03.828253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:03.828984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:03.835794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:03.836280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:03.836718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:03.837436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:03.837895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:03.838320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:03.905009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:03.913603 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f00c50e-854e-40c1-9b00-30940d3f123e tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1225 microversion: 2.1 time: 0.090360 Oct 31 16:13:03.914212 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3392/6641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:03 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:04.937426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:04.937982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:04.946008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:04.946517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:04.946967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:04.947689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:04.948167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:04.948629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:05.015076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:05.023436 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-148790e8-b090-49f1-b0a6-85d197843bb2 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1225 microversion: 2.1 time: 0.090001 Oct 31 16:13:05.024040 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3250/6642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:04 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:06.046322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:06.046930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:06.053833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:06.054313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:06.054774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:06.055462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:06.055913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:06.056335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:06.118359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:06.126208 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-48a2a934-b2c1-46f9-ae06-35eaa533b41b tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1225 microversion: 2.1 time: 0.083792 Oct 31 16:13:06.126783 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3393/6643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:06 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:07.150447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:07.151014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:07.158043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:07.158548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:07.159984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:07.160838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:07.161345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:07.161792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:07.194090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:07.195142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:07.195605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:07.196190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lazy-loading 'fault' on Instance uuid f0ba5774-3c86-47f4-9635-da24662d90fb {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:13:07.243861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:07.252142 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-af0f9ecd-5a8b-411a-8d36-e4f43c94f3da tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 200 len: 1230 microversion: 2.1 time: 0.105839 Oct 31 16:13:07.254452 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3251/6644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:07 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:08.280476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:08.281080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: f0ba5774-3c86-47f4-9635-da24662d90fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:08.288095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:08.288580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:08.289019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:08.289743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:08.290201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:08.290629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:08.304386 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance f0ba5774-3c86-47f4-9635-da24662d90fb could not be found. Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb HTTP/1.1 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f0ba5774-3c86-47f4-9635-da24662d90fb could not be found. Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f0ba5774-3c86-47f4-9635-da24662d90fb'} Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0ba5774-3c86-47f4-9635-da24662d90fb could not be found. Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0ba5774-3c86-47f4-9635-da24662d90fb could not be found. Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:08.306099 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0ba5774-3c86-47f4-9635-da24662d90fb could not be found. Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance f0ba5774-3c86-47f4-9635-da24662d90fb could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6100fa41-ac0e-408b-b349-19ef35705266 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb" status: 404 len: 111 microversion: 2.1 time: 0.033640 Oct 31 16:13:08.310225 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3394/6645] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:08 2022] GET /compute/v2.1/servers/f0ba5774-3c86-47f4-9635-da24662d90fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:13:14.528705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:14.529242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:14.538385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-21dc6aa4-2f95-47fb-b3a9-cb40e25e53ac req-2f72f91a-f198-49a1-838a-f2833a1beade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "228b7d45-41d6-470f-9f10-26245a40ee1e", "tag": "3181752a-4311-4be0-a1e6-409225e30e15"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:14.547864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:14.548366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:14.548812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:14.549576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:14.550048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:14.550482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:14.553525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-21dc6aa4-2f95-47fb-b3a9-cb40e25e53ac req-2f72f91a-f198-49a1-838a-f2833a1beade service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:14.554047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-21dc6aa4-2f95-47fb-b3a9-cb40e25e53ac req-2f72f91a-f198-49a1-838a-f2833a1beade service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:14.554521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-21dc6aa4-2f95-47fb-b3a9-cb40e25e53ac req-2f72f91a-f198-49a1-838a-f2833a1beade service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:14.567934 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-21dc6aa4-2f95-47fb-b3a9-cb40e25e53ac req-2f72f91a-f198-49a1-838a-f2833a1beade service nova] Creating event network-changed:3181752a-4311-4be0-a1e6-409225e30e15 for instance 228b7d45-41d6-470f-9f10-26245a40ee1e on n-h1-858384-17 Oct 31 16:13:14.573555 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-21dc6aa4-2f95-47fb-b3a9-cb40e25e53ac req-2f72f91a-f198-49a1-838a-f2833a1beade service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038704 Oct 31 16:13:14.574999 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3395/6646] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:13:14.584545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:13:14.672282 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1750ac27-234f-4cb5-bc2e-9e867dab16c8 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 204 len: 0 microversion: 2.1 time: 0.147128 Oct 31 16:13:14.673110 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3252/6647] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:13:14 2022] DELETE /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:13:14.682614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:14.683574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:14.689875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:14.690816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:14.691430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:14.692141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:14.692603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:14.693035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:14.830232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:14.839236 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0f12a12e-e975-4af2-99a5-bc46b90d7545 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1577 microversion: 2.1 time: 0.160939 Oct 31 16:13:14.839949 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3396/6648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:14 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:15.864033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:15.865031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:15.871974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:15.872476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:15.872925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:15.873663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:15.874138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:15.874623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:16.015510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:16.023262 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33bf35b1-3256-45ab-b267-54d867e9e910 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1577 microversion: 2.1 time: 0.163682 Oct 31 16:13:16.023840 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3253/6649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:15 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:16.620739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-841406aa-a482-49fa-ae54-f1b99373b594 req-7598c9e1-324f-4751-92f9-5efca92e9478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "228b7d45-41d6-470f-9f10-26245a40ee1e", "name": "network-vif-deleted", "tag": "3181752a-4311-4be0-a1e6-409225e30e15"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:16.632969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-841406aa-a482-49fa-ae54-f1b99373b594 req-7598c9e1-324f-4751-92f9-5efca92e9478 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:16.633552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-841406aa-a482-49fa-ae54-f1b99373b594 req-7598c9e1-324f-4751-92f9-5efca92e9478 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:16.634148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-841406aa-a482-49fa-ae54-f1b99373b594 req-7598c9e1-324f-4751-92f9-5efca92e9478 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:16.646507 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-841406aa-a482-49fa-ae54-f1b99373b594 req-7598c9e1-324f-4751-92f9-5efca92e9478 service nova] Creating event network-vif-deleted:3181752a-4311-4be0-a1e6-409225e30e15 for instance 228b7d45-41d6-470f-9f10-26245a40ee1e on n-h1-858384-17 Oct 31 16:13:16.651477 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-841406aa-a482-49fa-ae54-f1b99373b594 req-7598c9e1-324f-4751-92f9-5efca92e9478 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034422 Oct 31 16:13:16.652198 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3397/6650] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:13:17.046426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:17.047155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:17.054446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:17.054952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:17.055404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:17.056118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:17.056591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:17.057031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:17.119463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:17.127505 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f93eefb-f066-4245-b7cf-e742812b8cef tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1225 microversion: 2.1 time: 0.084937 Oct 31 16:13:17.128085 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3254/6651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:17 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:18.151863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:18.152563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:18.158868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:18.159358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:18.160296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:18.161412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:18.161882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:18.162317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:18.232680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:18.241254 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53607275-b35a-44c2-9b16-a97e0d0eb85f tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1225 microversion: 2.1 time: 0.094351 Oct 31 16:13:18.241956 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3398/6652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:18 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:19.264276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:19.264909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:19.272939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:19.273478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:19.273930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:19.274645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:19.275123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:19.275602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:19.340850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:19.349411 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e86765d-2c90-43af-bf74-b07529c15c18 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1225 microversion: 2.1 time: 0.089090 Oct 31 16:13:19.350218 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3255/6653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:19 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:20.373095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:20.373719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:20.381376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:20.381856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:20.382285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:20.382998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:20.383448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:20.383867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:20.446531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27f6a45a29a4a6e89fdd36c0beac7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd887f85c698b44dc8f077b5b129134a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:20.454447 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3a40234-7d23-4b72-a9df-8fd06ef259c7 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 200 len: 1225 microversion: 2.1 time: 0.085337 Oct 31 16:13:20.455019 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3399/6654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:20 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:21.479353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:21.479866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 228b7d45-41d6-470f-9f10-26245a40ee1e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:21.486136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:21.486630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:21.487075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:21.487910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:21.488404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:21.488838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:21.501995 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 228b7d45-41d6-470f-9f10-26245a40ee1e could not be found. Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e HTTP/1.1 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 228b7d45-41d6-470f-9f10-26245a40ee1e could not be found. Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '228b7d45-41d6-470f-9f10-26245a40ee1e'} Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 228b7d45-41d6-470f-9f10-26245a40ee1e could not be found. Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 228b7d45-41d6-470f-9f10-26245a40ee1e could not be found. Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:21.503901 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 228b7d45-41d6-470f-9f10-26245a40ee1e could not be found. Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 228b7d45-41d6-470f-9f10-26245a40ee1e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89b7d9b1-f4e7-48f3-bfcb-7216dbd4df78 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e" status: 404 len: 111 microversion: 2.1 time: 0.030282 Oct 31 16:13:21.508465 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3256/6655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:21 2022] GET /compute/v2.1/servers/228b7d45-41d6-470f-9f10-26245a40ee1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:13:21.956343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:21.957469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:21.964166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:21.964647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:21.965074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:21.965787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:21.966238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:21.966656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:21.983421 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 HTTP/1.1 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '883da993-2522-4964-be37-1cb2655c2cb4'} Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:13:21.985076 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55b1eda0-302d-4dcc-b4e9-2d8a673762b0 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 404 len: 111 microversion: 2.1 time: 0.034101 Oct 31 16:13:21.989720 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3400/6656] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:13:21 2022] DELETE /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:13:21.995204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:21.995826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] [instance: 883da993-2522-4964-be37-1cb2655c2cb4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:22.001866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:22.002364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:22.002817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:22.003969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:22.004665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:22.005116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:22.018381 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] HTTP exception thrown: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Request method failure captured: Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 HTTP/1.1 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_GkTMI7vOQRDKgSPpdRo9xhm0eZkrk49a4tbL0IsjmgEkkNE1kGIfkN485nJJP7eXT9pyyBRUXOa6QlXom6hzm_7zs6SQN8W8DAwzoEZl8qz32hW7XGpI_msS0fN0zwXvGWemP72ARIaMnzMwBVpN-4Lo59xqDBKMRxsqY7gfTRSxI Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d887f85c698b44dc8f077b5b129134a0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d887f85c698b44dc8f077b5b129134a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d887f85c698b44dc8f077b5b129134a0"}]}] Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: d887f85c698b44dc8f077b5b129134a0 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestVolumeBootPattern-1444237217 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e27f6a45a29a4a6e89fdd36c0beac7c3 Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestVolumeBootPattern-1444237217-project Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '883da993-2522-4964-be37-1cb2655c2cb4'} Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:22.020762 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Returning 404 to user: Instance 883da993-2522-4964-be37-1cb2655c2cb4 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0323cf7a-277a-47e0-a85b-5cb8207bf1b9 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4" status: 404 len: 111 microversion: 2.1 time: 0.030964 Oct 31 16:13:22.025006 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3257/6657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:21 2022] GET /compute/v2.1/servers/883da993-2522-4964-be37-1cb2655c2cb4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:13:25.434146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7cb36220-71b3-46c4-83eb-6a72788fe219 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] Calling method '.version_select at 0x7f16e0360ee0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:25.462776 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7cb36220-71b3-46c4-83eb-6a72788fe219 tempest-TestVolumeBootPattern-1444237217 tempest-TestVolumeBootPattern-1444237217-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-569374621" status: 202 len: 0 microversion: 2.1 time: 0.032795 Oct 31 16:13:25.463368 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3401/6658] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Oct 31 16:13:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-569374621 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:13:43.923268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:13:43.924017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:13:44.038257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-39024047", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:44.092507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] validate_networks() for None {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:13:44.285302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:13:44.286477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:13:44.286985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:13:44.287403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:13:44.287823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:13:44.296581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:44.297073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:44.297555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:44.298285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:44.298751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:44.299183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:44.316524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Getting quotas for project 205336a74d374655a47ae2f7e82a89a6. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:13:44.321784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Getting quotas for user 66dd11ed207349aeb854f592e5d0f805 and project 205336a74d374655a47ae2f7e82a89a6. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:13:44.333892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:13:44.336208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:13:44.381326 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba84de40-5b4a-4dcb-a63b-76e6af40f43a tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.463492 Oct 31 16:13:44.384354 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3258/6659] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:13:44.397389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8831610f-4b61-4e69-bae4-73b0f1841bd3 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:44.398406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8831610f-4b61-4e69-bae4-73b0f1841bd3 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:44.400734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=48 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:13:44.401700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:13:44.461823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8831610f-4b61-4e69-bae4-73b0f1841bd3 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:44.468934 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8831610f-4b61-4e69-bae4-73b0f1841bd3 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1220 microversion: 2.1 time: 0.077556 Oct 31 16:13:44.469969 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3402/6660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:44 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:45.495342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:45.495965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:45.506101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:45.506615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:45.507076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:45.507811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:45.508321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:45.508830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:45.579062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:45.588936 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cc0f1112-5967-481b-98ec-7221adf9b575 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1280 microversion: 2.1 time: 0.098429 Oct 31 16:13:45.590366 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3259/6661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:45 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:46.615949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:46.616558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:46.623504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:46.623985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:46.624418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:46.625112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:46.625590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:46.626011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:46.847387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:46.856091 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b2a35c6-fc1e-47f6-8197-b92977ed3e56 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1320 microversion: 2.1 time: 0.243992 Oct 31 16:13:46.856690 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3403/6662] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:46 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:47.073965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-16efebb0-fbb5-4633-a282-18e2675bf63a req-51add448-ccf1-48e4-abfc-0fc861a72dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb735071-67f3-472b-99fe-b2b64d0596a7", "tag": "55109499-31bc-45df-8221-f89363959d5c"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:47.094791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-16efebb0-fbb5-4633-a282-18e2675bf63a req-51add448-ccf1-48e4-abfc-0fc861a72dfc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:47.095322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-16efebb0-fbb5-4633-a282-18e2675bf63a req-51add448-ccf1-48e4-abfc-0fc861a72dfc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:47.095764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-16efebb0-fbb5-4633-a282-18e2675bf63a req-51add448-ccf1-48e4-abfc-0fc861a72dfc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:47.108212 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-16efebb0-fbb5-4633-a282-18e2675bf63a req-51add448-ccf1-48e4-abfc-0fc861a72dfc service nova] Creating event network-changed:55109499-31bc-45df-8221-f89363959d5c for instance bb735071-67f3-472b-99fe-b2b64d0596a7 on n-h1-858384-17 Oct 31 16:13:47.117241 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-16efebb0-fbb5-4633-a282-18e2675bf63a req-51add448-ccf1-48e4-abfc-0fc861a72dfc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047508 Oct 31 16:13:47.117872 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3260/6663] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:13:47.880917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:47.881520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:47.888246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:47.888731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:47.889178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:47.889864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:47.890329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:47.890742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:48.023542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:48.031234 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cee52600-5743-442f-a41a-5c21d07e00af tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1320 microversion: 2.1 time: 0.155272 Oct 31 16:13:48.031806 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3404/6664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:47 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:49.056488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:49.057239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:49.063532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:49.064046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:49.064509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:49.065254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:49.065805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:49.066178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:49.209758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:49.217532 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec091f3c-19fc-461f-b0e3-0bcdcb8086e9 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1320 microversion: 2.1 time: 0.167020 Oct 31 16:13:49.218111 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3261/6665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:49 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:50.241170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:50.241681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:50.248441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:50.248923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:50.249391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:50.250082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:50.250535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:50.250956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:50.380498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:50.388147 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-584a6a3b-7205-49eb-84ff-6ce0e7274320 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1320 microversion: 2.1 time: 0.151610 Oct 31 16:13:50.388719 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3405/6666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:50 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1320 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:13:51.412646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:51.413320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:51.419664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:51.420153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:51.420598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:51.421329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:51.421808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:51.422240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:51.555009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:51.562868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-316fc173-84dc-45f3-a40e-8bbf951af7c5 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1320 microversion: 2.1 time: 0.154896 Oct 31 16:13:51.563460 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3262/6667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:51 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1320 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:51.866288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b1d0ad0f-6a08-4693-b0f9-e4e80a9514ea req-5c1a3aef-c5ff-416f-a82f-dfef2fc2ae65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb735071-67f3-472b-99fe-b2b64d0596a7", "name": "network-vif-plugged", "status": "completed", "tag": "55109499-31bc-45df-8221-f89363959d5c"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:51.878373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b1d0ad0f-6a08-4693-b0f9-e4e80a9514ea req-5c1a3aef-c5ff-416f-a82f-dfef2fc2ae65 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:51.879454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b1d0ad0f-6a08-4693-b0f9-e4e80a9514ea req-5c1a3aef-c5ff-416f-a82f-dfef2fc2ae65 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:51.880136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b1d0ad0f-6a08-4693-b0f9-e4e80a9514ea req-5c1a3aef-c5ff-416f-a82f-dfef2fc2ae65 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:51.891411 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b1d0ad0f-6a08-4693-b0f9-e4e80a9514ea req-5c1a3aef-c5ff-416f-a82f-dfef2fc2ae65 service nova] Creating event network-vif-plugged:55109499-31bc-45df-8221-f89363959d5c for instance bb735071-67f3-472b-99fe-b2b64d0596a7 on n-h1-858384-17 Oct 31 16:13:51.896553 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b1d0ad0f-6a08-4693-b0f9-e4e80a9514ea req-5c1a3aef-c5ff-416f-a82f-dfef2fc2ae65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034947 Oct 31 16:13:51.897342 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3406/6668] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:13:52.586796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:52.587428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:52.594328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:52.594834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:52.595292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:52.596004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:52.596478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:52.596928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:52.734197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:52.742079 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3bd218ac-f9b3-4293-83d1-09159732cfa4 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1320 microversion: 2.1 time: 0.159482 Oct 31 16:13:52.742673 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3263/6669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:52 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:53.766709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:53.767407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:53.774339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:53.774819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:53.775246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:53.775932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:53.776381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:53.776802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:53.910902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:53.919549 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cc78b024-e61a-4578-8005-0101011d48fd tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1470 microversion: 2.1 time: 0.157805 Oct 31 16:13:53.920135 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3407/6670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:53 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:53.994032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c7ab239-f4d1-438b-b99d-46f1b4ca3b20 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Calling method '.version_select at 0x7f16e038f550>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:54.060110 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c7ab239-f4d1-438b-b99d-46f1b4ca3b20 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/90519aa092fc4eb7a6056913bac8c3cf" status: 200 len: 371 microversion: 2.1 time: 0.119121 Oct 31 16:13:54.060697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3264/6671] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 16:13:53 2022] GET /compute/v2.1/os-quota-sets/90519aa092fc4eb7a6056913bac8c3cf => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:13:54.072931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b17c26c8-611b-4be2-8bcb-bf4a0f1e1300 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1039890013", "id": 1153518195, "os-flavor-access:is_public": "True"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:54.090789 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b17c26c8-611b-4be2-8bcb-bf4a0f1e1300 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021575 Oct 31 16:13:54.091375 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3408/6672] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:13:54 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:13:54.104365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1153518195"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:54.106767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:54.112860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.113355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.113814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.115304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.115843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.116289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.201552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3f1332931cdb44f7b15dd8ded45e1f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90519aa092fc4eb7a6056913bac8c3cf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:54.207423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1039890013 {{(pid=120588) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:13:54.215001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.215499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.215946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.216690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.217183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.217626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.240625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Getting quotas for project 205336a74d374655a47ae2f7e82a89a6. Resources: {'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:13:54.245830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Getting quotas for user 66dd11ed207349aeb854f592e5d0f805 and project 205336a74d374655a47ae2f7e82a89a6. Resources: {'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:13:54.260280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] ram quota exceeded for 90519aa092fc4eb7a6056913bac8c3cf, tried to resize instance. Oct 31 16:13:54.260837 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Request method failure captured: Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7/action HTTP/1.1 Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 39 Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_Q39DxHy3KM8VnmQJrxv5d7npJF6YbJjRVziMwHtX6UmelCK4r_utFxxRofioYlmpiOuPgiMPkitVSd_krmSVIrghz6MKvb65gvN4JA-oAHN7gKDnSIiYCy2yfq4QCO7_PSHzx6e-1mePTd9XyF87BvRnmoBHbHXO2T2K6nE4B6ejc Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 90519aa092fc4eb7a6056913bac8c3cf Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-607638400 Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member,admin Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member,admin Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90519aa092fc4eb7a6056913bac8c3cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90519aa092fc4eb7a6056913bac8c3cf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90519aa092fc4eb7a6056913bac8c3cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90519aa092fc4eb7a6056913bac8c3cf"}]}] Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersAdminNegativeTestJSON-607638400 Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 90519aa092fc4eb7a6056913bac8c3cf Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-607638400 Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersAdminNegativeTestJSON-607638400-project-admin Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 3f1332931cdb44f7b15dd8ded45e1f53 Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersAdminNegativeTestJSON-607638400-project-admin Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: {"resize": {"flavorRef": "1153518195"}} Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'bb735071-67f3-472b-99fe-b2b64d0596a7', 'body': {'resize': {'flavorRef': '1153518195'}}} Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3879, in _check_quota_for_upsize Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:13:54.262980 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4245, in resize Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3897, in _check_quota_for_upsize Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58051793-d448-415a-a1d5-73edea04ec0a tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7/action" status: 403 len: 118 microversion: 2.1 time: 0.164115 Oct 31 16:13:54.267610 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3265/6673] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:13:54 2022] POST /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7/action => generated 118 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:13:54.273925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f82e0343-12fe-4e70-a370-574503ec22f6 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:54.292934 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f82e0343-12fe-4e70-a370-574503ec22f6 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1153518195" status: 202 len: 0 microversion: 2.1 time: 0.022825 Oct 31 16:13:54.294976 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3409/6674] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 16:13:54 2022] DELETE /compute/v2.1/flavors/1153518195 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:13:54.302616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3e072b76-b9e1-4dbb-8729-91fa352a279f tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:54.327669 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3e072b76-b9e1-4dbb-8729-91fa352a279f tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029293 Oct 31 16:13:54.328267 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3266/6675] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 16:13:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:54.352189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d22cacd2-dc27-406b-9990-7742e37aaef8 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Calling method '.version_select at 0x7f16e02444c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:54.431396 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d22cacd2-dc27-406b-9990-7742e37aaef8 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/90519aa092fc4eb7a6056913bac8c3cf" status: 200 len: 371 microversion: 2.1 time: 0.084739 Oct 31 16:13:54.432229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3410/6676] 10.222.0.20 () {58 vars in 1242 bytes} [Mon Oct 31 16:13:54 2022] GET /compute/v2.1/os-quota-sets/90519aa092fc4eb7a6056913bac8c3cf => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:13:54.449287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8cad0810-9bcb-42e8-b8f5-f57e6083a4a0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-161631525", "id": 1200811346, "os-flavor-access:is_public": "True"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:54.469264 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8cad0810-9bcb-42e8-b8f5-f57e6083a4a0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.023687 Oct 31 16:13:54.469887 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3267/6677] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:13:54 2022] POST /compute/v2.1/flavors => generated 436 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:13:54.483749 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1200811346"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:54.486109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:54.498313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.498791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.499230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.499944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.500403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.500829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.734614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3f1332931cdb44f7b15dd8ded45e1f53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90519aa092fc4eb7a6056913bac8c3cf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:54.741023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-161631525 {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:13:54.748121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.748607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.749055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.749839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.750301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.750732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.779027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Getting quotas for project 205336a74d374655a47ae2f7e82a89a6. Resources: {'cores', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:13:54.784468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Getting quotas for user 66dd11ed207349aeb854f592e5d0f805 and project 205336a74d374655a47ae2f7e82a89a6. Resources: {'cores', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:13:54.799190 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.compute.api [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] cores quota exceeded for 90519aa092fc4eb7a6056913bac8c3cf, tried to resize instance. Oct 31 16:13:54.799728 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Request method failure captured: Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7/action HTTP/1.1 Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 39 Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_Q39DxHy3KM8VnmQJrxv5d7npJF6YbJjRVziMwHtX6UmelCK4r_utFxxRofioYlmpiOuPgiMPkitVSd_krmSVIrghz6MKvb65gvN4JA-oAHN7gKDnSIiYCy2yfq4QCO7_PSHzx6e-1mePTd9XyF87BvRnmoBHbHXO2T2K6nE4B6ejc Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 90519aa092fc4eb7a6056913bac8c3cf Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-607638400 Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member,admin Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member,admin Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90519aa092fc4eb7a6056913bac8c3cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_90519aa092fc4eb7a6056913bac8c3cf", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/90519aa092fc4eb7a6056913bac8c3cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/90519aa092fc4eb7a6056913bac8c3cf"}]}] Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersAdminNegativeTestJSON-607638400 Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 90519aa092fc4eb7a6056913bac8c3cf Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-607638400 Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersAdminNegativeTestJSON-607638400-project-admin Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 3f1332931cdb44f7b15dd8ded45e1f53 Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersAdminNegativeTestJSON-607638400-project-admin Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: {"resize": {"flavorRef": "1200811346"}} Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'bb735071-67f3-472b-99fe-b2b64d0596a7', 'body': {'resize': {'flavorRef': '1200811346'}}} Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3879, in _check_quota_for_upsize Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:13:54.802214 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4245, in resize Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3897, in _check_quota_for_upsize Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1448230-bfec-4f3c-b745-47ad8b3d7fa0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7/action" status: 403 len: 113 microversion: 2.1 time: 0.324832 Oct 31 16:13:54.806273 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3411/6678] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:13:54 2022] POST /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7/action => generated 113 bytes in 326 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:13:54.813708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-825078bd-12f5-412f-b283-add71b02f741 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:54.834022 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-825078bd-12f5-412f-b283-add71b02f741 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1200811346" status: 202 len: 0 microversion: 2.1 time: 0.023569 Oct 31 16:13:54.834633 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3268/6679] 10.222.0.20 () {58 vars in 1161 bytes} [Mon Oct 31 16:13:54 2022] DELETE /compute/v2.1/flavors/1200811346 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:13:54.842892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2d6297d-5a53-4bc5-9860-8c7124a940a0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:54.864573 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2d6297d-5a53-4bc5-9860-8c7124a940a0 tempest-ServersAdminNegativeTestJSON-607638400 tempest-ServersAdminNegativeTestJSON-607638400-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024872 Oct 31 16:13:54.865174 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3412/6680] 10.222.0.20 () {58 vars in 1146 bytes} [Mon Oct 31 16:13:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:54.887316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:54.887835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:54.893912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.894421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.895069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.895797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:54.896283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:54.896731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:54.930382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:13:55.010187 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2bd533c8-06ea-4f0e-9aa8-1988359a00ff tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 204 len: 0 microversion: 2.1 time: 0.126386 Oct 31 16:13:55.010917 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3269/6681] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:13:54 2022] DELETE /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:13:55.019938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:55.020604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:55.026698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:55.027190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:55.027627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:55.028323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:55.028779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:55.029235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:55.160319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:55.168056 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4cca2d80-9732-4f32-9424-1de87e6b32a6 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1476 microversion: 2.1 time: 0.152363 Oct 31 16:13:55.168628 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3413/6682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:55 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:56.191519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:56.192780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:56.199727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:56.200220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:56.200665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:56.201385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:56.201847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:56.202279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:56.338600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66dd11ed207349aeb854f592e5d0f805', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205336a74d374655a47ae2f7e82a89a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:13:56.346488 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d43cf22d-586e-498f-aa97-f0775c364910 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 200 len: 1476 microversion: 2.1 time: 0.159236 Oct 31 16:13:56.347081 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3270/6683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:56 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 1476 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:13:56.736348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5b4f4cac-427f-4359-b0b5-4d735caab82e req-87b6e06e-c58a-464e-af4b-eb4ac4eb47fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb735071-67f3-472b-99fe-b2b64d0596a7", "name": "network-vif-deleted", "tag": "55109499-31bc-45df-8221-f89363959d5c"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:13:56.750197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5b4f4cac-427f-4359-b0b5-4d735caab82e req-87b6e06e-c58a-464e-af4b-eb4ac4eb47fc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:56.750594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5b4f4cac-427f-4359-b0b5-4d735caab82e req-87b6e06e-c58a-464e-af4b-eb4ac4eb47fc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:56.751254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5b4f4cac-427f-4359-b0b5-4d735caab82e req-87b6e06e-c58a-464e-af4b-eb4ac4eb47fc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:56.768708 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5b4f4cac-427f-4359-b0b5-4d735caab82e req-87b6e06e-c58a-464e-af4b-eb4ac4eb47fc service nova] Creating event network-vif-deleted:55109499-31bc-45df-8221-f89363959d5c for instance bb735071-67f3-472b-99fe-b2b64d0596a7 on n-h1-858384-17 Oct 31 16:13:56.774454 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5b4f4cac-427f-4359-b0b5-4d735caab82e req-87b6e06e-c58a-464e-af4b-eb4ac4eb47fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041762 Oct 31 16:13:56.775402 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3414/6684] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:13:57.370422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:13:57.370983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] [instance: bb735071-67f3-472b-99fe-b2b64d0596a7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:13:57.378109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:57.378608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:57.379057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:57.379940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:13:57.380591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:13:57.381036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:13:57.397843 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] HTTP exception thrown: Instance bb735071-67f3-472b-99fe-b2b64d0596a7 could not be found. Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Request method failure captured: Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 HTTP/1.1 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_Q3HaA7pRsxKj3MOU1tYhgx0k3Wd_Hn6aXLkJWFmL24nkfg5-5VTF-ce92c0Cqi1Pdib73OZ8A3rmdFOIj0ZGDXJNVotNG--xNfZEKwpewtIU-OCOv-7FKYr8KiGJFK95Vd4IFHOt2im1H3HqeRL9tbmka7mD_rmkPKGk5yMQUGDfE Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 205336a74d374655a47ae2f7e82a89a6 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-708877660 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/205336a74d374655a47ae2f7e82a89a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_205336a74d374655a47ae2f7e82a89a6", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/205336a74d374655a47ae2f7e82a89a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/205336a74d374655a47ae2f7e82a89a6"}]}] Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersAdminNegativeTestJSON-708877660 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 205336a74d374655a47ae2f7e82a89a6 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-708877660 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersAdminNegativeTestJSON-708877660-project Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 66dd11ed207349aeb854f592e5d0f805 Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersAdminNegativeTestJSON-708877660-project Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance bb735071-67f3-472b-99fe-b2b64d0596a7 could not be found. Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'bb735071-67f3-472b-99fe-b2b64d0596a7'} Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb735071-67f3-472b-99fe-b2b64d0596a7 could not be found. Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb735071-67f3-472b-99fe-b2b64d0596a7 could not be found. Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:57.399975 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb735071-67f3-472b-99fe-b2b64d0596a7 could not be found. Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] Returning 404 to user: Instance bb735071-67f3-472b-99fe-b2b64d0596a7 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-548eb17d-7b94-499b-ac6e-ce2faaf38cb2 tempest-ServersAdminNegativeTestJSON-708877660 tempest-ServersAdminNegativeTestJSON-708877660-project] 10.222.0.20 "GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7" status: 404 len: 111 microversion: 2.1 time: 0.034958 Oct 31 16:13:57.405559 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3271/6685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:13:57 2022] GET /compute/v2.1/servers/bb735071-67f3-472b-99fe-b2b64d0596a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:14:03.620697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-540157215", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "1e2c47cb-fd4b-4a46-b0ed-805df7bf7bdc"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:03.674270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] validate_networks() for [('1e2c47cb-fd4b-4a46-b0ed-805df7bf7bdc', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:14:04.063501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:14:04.063918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:14:04.064393 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:14:04.064798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:14:04.065236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:14:04.074478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:04.074961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:04.075391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:04.076107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:04.076560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:04.076977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:04.094243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Getting quotas for project ddcb4c4dd7664f1f80b44fc2843137f0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:14:04.100104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Getting quotas for user e212989607174682a05725d43db7621c and project ddcb4c4dd7664f1f80b44fc2843137f0. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:14:04.112160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:14:04.114564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:14:04.164592 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f58e86b9-59ef-478d-b2f7-a59bd3585d5f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665412 Oct 31 16:14:04.165441 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3415/6686] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:14:04.176621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e238f2f-848e-4720-8cfa-838745b3c37f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:04.177439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5e238f2f-848e-4720-8cfa-838745b3c37f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:04.181211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:04.228892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=5 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:04.241843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5e238f2f-848e-4720-8cfa-838745b3c37f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:04.248797 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e238f2f-848e-4720-8cfa-838745b3c37f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1214 microversion: 2.1 time: 0.076210 Oct 31 16:14:04.264787 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3272/6687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:04 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:05.277103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:05.277843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:05.286740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:05.287250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:05.287677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:05.288388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:05.288851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:05.289354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:05.407045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:05.418815 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24c51689-0613-49ca-828a-9709755e0774 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1274 microversion: 2.1 time: 0.147611 Oct 31 16:14:05.419744 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3416/6688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:05 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:14:06.444626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:06.445293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:06.453514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:06.454254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:06.454734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:06.455851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:06.456336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:06.456781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:06.649960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:06.658191 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e9c8f314-de1a-4927-9d71-f6990b868007 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1314 microversion: 2.1 time: 0.218103 Oct 31 16:14:06.658791 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3273/6689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:06 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:06.884704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7389997c-b25a-467a-af81-fc665dca2676 req-94a148b2-7da4-4a7d-8d80-573b7252b7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41485040-caac-497c-bd75-f45ccccbb325", "tag": "a16a73c7-1322-4061-87c9-ad7709cb2aed"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:06.903326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7389997c-b25a-467a-af81-fc665dca2676 req-94a148b2-7da4-4a7d-8d80-573b7252b7eb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:06.904884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7389997c-b25a-467a-af81-fc665dca2676 req-94a148b2-7da4-4a7d-8d80-573b7252b7eb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:06.905584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7389997c-b25a-467a-af81-fc665dca2676 req-94a148b2-7da4-4a7d-8d80-573b7252b7eb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:06.928753 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7389997c-b25a-467a-af81-fc665dca2676 req-94a148b2-7da4-4a7d-8d80-573b7252b7eb service nova] Creating event network-changed:a16a73c7-1322-4061-87c9-ad7709cb2aed for instance 41485040-caac-497c-bd75-f45ccccbb325 on n-h2-858384-17 Oct 31 16:14:06.934900 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7389997c-b25a-467a-af81-fc665dca2676 req-94a148b2-7da4-4a7d-8d80-573b7252b7eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054498 Oct 31 16:14:06.935850 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3417/6690] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:07.682558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:07.683114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:07.689922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:07.690414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:07.690856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:07.692112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:07.692583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:07.693016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:07.826188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:07.834727 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3084a729-eb44-4015-8bb4-54e3de096370 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1314 microversion: 2.1 time: 0.156158 Oct 31 16:14:07.835297 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3274/6691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:07 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:08.859169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:08.859868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:08.866226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:08.866716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:08.867147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:08.867838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:08.868294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:08.868718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:09.057923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:09.065901 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d01d803-aee2-46b0-8c34-5a46a39651fe tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1314 microversion: 2.1 time: 0.211891 Oct 31 16:14:09.067001 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3418/6692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:08 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:10.089468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:10.090329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:10.097199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:10.097789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:10.098657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:10.099440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:10.099924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:10.100367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:10.275677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:10.283625 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-684579f3-d127-4cf9-ae29-c652b98a1d5c tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1314 microversion: 2.1 time: 0.198115 Oct 31 16:14:10.284213 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3275/6693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:10 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:11.307681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:11.308277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:11.315500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:11.315985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:11.316454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:11.317289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:11.317646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:11.318070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:11.460020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:11.468345 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-303fd215-3683-490c-b8bd-fac1668e835d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1314 microversion: 2.1 time: 0.164512 Oct 31 16:14:11.468928 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3419/6694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:11 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:12.103703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-41674326-d423-4453-9f42-e9ba0875d66a req-02c2b69e-f094-490d-8a13-5f20b33831f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41485040-caac-497c-bd75-f45ccccbb325", "name": "network-vif-plugged", "status": "completed", "tag": "a16a73c7-1322-4061-87c9-ad7709cb2aed"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:12.116377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41674326-d423-4453-9f42-e9ba0875d66a req-02c2b69e-f094-490d-8a13-5f20b33831f1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:12.116926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41674326-d423-4453-9f42-e9ba0875d66a req-02c2b69e-f094-490d-8a13-5f20b33831f1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:12.117453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41674326-d423-4453-9f42-e9ba0875d66a req-02c2b69e-f094-490d-8a13-5f20b33831f1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:12.130117 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-41674326-d423-4453-9f42-e9ba0875d66a req-02c2b69e-f094-490d-8a13-5f20b33831f1 service nova] Creating event network-vif-plugged:a16a73c7-1322-4061-87c9-ad7709cb2aed for instance 41485040-caac-497c-bd75-f45ccccbb325 on n-h2-858384-17 Oct 31 16:14:12.135279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-41674326-d423-4453-9f42-e9ba0875d66a req-02c2b69e-f094-490d-8a13-5f20b33831f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035547 Oct 31 16:14:12.135952 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3276/6695] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:12.493073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:12.493725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:12.500566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:12.501053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:12.501784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:12.502485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:12.502947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:12.503378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:12.640473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:12.648430 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aacb24bc-e95a-46ca-820d-31edb55310b8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1314 microversion: 2.1 time: 0.160188 Oct 31 16:14:12.649012 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3420/6696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:12 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:13.673831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:13.674554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:13.681255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:13.681782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:13.682237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:13.682931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:13.683426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:13.683863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:13.911952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:13.919723 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-faa8434e-fe64-4214-9f83-df794df7c96b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1502 microversion: 2.1 time: 0.251040 Oct 31 16:14:13.920302 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3277/6697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:13 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:13.942835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:13.945233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:13.951302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:13.951780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:13.952209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:13.952885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:13.953365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:13.953785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:13.982956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:13.988698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Old instance type m1.heat2, new instance type m1.heat {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:14:13.995169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:14:13.995673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:14:13.996051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:14:13.996453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:14:13.996852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:14:14.059404 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1490e93c-bac6-4741-987c-5ba4a1945582 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "POST /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325/action" status: 202 len: 0 microversion: 2.1 time: 0.120644 Oct 31 16:14:14.060026 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3421/6698] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:14:13 2022] POST /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:14:14.068732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:14.069391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:14.071368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:14.076597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:14.077030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:14.077514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:14.078227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:14.078698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:14.079140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:14.084680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:14.246432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:14.261002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:14.268964 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07f19e79-ef2b-4bf4-9a9d-af4f4ad1db94 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1511 microversion: 2.1 time: 0.204571 Oct 31 16:14:14.270308 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3278/6699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:14 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:15.289870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:15.290642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:15.295634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:15.296241 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:15.298772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:15.304884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:15.305400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:15.305846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:15.306538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:15.307000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:15.307428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:15.311820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:15.528851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:15.537166 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4562a1f-6ae5-4848-bdee-5d28e3a3e996 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1511 microversion: 2.1 time: 0.247811 Oct 31 16:14:15.537770 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3422/6700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:15 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:16.559773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:16.560391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:16.567988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:16.568484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:16.568926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:16.569655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:16.570123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:16.570556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:16.706960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:16.714635 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09db2efb-d38a-43dc-86df-829535a73c34 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.158722 Oct 31 16:14:16.715215 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3279/6701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:16 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:17.738058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:17.738670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:17.745563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:17.746050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:17.746485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:17.747171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:17.747622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:17.748046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:17.881327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:17.888992 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4db8ba63-79cd-42a9-b5e8-3d7a3de38ab7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.155021 Oct 31 16:14:17.889585 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3423/6702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:17 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:18.913362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:18.913933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:18.920712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:18.921237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:18.921685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:18.922385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:18.922852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:18.923286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:19.054150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:19.062147 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c69420d-7acc-4127-b919-01582b955263 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.152972 Oct 31 16:14:19.062718 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3280/6703] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:18 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:20.086953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:20.087562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:20.094876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:20.095367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:20.095848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:20.096543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:20.096999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:20.097488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:20.226450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:20.234244 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c0354ec-c22d-4a83-8c9a-21f775d7b7a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.151406 Oct 31 16:14:20.234827 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3424/6704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:20 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:21.258571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:21.259813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:21.266172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:21.266679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:21.267131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:21.267839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:21.268314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:21.268756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:21.401492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:21.409097 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7fe3e8f-2bf6-478b-9ae7-74231d2bf322 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.154757 Oct 31 16:14:21.409792 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3281/6705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:21 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:22.432350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:22.432859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:22.439683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:22.440165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:22.440603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:22.441326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:22.441781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:22.442933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:22.575869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:22.584616 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-582ecc12-b84c-4cf5-a070-ec8f0bf7f8d7 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.156219 Oct 31 16:14:22.585227 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3425/6706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:22 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:23.608037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:23.608660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:23.616074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:23.616568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:23.617016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:23.617741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:23.618207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:23.618641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:23.749694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:23.757726 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8b416480-da32-4573-98a5-8ba8aacf49f9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.153692 Oct 31 16:14:23.758312 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3282/6707] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:23 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:24.781236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:24.781835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:24.788610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:24.789079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:24.789597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:24.790225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:24.790689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:24.791095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:24.922610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:24.930668 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc4ce903-5b67-4b18-be3e-6a30805e5a04 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.153344 Oct 31 16:14:24.931243 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3426/6708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:24 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:25.954460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:25.954989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:25.962625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:25.963128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:25.963582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:25.964290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:25.964762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:25.965223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:26.099443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:26.107164 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec66def1-4db9-42c5-b967-fb58bffc74bb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.156742 Oct 31 16:14:26.107743 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3283/6709] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:25 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:27.131284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:27.131890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:27.138861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:27.139347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:27.139783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:27.140474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:27.140931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:27.141385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:27.273810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:27.281567 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69da4328-60ab-435b-918c-89e805eff78a tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.155301 Oct 31 16:14:27.282153 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3427/6710] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:27 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:28.304625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:28.305307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:28.312152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:28.312649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:28.313100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:28.313830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:28.314303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:28.314748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:28.447305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:28.454939 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-14964204-c429-4c13-892a-0e887c65d5a6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.155004 Oct 31 16:14:28.455517 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3284/6711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:28 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:29.478222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:29.478823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:29.485630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:29.486118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:29.486545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:29.487233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:29.487687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:29.488107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:29.619807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:29.627747 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3029031d-7973-4097-b1fa-409874bc0b58 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.153410 Oct 31 16:14:29.628326 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3428/6712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:29 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:14:30.651228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:30.651860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:30.658867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:30.659368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:30.659821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:30.661195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:30.661674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:30.662120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:30.794779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:30.803495 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e166c2a8-9c29-4070-989b-953ccf73a3cb tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.156164 Oct 31 16:14:30.804093 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3285/6713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:30 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:31.827074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:31.827678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:31.835081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:31.835497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:31.835923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:31.836608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:31.837057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:31.837501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:31.975028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:31.983436 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0830ca0a-ace1-4488-b3cc-5e0e9981c6b9 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.160178 Oct 31 16:14:31.984069 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3429/6714] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:31 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:33.007596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:33.008220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:33.015083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:33.015580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:33.016026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:33.016722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:33.017218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:33.017653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:33.151586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:33.159264 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bf430215-116c-4e69-84a5-b35612571755 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.155909 Oct 31 16:14:33.159853 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3286/6715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:33 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:34.183185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:34.183762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:34.190532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:34.191010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:34.191440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:34.192779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:34.193264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:34.193689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:34.323802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:34.331540 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed79f776-451f-4553-abd7-e518618461e6 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.152235 Oct 31 16:14:34.332120 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3430/6716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:34 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:14:35.355446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:35.356096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:35.362958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:35.364042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:35.364633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:35.365374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:35.365850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:35.366290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:35.495528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:35.503495 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23a0597e-891d-43c0-85db-a929579d5813 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.151969 Oct 31 16:14:35.504688 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3287/6717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:35 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:36.527529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:36.528137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:36.534993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:36.535604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:36.536039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:36.536737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:36.537222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:36.537649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:36.665983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:36.673660 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-307225e6-3a6b-4a45-bba2-8211aeb30bc5 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.150116 Oct 31 16:14:36.674235 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3431/6718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:36 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:37.700841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:37.701417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:37.709294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:37.709795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:37.710250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:37.710959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:37.711437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:37.711882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:37.847294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:37.855858 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7a5ad67-9f58-4981-93a7-eb140587b294 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.159026 Oct 31 16:14:37.856446 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3288/6719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:37 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:38.879656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:38.880275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:38.887495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:38.887983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:38.888419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:38.889116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:38.889599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:38.890028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:39.024793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:39.032534 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8397d983-dc44-4a12-86e1-40f72313ce8d tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.157388 Oct 31 16:14:39.033107 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3432/6720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:38 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:40.056446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:40.057092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:40.063873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:40.064369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:40.064815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:40.065547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:40.066016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:40.067090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:40.197064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:40.205099 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7047b047-2f33-4720-8257-b1e78c6debd4 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.152531 Oct 31 16:14:40.205700 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3289/6721] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:40 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:41.228381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:41.228948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:41.236424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:41.236913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:41.237390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:41.238367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:41.239019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:41.239449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:41.370609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:41.378549 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f15a38d7-7d86-4924-901b-8c24d1ed7c83 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.154288 Oct 31 16:14:41.379745 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3433/6722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:41 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:42.402432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:42.403122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:42.410611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:42.411146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:42.411635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:42.412336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:42.412802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:42.413337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:42.543485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:42.551462 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd8bff6b-cbe3-48db-bfa5-61504ad54061 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1516 microversion: 2.1 time: 0.152836 Oct 31 16:14:42.552240 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3290/6723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:42 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:43.580183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:43.580770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:43.587968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:43.588547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:43.589033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:43.590082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:43.590611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:43.591150 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:43.787635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:43.795483 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1ba602e-88fc-4380-a48c-7398ea409769 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1515 microversion: 2.1 time: 0.223745 Oct 31 16:14:43.796075 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3434/6724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:43 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:44.059693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-49c85914-091e-4b44-9268-1a2175c7fecf req-b5a241b3-48c9-4549-92c8-dd9105ef25ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41485040-caac-497c-bd75-f45ccccbb325", "name": "network-vif-unplugged", "status": "completed", "tag": "a16a73c7-1322-4061-87c9-ad7709cb2aed"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:44.070527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-49c85914-091e-4b44-9268-1a2175c7fecf req-b5a241b3-48c9-4549-92c8-dd9105ef25ad service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:44.071027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-49c85914-091e-4b44-9268-1a2175c7fecf req-b5a241b3-48c9-4549-92c8-dd9105ef25ad service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:44.071474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-49c85914-091e-4b44-9268-1a2175c7fecf req-b5a241b3-48c9-4549-92c8-dd9105ef25ad service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:44.086369 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-49c85914-091e-4b44-9268-1a2175c7fecf req-b5a241b3-48c9-4549-92c8-dd9105ef25ad service nova] Creating event network-vif-unplugged:a16a73c7-1322-4061-87c9-ad7709cb2aed for instance 41485040-caac-497c-bd75-f45ccccbb325 on n-h1-858384-17 Oct 31 16:14:44.092357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-49c85914-091e-4b44-9268-1a2175c7fecf req-b5a241b3-48c9-4549-92c8-dd9105ef25ad service nova] Instance 41485040-caac-497c-bd75-f45ccccbb325 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:14:44.103510 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-49c85914-091e-4b44-9268-1a2175c7fecf req-b5a241b3-48c9-4549-92c8-dd9105ef25ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047588 Oct 31 16:14:44.104289 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3291/6725] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:44.819472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:44.820108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:44.826988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:44.827476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:44.827911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:44.828610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:44.829067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:44.829515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:45.016061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:45.026260 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ade767e5-f6cf-44f5-9d13-ebf70f8f280e tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1515 microversion: 2.1 time: 0.210647 Oct 31 16:14:45.027063 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3435/6726] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:44 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:46.051816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:46.052521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:46.054461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=28 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:46.059518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:46.060012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:46.060457 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:46.061222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:46.061691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:46.062261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:46.065520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=82 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:46.122566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-830cd5f3-cabe-4e22-a413-71108eb209f6 req-f4115739-a988-4f01-88cf-9b3ae48cf9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41485040-caac-497c-bd75-f45ccccbb325", "tag": "a16a73c7-1322-4061-87c9-ad7709cb2aed"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:46.132996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=28 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:46.136239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-830cd5f3-cabe-4e22-a413-71108eb209f6 req-f4115739-a988-4f01-88cf-9b3ae48cf9d4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:46.137247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-830cd5f3-cabe-4e22-a413-71108eb209f6 req-f4115739-a988-4f01-88cf-9b3ae48cf9d4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:46.137247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-830cd5f3-cabe-4e22-a413-71108eb209f6 req-f4115739-a988-4f01-88cf-9b3ae48cf9d4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:46.145203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=84 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:14:46.155687 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-830cd5f3-cabe-4e22-a413-71108eb209f6 req-f4115739-a988-4f01-88cf-9b3ae48cf9d4 service nova] Creating event network-changed:a16a73c7-1322-4061-87c9-ad7709cb2aed for instance 41485040-caac-497c-bd75-f45ccccbb325 on n-h1-858384-17 Oct 31 16:14:46.161881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-830cd5f3-cabe-4e22-a413-71108eb209f6 req-f4115739-a988-4f01-88cf-9b3ae48cf9d4 service nova] Instance 41485040-caac-497c-bd75-f45ccccbb325 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:14:46.173277 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-830cd5f3-cabe-4e22-a413-71108eb209f6 req-f4115739-a988-4f01-88cf-9b3ae48cf9d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054331 Oct 31 16:14:46.174234 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3436/6727] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:14:46.213204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:46.221109 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ddb0a530-20a0-4cb5-b93e-b1b841721022 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1513 microversion: 2.1 time: 0.175080 Oct 31 16:14:46.221713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3292/6728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:46 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:47.248924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:47.249681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:47.257059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:47.257571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:47.258013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:47.258710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:47.259165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:47.259595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:47.458981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:47.466673 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d6706631-c570-4b66-a16f-b2fb5026bd2b tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1510 microversion: 2.1 time: 0.222867 Oct 31 16:14:47.467254 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3437/6729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:47 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:47.489870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:47.490513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:47.497242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:47.497737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:47.498211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:47.498904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:47.499367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:47.499801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:47.526359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:14:47.577454 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Found an unconfirmed migration during delete, id: 16, status: finished Oct 31 16:14:49.342121 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4cd56f4e-5aa9-4a94-a8f3-4b7025498b22 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 204 len: 0 microversion: 2.1 time: 1.856550 Oct 31 16:14:49.346134 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3293/6730] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:14:47 2022] DELETE /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 0 bytes in 1858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:14:49.352476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:49.353139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:49.360166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:49.360658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:49.361096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:49.361816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:49.362276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:49.362741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:49.496311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:49.505077 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-40aeab99-155e-4d1d-8e11-0fdaf62658ea tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1502 microversion: 2.1 time: 0.156910 Oct 31 16:14:49.505681 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3438/6731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:49 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:50.287787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-02e64bb2-b9e9-403c-aca5-da2c936b4200 req-2bbb33b1-74b7-4eec-b5dc-f828f08c5169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41485040-caac-497c-bd75-f45ccccbb325", "name": "network-vif-plugged", "status": "completed", "tag": "a16a73c7-1322-4061-87c9-ad7709cb2aed"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:50.297106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-02e64bb2-b9e9-403c-aca5-da2c936b4200 req-2bbb33b1-74b7-4eec-b5dc-f828f08c5169 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:50.297618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-02e64bb2-b9e9-403c-aca5-da2c936b4200 req-2bbb33b1-74b7-4eec-b5dc-f828f08c5169 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:50.298056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-02e64bb2-b9e9-403c-aca5-da2c936b4200 req-2bbb33b1-74b7-4eec-b5dc-f828f08c5169 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:50.309080 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-02e64bb2-b9e9-403c-aca5-da2c936b4200 req-2bbb33b1-74b7-4eec-b5dc-f828f08c5169 service nova] Creating event network-vif-plugged:a16a73c7-1322-4061-87c9-ad7709cb2aed for instance 41485040-caac-497c-bd75-f45ccccbb325 on n-h1-858384-17 Oct 31 16:14:50.313819 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-02e64bb2-b9e9-403c-aca5-da2c936b4200 req-2bbb33b1-74b7-4eec-b5dc-f828f08c5169 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080219 Oct 31 16:14:50.314438 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3294/6732] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:50.528712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:50.529276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:50.536865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:50.537381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:50.537817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:50.538502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:50.538952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:50.539374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:50.741352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e212989607174682a05725d43db7621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddcb4c4dd7664f1f80b44fc2843137f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:14:50.749034 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34765315-5f8c-4bcc-9ac1-ec8d446ecfae tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 200 len: 1502 microversion: 2.1 time: 0.224358 Oct 31 16:14:50.749651 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3439/6733] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:50 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:14:51.116361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c5852996-963c-42a8-974f-2729a6f0b02a req-b28dd0cb-7ab4-439d-a564-10b16facebab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41485040-caac-497c-bd75-f45ccccbb325", "name": "network-vif-deleted", "tag": "a16a73c7-1322-4061-87c9-ad7709cb2aed"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:14:51.143207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c5852996-963c-42a8-974f-2729a6f0b02a req-b28dd0cb-7ab4-439d-a564-10b16facebab service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:51.143715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c5852996-963c-42a8-974f-2729a6f0b02a req-b28dd0cb-7ab4-439d-a564-10b16facebab service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:51.144767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c5852996-963c-42a8-974f-2729a6f0b02a req-b28dd0cb-7ab4-439d-a564-10b16facebab service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:51.158019 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c5852996-963c-42a8-974f-2729a6f0b02a req-b28dd0cb-7ab4-439d-a564-10b16facebab service nova] Creating event network-vif-deleted:a16a73c7-1322-4061-87c9-ad7709cb2aed for instance 41485040-caac-497c-bd75-f45ccccbb325 on n-h1-858384-17 Oct 31 16:14:51.163807 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c5852996-963c-42a8-974f-2729a6f0b02a req-b28dd0cb-7ab4-439d-a564-10b16facebab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051968 Oct 31 16:14:51.164713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3295/6734] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:14:51.774655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:51.775258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:51.782024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:51.782499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:51.782935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:51.783614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:51.784067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:51.784497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:51.797782 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] HTTP exception thrown: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Request method failure captured: Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 HTTP/1.1 Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_RL419bRF8C-z3-if0HfE_mlZefcx33VDm17TOZ5cePwVLruiB4xrW48ChE4AgeXbkddQqKXIE9ep8L6cYsq9mB9WhBnMrH4GF5UgopGuxpl92nSVbyzWEGVE8dvmA7zs1M3a-qmd_BgXegU3pEpvcx1e2jGLjQZUrP-KM2joz6OKs Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: ddcb4c4dd7664f1f80b44fc2843137f0 Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-477987959 Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ddcb4c4dd7664f1f80b44fc2843137f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ddcb4c4dd7664f1f80b44fc2843137f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ddcb4c4dd7664f1f80b44fc2843137f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ddcb4c4dd7664f1f80b44fc2843137f0"}]}] Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-477987959 Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: ddcb4c4dd7664f1f80b44fc2843137f0 Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-477987959 Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-477987959-project Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e212989607174682a05725d43db7621c Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-477987959-project Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '41485040-caac-497c-bd75-f45ccccbb325'} Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:51.799411 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Returning 404 to user: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e75ad5f-c4af-4401-94d3-3dc7c857f659 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 404 len: 111 microversion: 2.1 time: 0.030615 Oct 31 16:14:51.804929 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3440/6735] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:51 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:14:51.818484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:51.819077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:51.825180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:51.825674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:51.826121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:51.826811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:51.827273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:51.827704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:51.840624 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] HTTP exception thrown: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Request method failure captured: Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 HTTP/1.1 Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_RL419bRF8C-z3-if0HfE_mlZefcx33VDm17TOZ5cePwVLruiB4xrW48ChE4AgeXbkddQqKXIE9ep8L6cYsq9mB9WhBnMrH4GF5UgopGuxpl92nSVbyzWEGVE8dvmA7zs1M3a-qmd_BgXegU3pEpvcx1e2jGLjQZUrP-KM2joz6OKs Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: ddcb4c4dd7664f1f80b44fc2843137f0 Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-DeleteServersTestJSON-477987959 Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ddcb4c4dd7664f1f80b44fc2843137f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ddcb4c4dd7664f1f80b44fc2843137f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ddcb4c4dd7664f1f80b44fc2843137f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ddcb4c4dd7664f1f80b44fc2843137f0"}]}] Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-DeleteServersTestJSON-477987959 Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: ddcb4c4dd7664f1f80b44fc2843137f0 Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-DeleteServersTestJSON-477987959 Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-DeleteServersTestJSON-477987959-project Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e212989607174682a05725d43db7621c Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-DeleteServersTestJSON-477987959-project Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '41485040-caac-497c-bd75-f45ccccbb325'} Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:14:51.842205 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Returning 404 to user: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6185ce1e-eed8-4449-af8f-dd7d8153cbf8 tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 404 len: 111 microversion: 2.1 time: 0.030855 Oct 31 16:14:51.847247 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3296/6736] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:14:51 2022] DELETE /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:14:51.852061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:14:51.852665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] [instance: 41485040-caac-497c-bd75-f45ccccbb325] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:14:51.858772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:51.859249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:51.859675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:51.860352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:14:51.860802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:14:51.861252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:14:51.874867 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] HTTP exception thrown: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Request method failure captured: Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 HTTP/1.1 Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_RL419bRF8C-z3-if0HfE_mlZefcx33VDm17TOZ5cePwVLruiB4xrW48ChE4AgeXbkddQqKXIE9ep8L6cYsq9mB9WhBnMrH4GF5UgopGuxpl92nSVbyzWEGVE8dvmA7zs1M3a-qmd_BgXegU3pEpvcx1e2jGLjQZUrP-KM2joz6OKs Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: ddcb4c4dd7664f1f80b44fc2843137f0 Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-DeleteServersTestJSON-477987959 Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ddcb4c4dd7664f1f80b44fc2843137f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ddcb4c4dd7664f1f80b44fc2843137f0", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ddcb4c4dd7664f1f80b44fc2843137f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ddcb4c4dd7664f1f80b44fc2843137f0"}]}] Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-DeleteServersTestJSON-477987959 Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: ddcb4c4dd7664f1f80b44fc2843137f0 Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-DeleteServersTestJSON-477987959 Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-DeleteServersTestJSON-477987959-project Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e212989607174682a05725d43db7621c Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-DeleteServersTestJSON-477987959-project Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '41485040-caac-497c-bd75-f45ccccbb325'} Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:14:51.876604 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] Returning 404 to user: Instance 41485040-caac-497c-bd75-f45ccccbb325 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4bcd6cb5-7b49-4a72-8780-1181160e727f tempest-DeleteServersTestJSON-477987959 tempest-DeleteServersTestJSON-477987959-project] 10.222.0.20 "GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325" status: 404 len: 111 microversion: 2.1 time: 0.029824 Oct 31 16:14:51.881964 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3441/6737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:14:51 2022] GET /compute/v2.1/servers/41485040-caac-497c-bd75-f45ccccbb325 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:15:00.930864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-293654567", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "6bc8c88a-b88a-415f-9bd0-a802de5dc89c"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:00.987584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] validate_networks() for [('6bc8c88a-b88a-415f-9bd0-a802de5dc89c', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:15:01.448367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:15:01.448815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:15:01.449333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:15:01.449760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:15:01.450202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:15:01.460401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:01.460992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:01.461485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:01.462421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:01.462901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:01.463347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:01.481816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Getting quotas for project 0a22744b75fc484cbf5fb017340c07ef. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:15:01.487473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Getting quotas for user e14118ace807403390ff791b0e61b610 and project 0a22744b75fc484cbf5fb017340c07ef. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:15:01.500584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:15:01.503835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:15:01.550881 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f6bf6cd-e1f5-4c77-a312-6a8cb62dde9a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757450 Oct 31 16:15:01.551713 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3297/6738] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:15:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:15:01.562976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ffb95cac-3a04-4e35-98f2-e67393edde3d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:01.564823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ffb95cac-3a04-4e35-98f2-e67393edde3d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:01.649977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ffb95cac-3a04-4e35-98f2-e67393edde3d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:01.658182 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ffb95cac-3a04-4e35-98f2-e67393edde3d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1217 microversion: 2.1 time: 0.099057 Oct 31 16:15:01.659846 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3442/6739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:01 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:15:02.685274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:02.686033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:02.697951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:02.698594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:02.699210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:02.700055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:02.700663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:02.701257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:02.802848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:02.817280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0e94947e-20e4-4761-be76-eaf298ceff15 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1277 microversion: 2.1 time: 0.138545 Oct 31 16:15:02.819866 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3298/6740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:02 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:03.851193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:03.851807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:03.854022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=25 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:03.864286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:03.865193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:03.865705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:03.866500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:03.867116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:03.867563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:04.104964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:04.113104 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-35fba561-7da9-439f-a464-0e79b174011e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1317 microversion: 2.1 time: 0.266438 Oct 31 16:15:04.113713 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3443/6741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:03 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:04.436699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-87fdd1a7-ca36-4af4-bfe4-8451ae210eeb req-3b69158c-f57b-4c07-9075-f979a972edea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7edc0a9e-a851-4dae-9cdf-b004f04b9b29", "tag": "6c8430ed-b96a-4516-9eaa-3ad60653916a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:04.447074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-87fdd1a7-ca36-4af4-bfe4-8451ae210eeb req-3b69158c-f57b-4c07-9075-f979a972edea service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:04.447576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-87fdd1a7-ca36-4af4-bfe4-8451ae210eeb req-3b69158c-f57b-4c07-9075-f979a972edea service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:04.448025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-87fdd1a7-ca36-4af4-bfe4-8451ae210eeb req-3b69158c-f57b-4c07-9075-f979a972edea service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:04.459694 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-87fdd1a7-ca36-4af4-bfe4-8451ae210eeb req-3b69158c-f57b-4c07-9075-f979a972edea service nova] Creating event network-changed:6c8430ed-b96a-4516-9eaa-3ad60653916a for instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 on n-h2-858384-17 Oct 31 16:15:04.464706 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-87fdd1a7-ca36-4af4-bfe4-8451ae210eeb req-3b69158c-f57b-4c07-9075-f979a972edea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083636 Oct 31 16:15:04.465534 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3299/6742] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:05.135923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:05.136538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:05.143736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:05.144224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:05.144665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:05.145386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:05.145848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:05.146274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:05.278754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:05.287215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52964ee3-0a11-4972-b1c6-160ae5d141f3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1317 microversion: 2.1 time: 0.155339 Oct 31 16:15:05.287806 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3444/6743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:05 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:06.312208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:06.312949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:06.320344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:06.320855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:06.321360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:06.322073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:06.322585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:06.323065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:06.459155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:06.466967 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2fe400d6-02e6-4cbf-9343-1d97447f5874 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1317 microversion: 2.1 time: 0.159962 Oct 31 16:15:06.467548 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3300/6744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:06 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:07.489952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:07.490471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:07.497387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:07.497869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:07.498299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:07.499005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:07.499712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:07.500129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:07.635950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:07.643845 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a296be60-cc27-4a2b-bb8f-03f0c924d5ca tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1317 microversion: 2.1 time: 0.157743 Oct 31 16:15:07.644469 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3445/6745] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:07 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:08.667482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:08.668130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:08.675137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:08.675664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:08.676238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:08.677102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:08.677643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:08.678342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:08.807597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:08.815943 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c9e36546-1868-46fb-8371-064649776fe7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1317 microversion: 2.1 time: 0.152575 Oct 31 16:15:08.816471 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3301/6746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:08 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:09.839548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:09.840267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:09.847719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:09.848199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:09.848629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:09.849349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:09.849802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:09.850246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:09.979914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:09.988075 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6e26edd2-276a-4615-bc94-9a0f7a793368 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1317 microversion: 2.1 time: 0.152412 Oct 31 16:15:09.988665 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3446/6747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:09 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:10.350219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f92c6b96-ee85-45ef-bc78-386977cab6cf req-d30f16e8-8634-4eab-91ea-20d83a359498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edc0a9e-a851-4dae-9cdf-b004f04b9b29", "name": "network-vif-plugged", "status": "completed", "tag": "6c8430ed-b96a-4516-9eaa-3ad60653916a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:10.360885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f92c6b96-ee85-45ef-bc78-386977cab6cf req-d30f16e8-8634-4eab-91ea-20d83a359498 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:10.361618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f92c6b96-ee85-45ef-bc78-386977cab6cf req-d30f16e8-8634-4eab-91ea-20d83a359498 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:10.362201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f92c6b96-ee85-45ef-bc78-386977cab6cf req-d30f16e8-8634-4eab-91ea-20d83a359498 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:10.373872 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f92c6b96-ee85-45ef-bc78-386977cab6cf req-d30f16e8-8634-4eab-91ea-20d83a359498 service nova] Creating event network-vif-plugged:6c8430ed-b96a-4516-9eaa-3ad60653916a for instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 on n-h2-858384-17 Oct 31 16:15:10.380054 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f92c6b96-ee85-45ef-bc78-386977cab6cf req-d30f16e8-8634-4eab-91ea-20d83a359498 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033652 Oct 31 16:15:10.380663 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3302/6748] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:11.011555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:11.012169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:11.019279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:11.019764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:11.020200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:11.020893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:11.021455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:11.021884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:11.155746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:11.164061 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7227bdf6-e9e7-4e4d-83da-27b1b802ac51 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1317 microversion: 2.1 time: 0.156467 Oct 31 16:15:11.164643 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3447/6749] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:11 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:12.185564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:12.186641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:12.191678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:12.192452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:12.199499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.200004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.200434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.201157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.201609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.202044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.337881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:12.345568 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9950484a-c2fb-4360-b4cc-9c9e9bb1c380 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1507 microversion: 2.1 time: 0.161861 Oct 31 16:15:12.346141 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3303/6750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:12 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:12.369054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:12.369680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:12.371579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:12.377894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.378527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.378978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.379668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.380130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.380558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.510487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:12.518275 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6c8c7e89-6c21-4e0d-8ed0-afbab407b3af tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1507 microversion: 2.1 time: 0.153058 Oct 31 16:15:12.519569 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3448/6751] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:12 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:12.541204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-81dcc6b1-26ea-4c17-980f-46a56085705a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:12.543628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-81dcc6b1-26ea-4c17-980f-46a56085705a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:12.549670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81dcc6b1-26ea-4c17-980f-46a56085705a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.550172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81dcc6b1-26ea-4c17-980f-46a56085705a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.550629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81dcc6b1-26ea-4c17-980f-46a56085705a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.551430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81dcc6b1-26ea-4c17-980f-46a56085705a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.552123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81dcc6b1-26ea-4c17-980f-46a56085705a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.552573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81dcc6b1-26ea-4c17-980f-46a56085705a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.618985 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-81dcc6b1-26ea-4c17-980f-46a56085705a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "PUT /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1079 microversion: 2.1 time: 0.081667 Oct 31 16:15:12.619620 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3304/6752] 10.222.0.20 () {60 vars in 1256 bytes} [Mon Oct 31 16:15:12 2022] PUT /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1079 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:12.638746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:12.639353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:12.646348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.646833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.647270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.647965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.648422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.648846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.779433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:12.787857 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2fed8822-e09f-4505-8de0-ee699c4a7fc3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1505 microversion: 2.1 time: 0.153018 Oct 31 16:15:12.788447 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3449/6753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:12 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:12.810081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:12.810695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:12.816588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.817089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.817585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.818279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.818742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.819177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.953330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:12.961653 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07ce21bb-e584-410d-a3d6-dde3b6a8fd52 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1505 microversion: 2.1 time: 0.155368 Oct 31 16:15:12.962232 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3305/6754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:12 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:12.984665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:12.987061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:12.993556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.994040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.994476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:12.995167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:12.995621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:12.996050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:13.027888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:13.033344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Old instance type m1.heat2, new instance type m1.heat {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:15:13.040748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:15:13.041200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:15:13.041677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:15:13.042087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:15:13.042494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:15:13.105296 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b4ce9666-82c2-4f65-9e4e-9025a90d4b67 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "POST /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29/action" status: 202 len: 0 microversion: 2.1 time: 0.124899 Oct 31 16:15:13.105910 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3450/6755] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:15:12 2022] POST /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:15:13.114258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:13.114989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:13.121282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:13.121781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:13.122241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:13.122918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:13.123476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:13.123912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:13.285292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:13.293361 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7b309bb4-1a1c-4967-8f5e-e0de2496325a tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1516 microversion: 2.1 time: 0.183018 Oct 31 16:15:13.293941 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3306/6756] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:13 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:14.319899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:14.320591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:14.328072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:14.328556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:14.328987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:14.329709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:14.330171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:14.330740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:14.559617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:14.568463 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dc6e5c0c-9b23-4362-8c3a-f5d810314994 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1516 microversion: 2.1 time: 0.254611 Oct 31 16:15:14.569332 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3451/6757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:14 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:15.591794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:15.592442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:15.600359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:15.600863 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:15.601350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:15.602091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:15.602571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:15.603015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:15.730295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:15.738662 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4de8a751-a778-421d-b734-fa53bd3907dd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.150726 Oct 31 16:15:15.739253 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3307/6758] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:15 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:16.762168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:16.762777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:16.765523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=38 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:16.771384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:16.771858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:16.772292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:16.772988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:16.773470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:16.773925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:16.907224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:16.916596 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fdc45cf5-2571-4bec-82e8-b7cfa3f18824 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.158281 Oct 31 16:15:16.917191 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3452/6759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:16 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:17.939494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:17.940108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:17.943534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:17.948669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:17.949185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:17.949629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:17.950321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:17.950783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:17.951213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:17.955853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:18.086933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:18.094602 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7dd29117-fecc-4869-a39d-bf585baadec1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.159050 Oct 31 16:15:18.095196 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3308/6760] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:17 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:19.119329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:19.119932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:19.126981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:19.127458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:19.130113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:19.131309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:19.131770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:19.132197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:19.268027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:19.276408 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7becd7ba-ce95-4b5a-8828-260231f8f27d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.160937 Oct 31 16:15:19.276987 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3453/6761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:19 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:20.299294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:20.299942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:20.306507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:20.306998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:20.307443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:20.308136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:20.308630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:20.309062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:20.442182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:20.450019 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5afb37c9-3bf7-4371-8be9-edb364b7d246 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.154616 Oct 31 16:15:20.450598 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3309/6762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:20 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:21.474428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:21.475094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:21.481925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:21.482405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:21.482838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:21.483526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:21.483980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:21.484405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:21.614139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:21.621771 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b5fe10e9-154c-4202-ae86-6b19c2d021ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.151797 Oct 31 16:15:21.622378 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3454/6763] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:21 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:22.645590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:22.646202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:22.652695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:22.653218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:22.653663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:22.654362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:22.654825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:22.655257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:22.787339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:22.794998 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27ee67e7-12a5-45dc-a93c-f3524fbf190f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.153566 Oct 31 16:15:22.795583 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3310/6764] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:22 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:23.818966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:23.819588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:23.826531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:23.827055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:23.827430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:23.828108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:23.828556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:23.828974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:23.962456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:23.970069 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0fbf4faf-5ec5-4b53-ab77-8d351d9fd738 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.155483 Oct 31 16:15:23.970641 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3455/6765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:23 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:24.994052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:24.994688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:25.001952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:25.002497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:25.002945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:25.003670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:25.004196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:25.004631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:25.136703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:25.145247 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b08c27a-bb7e-4f48-9132-0c7ea2e97696 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.154526 Oct 31 16:15:25.145839 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3311/6766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:24 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:26.168085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:26.168719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:26.175470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:26.176581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:26.176581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:26.177091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:26.177564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:26.177983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:26.308650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:26.317054 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a78f1209-d9a9-4f18-a8f1-3397ac8c5db3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.152202 Oct 31 16:15:26.317935 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3456/6767] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:26 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:27.340651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:27.341307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:27.348909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:27.349435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:27.349892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:27.350590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:27.351060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:27.351503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:27.488124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:27.496168 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-431e51da-a49d-43b5-baa3-34f5b4e377c8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.159355 Oct 31 16:15:27.496756 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3312/6768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:27 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:28.520423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:28.520998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:28.529866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:28.530354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:28.530781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:28.531464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:28.531909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:28.532326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:28.664069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:28.672093 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-18ddec3c-e11a-4372-937d-d5eba4a89455 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.156102 Oct 31 16:15:28.672675 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3457/6769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:28 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:29.695232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:29.695854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:29.702661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:29.703155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:29.703598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:29.704319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:29.704786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:29.705248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:29.832938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:29.840682 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bfd295d4-ebc7-4d84-98b7-5935210e1d3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.149364 Oct 31 16:15:29.841286 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3313/6770] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:29 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:30.865508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:30.866685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:30.873918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:30.874401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:30.874834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:30.875525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:30.875977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:30.876397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:30.881061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:31.015707 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:31.023589 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-87c61f45-9b77-42e9-914c-25e1ac254216 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.162629 Oct 31 16:15:31.024162 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3458/6771] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:30 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:32.047165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:32.047786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:32.054774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:32.055265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:32.055706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:32.056401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:32.056866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:32.057330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:32.185464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:32.194234 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dff3dfe5-4e00-4a9b-949f-c172141bea73 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.150805 Oct 31 16:15:32.194884 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3314/6772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:32 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:33.217575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:33.218170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:33.226217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:33.226698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:33.227128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:33.227844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:33.228324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:33.228746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:33.358321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:33.365897 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2a97b36d-49bc-486d-a23c-491d6ca91aaf tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.152241 Oct 31 16:15:33.366473 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3459/6773] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:33 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:34.390103 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:34.390749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:34.397665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:34.398162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:34.398628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:34.399321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:34.399785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:34.400216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:34.532785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:34.541267 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6f9612c3-9065-497d-8064-fbd6d85a35a7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.155010 Oct 31 16:15:34.541850 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3315/6774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:34 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:35.563851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:35.564455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:35.572354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:35.572842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:35.573321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:35.574015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:35.574468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:35.574888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:35.707831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:35.715545 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a89e82a4-f1a9-4501-a812-c74658068f8d tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.155677 Oct 31 16:15:35.716131 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3460/6775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:35 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:36.739953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:36.740502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:36.747379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:36.747869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:36.748571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:36.749355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:36.749824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:36.750259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:36.879931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:36.887639 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e5c7baeb-57be-4632-8cb6-a3e24c3cd3c3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.152113 Oct 31 16:15:36.888215 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3316/6776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:36 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:37.910986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:37.911592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:37.918362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:37.918840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:37.919266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:37.919973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:37.920425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:37.920844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:38.054030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:38.061599 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8a0a6a2d-dea0-4023-8a39-51467ed74b1f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.154616 Oct 31 16:15:38.062173 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3461/6777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:37 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:39.086221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:39.086866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:39.094434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:39.094949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:39.095408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:39.096142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:39.096618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:39.097997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:39.237993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:39.245764 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdfba148-710d-49a4-93b8-8069e6d99d92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.164368 Oct 31 16:15:39.246361 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3317/6778] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:39 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:40.269532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:40.270138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:40.276824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:40.277339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:40.277770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:40.278451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:40.278902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:40.279328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:40.412155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:40.419817 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-40809e9e-83e3-4e9b-88a0-1bee2e59d7e7 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.154376 Oct 31 16:15:40.420408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3462/6779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:40 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:41.444085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:41.444706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:41.451449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:41.451944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:41.452391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:41.453086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:41.453578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:41.454015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:41.584264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:41.591984 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7814e2d-1c1d-47fb-ad3f-9cee21550e0c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1521 microversion: 2.1 time: 0.152023 Oct 31 16:15:41.592564 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3318/6780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:41 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:42.399704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5f2684d1-fda9-4793-861c-389de606a0d7 req-bca7a5b9-cfb6-432d-962a-252af968f350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edc0a9e-a851-4dae-9cdf-b004f04b9b29", "name": "network-vif-unplugged", "status": "completed", "tag": "6c8430ed-b96a-4516-9eaa-3ad60653916a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:42.410366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5f2684d1-fda9-4793-861c-389de606a0d7 req-bca7a5b9-cfb6-432d-962a-252af968f350 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:42.411028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5f2684d1-fda9-4793-861c-389de606a0d7 req-bca7a5b9-cfb6-432d-962a-252af968f350 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:42.411475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5f2684d1-fda9-4793-861c-389de606a0d7 req-bca7a5b9-cfb6-432d-962a-252af968f350 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:42.423609 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5f2684d1-fda9-4793-861c-389de606a0d7 req-bca7a5b9-cfb6-432d-962a-252af968f350 service nova] Creating event network-vif-unplugged:6c8430ed-b96a-4516-9eaa-3ad60653916a for instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 on n-h1-858384-17 Oct 31 16:15:42.429408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-5f2684d1-fda9-4793-861c-389de606a0d7 req-bca7a5b9-cfb6-432d-962a-252af968f350 service nova] Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:15:42.440654 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5f2684d1-fda9-4793-861c-389de606a0d7 req-bca7a5b9-cfb6-432d-962a-252af968f350 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044238 Oct 31 16:15:42.441714 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3463/6781] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:42.615818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:42.616452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:42.623307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:42.623815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:42.624270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:42.624985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:42.625488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:42.625932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:42.761233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:42.769239 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aff8bea2-3e86-4fc1-a60d-bd1f8d905147 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1520 microversion: 2.1 time: 0.157234 Oct 31 16:15:42.769840 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3319/6782] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:42 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:43.795696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:43.796365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:43.802693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:43.803172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:43.803600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:43.804521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:43.805409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:43.805841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:43.939485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:43.947736 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4300c606-6b55-4e7d-8fc2-c7b832f0a2a6 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1518 microversion: 2.1 time: 0.157540 Oct 31 16:15:43.948313 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3464/6783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:43 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:44.474412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7c5d3354-78f6-4bc5-bb34-13b73a094d7a req-c3f6cc20-4885-4b3d-a5ab-b05f580727a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7edc0a9e-a851-4dae-9cdf-b004f04b9b29", "tag": "6c8430ed-b96a-4516-9eaa-3ad60653916a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:44.484735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7c5d3354-78f6-4bc5-bb34-13b73a094d7a req-c3f6cc20-4885-4b3d-a5ab-b05f580727a8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:44.485252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7c5d3354-78f6-4bc5-bb34-13b73a094d7a req-c3f6cc20-4885-4b3d-a5ab-b05f580727a8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:44.485699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7c5d3354-78f6-4bc5-bb34-13b73a094d7a req-c3f6cc20-4885-4b3d-a5ab-b05f580727a8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:44.497909 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7c5d3354-78f6-4bc5-bb34-13b73a094d7a req-c3f6cc20-4885-4b3d-a5ab-b05f580727a8 service nova] Creating event network-changed:6c8430ed-b96a-4516-9eaa-3ad60653916a for instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 on n-h1-858384-17 Oct 31 16:15:44.503426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-7c5d3354-78f6-4bc5-bb34-13b73a094d7a req-c3f6cc20-4885-4b3d-a5ab-b05f580727a8 service nova] Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:15:44.515339 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7c5d3354-78f6-4bc5-bb34-13b73a094d7a req-c3f6cc20-4885-4b3d-a5ab-b05f580727a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044865 Oct 31 16:15:44.515960 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3320/6784] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:44.971357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:44.972686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:44.980879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:44.981428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:44.981882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:44.982700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:44.983250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:44.983766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:45.284562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:45.293905 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24767547-710b-4921-b1ec-81e1b01a0e3b tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1515 microversion: 2.1 time: 0.326509 Oct 31 16:15:45.294642 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3465/6785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:44 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:45.318558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26579f1b-a67a-45ee-a3f9-230151df3a65 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:45.319207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26579f1b-a67a-45ee-a3f9-230151df3a65 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:45.325871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26579f1b-a67a-45ee-a3f9-230151df3a65 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:45.326369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26579f1b-a67a-45ee-a3f9-230151df3a65 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:45.327010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26579f1b-a67a-45ee-a3f9-230151df3a65 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:45.327732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26579f1b-a67a-45ee-a3f9-230151df3a65 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:45.328201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26579f1b-a67a-45ee-a3f9-230151df3a65 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:45.328636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26579f1b-a67a-45ee-a3f9-230151df3a65 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:45.397397 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26579f1b-a67a-45ee-a3f9-230151df3a65 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "POST /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29/action" status: 204 len: 0 microversion: 2.1 time: 0.083682 Oct 31 16:15:45.397958 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3321/6786] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:15:45 2022] POST /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:15:45.406146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:45.406763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:45.413909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:45.414650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:45.415237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:45.416113 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:45.416785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:45.417434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:45.709506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:45.717283 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-533fbfec-e14b-4df0-879d-199b6d641460 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1515 microversion: 2.1 time: 0.315067 Oct 31 16:15:45.717883 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3466/6787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:45 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:15:46.742091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:46.742767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:46.749080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:46.749602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:46.750045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:46.750768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:46.751234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:46.751666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:46.893057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:46.903304 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae1a897a-d683-4aa6-89a3-8f6874e1d70f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1515 microversion: 2.1 time: 0.166434 Oct 31 16:15:46.903903 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3322/6788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:46 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:47.928783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:47.929358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:47.932087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=30 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:47.937642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:47.938130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:47.938570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:47.939266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:47.939724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:47.940151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:48.070004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:48.077721 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0d43403f-63aa-463e-bdf7-2f4417453226 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1507 microversion: 2.1 time: 0.153716 Oct 31 16:15:48.078308 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3467/6789] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:47 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:48.101454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:48.102093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:48.104924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=30 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:48.110336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:48.110832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:48.111283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:48.111991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:48.112460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:48.112895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:48.116067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:15:48.245468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:48.253486 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da2f15aa-7035-4ae9-8898-f3c8c7bfebfc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1507 microversion: 2.1 time: 0.156928 Oct 31 16:15:48.254064 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3323/6790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:48 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:48.279868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-92e593fa-a9ec-4285-9046-dea9e3e29dc1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Action: 'create', calling method: .version_select at 0x7f16e00871f0>, body: {"keypair": {"name": "tempest-keypair-805103459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfAh5gumDcgjDKtrzurOXIyCMVr3GC+z2tss73RhQw9H7J5R6/y+XOEvicuopZWwCU4jrAVuyNiOS1dUebujo+THbfUSHUWlu78hainzH/mdD0ML9JnZ/ksizWmPisd7g=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:48.297337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-92e593fa-a9ec-4285-9046-dea9e3e29dc1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Getting quotas for project 0a22744b75fc484cbf5fb017340c07ef. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:15:48.303276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-92e593fa-a9ec-4285-9046-dea9e3e29dc1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Getting quotas for user e14118ace807403390ff791b0e61b610 and project 0a22744b75fc484cbf5fb017340c07ef. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:15:48.330236 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-92e593fa-a9ec-4285-9046-dea9e3e29dc1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054085 Oct 31 16:15:48.330854 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3468/6791] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:15:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:48.518974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fc0e5735-73b9-4384-9181-aac9469f1580 req-3cd60dcd-8079-4062-8fcd-222242b52b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edc0a9e-a851-4dae-9cdf-b004f04b9b29", "name": "network-vif-plugged", "status": "completed", "tag": "6c8430ed-b96a-4516-9eaa-3ad60653916a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:48.528487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fc0e5735-73b9-4384-9181-aac9469f1580 req-3cd60dcd-8079-4062-8fcd-222242b52b82 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:48.528987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fc0e5735-73b9-4384-9181-aac9469f1580 req-3cd60dcd-8079-4062-8fcd-222242b52b82 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:48.529458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fc0e5735-73b9-4384-9181-aac9469f1580 req-3cd60dcd-8079-4062-8fcd-222242b52b82 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:48.545341 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fc0e5735-73b9-4384-9181-aac9469f1580 req-3cd60dcd-8079-4062-8fcd-222242b52b82 service nova] Creating event network-vif-plugged:6c8430ed-b96a-4516-9eaa-3ad60653916a for instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 on n-h1-858384-17 Oct 31 16:15:48.552116 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fc0e5735-73b9-4384-9181-aac9469f1580 req-3cd60dcd-8079-4062-8fcd-222242b52b82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035519 Oct 31 16:15:48.552987 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3324/6792] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:49.531224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:49.531860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:49.538798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:49.539280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:49.539711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:49.540398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:49.540854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:49.541368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:49.669974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:49.678351 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5053f38d-c89e-48af-bb9a-b85ec0eef769 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 200 len: 1507 microversion: 2.1 time: 0.151884 Oct 31 16:15:49.678937 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3469/6793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:49 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:49.703044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:49.703544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:49.710055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:49.710544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:49.710986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:49.711677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:49.712140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:49.712572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:49.736926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:15:49.812539 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8bbc9314-4dca-45e5-b6d8-7a95d4005f13 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 204 len: 0 microversion: 2.1 time: 0.114399 Oct 31 16:15:49.813147 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3325/6794] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:15:49 2022] DELETE /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:15:49.869446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-870592511", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "6bc8c88a-b88a-415f-9bd0-a802de5dc89c"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:49.924014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] validate_networks() for [('6bc8c88a-b88a-415f-9bd0-a802de5dc89c', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:15:50.388117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:15:50.388534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:15:50.388999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:15:50.389425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:15:50.389849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:15:50.399540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:50.400033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:50.400490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:50.401408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:50.401871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:50.402291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:50.421992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Getting quotas for project 0a22744b75fc484cbf5fb017340c07ef. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:15:50.427221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Getting quotas for user e14118ace807403390ff791b0e61b610 and project 0a22744b75fc484cbf5fb017340c07ef. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:15:50.439275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:15:50.441598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:15:50.486885 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-484d310c-db92-45b2-b397-30f7bf054b9f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621421 Oct 31 16:15:50.487535 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3470/6795] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:15:50.500023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-971498ce-b6d4-4b73-b3e3-0ea20206f588 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:50.500751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-971498ce-b6d4-4b73-b3e3-0ea20206f588 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:50.555500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-971498ce-b6d4-4b73-b3e3-0ea20206f588 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:50.564769 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-971498ce-b6d4-4b73-b3e3-0ea20206f588 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1217 microversion: 2.1 time: 0.069471 Oct 31 16:15:50.565387 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3326/6796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:50 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:51.536995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e7a0f16d-1418-4407-ad62-60a4cd17a883 req-4b2d3546-7e6d-4642-87f8-341d56b1e0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edc0a9e-a851-4dae-9cdf-b004f04b9b29", "name": "network-vif-deleted", "tag": "6c8430ed-b96a-4516-9eaa-3ad60653916a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:51.557812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e7a0f16d-1418-4407-ad62-60a4cd17a883 req-4b2d3546-7e6d-4642-87f8-341d56b1e0c6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:51.558677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e7a0f16d-1418-4407-ad62-60a4cd17a883 req-4b2d3546-7e6d-4642-87f8-341d56b1e0c6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:51.559316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e7a0f16d-1418-4407-ad62-60a4cd17a883 req-4b2d3546-7e6d-4642-87f8-341d56b1e0c6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:51.586498 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e7a0f16d-1418-4407-ad62-60a4cd17a883 req-4b2d3546-7e6d-4642-87f8-341d56b1e0c6 service nova] Creating event network-vif-deleted:6c8430ed-b96a-4516-9eaa-3ad60653916a for instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 on n-h1-858384-17 Oct 31 16:15:51.588988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:51.589645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:51.593027 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e7a0f16d-1418-4407-ad62-60a4cd17a883 req-4b2d3546-7e6d-4642-87f8-341d56b1e0c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061925 Oct 31 16:15:51.594111 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3471/6797] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:51.605717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:51.606238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:51.606693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:51.607428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:51.607900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:51.608347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:51.718225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:51.729855 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06d572c3-680f-4b65-a314-df76eebcbd92 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1277 microversion: 2.1 time: 0.145605 Oct 31 16:15:51.733974 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3327/6798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:51 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:52.756131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:52.756938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:52.764024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:52.764512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:52.764948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:52.765680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:52.766137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:52.766559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:52.900050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:52.908066 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-809f910d-8b6b-4077-8f6c-34aca06556ea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1317 microversion: 2.1 time: 0.157164 Oct 31 16:15:52.908661 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3472/6799] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:52 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:53.106747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-49af707e-6b14-4078-ade4-d80d223f61e8 req-6add4a01-6721-4fdc-886b-88372fc3a978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd7d667-a269-44e4-b2b2-7c374b206ee9", "tag": "29866503-6986-4cfb-8ac5-6058f576e13a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:53.116264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-49af707e-6b14-4078-ade4-d80d223f61e8 req-6add4a01-6721-4fdc-886b-88372fc3a978 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:53.116851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-49af707e-6b14-4078-ade4-d80d223f61e8 req-6add4a01-6721-4fdc-886b-88372fc3a978 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:53.117957 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-49af707e-6b14-4078-ade4-d80d223f61e8 req-6add4a01-6721-4fdc-886b-88372fc3a978 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:53.129374 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-49af707e-6b14-4078-ade4-d80d223f61e8 req-6add4a01-6721-4fdc-886b-88372fc3a978 service nova] Creating event network-changed:29866503-6986-4cfb-8ac5-6058f576e13a for instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 on n-h1-858384-17 Oct 31 16:15:53.134669 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-49af707e-6b14-4078-ade4-d80d223f61e8 req-6add4a01-6721-4fdc-886b-88372fc3a978 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088487 Oct 31 16:15:53.135278 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3328/6800] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:53.932216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:53.932839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:53.939977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:53.940472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:53.940913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:53.941662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:53.942119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:53.942548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:54.093999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:54.102471 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65ef0632-a650-4dbb-bbc6-7e4bfdc27866 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1317 microversion: 2.1 time: 0.173785 Oct 31 16:15:54.103075 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3473/6801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:53 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:55.127395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:55.128014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:55.134766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:55.135255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:55.135702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:55.136400 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:55.136867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:55.137343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:55.270389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:55.278672 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-326104ea-5970-47f5-8722-13adb66641a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1317 microversion: 2.1 time: 0.156801 Oct 31 16:15:55.279242 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3329/6802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:55 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:56.301514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:56.302118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:56.309048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:56.309556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:56.309988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:56.310681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:56.311137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:56.311561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:56.443848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:56.451543 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f820cb3d-039e-431e-ac93-a2cbf78c0cea tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1317 microversion: 2.1 time: 0.153891 Oct 31 16:15:56.452134 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3474/6803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:56 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:57.474974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:57.475594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:57.482448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:57.482937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:57.483377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:57.484225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:57.484694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:57.485135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:57.614144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:57.622003 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0d057a92-2099-41be-9a53-7e3ab2f8f679 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1317 microversion: 2.1 time: 0.150970 Oct 31 16:15:57.622576 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3330/6804] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:57 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:15:58.550994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-feaf2d3c-b92d-4f76-ad4d-d307577f141a req-2e0e651b-af55-4435-a109-a4e7f2c9f55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd7d667-a269-44e4-b2b2-7c374b206ee9", "name": "network-vif-plugged", "status": "completed", "tag": "29866503-6986-4cfb-8ac5-6058f576e13a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:15:58.562628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-feaf2d3c-b92d-4f76-ad4d-d307577f141a req-2e0e651b-af55-4435-a109-a4e7f2c9f55d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:58.563142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-feaf2d3c-b92d-4f76-ad4d-d307577f141a req-2e0e651b-af55-4435-a109-a4e7f2c9f55d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:58.563536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-feaf2d3c-b92d-4f76-ad4d-d307577f141a req-2e0e651b-af55-4435-a109-a4e7f2c9f55d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:58.575807 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-feaf2d3c-b92d-4f76-ad4d-d307577f141a req-2e0e651b-af55-4435-a109-a4e7f2c9f55d service nova] Creating event network-vif-plugged:29866503-6986-4cfb-8ac5-6058f576e13a for instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 on n-h1-858384-17 Oct 31 16:15:58.580966 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-feaf2d3c-b92d-4f76-ad4d-d307577f141a req-2e0e651b-af55-4435-a109-a4e7f2c9f55d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033734 Oct 31 16:15:58.581614 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3475/6805] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:15:58.646170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:58.646720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:58.654452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:58.654950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:58.655396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:58.656107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:58.656576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:58.657013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:58.816818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:15:58.824995 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f7b087c6-7780-4b87-aacb-873a79c539a8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1317 microversion: 2.1 time: 0.182749 Oct 31 16:15:58.825606 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3331/6806] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:58 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:15:59.849939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:15:59.850541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:15:59.856645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:59.857137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:59.857579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:59.858270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:15:59.858720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:15:59.859141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:15:59.995859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:00.003793 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a95eb816-2113-42b2-a845-cce86e4c8317 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1506 microversion: 2.1 time: 0.159026 Oct 31 16:16:00.004366 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3476/6807] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:15:59 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:00.026380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:00.027080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:00.033772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:00.034342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:00.034783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:00.035484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:00.035949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:00.036382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:00.164482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:00.172291 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9af24b04-3c35-4b68-914f-046fdc65ea89 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1506 microversion: 2.1 time: 0.149829 Oct 31 16:16:00.172872 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3332/6808] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:00 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:00.196688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:00.199853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:00.205928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:00.206409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:00.206841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:00.207528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:00.207979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:00.208399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:00.238946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:00.245010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Old instance type m1.heat2, new instance type m1.heat {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:16:00.251743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:16:00.252160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:16:00.252628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:16:00.253033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:16:00.253465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:16:00.268887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:00.316751 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a4a8de2-3cf1-4a66-938f-19ba14548821 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "POST /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9/action" status: 202 len: 0 microversion: 2.1 time: 0.124013 Oct 31 16:16:00.317852 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3477/6809] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:16:00 2022] POST /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:16:00.326143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:00.326715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:00.332650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:00.333158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:00.333621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:00.334353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:00.334819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:00.335254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:00.500300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:00.508422 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3887ade6-4de2-4631-af5a-6911e0e8cbf2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1513 microversion: 2.1 time: 0.186377 Oct 31 16:16:00.508997 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3333/6810] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:00 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:01.529075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:01.529887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:01.535604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:01.536219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:01.544631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:01.545043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:01.545503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:01.546584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:01.547038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:01.547461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:01.685045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:01.692694 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e9d217b9-aeec-456f-84ff-030b01ad16cd tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1513 microversion: 2.1 time: 0.164355 Oct 31 16:16:01.693541 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3478/6811] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:01 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:02.716942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:02.717594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:02.719541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:02.725458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:02.725949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:02.726392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:02.727086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:02.727550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:02.727980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:02.858852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:02.866492 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58acd245-88c3-42a5-85d9-06054c2039bb tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.153721 Oct 31 16:16:02.867068 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3334/6812] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:02 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:03.891437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:03.891965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:03.898654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:03.899153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:03.899583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:03.900268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:03.900742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:03.901190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:04.029970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:04.037627 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b055fe13-20c3-4580-a806-14ed07c9f327 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.150095 Oct 31 16:16:04.038207 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3479/6813] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:03 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:05.062272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:05.062894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:05.069652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:05.070150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:05.070595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:05.071292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:05.071761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:05.072192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:05.214088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:05.221984 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-db26c0f8-04c6-464c-a111-d1d22270c8fc tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.164215 Oct 31 16:16:05.222573 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3335/6814] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:05 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:06.245315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:06.245982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:06.253461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:06.253937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:06.254368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:06.255047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:06.255496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:06.255915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:06.388566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:06.396315 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9c28cf44-8069-4344-aa42-f199431c90b4 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.154934 Oct 31 16:16:06.396897 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3480/6815] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:06 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:07.420237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:07.420948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:07.427674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:07.428189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:07.428612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:07.429346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:07.429812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:07.430248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:07.559883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:07.568062 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-eb524ea6-0cfb-45ec-b0fc-ec55d87934b8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.152336 Oct 31 16:16:07.568642 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3336/6816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:07 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:08.592466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:08.593108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:08.599975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:08.600493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:08.600929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:08.601651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:08.602106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:08.602529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:08.731973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:08.739755 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d2e73287-3938-4c48-96aa-ef3e17895af0 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.152046 Oct 31 16:16:08.740329 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3481/6817] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:08 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:09.763255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:09.763904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:09.771251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:09.771755 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:09.772210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:09.772949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:09.773456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:09.773901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:09.907983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:09.915741 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e1dc8901-66ab-4810-97aa-aeb9230eef56 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.156372 Oct 31 16:16:09.916320 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3337/6818] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:09 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:10.940303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:10.941294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:10.948736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:10.949258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:10.949699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:10.950401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:10.950860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:10.951320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:11.085372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:11.093677 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3d99e490-c225-4465-b77f-5fcc09c7517c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.157427 Oct 31 16:16:11.094266 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3482/6819] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:10 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:12.117525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:12.118147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:12.125206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.125701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.126145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.126845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:12.127307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:12.127742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:12.262639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:12.270511 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8d6e6985-8c46-4fdd-9390-33f9b6361e38 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.157012 Oct 31 16:16:12.271093 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3338/6820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:12 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:13.294233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:13.294810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:13.301527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:13.302007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:13.302434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:13.303114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:13.303563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:13.303984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:13.435585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:13.443570 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f2dddb37-ff53-49db-8538-236459b71a33 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.153464 Oct 31 16:16:13.444149 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3483/6821] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:13 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:14.467070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:14.467608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:14.474506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:14.475002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:14.475442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:14.476136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:14.476602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:14.477033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:14.612505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:14.620398 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-218c6196-fa69-45c0-ba2c-029d93fb7b87 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.157289 Oct 31 16:16:14.621027 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3339/6822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:14 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:15.644404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:15.645007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:15.653894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:15.654372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:15.654802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:15.655486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:15.655939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:15.656368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:15.787743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:15.795422 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7ec75618-4efb-4f0f-81ac-209dba2bbb12 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.155546 Oct 31 16:16:15.795999 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3484/6823] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:15 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:16.818662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:16.819291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:16.826145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:16.826639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:16.827092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:16.827783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:16.828247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:16.828678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:16.843566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:16.964096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:16.972606 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b68068a-391d-43fc-8bc2-01d3c3220f93 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.157816 Oct 31 16:16:16.973307 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3340/6824] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:16 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:17.995913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:17.996501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:17.999272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:18.005372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:18.005856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:18.006288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:18.007229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:18.007680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:18.008110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:18.141158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:18.148833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e85f97c7-21ba-4188-8e7a-28d1f067785f tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.156827 Oct 31 16:16:18.149451 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3485/6825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:17 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:19.172456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:19.173074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:19.176015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:19.181685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:19.182193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:19.182636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:19.183337 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:19.183891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:19.184331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:19.316955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:19.324605 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59e4cc1f-fc02-487c-8bca-b97c784ab600 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.156362 Oct 31 16:16:19.325206 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3341/6826] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:19 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:20.348921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:20.349548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:20.356287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:20.356762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:20.357228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:20.357909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:20.358359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:20.358776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:20.490883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:20.498482 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd2fc49e-8c50-4e48-909e-4892964ba5f8 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.154081 Oct 31 16:16:20.499066 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3486/6827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:20 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:21.521894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:21.522512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:21.525219 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:16:21.525363 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:16:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 (ip 10.222.0.20) !!! Oct 31 16:16:21.531236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:21.531749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:21.532195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:21.532893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:21.533394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:21.533816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:21.671194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:21.679877 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ca5578eb-20b7-417a-828f-79f810c87b97 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.161968 Oct 31 16:16:21.680472 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3342/6828] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:21 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:22.703513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:22.704121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:22.711828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:22.712310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:22.712750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:22.713460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:22.713917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:22.714339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:22.847072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:22.855561 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-32faaadf-88c5-4858-bafa-2c922890f56c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.155903 Oct 31 16:16:22.856141 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3487/6829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:22 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:23.879828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:23.880366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:23.888019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:23.888516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:23.888960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:23.889681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:23.890147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:23.890582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:24.020452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:24.029026 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c8985f5-ff47-443b-aa3a-6b62f91f7e2c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.153104 Oct 31 16:16:24.029641 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3343/6830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:23 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:25.052897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:25.053766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:25.060699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:25.061214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:25.061653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:25.062340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:25.062795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:25.063219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:25.193433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:25.201241 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a0022a83-eeca-489f-bcdc-3f7ffb04f4c1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.152200 Oct 31 16:16:25.201854 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3488/6831] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:25 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:26.225028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:26.226223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:26.233091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:26.233617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:26.234083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:26.234767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:26.235238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:26.235715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:26.370717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:26.378343 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa0ecf27-997f-4b22-a343-63a0f0d8111c tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.157178 Oct 31 16:16:26.378914 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3344/6832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:26 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:27.402544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:27.403147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:27.410773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:27.411319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:27.411755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:27.412459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:27.412916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:27.413415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:27.549316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:27.557666 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19111f12-e2ff-4c2e-b52d-47a983412a30 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.159288 Oct 31 16:16:27.558268 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3489/6833] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:27 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:28.581244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:28.581869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:28.589497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:28.589989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:28.590430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:28.591128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:28.591591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:28.592026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:28.720856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:28.728502 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-79c3a225-c81a-46d2-a595-9df72ffbc947 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1518 microversion: 2.1 time: 0.151077 Oct 31 16:16:28.729074 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3345/6834] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:28 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:29.493654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-46beb3a6-91a0-48c4-8115-486cd0ba6958 req-bb6dbc90-0084-41df-a896-cdc2c0c6b3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd7d667-a269-44e4-b2b2-7c374b206ee9", "name": "network-vif-unplugged", "status": "completed", "tag": "29866503-6986-4cfb-8ac5-6058f576e13a"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:29.504412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-46beb3a6-91a0-48c4-8115-486cd0ba6958 req-bb6dbc90-0084-41df-a896-cdc2c0c6b3a7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:29.504893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-46beb3a6-91a0-48c4-8115-486cd0ba6958 req-bb6dbc90-0084-41df-a896-cdc2c0c6b3a7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:29.505375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-46beb3a6-91a0-48c4-8115-486cd0ba6958 req-bb6dbc90-0084-41df-a896-cdc2c0c6b3a7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:29.752384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:29.753098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:29.760292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:29.761050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:29.761528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:29.762248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:29.762717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:29.763157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:29.786866 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-46beb3a6-91a0-48c4-8115-486cd0ba6958 req-bb6dbc90-0084-41df-a896-cdc2c0c6b3a7 service nova] Creating event network-vif-unplugged:29866503-6986-4cfb-8ac5-6058f576e13a for instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 on n-h2-858384-17 Oct 31 16:16:29.801425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-46beb3a6-91a0-48c4-8115-486cd0ba6958 req-bb6dbc90-0084-41df-a896-cdc2c0c6b3a7 service nova] Instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:16:29.820868 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-46beb3a6-91a0-48c4-8115-486cd0ba6958 req-bb6dbc90-0084-41df-a896-cdc2c0c6b3a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.329838 Oct 31 16:16:29.821946 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3490/6835] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:29.934730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:29.942873 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f1025bc4-4f81-420d-a525-dc6c41301f49 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1517 microversion: 2.1 time: 0.194355 Oct 31 16:16:29.943451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3346/6836] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:29 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:16:30.968941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:30.969583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:30.975687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:30.976171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:30.976609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:30.978145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:30.978609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:30.979037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:30.983520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:31.117508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:31.125261 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8f7559d2-91ca-4f7d-9eb9-06a32b683909 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1515 microversion: 2.1 time: 0.161449 Oct 31 16:16:31.125833 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3491/6837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:30 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:31.844370 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-788af56e-4b0c-4eac-a445-4907a2fd7891 req-05158b9c-5276-4dab-8688-317f5b921d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd7d667-a269-44e4-b2b2-7c374b206ee9", "tag": "29866503-6986-4cfb-8ac5-6058f576e13a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:31.854492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-788af56e-4b0c-4eac-a445-4907a2fd7891 req-05158b9c-5276-4dab-8688-317f5b921d6e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:31.854978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-788af56e-4b0c-4eac-a445-4907a2fd7891 req-05158b9c-5276-4dab-8688-317f5b921d6e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:31.855415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-788af56e-4b0c-4eac-a445-4907a2fd7891 req-05158b9c-5276-4dab-8688-317f5b921d6e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:31.866743 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-788af56e-4b0c-4eac-a445-4907a2fd7891 req-05158b9c-5276-4dab-8688-317f5b921d6e service nova] Creating event network-changed:29866503-6986-4cfb-8ac5-6058f576e13a for instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 on n-h2-858384-17 Oct 31 16:16:31.872563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-788af56e-4b0c-4eac-a445-4907a2fd7891 req-05158b9c-5276-4dab-8688-317f5b921d6e service nova] Instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:16:31.884154 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-788af56e-4b0c-4eac-a445-4907a2fd7891 req-05158b9c-5276-4dab-8688-317f5b921d6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042811 Oct 31 16:16:31.884776 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3347/6838] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:32.150052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:32.150709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:32.157796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:32.158288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:32.158719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:32.159820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:32.160488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:32.161161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:32.398283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:32.406779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-86b50b9f-edf0-41da-ad55-b776594a620e tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1512 microversion: 2.1 time: 0.261348 Oct 31 16:16:32.407705 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3492/6839] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:32 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1512 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:32.431898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d638ba8d-4f92-4e8b-925b-88d681a39556 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:32.432542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d638ba8d-4f92-4e8b-925b-88d681a39556 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:32.438735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d638ba8d-4f92-4e8b-925b-88d681a39556 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:32.439243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d638ba8d-4f92-4e8b-925b-88d681a39556 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:32.439702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d638ba8d-4f92-4e8b-925b-88d681a39556 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:32.440425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d638ba8d-4f92-4e8b-925b-88d681a39556 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:32.440890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d638ba8d-4f92-4e8b-925b-88d681a39556 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:32.441368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d638ba8d-4f92-4e8b-925b-88d681a39556 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:32.501038 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d638ba8d-4f92-4e8b-925b-88d681a39556 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "POST /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9/action" status: 204 len: 0 microversion: 2.1 time: 0.073999 Oct 31 16:16:32.502095 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3348/6840] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:16:32 2022] POST /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:16:32.514789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:32.521037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:32.532751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:32.536775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:32.538748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:32.540744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:32.542862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:32.543379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:32.714252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:32.724504 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a501a7e3-7744-4ce0-9dc8-b0abecdaf0f1 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1512 microversion: 2.1 time: 0.217670 Oct 31 16:16:32.725099 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3493/6841] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:32 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:33.750229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:33.750943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:33.757182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:33.757686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:33.758136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:33.758912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:33.759379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:33.759820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:33.894968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:33.902720 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a59e7735-41c1-45b0-83f2-7284ae4330ee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1504 microversion: 2.1 time: 0.158407 Oct 31 16:16:33.903293 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3349/6842] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:33 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:33.925823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:33.926441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:33.933850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:33.934343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:33.934778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:33.935477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:33.935937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:33.936367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.064673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:34.072503 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-94fb07e5-b55f-4055-beab-e40556113ef3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1504 microversion: 2.1 time: 0.150492 Oct 31 16:16:34.073082 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3494/6843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:33 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:34.094919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:34.095476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:34.101438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.101936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.102385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.103761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.104243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.104686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.232139 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:34.239954 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6bd99f3d-d05c-4d76-a516-56887f418dee tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1504 microversion: 2.1 time: 0.148910 Oct 31 16:16:34.240534 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3350/6844] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:34 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:34.263964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:34.264459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:34.270427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.270904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.271332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.272018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.272466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.272885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.298293 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:16:34.375620 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec76ca16-c871-4be3-87a8-2a31b1e552ed tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 204 len: 0 microversion: 2.1 time: 0.116366 Oct 31 16:16:34.376302 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3495/6845] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:16:34 2022] DELETE /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:16:34.392444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:34.392961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:34.399017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.399581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.400034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.400743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.401244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.401686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.429782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:16:34.473445 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.compute.api [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Instance is already in deleting state, ignoring this request Oct 31 16:16:34.474290 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7f74f3e3-d9f8-4908-9d9e-484e9fcac1ec tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 204 len: 0 microversion: 2.1 time: 0.085777 Oct 31 16:16:34.474854 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3351/6846] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:16:34 2022] DELETE /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:16:34.484035 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:34.484743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:34.490706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.491201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.491643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.492337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.492797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.493266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.627109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:34.635427 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-654ee325-8e24-46c4-b6cf-e387ce9d82e3 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1510 microversion: 2.1 time: 0.155556 Oct 31 16:16:34.636032 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3496/6847] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:34 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:16:34.732667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-41761b06-f1ff-439a-93ee-7e11b304555e req-5059d2be-e597-42b4-9240-b11d51936451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd7d667-a269-44e4-b2b2-7c374b206ee9", "name": "network-vif-plugged", "status": "completed", "tag": "29866503-6986-4cfb-8ac5-6058f576e13a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:34.742443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41761b06-f1ff-439a-93ee-7e11b304555e req-5059d2be-e597-42b4-9240-b11d51936451 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:34.742946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41761b06-f1ff-439a-93ee-7e11b304555e req-5059d2be-e597-42b4-9240-b11d51936451 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:34.743434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-41761b06-f1ff-439a-93ee-7e11b304555e req-5059d2be-e597-42b4-9240-b11d51936451 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:34.754964 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-41761b06-f1ff-439a-93ee-7e11b304555e req-5059d2be-e597-42b4-9240-b11d51936451 service nova] Creating event network-vif-plugged:29866503-6986-4cfb-8ac5-6058f576e13a for instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 on n-h2-858384-17 Oct 31 16:16:34.760245 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-41761b06-f1ff-439a-93ee-7e11b304555e req-5059d2be-e597-42b4-9240-b11d51936451 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032327 Oct 31 16:16:34.760848 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3352/6848] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:35.658691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:35.659350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:35.666345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:35.666833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:35.667270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:35.667963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:35.668424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:35.668850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:35.826207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e14118ace807403390ff791b0e61b610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a22744b75fc484cbf5fb017340c07ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:35.834002 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bb3940f0-980a-4097-97ed-41b3562384f5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 200 len: 1510 microversion: 2.1 time: 0.179117 Oct 31 16:16:35.834519 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3497/6849] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:35 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:36.592391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-466432d5-7709-4fe5-acb9-9d7eaba3f4b2 req-7c40c1cd-5f48-4c89-9c80-03cdbb134200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd7d667-a269-44e4-b2b2-7c374b206ee9", "name": "network-vif-deleted", "tag": "29866503-6986-4cfb-8ac5-6058f576e13a"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:36.602391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-466432d5-7709-4fe5-acb9-9d7eaba3f4b2 req-7c40c1cd-5f48-4c89-9c80-03cdbb134200 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:36.602883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-466432d5-7709-4fe5-acb9-9d7eaba3f4b2 req-7c40c1cd-5f48-4c89-9c80-03cdbb134200 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:36.603915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-466432d5-7709-4fe5-acb9-9d7eaba3f4b2 req-7c40c1cd-5f48-4c89-9c80-03cdbb134200 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:36.616062 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-466432d5-7709-4fe5-acb9-9d7eaba3f4b2 req-7c40c1cd-5f48-4c89-9c80-03cdbb134200 service nova] Creating event network-vif-deleted:29866503-6986-4cfb-8ac5-6058f576e13a for instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 on n-h2-858384-17 Oct 31 16:16:36.622063 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-466432d5-7709-4fe5-acb9-9d7eaba3f4b2 req-7c40c1cd-5f48-4c89-9c80-03cdbb134200 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034750 Oct 31 16:16:36.622679 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3353/6850] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:36.858947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:36.859579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 8cd7d667-a269-44e4-b2b2-7c374b206ee9] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:36.866107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:36.866597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:36.867041 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:36.867739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:36.868203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:36.868632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:36.882863 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] HTTP exception thrown: Instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 could not be found. Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Request method failure captured: Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 HTTP/1.1 Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_SED4vSQs--10Of1hOLuEkrsTrZ-oyCXP5IcJbqlRTYDDr8_gAVBNtjOPkv_B0cnr5K2-Hg6B4CvqZlNuz-4yRzpPAAho0EoWglvnpf-QZgAKOXvzUwh-EH0HEeytl_63QFq391pWI89d8u6Ve277vZApvJdcsbOE3BVZ_hJsHooCw Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 0a22744b75fc484cbf5fb017340c07ef Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1377268006 Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a22744b75fc484cbf5fb017340c07ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a22744b75fc484cbf5fb017340c07ef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a22744b75fc484cbf5fb017340c07ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a22744b75fc484cbf5fb017340c07ef"}]}] Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerDiskConfigTestJSON-1377268006 Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 0a22744b75fc484cbf5fb017340c07ef Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1377268006 Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerDiskConfigTestJSON-1377268006-project Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e14118ace807403390ff791b0e61b610 Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerDiskConfigTestJSON-1377268006-project Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 could not be found. Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8cd7d667-a269-44e4-b2b2-7c374b206ee9'} Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 could not be found. Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 could not be found. Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:16:36.884520 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 could not be found. Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Returning 404 to user: Instance 8cd7d667-a269-44e4-b2b2-7c374b206ee9 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d73c783d-1991-427b-bd75-ffdec38ed6b5 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9" status: 404 len: 111 microversion: 2.1 time: 0.031216 Oct 31 16:16:36.890294 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3498/6851] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:36 2022] GET /compute/v2.1/servers/8cd7d667-a269-44e4-b2b2-7c374b206ee9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:16:36.895521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3edfbb5e-9a97-463e-bfe2-5ee4e5bd4683 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '.version_select at 0x7f16e0084940>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:36.918714 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3edfbb5e-9a97-463e-bfe2-5ee4e5bd4683 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805103459" status: 202 len: 0 microversion: 2.1 time: 0.027204 Oct 31 16:16:36.919304 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3354/6852] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Oct 31 16:16:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805103459 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:16:37.535480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:37.535974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:37.542650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:37.543128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:37.543560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:37.544245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:37.544698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:37.545119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:37.558842 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] HTTP exception thrown: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Request method failure captured: Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 HTTP/1.1 Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_SED4vSQs--10Of1hOLuEkrsTrZ-oyCXP5IcJbqlRTYDDr8_gAVBNtjOPkv_B0cnr5K2-Hg6B4CvqZlNuz-4yRzpPAAho0EoWglvnpf-QZgAKOXvzUwh-EH0HEeytl_63QFq391pWI89d8u6Ve277vZApvJdcsbOE3BVZ_hJsHooCw Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 0a22744b75fc484cbf5fb017340c07ef Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1377268006 Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a22744b75fc484cbf5fb017340c07ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a22744b75fc484cbf5fb017340c07ef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a22744b75fc484cbf5fb017340c07ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a22744b75fc484cbf5fb017340c07ef"}]}] Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerDiskConfigTestJSON-1377268006 Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 0a22744b75fc484cbf5fb017340c07ef Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1377268006 Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerDiskConfigTestJSON-1377268006-project Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: e14118ace807403390ff791b0e61b610 Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerDiskConfigTestJSON-1377268006-project Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '7edc0a9e-a851-4dae-9cdf-b004f04b9b29'} Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:16:37.560359 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.564831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Returning 404 to user: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:16:37.566278 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d3a7b3a7-3c6d-4279-b9c1-434e76ae7fab tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 404 len: 111 microversion: 2.1 time: 0.030405 Oct 31 16:16:37.566868 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3499/6853] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:16:37 2022] DELETE /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:16:37.574949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:37.575693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] [instance: 7edc0a9e-a851-4dae-9cdf-b004f04b9b29] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:37.581883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:37.582417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:37.582873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:37.583575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:37.584046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:37.584484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:37.597818 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] HTTP exception thrown: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Request method failure captured: Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 HTTP/1.1 Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_SED4vSQs--10Of1hOLuEkrsTrZ-oyCXP5IcJbqlRTYDDr8_gAVBNtjOPkv_B0cnr5K2-Hg6B4CvqZlNuz-4yRzpPAAho0EoWglvnpf-QZgAKOXvzUwh-EH0HEeytl_63QFq391pWI89d8u6Ve277vZApvJdcsbOE3BVZ_hJsHooCw Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 0a22744b75fc484cbf5fb017340c07ef Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1377268006 Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a22744b75fc484cbf5fb017340c07ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0a22744b75fc484cbf5fb017340c07ef", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0a22744b75fc484cbf5fb017340c07ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0a22744b75fc484cbf5fb017340c07ef"}]}] Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerDiskConfigTestJSON-1377268006 Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 0a22744b75fc484cbf5fb017340c07ef Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1377268006 Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerDiskConfigTestJSON-1377268006-project Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: e14118ace807403390ff791b0e61b610 Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerDiskConfigTestJSON-1377268006-project Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '7edc0a9e-a851-4dae-9cdf-b004f04b9b29'} Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:16:37.599454 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] Returning 404 to user: Instance 7edc0a9e-a851-4dae-9cdf-b004f04b9b29 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ad190c09-e20f-4e46-b46a-3cf0a49215a2 tempest-ServerDiskConfigTestJSON-1377268006 tempest-ServerDiskConfigTestJSON-1377268006-project] 10.222.0.20 "GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29" status: 404 len: 111 microversion: 2.1 time: 0.029857 Oct 31 16:16:37.604763 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3355/6854] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:37 2022] GET /compute/v2.1/servers/7edc0a9e-a851-4dae-9cdf-b004f04b9b29 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:16:46.598183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cd8b85ed-3dd1-42fb-af5a-f235d3c3f5c1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'create', calling method: .version_select at 0x7f16e0036e50>, body: {"keypair": {"name": "tempest-keypair-1205507471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPYIL4R5E51+09Fh5jqBLJIGqk9nGg0h4mN/Nq49Ye4w9UH+BQb9eZN0LKmAjMsm58UW9rDMp0jj09OhpVBcFWQxR3CMEn8lusl7nQFXb9W8NuSusFvdYfr3yiWM66a3g=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:46.616731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-cd8b85ed-3dd1-42fb-af5a-f235d3c3f5c1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:16:46.622218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-cd8b85ed-3dd1-42fb-af5a-f235d3c3f5c1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for user caa0eaf7405a4edaa9961792a2efdd0b and project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:16:46.654240 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cd8b85ed-3dd1-42fb-af5a-f235d3c3f5c1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190317 Oct 31 16:16:46.654865 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3500/6855] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:16:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:47.965390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1863862359", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e277981e-27eb-4f80-bff7-dce3df886165"}], "security_groups": [{"name": "tempest-securitygroup--556064750"}], "key_name": "tempest-keypair-1205507471", "user_data": "}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:47.976340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:47.977048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:48.081527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] validate_networks() for [('e277981e-27eb-4f80-bff7-dce3df886165', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:16:48.541754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:16:48.542223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:16:48.542708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:16:48.543131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:16:48.543586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:16:48.555473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:48.555979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:48.556431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:48.557223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:48.557695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:48.558130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:48.579414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:16:48.585234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for user caa0eaf7405a4edaa9961792a2efdd0b and project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:16:48.598934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:16:48.601304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:16:48.669569 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e658c438-a68d-40fe-9174-886e87c42bfa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.705411 Oct 31 16:16:48.670937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3356/6856] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:16:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:16:48.683825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f84dfa1-fdc4-427f-a4c2-948d7a02ef86 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:48.684686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f84dfa1-fdc4-427f-a4c2-948d7a02ef86 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:48.689823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:48.690624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:48.782410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f84dfa1-fdc4-427f-a4c2-948d7a02ef86 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:48.790462 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f84dfa1-fdc4-427f-a4c2-948d7a02ef86 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1239 microversion: 2.1 time: 0.112020 Oct 31 16:16:48.791682 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3501/6857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:48 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1239 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:49.816721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:49.817368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:49.823523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:49.824021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:49.824470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:49.825197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:49.825670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:49.826708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:49.895515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:49.903310 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bbe3c3ae-0926-44dc-b20c-3490df64b068 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1291 microversion: 2.1 time: 0.091578 Oct 31 16:16:49.904136 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3357/6858] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:49 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1291 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:50.927291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:50.927911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:50.935217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:50.936273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:50.936715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:50.937646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:50.938110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:50.938545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:51.080404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:51.090012 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bebb91be-c4d8-4a5e-9a5c-08f15068d382 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1364 microversion: 2.1 time: 0.166891 Oct 31 16:16:51.090593 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3502/6859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:50 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:51.376828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-1b18a65a-87be-4131-9a1f-038ce7db4956 req-bc4f350a-1cd3-4cf7-9e86-3b77e3856f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf", "tag": "455bc006-50cb-440c-add5-fe019e5f272d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:51.388464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1b18a65a-87be-4131-9a1f-038ce7db4956 req-bc4f350a-1cd3-4cf7-9e86-3b77e3856f2e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:51.389011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1b18a65a-87be-4131-9a1f-038ce7db4956 req-bc4f350a-1cd3-4cf7-9e86-3b77e3856f2e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:51.389472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-1b18a65a-87be-4131-9a1f-038ce7db4956 req-bc4f350a-1cd3-4cf7-9e86-3b77e3856f2e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:51.401708 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-1b18a65a-87be-4131-9a1f-038ce7db4956 req-bc4f350a-1cd3-4cf7-9e86-3b77e3856f2e service nova] Creating event network-changed:455bc006-50cb-440c-add5-fe019e5f272d for instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf on n-h1-858384-17 Oct 31 16:16:51.407534 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-1b18a65a-87be-4131-9a1f-038ce7db4956 req-bc4f350a-1cd3-4cf7-9e86-3b77e3856f2e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036201 Oct 31 16:16:51.408369 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3358/6860] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:16:52.113694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:52.114300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:52.121253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:52.121734 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:52.122167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:52.122878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:52.123874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:52.124395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:52.256938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:52.265495 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ef277412-12d3-466c-af40-8871e69361b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1364 microversion: 2.1 time: 0.155721 Oct 31 16:16:52.266075 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3503/6861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:52 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:53.290725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:53.291446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:53.297657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:53.298152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:53.298604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:53.299304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:53.299774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:53.300209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:53.429834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:53.437997 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75071a1f-0b0a-4a93-8dae-6eadb60aca97 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1364 microversion: 2.1 time: 0.152506 Oct 31 16:16:53.438581 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3359/6862] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:53 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:54.461827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:54.462440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:54.471271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:54.471752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:54.472185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:54.472883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:54.473361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:54.473786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:54.617950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:54.626825 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe2cc4e6-f0e7-4d24-913c-98233b64df10 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1364 microversion: 2.1 time: 0.168897 Oct 31 16:16:54.627431 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3504/6863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:54 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:55.650623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:55.651182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:55.658331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:55.658831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:55.659284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:55.659990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:55.660462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:55.660906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:55.797289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:55.804959 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73599977-03aa-498d-a074-bad74313581c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1364 microversion: 2.1 time: 0.158327 Oct 31 16:16:55.805576 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3360/6864] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:55 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:56.828042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:56.828840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:56.836015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:56.836507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:56.836940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:56.837696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:56.838154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:56.838577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:56.879717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bdd0ca5a-2d89-4baf-9d19-c922739cd423 req-c893135b-924d-4b4f-8dfc-17c9c4f028a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf", "name": "network-vif-plugged", "status": "completed", "tag": "455bc006-50cb-440c-add5-fe019e5f272d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:16:56.891639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bdd0ca5a-2d89-4baf-9d19-c922739cd423 req-c893135b-924d-4b4f-8dfc-17c9c4f028a3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:56.892133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bdd0ca5a-2d89-4baf-9d19-c922739cd423 req-c893135b-924d-4b4f-8dfc-17c9c4f028a3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:56.892900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bdd0ca5a-2d89-4baf-9d19-c922739cd423 req-c893135b-924d-4b4f-8dfc-17c9c4f028a3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:56.907414 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bdd0ca5a-2d89-4baf-9d19-c922739cd423 req-c893135b-924d-4b4f-8dfc-17c9c4f028a3 service nova] Creating event network-vif-plugged:455bc006-50cb-440c-add5-fe019e5f272d for instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf on n-h1-858384-17 Oct 31 16:16:56.915351 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bdd0ca5a-2d89-4baf-9d19-c922739cd423 req-c893135b-924d-4b4f-8dfc-17c9c4f028a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040407 Oct 31 16:16:56.916502 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3361/6865] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:16:56.983757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:56.994446 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-197cf7bb-091b-4075-8024-84d62c79636d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1364 microversion: 2.1 time: 0.169923 Oct 31 16:16:57.000302 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3505/6866] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:56 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:58.021789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:58.022539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:58.030187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:58.030738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:58.031723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:58.032694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:58.033267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:58.035017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:58.174356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:58.182362 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c4a30a03-fd19-43df-9d51-a0d98cf46c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1364 microversion: 2.1 time: 0.167201 Oct 31 16:16:58.182944 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3362/6867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:58 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:16:59.206151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:59.206675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:59.209331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:59.214701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:59.215181 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:59.215614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:59.216308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:59.216756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:59.217198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:59.348341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:16:59.357211 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-363bd670-3cdd-4a04-99b0-5a2a63b6964d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1550 microversion: 2.1 time: 0.154721 Oct 31 16:16:59.357801 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3506/6868] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:16:59 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:16:59.381379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5eade938-4daf-4a18-9288-0a1cfb139f1c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:16:59.381886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5eade938-4daf-4a18-9288-0a1cfb139f1c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:16:59.383889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:59.384565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:16:59.391202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eade938-4daf-4a18-9288-0a1cfb139f1c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:59.392013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eade938-4daf-4a18-9288-0a1cfb139f1c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:59.392473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eade938-4daf-4a18-9288-0a1cfb139f1c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:59.393213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eade938-4daf-4a18-9288-0a1cfb139f1c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:16:59.393688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eade938-4daf-4a18-9288-0a1cfb139f1c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:16:59.394127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5eade938-4daf-4a18-9288-0a1cfb139f1c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:16:59.473438 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5eade938-4daf-4a18-9288-0a1cfb139f1c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095864 Oct 31 16:16:59.474082 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3363/6869] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 16:16:59 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:00.722673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-aeaa5a9d-3d75-45ff-ac9b-e4fe51856c0d req-0ec39bf3-cf8f-4c40-8732-4470d56ebc24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf", "tag": "455bc006-50cb-440c-add5-fe019e5f272d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:00.732703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aeaa5a9d-3d75-45ff-ac9b-e4fe51856c0d req-0ec39bf3-cf8f-4c40-8732-4470d56ebc24 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:00.733214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aeaa5a9d-3d75-45ff-ac9b-e4fe51856c0d req-0ec39bf3-cf8f-4c40-8732-4470d56ebc24 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:00.733646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-aeaa5a9d-3d75-45ff-ac9b-e4fe51856c0d req-0ec39bf3-cf8f-4c40-8732-4470d56ebc24 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:00.744627 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-aeaa5a9d-3d75-45ff-ac9b-e4fe51856c0d req-0ec39bf3-cf8f-4c40-8732-4470d56ebc24 service nova] Creating event network-changed:455bc006-50cb-440c-add5-fe019e5f272d for instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf on n-h1-858384-17 Oct 31 16:17:00.749706 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-aeaa5a9d-3d75-45ff-ac9b-e4fe51856c0d req-0ec39bf3-cf8f-4c40-8732-4470d56ebc24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031549 Oct 31 16:17:00.750331 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3507/6870] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:34.879012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:34.879894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=34 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:34.883953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:34.884575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:34.893039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:34.893566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:34.894020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:34.894724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:34.895226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:34.895664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:35.027068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:35.035013 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-65b022e4-c84a-4337-bcc8-feb63f4259cb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1669 microversion: 2.1 time: 0.157907 Oct 31 16:17:35.035590 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3364/6871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:34 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:35.056419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=15 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:35.057772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=32 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:35.062446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:35.063155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:35.070004 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:35.070491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:35.070930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:35.071623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:35.072086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:35.072516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:35.208199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:35.217445 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d9fcb7c-c35e-4dbe-ab76-869947c63ca8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1669 microversion: 2.1 time: 0.163195 Oct 31 16:17:35.218041 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3508/6872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:35 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1669 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:35.240038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:35.240691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:35.247201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:35.247705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:35.248155 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:35.248854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:35.249366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:35.249808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:35.376700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:35.384329 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5d248a03-caa6-4c24-9822-1782c96940a9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1669 microversion: 2.1 time: 0.148154 Oct 31 16:17:35.384906 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3365/6873] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:35 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:35.407740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:35.409898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:35.415740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:35.416222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:35.417777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:35.418471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:35.418929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:35.419353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:35.448180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:35.453717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Old instance type m1.heat2, new instance type m1.heat {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:17:35.460141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:17:35.460545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:17:35.461016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:17:35.461463 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:17:35.461877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:17:35.525543 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9ed4a2cd-bb79-4c0c-8faa-ee3aedbb1d39 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf/action" status: 202 len: 0 microversion: 2.1 time: 0.121916 Oct 31 16:17:35.526166 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3509/6874] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:17:35 2022] POST /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:17:35.534759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:35.535373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:35.541293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:35.542329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:35.542780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:35.543484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:35.544034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:35.544576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:35.722731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:35.731047 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1072d4a8-65c8-479d-98d9-a1e7566aaab9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1678 microversion: 2.1 time: 0.200343 Oct 31 16:17:35.731855 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3366/6875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:35 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:36.755429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:36.756067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:36.767194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:36.767615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:36.768067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:36.768742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:36.769234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:36.769660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:36.909028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:36.917459 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-03940de6-f679-4300-93de-00fa4627b71a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1678 microversion: 2.1 time: 0.165413 Oct 31 16:17:36.918326 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3510/6876] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:36 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:37.941696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:37.942343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:37.949052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:37.950094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:37.950539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:37.951230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:37.951731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:37.952165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:38.091552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:38.099257 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a98fb948-8b7d-42e3-8bd3-78dfd8df5f00 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.161543 Oct 31 16:17:38.099844 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3367/6877] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:37 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:39.124294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:39.124878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:39.132161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:39.132670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:39.133106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:39.133834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:39.134290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:39.134712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:39.270195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:39.278726 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-794a7824-d01e-4d95-8fe2-9402d986993c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.158144 Oct 31 16:17:39.279729 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3511/6878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:39 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:40.303334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:40.303953 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:40.310713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:40.311202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:40.311647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:40.312345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:40.312810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:40.313268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:40.444611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:40.452280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-40ca09d0-fa31-49d1-887a-816d3243ab69 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.152923 Oct 31 16:17:40.452856 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3368/6879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:40 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:41.478180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:41.479783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:41.488845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.489578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.490018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.490720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:41.491171 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:41.491595 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:41.627261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:41.635535 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3a387d40-2e80-49d9-b557-ace4310d09c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.163541 Oct 31 16:17:41.636141 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3512/6880] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:41 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:42.660676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:42.661342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:42.668126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:42.668625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:42.669078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:42.669805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:42.670278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:42.671489 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:42.801550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:42.809276 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae57b04b-b981-4f08-a178-002eab0705de tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.152474 Oct 31 16:17:42.809875 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3369/6881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:42 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:43.832998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:43.833964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:43.840408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:43.841089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:43.841555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:43.842261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:43.842758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:43.843190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:43.975844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:43.984283 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-82b68c66-0a18-4f1c-9ccb-e0ea07c0742e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.155971 Oct 31 16:17:43.984910 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3513/6882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:43 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:45.009422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:45.010074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:45.017778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:45.018283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:45.018733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:45.019445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:45.019924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:45.020364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:45.158982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:45.166818 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-36e084a0-eac6-4510-8e8b-fc38ecb44f20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.161408 Oct 31 16:17:45.167404 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3370/6883] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:45 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:46.191012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:46.191620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:46.198573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:46.199057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:46.199492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:46.200178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:46.200631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:46.201053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:46.336281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:46.344246 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22b7496d-0dd9-4408-812d-313153cf4139 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.157372 Oct 31 16:17:46.344832 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3514/6884] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:46 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:47.368182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:47.368797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:47.375954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:47.376445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:47.376893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:47.377612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:47.378079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:47.378518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:47.508426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:47.516966 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-861fc74b-0118-443f-ae0a-8f39358b5e72 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.152479 Oct 31 16:17:47.517582 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3371/6885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:47 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:48.541042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:48.541700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:48.549404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:48.549892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:48.550330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:48.551029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:48.551491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:48.551924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:48.681460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:48.689447 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0dc31e2-ddcd-41c3-a178-9979b1acec8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1683 microversion: 2.1 time: 0.152305 Oct 31 16:17:48.690034 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3515/6886] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:48 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:49.713173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:49.713790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:49.721660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:49.722163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:49.722606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:49.723311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:49.723777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:49.724215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:49.750329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-a0172ba9-8887-4aca-8316-8ac13e59ed29 req-e7c34692-096c-408f-88d2-33d1056f65dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf", "name": "network-vif-unplugged", "status": "completed", "tag": "455bc006-50cb-440c-add5-fe019e5f272d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:49.762209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a0172ba9-8887-4aca-8316-8ac13e59ed29 req-e7c34692-096c-408f-88d2-33d1056f65dc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:49.762962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a0172ba9-8887-4aca-8316-8ac13e59ed29 req-e7c34692-096c-408f-88d2-33d1056f65dc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:49.763534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-a0172ba9-8887-4aca-8316-8ac13e59ed29 req-e7c34692-096c-408f-88d2-33d1056f65dc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:49.776477 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-a0172ba9-8887-4aca-8316-8ac13e59ed29 req-e7c34692-096c-408f-88d2-33d1056f65dc service nova] Creating event network-vif-unplugged:455bc006-50cb-440c-add5-fe019e5f272d for instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf on n-h2-858384-17 Oct 31 16:17:49.782954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-a0172ba9-8887-4aca-8316-8ac13e59ed29 req-e7c34692-096c-408f-88d2-33d1056f65dc service nova] Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:17:49.797706 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-a0172ba9-8887-4aca-8316-8ac13e59ed29 req-e7c34692-096c-408f-88d2-33d1056f65dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051135 Oct 31 16:17:49.798661 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3516/6887] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:17:49.858917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:49.866777 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2a5d044e-fa0a-4ca3-bde3-623eafa42b0e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1682 microversion: 2.1 time: 0.157547 Oct 31 16:17:49.867354 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3372/6888] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:49 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:50.892815 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:50.893569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:50.899911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:50.900402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:50.900841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:50.901598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:50.902067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:50.902517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:51.038993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:51.046733 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2efd9daa-0975-4b2a-a460-600dcc000c8b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1680 microversion: 2.1 time: 0.159342 Oct 31 16:17:51.047325 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3517/6889] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:50 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:51.830325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2e4b86ee-25f7-46a8-95f2-72525a70a19e req-ed194888-b1ed-4081-8be0-4f61ff7e1cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf", "tag": "455bc006-50cb-440c-add5-fe019e5f272d"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:51.839718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2e4b86ee-25f7-46a8-95f2-72525a70a19e req-ed194888-b1ed-4081-8be0-4f61ff7e1cc6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:51.840209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2e4b86ee-25f7-46a8-95f2-72525a70a19e req-ed194888-b1ed-4081-8be0-4f61ff7e1cc6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:51.840652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2e4b86ee-25f7-46a8-95f2-72525a70a19e req-ed194888-b1ed-4081-8be0-4f61ff7e1cc6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:51.852503 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2e4b86ee-25f7-46a8-95f2-72525a70a19e req-ed194888-b1ed-4081-8be0-4f61ff7e1cc6 service nova] Creating event network-changed:455bc006-50cb-440c-add5-fe019e5f272d for instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf on n-h2-858384-17 Oct 31 16:17:51.857781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-2e4b86ee-25f7-46a8-95f2-72525a70a19e req-ed194888-b1ed-4081-8be0-4f61ff7e1cc6 service nova] Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:17:51.869728 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2e4b86ee-25f7-46a8-95f2-72525a70a19e req-ed194888-b1ed-4081-8be0-4f61ff7e1cc6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044241 Oct 31 16:17:51.870320 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3373/6890] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:52.071125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:52.071774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:52.079086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:52.079704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:52.080148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:52.080915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:52.081363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:52.081800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:52.228953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:52.239225 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9ff58d54-dba8-4f39-a53f-9d9a5e7e444e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1680 microversion: 2.1 time: 0.172026 Oct 31 16:17:52.240280 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3518/6891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:52 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:53.270344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:53.271059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:53.277680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:53.278454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:53.279097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:53.280012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:53.280670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:53.281287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:53.427231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:53.436156 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64b69b2b-c434-430a-b4a8-3cd1cbd008a0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1677 microversion: 2.1 time: 0.172241 Oct 31 16:17:53.436732 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3374/6892] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:53 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:53.459403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-173b9818-98a8-4156-9f33-3591e9780d7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:53.459990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-173b9818-98a8-4156-9f33-3591e9780d7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:53.467704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-173b9818-98a8-4156-9f33-3591e9780d7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:53.468186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-173b9818-98a8-4156-9f33-3591e9780d7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:53.468623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-173b9818-98a8-4156-9f33-3591e9780d7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:53.469346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-173b9818-98a8-4156-9f33-3591e9780d7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:53.469829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-173b9818-98a8-4156-9f33-3591e9780d7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:53.470254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-173b9818-98a8-4156-9f33-3591e9780d7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:53.529931 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-173b9818-98a8-4156-9f33-3591e9780d7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf/action" status: 204 len: 0 microversion: 2.1 time: 0.074270 Oct 31 16:17:53.530629 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3519/6893] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:17:53 2022] POST /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:17:53.539768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:53.540496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:53.546898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:53.547390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:53.548402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:53.549537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:53.550223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:53.550870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:53.778132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:53.786246 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d36409fa-0d97-4c3b-a1c7-64e21cedf1b5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1677 microversion: 2.1 time: 0.250950 Oct 31 16:17:53.786865 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3375/6894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:53 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1677 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:17:54.811590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:54.812313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:54.820547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:54.821030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:54.821517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:54.822212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:54.822663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:54.823087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:54.962621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:54.970766 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a625a33d-2df5-40d1-ae9f-f5a585bc26bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1669 microversion: 2.1 time: 0.164349 Oct 31 16:17:54.971470 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3520/6895] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:54 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:54.996910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:54.997559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:55.005282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.005786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.006237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.006946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.007416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.007854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.097745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-231b5f2c-2e5a-4db1-bf0f-07ec15b51524 req-23f5bbfa-d5c8-474c-a380-d98d222ce5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf", "name": "network-vif-plugged", "status": "completed", "tag": "455bc006-50cb-440c-add5-fe019e5f272d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:55.109268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-231b5f2c-2e5a-4db1-bf0f-07ec15b51524 req-23f5bbfa-d5c8-474c-a380-d98d222ce5af service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.109766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-231b5f2c-2e5a-4db1-bf0f-07ec15b51524 req-23f5bbfa-d5c8-474c-a380-d98d222ce5af service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.110870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-231b5f2c-2e5a-4db1-bf0f-07ec15b51524 req-23f5bbfa-d5c8-474c-a380-d98d222ce5af service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.122552 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-231b5f2c-2e5a-4db1-bf0f-07ec15b51524 req-23f5bbfa-d5c8-474c-a380-d98d222ce5af service nova] Creating event network-vif-plugged:455bc006-50cb-440c-add5-fe019e5f272d for instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf on n-h2-858384-17 Oct 31 16:17:55.127689 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-231b5f2c-2e5a-4db1-bf0f-07ec15b51524 req-23f5bbfa-d5c8-474c-a380-d98d222ce5af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034762 Oct 31 16:17:55.128408 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3521/6896] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:55.149517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:55.157365 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5f4b3b2d-342f-4065-8b50-006dc911ded0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1669 microversion: 2.1 time: 0.164879 Oct 31 16:17:55.165234 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3376/6897] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:54 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:17:55.181050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:55.181912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:55.188163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.188647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.189268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.189962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.190418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.190843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.330856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:55.338599 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-34b3329c-6228-42c5-b5bf-3d2a84a64516 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1669 microversion: 2.1 time: 0.161796 Oct 31 16:17:55.339211 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3522/6898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:55 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:55.362286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:55.362831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:55.368825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.369364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.369815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.370523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.371023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.371462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.400240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:17:55.487768 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a3f90c75-78ee-49e8-ab03-fbcd615865eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 204 len: 0 microversion: 2.1 time: 0.129293 Oct 31 16:17:55.488546 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3377/6899] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:17:55 2022] DELETE /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:17:55.497284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:55.497935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:55.505195 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.505700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.506142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.506858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:55.507321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:55.507775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:55.510789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:55.655070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:55.663468 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-02522bf0-5163-4198-8b18-148c428a27e8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1675 microversion: 2.1 time: 0.170157 Oct 31 16:17:55.664064 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3523/6900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:55 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:17:56.694283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:56.695051 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:56.702036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:56.702537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:56.702987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:56.703698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:56.704174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:56.704611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:56.836229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:56.844063 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-570e7eb6-12d7-4214-bf23-8e8f5906f7aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1675 microversion: 2.1 time: 0.154055 Oct 31 16:17:56.844648 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3378/6901] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:56 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:17:57.762720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-722719ed-8498-421a-a5bd-c0e52396a22c req-ebcdbadb-9d12-48d6-ac7e-3cd77188bd81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf", "name": "network-vif-deleted", "tag": "455bc006-50cb-440c-add5-fe019e5f272d"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:57.779650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-722719ed-8498-421a-a5bd-c0e52396a22c req-ebcdbadb-9d12-48d6-ac7e-3cd77188bd81 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:57.780300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-722719ed-8498-421a-a5bd-c0e52396a22c req-ebcdbadb-9d12-48d6-ac7e-3cd77188bd81 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:57.780968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-722719ed-8498-421a-a5bd-c0e52396a22c req-ebcdbadb-9d12-48d6-ac7e-3cd77188bd81 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:57.799533 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-722719ed-8498-421a-a5bd-c0e52396a22c req-ebcdbadb-9d12-48d6-ac7e-3cd77188bd81 service nova] Creating event network-vif-deleted:455bc006-50cb-440c-add5-fe019e5f272d for instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf on n-h2-858384-17 Oct 31 16:17:57.806052 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-722719ed-8498-421a-a5bd-c0e52396a22c req-ebcdbadb-9d12-48d6-ac7e-3cd77188bd81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046465 Oct 31 16:17:57.806748 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3524/6902] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:17:57.868453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:57.871564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:57.886833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:57.887342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:57.887810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:57.888529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:57.888998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:57.889501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:57.894042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:17:57.925521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:57.925935 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:57.926388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:57.926844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lazy-loading 'fault' on Instance uuid f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:17:57.971233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:17:57.979450 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-022a163a-1711-461d-b6be-1e168d0503b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 200 len: 1329 microversion: 2.1 time: 0.115072 Oct 31 16:17:57.980039 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3379/6903] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:57 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 1329 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:17:59.004952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:59.005709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:59.012656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:59.013159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:59.013592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:59.014282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:59.014732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:59.015191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:59.029059 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf HTTP/1.1 Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf'} Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:59.030699 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd94b278-b44e-485e-9856-38afa93cfa32 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 404 len: 111 microversion: 2.1 time: 0.031935 Oct 31 16:17:59.036481 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3525/6904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:58 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:17:59.046248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:17:59.046878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:17:59.053815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:59.054311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:59.054758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:59.055459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:59.055930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:59.056372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:59.070183 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf HTTP/1.1 Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf'} Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:17:59.071812 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9a116183-92cb-4009-ba20-74bdc346a091 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 404 len: 111 microversion: 2.1 time: 0.030926 Oct 31 16:17:59.076021 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3380/6905] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:17:59 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:17:59.121290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1763906167", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "e277981e-27eb-4f80-bff7-dce3df886165"}], "security_groups": [{"name": "tempest-securitygroup--556064750"}], "key_name": "tempest-keypair-1205507471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:17:59.226627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] validate_networks() for [('e277981e-27eb-4f80-bff7-dce3df886165', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:17:59.933991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:17:59.934418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:17:59.934912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:17:59.935306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:17:59.935991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:17:59.945883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:59.946365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:59.946800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:59.947535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:17:59.947993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:17:59.948416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:17:59.965959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:17:59.971194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for user caa0eaf7405a4edaa9961792a2efdd0b and project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:17:59.983792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:17:59.986145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:18:00.036316 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8d5c6ba-4bfd-4b03-877a-75e9be17d00a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.918956 Oct 31 16:18:00.037345 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3526/6906] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:17:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:18:00.048213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-59d80fcd-e0c3-42c5-b5f1-15e693f19f24 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:00.048828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-59d80fcd-e0c3-42c5-b5f1-15e693f19f24 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:00.103293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-59d80fcd-e0c3-42c5-b5f1-15e693f19f24 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:00.111085 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-59d80fcd-e0c3-42c5-b5f1-15e693f19f24 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1239 microversion: 2.1 time: 0.066736 Oct 31 16:18:00.112640 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3381/6907] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:00 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:01.136639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:01.137291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:01.144410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:01.145182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:01.145812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:01.146542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:01.147008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:01.147625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:01.219083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:01.229707 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b7f2ce70-4f5b-43a4-90b1-ed7a0d6da65e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1299 microversion: 2.1 time: 0.097797 Oct 31 16:18:01.230300 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3527/6908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:01 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:02.255592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:02.256359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:02.264008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:02.264511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:02.264965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:02.265710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:02.266218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:02.266660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:02.401999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:02.410039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5c626ac-cd97-4880-974f-8fc3a6216a05 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1364 microversion: 2.1 time: 0.158680 Oct 31 16:18:02.410676 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3382/6909] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:02 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:02.519940 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-12a9292b-2b97-45d7-8d2c-57393a2ce299 req-b64c47cc-1cc8-44cd-9602-1ba2f41be2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52aad2ab-1360-4586-9203-0556d835b50e", "tag": "4fdb6784-7c68-4250-9669-a46c3ee83412"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:02.532994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-12a9292b-2b97-45d7-8d2c-57393a2ce299 req-b64c47cc-1cc8-44cd-9602-1ba2f41be2ac service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:02.533533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-12a9292b-2b97-45d7-8d2c-57393a2ce299 req-b64c47cc-1cc8-44cd-9602-1ba2f41be2ac service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:02.533942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-12a9292b-2b97-45d7-8d2c-57393a2ce299 req-b64c47cc-1cc8-44cd-9602-1ba2f41be2ac service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:02.546702 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-12a9292b-2b97-45d7-8d2c-57393a2ce299 req-b64c47cc-1cc8-44cd-9602-1ba2f41be2ac service nova] Creating event network-changed:4fdb6784-7c68-4250-9669-a46c3ee83412 for instance 52aad2ab-1360-4586-9203-0556d835b50e on n-h2-858384-17 Oct 31 16:18:02.552234 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-12a9292b-2b97-45d7-8d2c-57393a2ce299 req-b64c47cc-1cc8-44cd-9602-1ba2f41be2ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036015 Oct 31 16:18:02.552835 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3528/6910] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:18:03.434327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:03.434950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:03.441980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:03.442485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:03.442937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:03.443645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:03.444118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:03.444560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:03.580446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:03.588876 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e5dc025-46d4-48f7-b96f-76cd8b9d1e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1364 microversion: 2.1 time: 0.158468 Oct 31 16:18:03.589491 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3383/6911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:03 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:04.613417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:04.614116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:04.621759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:04.622252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:04.622687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:04.623373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:04.623824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:04.624246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:04.754220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:04.762315 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ecf9c8b5-da5a-4b5b-ad5c-7fa43ab92794 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1364 microversion: 2.1 time: 0.153227 Oct 31 16:18:04.762902 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3529/6912] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:04 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:05.786604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:05.787878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:05.790741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:05.796032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:05.796527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:05.796971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:05.797696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:05.798163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:05.798596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:05.928606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:05.936409 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-82926628-500d-464c-b28e-021578b65c87 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1364 microversion: 2.1 time: 0.153976 Oct 31 16:18:05.936985 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3384/6913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:05 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:06.959791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:06.960363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:06.963209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:06.968508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:06.969002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:06.969483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:06.970296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:06.970816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:06.971865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:07.114585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:07.123659 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f2536dd-f822-40da-9f63-f57a02c4e96b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1364 microversion: 2.1 time: 0.167806 Oct 31 16:18:07.137204 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3530/6914] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:06 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:07.137625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2f11505f-dfb6-4dff-904f-d1767d9b2d3c req-f5511b1f-57df-43d3-a5e1-af178eb6fbd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52aad2ab-1360-4586-9203-0556d835b50e", "name": "network-vif-plugged", "status": "completed", "tag": "4fdb6784-7c68-4250-9669-a46c3ee83412"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:07.145545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f11505f-dfb6-4dff-904f-d1767d9b2d3c req-f5511b1f-57df-43d3-a5e1-af178eb6fbd2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:07.146080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f11505f-dfb6-4dff-904f-d1767d9b2d3c req-f5511b1f-57df-43d3-a5e1-af178eb6fbd2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:07.146609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2f11505f-dfb6-4dff-904f-d1767d9b2d3c req-f5511b1f-57df-43d3-a5e1-af178eb6fbd2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:07.158730 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2f11505f-dfb6-4dff-904f-d1767d9b2d3c req-f5511b1f-57df-43d3-a5e1-af178eb6fbd2 service nova] Creating event network-vif-plugged:4fdb6784-7c68-4250-9669-a46c3ee83412 for instance 52aad2ab-1360-4586-9203-0556d835b50e on n-h2-858384-17 Oct 31 16:18:07.164790 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2f11505f-dfb6-4dff-904f-d1767d9b2d3c req-f5511b1f-57df-43d3-a5e1-af178eb6fbd2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035546 Oct 31 16:18:07.165458 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3385/6915] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:18:08.149234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:08.150454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:08.157265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:08.157753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:08.158189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:08.158888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:08.159346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:08.159775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:08.290348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:08.298063 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fa59eca7-34e1-4454-9694-be9ea49a0677 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1364 microversion: 2.1 time: 0.152839 Oct 31 16:18:08.298718 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3531/6916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:08 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:09.323662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:09.324383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:09.330539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:09.331042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:09.331499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:09.332215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:09.332688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:09.333148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:09.463136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:09.470900 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c458efb6-dd5f-485f-a352-e5155d19d4bb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1550 microversion: 2.1 time: 0.152291 Oct 31 16:18:09.471481 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3386/6917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:09 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:09.495682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-199e3aa1-6172-4035-9529-d87d1af5c192 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:09.496216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-199e3aa1-6172-4035-9529-d87d1af5c192 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:09.503021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199e3aa1-6172-4035-9529-d87d1af5c192 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:09.503512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199e3aa1-6172-4035-9529-d87d1af5c192 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:09.503955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199e3aa1-6172-4035-9529-d87d1af5c192 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:09.504659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199e3aa1-6172-4035-9529-d87d1af5c192 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:09.505121 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199e3aa1-6172-4035-9529-d87d1af5c192 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:09.505576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-199e3aa1-6172-4035-9529-d87d1af5c192 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:09.591058 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-199e3aa1-6172-4035-9529-d87d1af5c192 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099747 Oct 31 16:18:09.591686 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3532/6918] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 16:18:09 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:18:10.514668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-54766648-8a8d-4ac6-9f5d-858c1aca535a req-7da6c370-0585-4fac-be00-e46162654e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52aad2ab-1360-4586-9203-0556d835b50e", "tag": "4fdb6784-7c68-4250-9669-a46c3ee83412"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:10.519485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:10.526143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-54766648-8a8d-4ac6-9f5d-858c1aca535a req-7da6c370-0585-4fac-be00-e46162654e94 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:10.526630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-54766648-8a8d-4ac6-9f5d-858c1aca535a req-7da6c370-0585-4fac-be00-e46162654e94 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:10.527066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-54766648-8a8d-4ac6-9f5d-858c1aca535a req-7da6c370-0585-4fac-be00-e46162654e94 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:10.538695 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-54766648-8a8d-4ac6-9f5d-858c1aca535a req-7da6c370-0585-4fac-be00-e46162654e94 service nova] Creating event network-changed:4fdb6784-7c68-4250-9669-a46c3ee83412 for instance 52aad2ab-1360-4586-9203-0556d835b50e on n-h2-858384-17 Oct 31 16:18:10.543805 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-54766648-8a8d-4ac6-9f5d-858c1aca535a req-7da6c370-0585-4fac-be00-e46162654e94 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032993 Oct 31 16:18:10.544487 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3387/6919] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:18:43.663346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:43.664138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:43.666620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:43.667273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=41 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:43.672409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-71dace7b-0310-424c-8b3c-d875e0bd7834 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:43.680224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71dace7b-0310-424c-8b3c-d875e0bd7834 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:43.680706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71dace7b-0310-424c-8b3c-d875e0bd7834 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:43.681152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-71dace7b-0310-424c-8b3c-d875e0bd7834 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:43.704002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-71dace7b-0310-424c-8b3c-d875e0bd7834 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 16:18:43.744208 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-71dace7b-0310-424c-8b3c-d875e0bd7834 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/action" status: 202 len: 0 microversion: 2.1 time: 0.081255 Oct 31 16:18:43.744819 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3533/6920] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:18:43 2022] POST /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:18:43.751778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:43.753040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=36 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:18:43.757317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:43.758044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:43.766233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:43.766759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:43.767195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:43.767908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:43.768387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:43.768938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:43.908894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:43.916645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2e26e9f1-f329-45ad-ad33-4301e3d4f779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.167098 Oct 31 16:18:43.917263 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3388/6921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:43 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:44.944104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:44.944726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:44.951560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:44.952420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:44.952918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:44.953677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:44.954142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:44.954575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:45.096104 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:45.103895 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c27954fa-14b3-4413-a345-9d69a72cc846 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.165142 Oct 31 16:18:45.104486 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3534/6922] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:44 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:46.129196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:46.129822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:46.137349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:46.137853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:46.138307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:46.139018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:46.140157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:46.140608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:46.272586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:46.281477 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b3bc4025-d36e-494e-b620-2b85cc6efa8f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.156122 Oct 31 16:18:46.282085 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3389/6923] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:46 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:47.305954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:47.306561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:47.313875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:47.314360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:47.314801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:47.315485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:47.315939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:47.316360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:47.446760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:47.455824 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8d1b6e8c-bb9b-487d-8494-e00ec7a4a888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.153736 Oct 31 16:18:47.456418 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3535/6924] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:47 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:48.480816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:48.481543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:48.488822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:48.489362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:48.489812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:48.490514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:48.490984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:48.491422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:48.625360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:48.633096 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1f5c342e-96c2-454a-b955-c6600e23d7e6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.156186 Oct 31 16:18:48.633700 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3390/6925] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:48 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:49.655907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:49.656530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:49.663655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:49.664148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:49.664590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:49.665343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:49.665806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:49.666236 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:49.799687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:49.807660 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bf3ce8e6-f65d-4948-8afd-dab8dfd3b275 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.155688 Oct 31 16:18:49.808276 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3536/6926] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:49 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:50.832331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:50.832930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:50.839378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:50.839881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:50.840347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:50.841056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:50.841561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:50.842007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:50.972129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:50.980019 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1865acac-3db6-4e1f-a4e7-cb590417f81f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.152248 Oct 31 16:18:50.980808 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3391/6927] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:50 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:52.004228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:52.004845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:52.011646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:52.012133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:52.012575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:52.013370 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:52.013835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:52.014266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:52.144895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:52.152580 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1324110b-e7e6-4e30-8970-6727b485779a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.152836 Oct 31 16:18:52.153175 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3537/6928] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:51 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:18:53.176879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:53.177534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:53.184408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:53.184908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:53.185396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:53.186101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:53.186575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:53.187013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:53.318367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:53.326988 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f62c1a11-5beb-450c-b225-4fd2e9f092ad tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.154729 Oct 31 16:18:53.327582 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3392/6929] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:53 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:54.351525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:54.352148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:54.359077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:54.359571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:54.360018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:54.361392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:54.361866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:54.362307 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:54.497175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:54.501981 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e08d825-d89e-4947-a74f-2c4e537d2085 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1656 microversion: 2.1 time: 0.154428 Oct 31 16:18:54.502582 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3538/6930] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:54 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:54.525097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:54.527403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:54.534885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:54.535381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:54.535823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:54.536523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:54.536989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:54.537450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:54.612605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:54.617949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Old instance type m1.heat2, new instance type m1.heat {{(pid=120588) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:18:54.624342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:18:54.624765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:18:54.625269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:18:54.625681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:18:54.626126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:18:55.008300 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c990ec88-1081-4f3a-8b58-0f64583b3c79 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/action" status: 202 len: 0 microversion: 2.1 time: 0.486976 Oct 31 16:18:55.009486 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3393/6931] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:18:54 2022] POST /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:18:55.025905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:55.027047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:55.040623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:55.041547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:55.042325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:55.043495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:55.044244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:55.044799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:55.205017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:55.213529 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dacd32cc-c529-4f97-bdb0-7ec3417b9dba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.199309 Oct 31 16:18:55.214676 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3539/6932] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:55 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:56.241553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:56.242411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:56.248520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:56.249026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:56.249515 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:56.250232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:56.251387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:56.252501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:56.394008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:56.402070 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30b9bf2c-1c76-4413-a428-1bdd083fc368 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1679 microversion: 2.1 time: 0.166755 Oct 31 16:18:56.402706 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3394/6933] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:56 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:18:57.439952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:57.440713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:57.447508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:57.447993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:57.448432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:57.449157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:57.449607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:57.450033 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:57.579714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:57.588037 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc67367b-e92f-4e72-841c-3683b4300e43 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1684 microversion: 2.1 time: 0.152243 Oct 31 16:18:57.588614 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3540/6934] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:57 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:58.613405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:58.614029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:58.621002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:58.621532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:58.621995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:58.622697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:58.623173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:58.623612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:58.755526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:58.763157 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52d96f67-ab31-452a-b0ea-f0fe8dedd2a7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1684 microversion: 2.1 time: 0.154406 Oct 31 16:18:58.763742 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3395/6935] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:58 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:18:59.467565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e6e6d544-f6a5-47dc-82dd-ec151c25bf12 req-4a0d6164-45a5-4cc1-a439-164abac421cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52aad2ab-1360-4586-9203-0556d835b50e", "name": "network-vif-unplugged", "status": "completed", "tag": "4fdb6784-7c68-4250-9669-a46c3ee83412"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:18:59.478546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e6e6d544-f6a5-47dc-82dd-ec151c25bf12 req-4a0d6164-45a5-4cc1-a439-164abac421cb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:59.479039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e6e6d544-f6a5-47dc-82dd-ec151c25bf12 req-4a0d6164-45a5-4cc1-a439-164abac421cb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:59.479460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e6e6d544-f6a5-47dc-82dd-ec151c25bf12 req-4a0d6164-45a5-4cc1-a439-164abac421cb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:59.491362 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e6e6d544-f6a5-47dc-82dd-ec151c25bf12 req-4a0d6164-45a5-4cc1-a439-164abac421cb service nova] Creating event network-vif-unplugged:4fdb6784-7c68-4250-9669-a46c3ee83412 for instance 52aad2ab-1360-4586-9203-0556d835b50e on n-h1-858384-17 Oct 31 16:18:59.496726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-e6e6d544-f6a5-47dc-82dd-ec151c25bf12 req-4a0d6164-45a5-4cc1-a439-164abac421cb service nova] Instance 52aad2ab-1360-4586-9203-0556d835b50e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:18:59.508452 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e6e6d544-f6a5-47dc-82dd-ec151c25bf12 req-4a0d6164-45a5-4cc1-a439-164abac421cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044738 Oct 31 16:18:59.509154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3541/6936] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:18:59.786939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:18:59.787562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:18:59.794491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:59.795270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:59.795793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:59.796982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:18:59.798055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:18:59.798354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:18:59.989345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:18:59.996946 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-87a64a1f-269f-4ef3-beae-6d1c068a7512 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1683 microversion: 2.1 time: 0.214087 Oct 31 16:18:59.997747 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3396/6937] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:18:59 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:01.023655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:01.024348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:01.031360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:01.031839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:01.032270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:01.032955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:01.033462 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:01.033990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:01.169406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:01.177837 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4600f022-721d-4662-b919-88e6856da15b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1681 microversion: 2.1 time: 0.158493 Oct 31 16:19:01.178413 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3542/6938] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:01 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:01.538459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-08faa9d2-2fd2-4f70-9615-00814358eb90 req-601800ee-ec8f-42fc-940d-0e6bd72a43cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52aad2ab-1360-4586-9203-0556d835b50e", "tag": "4fdb6784-7c68-4250-9669-a46c3ee83412"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:01.548750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08faa9d2-2fd2-4f70-9615-00814358eb90 req-601800ee-ec8f-42fc-940d-0e6bd72a43cf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:01.550083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08faa9d2-2fd2-4f70-9615-00814358eb90 req-601800ee-ec8f-42fc-940d-0e6bd72a43cf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:01.550723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-08faa9d2-2fd2-4f70-9615-00814358eb90 req-601800ee-ec8f-42fc-940d-0e6bd72a43cf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:01.562181 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-08faa9d2-2fd2-4f70-9615-00814358eb90 req-601800ee-ec8f-42fc-940d-0e6bd72a43cf service nova] Creating event network-changed:4fdb6784-7c68-4250-9669-a46c3ee83412 for instance 52aad2ab-1360-4586-9203-0556d835b50e on n-h1-858384-17 Oct 31 16:19:01.568063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-08faa9d2-2fd2-4f70-9615-00814358eb90 req-601800ee-ec8f-42fc-940d-0e6bd72a43cf service nova] Instance 52aad2ab-1360-4586-9203-0556d835b50e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:19:01.583483 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-08faa9d2-2fd2-4f70-9615-00814358eb90 req-601800ee-ec8f-42fc-940d-0e6bd72a43cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049790 Oct 31 16:19:01.584078 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3397/6939] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:02.202486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:02.203937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:02.212017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:02.212513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:02.212951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:02.213768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:02.214681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:02.215116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:02.467390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:02.475438 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0776f4d5-45f0-4666-a9ca-c08b2abc5499 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1677 microversion: 2.1 time: 0.276983 Oct 31 16:19:02.476074 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3543/6940] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:02 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1677 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:02.499911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-466a7eca-ca48-40d6-a456-9da0507824ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:02.500708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-466a7eca-ca48-40d6-a456-9da0507824ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:02.510776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-466a7eca-ca48-40d6-a456-9da0507824ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:02.511424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-466a7eca-ca48-40d6-a456-9da0507824ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:02.511977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-466a7eca-ca48-40d6-a456-9da0507824ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:02.512798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-466a7eca-ca48-40d6-a456-9da0507824ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:02.513460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-466a7eca-ca48-40d6-a456-9da0507824ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:02.513995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-466a7eca-ca48-40d6-a456-9da0507824ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:02.578533 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-466a7eca-ca48-40d6-a456-9da0507824ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/action" status: 204 len: 0 microversion: 2.1 time: 0.082741 Oct 31 16:19:02.580348 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3398/6941] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:19:02 2022] POST /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:19:02.590762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:02.591627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:02.598720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:02.599327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:02.599922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:02.600803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:02.601757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:02.602234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:02.822752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:02.830681 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21d8cb74-8019-4ce6-a055-5b1b780e6371 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1677 microversion: 2.1 time: 0.244883 Oct 31 16:19:02.831319 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3544/6942] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:02 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:03.855583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:03.856303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:03.863490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:03.863996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:03.864449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:03.865187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:03.865668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:03.866105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:04.009419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:04.017365 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8a0b52a7-f157-4f10-89ee-a6a16521ecfd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1677 microversion: 2.1 time: 0.166885 Oct 31 16:19:04.018157 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3399/6943] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:03 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:05.042244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:05.042855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:05.051109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.051608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.052050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.052752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.053242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.053675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.189738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:05.198114 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0de5a659-f5a4-43bc-8adf-6c7acd003827 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1656 microversion: 2.1 time: 0.159788 Oct 31 16:19:05.198697 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3545/6944] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:05 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1656 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:05.221455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:05.222449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:05.229408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.229908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.230357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.231063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.231536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.231984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.367073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:05.375067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b5fe524e-8c65-4650-a514-3e85ea77a2f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1656 microversion: 2.1 time: 0.157555 Oct 31 16:19:05.375725 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3400/6945] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:05 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1656 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:05.397911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e6161f0a-639d-45cd-a6a0-aa0d817c9469 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:05.404048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6161f0a-639d-45cd-a6a0-aa0d817c9469 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.404531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6161f0a-639d-45cd-a6a0-aa0d817c9469 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.404965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e6161f0a-639d-45cd-a6a0-aa0d817c9469 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.431330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e6161f0a-639d-45cd-a6a0-aa0d817c9469 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Going to try to start instance {{(pid=120587) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 16:19:05.433218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-77593a93-4290-4e28-9d24-91f5ebf30524 req-edbc6fe2-d0a4-43f8-863b-343c8c009341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52aad2ab-1360-4586-9203-0556d835b50e", "name": "network-vif-plugged", "status": "completed", "tag": "4fdb6784-7c68-4250-9669-a46c3ee83412"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:05.443331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-77593a93-4290-4e28-9d24-91f5ebf30524 req-edbc6fe2-d0a4-43f8-863b-343c8c009341 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.443835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-77593a93-4290-4e28-9d24-91f5ebf30524 req-edbc6fe2-d0a4-43f8-863b-343c8c009341 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.444279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-77593a93-4290-4e28-9d24-91f5ebf30524 req-edbc6fe2-d0a4-43f8-863b-343c8c009341 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.455802 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-77593a93-4290-4e28-9d24-91f5ebf30524 req-edbc6fe2-d0a4-43f8-863b-343c8c009341 service nova] Creating event network-vif-plugged:4fdb6784-7c68-4250-9669-a46c3ee83412 for instance 52aad2ab-1360-4586-9203-0556d835b50e on n-h1-858384-17 Oct 31 16:19:05.461785 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-77593a93-4290-4e28-9d24-91f5ebf30524 req-edbc6fe2-d0a4-43f8-863b-343c8c009341 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032424 Oct 31 16:19:05.462725 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3401/6946] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:19:05.480795 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e6161f0a-639d-45cd-a6a0-aa0d817c9469 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/action" status: 202 len: 0 microversion: 2.1 time: 0.086173 Oct 31 16:19:05.484812 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3546/6947] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:19:05 2022] POST /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:19:05.491290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:05.492393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:05.499063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.499575 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.500031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.500912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:05.501436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:05.501869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:05.736022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:05.744428 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b9f9bad3-cf82-4a39-b575-d55f1b441f18 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1665 microversion: 2.1 time: 0.258154 Oct 31 16:19:05.745012 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3402/6948] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:05 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1665 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:19:06.770042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:06.770753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:06.777599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:06.778097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:06.778544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:06.779247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:06.779710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:06.780140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:06.910272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:06.913863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:06.918931 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c61dcaa6-fe3c-45ab-b22d-beb45c52ef66 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1669 microversion: 2.1 time: 0.154101 Oct 31 16:19:06.919521 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3547/6949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:06 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:06.942491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:06.942992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:06.949704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:06.950199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:06.950646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:06.951342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:06.951805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:06.952273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:06.954959 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:06.980566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:19:07.055434 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-797f7c22-9bf6-49c2-aeb6-0d4321cf1ae7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 204 len: 0 microversion: 2.1 time: 0.117013 Oct 31 16:19:07.056064 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3403/6950] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:19:06 2022] DELETE /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:19:07.064601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:07.065259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:07.073767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:07.074264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:07.074711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:07.075418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:07.075887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:07.076320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:07.209027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:07.217031 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bad069f5-03a9-4d2e-b33b-91ae1615a617 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1675 microversion: 2.1 time: 0.156367 Oct 31 16:19:07.217648 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3548/6951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:07 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:08.242228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:08.242949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:08.249823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:08.250344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:08.250791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:08.251504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:08.251971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:08.252409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:08.449978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:08.457959 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-48d330fe-81fe-4fc7-a553-627d7073e061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 200 len: 1675 microversion: 2.1 time: 0.220723 Oct 31 16:19:08.458557 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3404/6952] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:08 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:09.252368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ad074aa6-001e-40b6-a59d-4905caa5b2be req-fcf65711-9ed1-492b-bc69-9b774ffc9e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52aad2ab-1360-4586-9203-0556d835b50e", "name": "network-vif-deleted", "tag": "4fdb6784-7c68-4250-9669-a46c3ee83412"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:09.263511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ad074aa6-001e-40b6-a59d-4905caa5b2be req-fcf65711-9ed1-492b-bc69-9b774ffc9e79 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:09.264217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ad074aa6-001e-40b6-a59d-4905caa5b2be req-fcf65711-9ed1-492b-bc69-9b774ffc9e79 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:09.264725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ad074aa6-001e-40b6-a59d-4905caa5b2be req-fcf65711-9ed1-492b-bc69-9b774ffc9e79 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:09.276952 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ad074aa6-001e-40b6-a59d-4905caa5b2be req-fcf65711-9ed1-492b-bc69-9b774ffc9e79 service nova] Creating event network-vif-deleted:4fdb6784-7c68-4250-9669-a46c3ee83412 for instance 52aad2ab-1360-4586-9203-0556d835b50e on n-h1-858384-17 Oct 31 16:19:09.282828 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ad074aa6-001e-40b6-a59d-4905caa5b2be req-fcf65711-9ed1-492b-bc69-9b774ffc9e79 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034081 Oct 31 16:19:09.283451 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3549/6953] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:09.482693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:09.483286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:09.490451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:09.490947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:09.491431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:09.492140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:09.492609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:09.493044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:09.506500 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e HTTP/1.1 Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '52aad2ab-1360-4586-9203-0556d835b50e'} Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:19:09.508224 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.512254 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:09.512254 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:19:09.512254 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:19:09.512254 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:19:09.512254 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:19:09.512254 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.512254 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.512254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:19:09.512254 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-80082632-6252-48fd-95f4-93fd6809e64c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 404 len: 111 microversion: 2.1 time: 0.031566 Oct 31 16:19:09.513423 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3405/6954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:09 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:19:09.529250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:09.530017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:09.537341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:09.537824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:09.538256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:09.538948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:09.539403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:09.539824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:09.554211 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e HTTP/1.1 Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '52aad2ab-1360-4586-9203-0556d835b50e'} Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:19:09.555915 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b420a98e-ca4c-4132-a46b-8caad5e33aa9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 404 len: 111 microversion: 2.1 time: 0.032412 Oct 31 16:19:09.568173 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3550/6955] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:09 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:19:09.608261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1499772449", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "e277981e-27eb-4f80-bff7-dce3df886165"}], "security_groups": [{"name": "tempest-securitygroup--556064750"}], "key_name": "tempest-keypair-1205507471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:09.714928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] validate_networks() for [('e277981e-27eb-4f80-bff7-dce3df886165', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:19:10.101502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:19:10.101942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:19:10.102452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:19:10.103061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:19:10.103274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:19:10.112357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:10.112850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:10.113328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:10.114093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:10.114562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:10.114995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:10.132018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:19:10.137577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for user caa0eaf7405a4edaa9961792a2efdd0b and project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:19:10.150588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:19:10.152920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:19:10.200825 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-48af1d9b-2571-4449-917b-300c47f56650 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.596514 Oct 31 16:19:10.201503 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3406/6956] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:19:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:19:10.214529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6f377f73-e7ae-4830-8fdb-91cb04d3b76a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:10.215099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6f377f73-e7ae-4830-8fdb-91cb04d3b76a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:10.276532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6f377f73-e7ae-4830-8fdb-91cb04d3b76a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:10.285573 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6f377f73-e7ae-4830-8fdb-91cb04d3b76a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1239 microversion: 2.1 time: 0.076055 Oct 31 16:19:10.286343 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3551/6957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:10 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:19:11.311057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:11.312410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:11.321413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:11.322220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:11.322680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:11.323410 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:11.323891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:11.324345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:11.393952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:11.403983 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-712386df-0a28-4111-887c-4232d4d35ac1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1299 microversion: 2.1 time: 0.097584 Oct 31 16:19:11.404599 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3407/6958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:11 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:12.428602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:12.429206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:12.436347 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:12.436841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:12.437382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:12.438164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:12.438701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:12.439201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:12.701170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:12.709573 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-62d397df-f8b9-462d-b9f7-945ec6dbaf8a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1364 microversion: 2.1 time: 0.285212 Oct 31 16:19:12.710272 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3552/6959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:12 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:12.853596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-7d415f55-2c3b-49cd-9542-04e0903d74df req-3e455325-d807-401c-b055-7b20d42b77c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8f5aeb-c505-4563-a605-8b0b2ae788d0", "tag": "703100eb-04b8-40f2-b615-1edd3c59060f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:12.866179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7d415f55-2c3b-49cd-9542-04e0903d74df req-3e455325-d807-401c-b055-7b20d42b77c2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:12.866681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7d415f55-2c3b-49cd-9542-04e0903d74df req-3e455325-d807-401c-b055-7b20d42b77c2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:12.867156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-7d415f55-2c3b-49cd-9542-04e0903d74df req-3e455325-d807-401c-b055-7b20d42b77c2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:12.879686 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-7d415f55-2c3b-49cd-9542-04e0903d74df req-3e455325-d807-401c-b055-7b20d42b77c2 service nova] Creating event network-changed:703100eb-04b8-40f2-b615-1edd3c59060f for instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 on n-h2-858384-17 Oct 31 16:19:12.885268 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-7d415f55-2c3b-49cd-9542-04e0903d74df req-3e455325-d807-401c-b055-7b20d42b77c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035836 Oct 31 16:19:12.886042 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3408/6960] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:13.733958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:13.734569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:13.736883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=43 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:13.743111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:13.743601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:13.744048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:13.744774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:13.745261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:13.745698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:13.879119 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:13.887437 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d861a0e-9208-4cb3-9e3d-1094e4ae2e93 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1364 microversion: 2.1 time: 0.157415 Oct 31 16:19:13.888019 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3553/6961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:13 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:14.914210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:14.914926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:14.916869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:14.922342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:14.922842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:14.923292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:14.924250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:14.924720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:14.925180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:15.109427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:15.117960 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-edc032d1-33bf-48db-b9a8-915eea189351 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1364 microversion: 2.1 time: 0.209927 Oct 31 16:19:15.118542 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3409/6962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:14 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:16.141981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:16.142594 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:16.150404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:16.150920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:16.151357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:16.152334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:16.152789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:16.153249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:16.337678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:16.345296 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-21da69d4-67ae-4e1e-860a-e00f0c131a89 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1364 microversion: 2.1 time: 0.207227 Oct 31 16:19:16.345867 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3554/6963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:16 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:17.368074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:17.368714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:17.375561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:17.376073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:17.376532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:17.377280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:17.377756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:17.378320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:17.464626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-101bb479-bcad-4d18-9abd-b43474652502 req-d7c5c079-7b72-4619-b8e0-9b5a32be62b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8f5aeb-c505-4563-a605-8b0b2ae788d0", "name": "network-vif-plugged", "status": "completed", "tag": "703100eb-04b8-40f2-b615-1edd3c59060f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:17.477550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-101bb479-bcad-4d18-9abd-b43474652502 req-d7c5c079-7b72-4619-b8e0-9b5a32be62b3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:17.478193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-101bb479-bcad-4d18-9abd-b43474652502 req-d7c5c079-7b72-4619-b8e0-9b5a32be62b3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:17.478712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-101bb479-bcad-4d18-9abd-b43474652502 req-d7c5c079-7b72-4619-b8e0-9b5a32be62b3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:17.490960 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-101bb479-bcad-4d18-9abd-b43474652502 req-d7c5c079-7b72-4619-b8e0-9b5a32be62b3 service nova] Creating event network-vif-plugged:703100eb-04b8-40f2-b615-1edd3c59060f for instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 on n-h2-858384-17 Oct 31 16:19:17.496114 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-101bb479-bcad-4d18-9abd-b43474652502 req-d7c5c079-7b72-4619-b8e0-9b5a32be62b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035332 Oct 31 16:19:17.497005 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3555/6964] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:17.532750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:17.541929 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be6427de-9ef9-4383-b3cb-083ce2241024 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1364 microversion: 2.1 time: 0.177885 Oct 31 16:19:17.542526 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3410/6965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:17 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:18.567075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:18.567805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:18.574139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:18.574625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:18.575058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:18.575758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:18.576850 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:18.577321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:18.709226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:18.716910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca27c355-e1b5-4c14-916b-129e391f86d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1364 microversion: 2.1 time: 0.154938 Oct 31 16:19:18.717512 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3556/6966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:18 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:19.741624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:19.742249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:19.748988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:19.749509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:19.749954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:19.750848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:19.751326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:19.751763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:19.882914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:19.891029 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8fb5bec3-1959-41b0-aab6-d6fab337349c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1550 microversion: 2.1 time: 0.153908 Oct 31 16:19:19.891601 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3411/6967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:19 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:19.916058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-383d0bbe-cf22-43d0-9a88-f9c94e59d8aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:19.916573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-383d0bbe-cf22-43d0-9a88-f9c94e59d8aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:19.923394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-383d0bbe-cf22-43d0-9a88-f9c94e59d8aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:19.923882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-383d0bbe-cf22-43d0-9a88-f9c94e59d8aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:19.924587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-383d0bbe-cf22-43d0-9a88-f9c94e59d8aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:19.925329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-383d0bbe-cf22-43d0-9a88-f9c94e59d8aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:19.925798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-383d0bbe-cf22-43d0-9a88-f9c94e59d8aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:19.926228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-383d0bbe-cf22-43d0-9a88-f9c94e59d8aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:20.006776 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-383d0bbe-cf22-43d0-9a88-f9c94e59d8aa tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095296 Oct 31 16:19:20.007392 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3557/6968] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 16:19:19 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:20.945690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-22286f18-f933-47ec-8cc4-944c563545ab req-bced48ab-4e26-4330-a062-b7bb389886fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8f5aeb-c505-4563-a605-8b0b2ae788d0", "tag": "703100eb-04b8-40f2-b615-1edd3c59060f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:20.950828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:20.951353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:20.957544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22286f18-f933-47ec-8cc4-944c563545ab req-bced48ab-4e26-4330-a062-b7bb389886fc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:20.957714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22286f18-f933-47ec-8cc4-944c563545ab req-bced48ab-4e26-4330-a062-b7bb389886fc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:20.958076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-22286f18-f933-47ec-8cc4-944c563545ab req-bced48ab-4e26-4330-a062-b7bb389886fc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:20.969455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-22286f18-f933-47ec-8cc4-944c563545ab req-bced48ab-4e26-4330-a062-b7bb389886fc service nova] Creating event network-changed:703100eb-04b8-40f2-b615-1edd3c59060f for instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 on n-h2-858384-17 Oct 31 16:19:20.974749 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-22286f18-f933-47ec-8cc4-944c563545ab req-bced48ab-4e26-4330-a062-b7bb389886fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034079 Oct 31 16:19:20.975771 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3412/6969] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:19:54.037260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:54.039671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=9 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:54.040346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=40 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:54.042065 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:19:54.042207 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:19:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0/action (ip 10.222.0.20) !!! Oct 31 16:19:54.047073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:19:54.049315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:54.061271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:54.061754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:54.062193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:54.062882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:54.063337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:54.063759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:54.097962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:54.103646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Old instance type m1.heat2, new instance type m1.heat {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:19:54.110422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:19:54.110775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:19:54.111252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:19:54.111654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:19:54.112066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:19:54.174615 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f657dc52-28ec-4a43-a10b-c0abea556061 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0/action" status: 202 len: 0 microversion: 2.1 time: 0.138037 Oct 31 16:19:54.175244 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3558/6970] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:19:54 2022] POST /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:19:54.182019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=7 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:54.182874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:19:54.184153 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:19:54.184288 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:19:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 (ip 10.222.0.20) !!! Oct 31 16:19:54.196565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:54.197316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:54.206680 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:54.207195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:54.207682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:54.208420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:54.208934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:54.209436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:54.360331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:54.368583 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e34f94cc-da1d-403e-b6ae-0f00288364b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1678 microversion: 2.1 time: 0.188929 Oct 31 16:19:54.369201 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3413/6971] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:54 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:55.394009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:55.394617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:55.405667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:55.406323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:55.407979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:55.409277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:55.409859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:55.410405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:55.985573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:55.993332 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66a3b9a4-5085-4679-9928-9bcbd40bcf5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1678 microversion: 2.1 time: 0.604108 Oct 31 16:19:55.993924 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3559/6972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:55 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1678 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:57.019454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:57.020711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:57.027640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:57.028146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:57.028604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:57.029509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:57.029981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:57.030427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:57.165436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:57.173864 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-83fce8a7-2465-4044-b805-de5fa828bc55 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.158375 Oct 31 16:19:57.174444 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3414/6973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:57 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:19:58.199051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:58.200265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:58.209914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:58.210399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:58.210836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:58.211530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:58.211991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:58.212416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:58.347282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:58.356870 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5d8450d-3671-4205-b9ad-455150a5952a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.162716 Oct 31 16:19:58.357652 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3560/6974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:58 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:19:59.382085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:19:59.382703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:19:59.390189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:59.390686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:59.391134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:59.391839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:19:59.392331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:19:59.392750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:19:59.522224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:19:59.530586 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd53a716-1cf0-4662-bea2-c7d4aa4f5f92 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.152427 Oct 31 16:19:59.531158 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3415/6975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:19:59 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:00.553526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:00.554186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:00.561475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:00.561958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:00.562395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:00.563088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:00.563552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:00.563981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:00.699040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:00.708920 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-60489775-8a7f-45f8-89a8-8d405d088f0d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.159309 Oct 31 16:20:00.709563 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3561/6976] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:00 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:01.734005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:01.734636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:01.741574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:01.742077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:01.742531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:01.743236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:01.743708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:01.744150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:01.874224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:01.881954 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a383b1ad-8fa9-46ce-80b4-011fac658bbb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.152752 Oct 31 16:20:01.882537 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3416/6977] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:01 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:02.905828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:02.906359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:02.913338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:02.913826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:02.914262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:02.914958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:02.915414 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:02.915837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:03.048063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:03.056027 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11081869-0c62-46f3-828c-847a5c979181 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.153982 Oct 31 16:20:03.056598 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3562/6978] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:02 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:04.081050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:04.081711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:04.088552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:04.089055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:04.089535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:04.090240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:04.090713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:04.091152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:04.225938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:04.233942 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ad5c40e8-a823-4901-a9e6-6d1f185e4655 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.157637 Oct 31 16:20:04.234538 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3417/6979] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:04 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:05.258011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:05.258622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:05.266332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:05.266811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:05.267245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:05.267927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:05.268379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:05.268803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:05.401834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:05.410313 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-04094eb8-f6c4-4e67-a488-5e27fe305020 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.156268 Oct 31 16:20:05.410889 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3563/6980] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:05 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:06.433214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:06.433841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:06.440790 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:06.441318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:06.441767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:06.442469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:06.442938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:06.443375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:06.570492 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:06.578496 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6ef09af4-b08a-4cb4-8dba-8201ac510e2c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.149390 Oct 31 16:20:06.579087 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3418/6981] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:06 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:07.602396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:07.603024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:07.610581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:07.611059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:07.611493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:07.612212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:07.612694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:07.613120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:07.740659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:07.748300 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-76fe1faf-22dd-43c3-9985-97a3246cca30 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1683 microversion: 2.1 time: 0.149809 Oct 31 16:20:07.748938 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3564/6982] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:07 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:08.773490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:08.774710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:08.782037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:08.782542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:08.782998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:08.783716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:08.784194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:08.784666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:09.010309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:09.019554 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26d33727-5bd7-42f0-bc66-992484ac67f9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1682 microversion: 2.1 time: 0.249964 Oct 31 16:20:09.020166 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3419/6983] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:08 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1682 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:09.103699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-001fd67a-e8b5-44d6-abd0-8bf14bc848f7 req-5a89d1ca-4a8e-4dbb-b372-668877597563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8f5aeb-c505-4563-a605-8b0b2ae788d0", "name": "network-vif-unplugged", "status": "completed", "tag": "703100eb-04b8-40f2-b615-1edd3c59060f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:09.113529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-001fd67a-e8b5-44d6-abd0-8bf14bc848f7 req-5a89d1ca-4a8e-4dbb-b372-668877597563 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:09.114030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-001fd67a-e8b5-44d6-abd0-8bf14bc848f7 req-5a89d1ca-4a8e-4dbb-b372-668877597563 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:09.114456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-001fd67a-e8b5-44d6-abd0-8bf14bc848f7 req-5a89d1ca-4a8e-4dbb-b372-668877597563 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:09.127047 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-001fd67a-e8b5-44d6-abd0-8bf14bc848f7 req-5a89d1ca-4a8e-4dbb-b372-668877597563 service nova] Creating event network-vif-unplugged:703100eb-04b8-40f2-b615-1edd3c59060f for instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 on n-h1-858384-17 Oct 31 16:20:09.132552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-001fd67a-e8b5-44d6-abd0-8bf14bc848f7 req-5a89d1ca-4a8e-4dbb-b372-668877597563 service nova] Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:20:09.145102 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-001fd67a-e8b5-44d6-abd0-8bf14bc848f7 req-5a89d1ca-4a8e-4dbb-b372-668877597563 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045984 Oct 31 16:20:09.145961 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3565/6984] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:20:10.044351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:10.044910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:10.052199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:10.052697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:10.053165 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:10.054033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:10.054505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:10.054942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:10.202645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:10.211053 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-90400d84-be00-4ba8-9db5-fddf3d26fb21 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1682 microversion: 2.1 time: 0.170701 Oct 31 16:20:10.211640 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3420/6985] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:10 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:11.186090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e568b8ac-5d93-479f-88f3-f0ba1f40ece4 req-7b6898d4-08dd-4a47-ad6b-8402313290d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8f5aeb-c505-4563-a605-8b0b2ae788d0", "tag": "703100eb-04b8-40f2-b615-1edd3c59060f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:11.196237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e568b8ac-5d93-479f-88f3-f0ba1f40ece4 req-7b6898d4-08dd-4a47-ad6b-8402313290d1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:11.196724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e568b8ac-5d93-479f-88f3-f0ba1f40ece4 req-7b6898d4-08dd-4a47-ad6b-8402313290d1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:11.197188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e568b8ac-5d93-479f-88f3-f0ba1f40ece4 req-7b6898d4-08dd-4a47-ad6b-8402313290d1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:11.209456 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e568b8ac-5d93-479f-88f3-f0ba1f40ece4 req-7b6898d4-08dd-4a47-ad6b-8402313290d1 service nova] Creating event network-changed:703100eb-04b8-40f2-b615-1edd3c59060f for instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 on n-h1-858384-17 Oct 31 16:20:11.214966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-e568b8ac-5d93-479f-88f3-f0ba1f40ece4 req-7b6898d4-08dd-4a47-ad6b-8402313290d1 service nova] Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:20:11.225864 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e568b8ac-5d93-479f-88f3-f0ba1f40ece4 req-7b6898d4-08dd-4a47-ad6b-8402313290d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044982 Oct 31 16:20:11.226437 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3566/6986] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:11.234966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:11.235681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:11.243404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:11.244070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:11.244526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:11.245315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:11.245793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:11.246268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:11.455263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:11.469116 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b1fe9a9-8e6c-4a26-b038-ea95385d7f64 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1680 microversion: 2.1 time: 0.238475 Oct 31 16:20:11.469815 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3421/6987] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:11 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1680 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:12.494230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:12.494935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:12.501987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.502471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.502915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.503602 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.504059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.504486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.639517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:12.647331 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-544a230f-6d43-4495-b0d0-eb24f9fc7937 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1677 microversion: 2.1 time: 0.157500 Oct 31 16:20:12.647910 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3567/6988] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:12 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:12.670509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:12.671055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:12.678435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.678930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.679379 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.680073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.680541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.680980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.717673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.718188 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.719401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.720127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.720591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.721029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.741121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:20:12.746555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for user caa0eaf7405a4edaa9961792a2efdd0b and project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:20:12.849608 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f36d4fac-b50b-42f9-bf59-9b85744c0d8e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0/action" status: 202 len: 0 microversion: 2.1 time: 0.182712 Oct 31 16:20:12.850389 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3422/6989] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:20:12 2022] POST /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:20:12.858717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:12.859368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:12.866052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.866768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.867258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:12.868398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:12.868398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:12.868971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:13.017520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:13.026371 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ddd5870b-301f-4b49-8233-59bb167e2fd2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1676 microversion: 2.1 time: 0.170854 Oct 31 16:20:13.029169 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3568/6990] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:12 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:14.053742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:14.054462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:14.061692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:14.062194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:14.062950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:14.063666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:14.064138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:14.064581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:14.530700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:14.539718 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0a80133c-6f33-4c69-af77-a2977c8c056b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1676 microversion: 2.1 time: 0.491120 Oct 31 16:20:14.540307 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3423/6991] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:14 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1676 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:15.564483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:15.565168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:15.572021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:15.572808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:15.573285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:15.573999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:15.574456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:15.574891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:15.819842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:15.827820 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-16684703-5077-4c68-9cbf-afc0f95ea433 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1676 microversion: 2.1 time: 0.267917 Oct 31 16:20:15.828626 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3569/6992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:15 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1676 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:16.471831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-87d6f3cc-d877-427d-a50f-7d6b3015a28a req-a097c991-8ad8-40a0-ab85-b8d7ca5ed293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8f5aeb-c505-4563-a605-8b0b2ae788d0", "tag": "703100eb-04b8-40f2-b615-1edd3c59060f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:16.481563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-87d6f3cc-d877-427d-a50f-7d6b3015a28a req-a097c991-8ad8-40a0-ab85-b8d7ca5ed293 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:16.482132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-87d6f3cc-d877-427d-a50f-7d6b3015a28a req-a097c991-8ad8-40a0-ab85-b8d7ca5ed293 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:16.482751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-87d6f3cc-d877-427d-a50f-7d6b3015a28a req-a097c991-8ad8-40a0-ab85-b8d7ca5ed293 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:16.503102 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-87d6f3cc-d877-427d-a50f-7d6b3015a28a req-a097c991-8ad8-40a0-ab85-b8d7ca5ed293 service nova] Creating event network-changed:703100eb-04b8-40f2-b615-1edd3c59060f for instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 on n-h2-858384-17 Oct 31 16:20:16.508651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-87d6f3cc-d877-427d-a50f-7d6b3015a28a req-a097c991-8ad8-40a0-ab85-b8d7ca5ed293 service nova] Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:20:16.521036 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-87d6f3cc-d877-427d-a50f-7d6b3015a28a req-a097c991-8ad8-40a0-ab85-b8d7ca5ed293 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114626 Oct 31 16:20:16.522060 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3424/6993] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:16.658579 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ea901613-b08e-4ffa-b6ed-f8f71aac2f87 req-1c41b1e3-6e0b-460d-8fc4-f3ff9c911c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8f5aeb-c505-4563-a605-8b0b2ae788d0", "name": "network-vif-plugged", "status": "completed", "tag": "703100eb-04b8-40f2-b615-1edd3c59060f"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:16.670549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ea901613-b08e-4ffa-b6ed-f8f71aac2f87 req-1c41b1e3-6e0b-460d-8fc4-f3ff9c911c16 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:16.671478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ea901613-b08e-4ffa-b6ed-f8f71aac2f87 req-1c41b1e3-6e0b-460d-8fc4-f3ff9c911c16 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:16.671478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ea901613-b08e-4ffa-b6ed-f8f71aac2f87 req-1c41b1e3-6e0b-460d-8fc4-f3ff9c911c16 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:16.684858 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ea901613-b08e-4ffa-b6ed-f8f71aac2f87 req-1c41b1e3-6e0b-460d-8fc4-f3ff9c911c16 service nova] Creating event network-vif-plugged:703100eb-04b8-40f2-b615-1edd3c59060f for instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 on n-h2-858384-17 Oct 31 16:20:16.692068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-ea901613-b08e-4ffa-b6ed-f8f71aac2f87 req-1c41b1e3-6e0b-460d-8fc4-f3ff9c911c16 service nova] Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:20:16.703873 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ea901613-b08e-4ffa-b6ed-f8f71aac2f87 req-1c41b1e3-6e0b-460d-8fc4-f3ff9c911c16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113562 Oct 31 16:20:16.704974 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3570/6994] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:16.852300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:16.853015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:16.859203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:16.860889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:16.861557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:16.862266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:16.862731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:16.863335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:17.111359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:17.119044 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7bb7f021-dee9-476f-a2c0-e6b4b9acf119 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1676 microversion: 2.1 time: 0.271015 Oct 31 16:20:17.119634 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3425/6995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:16 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1676 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:18.145431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:18.146135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:18.152323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:18.152842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:18.153314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:18.154015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:18.154476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:18.154908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:18.290978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:18.298832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23a9e53b-4d7c-4ac7-968b-4498e06de92d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1676 microversion: 2.1 time: 0.159214 Oct 31 16:20:18.299426 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3571/6996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:18 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:19.322718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:19.323332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:19.330658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.331147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.331614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.332310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.332778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.333239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.462721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:19.466226 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:19.471208 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-86e17377-d3eb-4666-84d0-76d1c38e4e52 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1669 microversion: 2.1 time: 0.152441 Oct 31 16:20:19.471788 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3426/6997] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:19 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:19.493627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:19.494266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:19.501064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.502172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.502704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.503401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.503857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.504289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.636122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:19.644607 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f6d03a5-d52b-4484-892b-f2f2a6c6ce13 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1669 microversion: 2.1 time: 0.154851 Oct 31 16:20:19.645237 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3572/6998] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:19 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:19.667846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:19.668477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:19.676162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.676673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.677146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.677870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.678351 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.678786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.811384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:19.819261 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96f381f1-9824-4277-9519-46e9bcdc1c7c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1669 microversion: 2.1 time: 0.155298 Oct 31 16:20:19.819860 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3427/6999] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:19 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:19.842272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:19.842779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:19.849792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.850281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.850724 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.851428 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.851883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.852360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.878372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:20:19.893120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:19.955942 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3048ed59-e84b-4154-b6fd-8092a678d439 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 204 len: 0 microversion: 2.1 time: 0.117295 Oct 31 16:20:19.959562 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3573/7000] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:20:19 2022] DELETE /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:20:19.964834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:19.965496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:19.972429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.972939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.973423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:19.974135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:19.974644 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:19.975087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:20.114255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:20.122229 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-62bbe69c-1f87-4ee7-a09d-a828ffd7417a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1675 microversion: 2.1 time: 0.161316 Oct 31 16:20:20.122826 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3428/7001] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:19 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:21.147458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:21.148152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:21.154925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:21.155407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:21.155844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:21.156538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:21.156993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:21.157445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:21.287127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:21.294868 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c89b8c9-d4d3-4d66-9cbd-06546a5ef6e1 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1675 microversion: 2.1 time: 0.152549 Oct 31 16:20:21.295456 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3574/7002] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:21 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:22.140391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bfd55b27-291b-453f-97a0-0e672eaa9ea8 req-193e4114-54e5-4962-9d96-11b3f271ebf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8f5aeb-c505-4563-a605-8b0b2ae788d0", "name": "network-vif-deleted", "tag": "703100eb-04b8-40f2-b615-1edd3c59060f"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:22.164889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfd55b27-291b-453f-97a0-0e672eaa9ea8 req-193e4114-54e5-4962-9d96-11b3f271ebf8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:22.165691 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfd55b27-291b-453f-97a0-0e672eaa9ea8 req-193e4114-54e5-4962-9d96-11b3f271ebf8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:22.166325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bfd55b27-291b-453f-97a0-0e672eaa9ea8 req-193e4114-54e5-4962-9d96-11b3f271ebf8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:22.185284 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bfd55b27-291b-453f-97a0-0e672eaa9ea8 req-193e4114-54e5-4962-9d96-11b3f271ebf8 service nova] Creating event network-vif-deleted:703100eb-04b8-40f2-b615-1edd3c59060f for instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 on n-h2-858384-17 Oct 31 16:20:22.191971 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bfd55b27-291b-453f-97a0-0e672eaa9ea8 req-193e4114-54e5-4962-9d96-11b3f271ebf8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055884 Oct 31 16:20:22.194028 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3429/7003] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:22.319652 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:22.320264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:22.327199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:22.327665 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:22.328093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:22.328787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:22.329272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:22.329696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:22.365807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:22.366296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:22.366729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:22.367176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lazy-loading 'fault' on Instance uuid 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:20:22.409855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:22.417541 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2563f5ea-3084-44ca-b0e4-6ae9d3f8c47c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 200 len: 1329 microversion: 2.1 time: 0.101709 Oct 31 16:20:22.418135 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3575/7004] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:22 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:23.438915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:23.444653 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:23.445385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:23.451872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:23.452363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:23.452808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:23.453527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:23.453993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:23.454430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:23.468223 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 HTTP/1.1 Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '6a8f5aeb-c505-4563-a605-8b0b2ae788d0'} Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:20:23.469960 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5e47c61e-a8c4-4aa7-a36e-fef4173e8386 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 404 len: 111 microversion: 2.1 time: 0.033551 Oct 31 16:20:23.474823 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3430/7005] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:23 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:20:23.486821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:23.487542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:23.494304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:23.494792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:23.495230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:23.495932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:23.496390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:23.496820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:23.510520 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 HTTP/1.1 Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '6a8f5aeb-c505-4563-a605-8b0b2ae788d0'} Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:20:23.512155 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-931c3e75-f99c-4ad3-ab07-28d16d750ed9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 404 len: 111 microversion: 2.1 time: 0.030582 Oct 31 16:20:23.516794 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3576/7006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:23 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:20:23.562598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-498161050", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "e277981e-27eb-4f80-bff7-dce3df886165"}], "security_groups": [{"name": "tempest-securitygroup--556064750"}], "key_name": "tempest-keypair-1205507471", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:23.669299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] validate_networks() for [('e277981e-27eb-4f80-bff7-dce3df886165', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:20:24.050424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:20:24.050872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:20:24.051362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:20:24.051784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:20:24.052210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:20:24.061257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:24.061763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:24.062213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:24.062961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:24.063436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:24.063881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:24.080736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:20:24.086376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for user caa0eaf7405a4edaa9961792a2efdd0b and project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:20:24.099383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:20:24.101756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:20:24.148206 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a56cbbe5-de18-4402-930f-cee3a0b65e82 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.589674 Oct 31 16:20:24.148867 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3431/7007] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:20:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:20:24.161374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-135eeb43-1fb3-4a54-b4ec-1aeac2e458bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:24.161985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-135eeb43-1fb3-4a54-b4ec-1aeac2e458bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:24.163959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:24.222647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-135eeb43-1fb3-4a54-b4ec-1aeac2e458bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:24.230557 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-135eeb43-1fb3-4a54-b4ec-1aeac2e458bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1238 microversion: 2.1 time: 0.073694 Oct 31 16:20:24.231235 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3577/7008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:24 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:25.255956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:25.256576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:25.258498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:25.264621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:25.265369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:25.265821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:25.266529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:25.266994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:25.267427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:25.374279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:25.382542 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9bda3d66-42b1-4904-bd00-fc9ea8e238f7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1296 microversion: 2.1 time: 0.131347 Oct 31 16:20:25.383115 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3432/7009] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:25 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1296 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:26.407208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:26.408079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:26.415907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:26.416404 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:26.416852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:26.417584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:26.418051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:26.418480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:26.524877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-dcbac20b-2817-4704-9494-7899b7b60a50 req-8bb1f1e4-c1fe-4065-b0f0-030dd45533a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:26.542261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dcbac20b-2817-4704-9494-7899b7b60a50 req-8bb1f1e4-c1fe-4065-b0f0-030dd45533a3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:26.542769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dcbac20b-2817-4704-9494-7899b7b60a50 req-8bb1f1e4-c1fe-4065-b0f0-030dd45533a3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:26.543218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dcbac20b-2817-4704-9494-7899b7b60a50 req-8bb1f1e4-c1fe-4065-b0f0-030dd45533a3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:26.556614 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-dcbac20b-2817-4704-9494-7899b7b60a50 req-8bb1f1e4-c1fe-4065-b0f0-030dd45533a3 service nova] Creating event network-changed:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h1-858384-17 Oct 31 16:20:26.561203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:26.572582 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4dcc55d3-6448-47ad-9fb9-c23501bf587f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1363 microversion: 2.1 time: 0.169247 Oct 31 16:20:26.573455 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3578/7010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:26 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:26.575279 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-dcbac20b-2817-4704-9494-7899b7b60a50 req-8bb1f1e4-c1fe-4065-b0f0-030dd45533a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055016 Oct 31 16:20:26.576181 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3433/7011] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:27.595846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:27.596488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:27.604139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:27.604627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:27.605068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:27.605785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:27.606243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:27.606671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:27.736770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:27.744757 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4eda131a-5f59-4d45-a38a-368f1b2b8c20 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1363 microversion: 2.1 time: 0.152792 Oct 31 16:20:27.745371 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3579/7012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:27 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:28.771267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:28.772164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:28.778354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:28.778849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:28.779324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:28.780027 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:28.780497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:28.780944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:28.914655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:28.922358 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01b9fdab-b7f8-4602-8b5f-3d781fddd768 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1363 microversion: 2.1 time: 0.157104 Oct 31 16:20:28.922933 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3434/7013] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:28 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:29.946744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:29.947348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:29.955456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:29.955952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:29.956384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:29.957722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:29.957722 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:29.958346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:30.094638 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:30.102371 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-943a2120-2613-4472-8dd2-dcaa203dca5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1363 microversion: 2.1 time: 0.160003 Oct 31 16:20:30.102964 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3580/7014] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:29 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:20:31.125883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:31.126543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:31.134094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:31.134596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:31.135047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:31.135749 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:31.136219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:31.136661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:31.263882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:31.271539 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-54a80057-514b-4109-802b-173de3f658bf tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1363 microversion: 2.1 time: 0.149573 Oct 31 16:20:31.272132 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3435/7015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:31 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:31.889997 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b07dc2d6-3554-4512-8375-77be80412b97 req-d9813a14-bbd8-4e75-8f6e-b9045c6b9856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "name": "network-vif-plugged", "status": "completed", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:31.902049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b07dc2d6-3554-4512-8375-77be80412b97 req-d9813a14-bbd8-4e75-8f6e-b9045c6b9856 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:31.902684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b07dc2d6-3554-4512-8375-77be80412b97 req-d9813a14-bbd8-4e75-8f6e-b9045c6b9856 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:31.903118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b07dc2d6-3554-4512-8375-77be80412b97 req-d9813a14-bbd8-4e75-8f6e-b9045c6b9856 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:31.915547 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b07dc2d6-3554-4512-8375-77be80412b97 req-d9813a14-bbd8-4e75-8f6e-b9045c6b9856 service nova] Creating event network-vif-plugged:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h1-858384-17 Oct 31 16:20:31.920566 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b07dc2d6-3554-4512-8375-77be80412b97 req-d9813a14-bbd8-4e75-8f6e-b9045c6b9856 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034290 Oct 31 16:20:31.921208 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3581/7016] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:20:32.295873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:32.296495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:32.303818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:32.304307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:32.304751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:32.305475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:32.305948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:32.306380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:32.435212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:32.443154 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ee5c6f7-b241-4998-a804-536cccd00772 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1363 microversion: 2.1 time: 0.151247 Oct 31 16:20:32.443738 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3436/7017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:32 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:20:33.468161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:33.468865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:33.475670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:33.476154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:33.476597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:33.477326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:33.477787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:33.478214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:33.609216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:20:33.617158 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a90551a4-3e87-4f5e-bc77-9018b28668c6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1548 microversion: 2.1 time: 0.154181 Oct 31 16:20:33.617753 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3582/7018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:20:33 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:20:33.641406 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64838a4f-e4f6-4415-ae9c-42bdc26f96ba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:20:33.641902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64838a4f-e4f6-4415-ae9c-42bdc26f96ba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:20:33.649488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64838a4f-e4f6-4415-ae9c-42bdc26f96ba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:33.649983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64838a4f-e4f6-4415-ae9c-42bdc26f96ba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:33.650430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64838a4f-e4f6-4415-ae9c-42bdc26f96ba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:33.651154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64838a4f-e4f6-4415-ae9c-42bdc26f96ba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:33.651640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64838a4f-e4f6-4415-ae9c-42bdc26f96ba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:33.652107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64838a4f-e4f6-4415-ae9c-42bdc26f96ba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:33.732383 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64838a4f-e4f6-4415-ae9c-42bdc26f96ba tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095193 Oct 31 16:20:33.732997 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3437/7019] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 16:20:33 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:20:34.999615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7fd89337-b75b-4142-a09b-14b54325fa88 req-7607ab98-641b-40c9-a45f-6d96947ae8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:20:35.004418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:20:35.011709 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7fd89337-b75b-4142-a09b-14b54325fa88 req-7607ab98-641b-40c9-a45f-6d96947ae8c4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:20:35.012185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7fd89337-b75b-4142-a09b-14b54325fa88 req-7607ab98-641b-40c9-a45f-6d96947ae8c4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:20:35.012618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7fd89337-b75b-4142-a09b-14b54325fa88 req-7607ab98-641b-40c9-a45f-6d96947ae8c4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:20:35.027359 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7fd89337-b75b-4142-a09b-14b54325fa88 req-7607ab98-641b-40c9-a45f-6d96947ae8c4 service nova] Creating event network-changed:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h1-858384-17 Oct 31 16:20:35.032430 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7fd89337-b75b-4142-a09b-14b54325fa88 req-7607ab98-641b-40c9-a45f-6d96947ae8c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036465 Oct 31 16:20:35.033236 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3583/7020] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:21:09.252102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:09.252893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:09.255163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=11 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:09.255807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=48 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:09.260498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:09.261198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:09.269545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:09.270055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:09.270508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:09.271214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:09.271686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:09.272128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:09.406634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:09.414300 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71546b89-84e2-41b1-a57d-6a7478a0ce5f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1667 microversion: 2.1 time: 0.163051 Oct 31 16:21:09.414880 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3438/7021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:09 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:09.435398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=15 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:09.436205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:09.441517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b6e9ac69-fa0b-4508-aa58-0796cb04e6d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d6aa861-4aae-4fe7-a9f0-2c58048dc426"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:21:09.443939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b6e9ac69-fa0b-4508-aa58-0796cb04e6d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:09.452754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e9ac69-fa0b-4508-aa58-0796cb04e6d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:09.453211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e9ac69-fa0b-4508-aa58-0796cb04e6d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:09.453656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e9ac69-fa0b-4508-aa58-0796cb04e6d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:09.454353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e9ac69-fa0b-4508-aa58-0796cb04e6d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:09.454816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e9ac69-fa0b-4508-aa58-0796cb04e6d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:09.455247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b6e9ac69-fa0b-4508-aa58-0796cb04e6d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:09.693110 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b6e9ac69-fa0b-4508-aa58-0796cb04e6d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260309 Oct 31 16:21:09.693772 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3584/7022] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 16:21:09 2022] POST /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:21:20.416464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:21:20.418903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:20.421530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:20.422880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:20.428516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:20.429023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:20.429572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:20.430295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:20.430773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:20.431221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:20.460460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:20.465894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Old instance type m1.heat2, new instance type m1.heat {{(pid=120588) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:21:20.473690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:21:20.474131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:21:20.474621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:21:20.475047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:21:20.475476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:21:20.539247 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e2bb35c7-abfc-4c78-9969-afae77843586 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/action" status: 202 len: 0 microversion: 2.1 time: 0.126616 Oct 31 16:21:20.539863 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3439/7023] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:21:20 2022] POST /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:21:20.546203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:20.547128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:20.551831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:20.551986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:20.559374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:20.559875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:20.560289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:20.560987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:20.561502 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:20.561945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:20.704994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:20.713716 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19ff9355-e92e-45d3-8f37-2adbb5899df7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1722 microversion: 2.1 time: 0.169514 Oct 31 16:21:20.714302 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3585/7024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:20 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:21:21.740625 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:21.741216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:21.748169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:21.748678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:21.749148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:21.749874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:21.750345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:21.751064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:21.976110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:21.984404 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-42b07c79-1487-4b0c-b856-5e8b111ac437 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1722 microversion: 2.1 time: 0.249767 Oct 31 16:21:21.985918 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3440/7025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:21 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:23.008445 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:23.009062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:23.016032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:23.016881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:23.017413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:23.018118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:23.018580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:23.019010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:23.148222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:23.156515 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed1d5f8c-0cf7-4cb5-bc58-598aa76f1888 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.151999 Oct 31 16:21:23.157617 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3586/7026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:23 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:24.181070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:24.181724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:24.188559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:24.189832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:24.190317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:24.191272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:24.191923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:24.192376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:24.324169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:24.332516 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-09f784d9-9006-497d-8460-eef7ee8b3beb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.155396 Oct 31 16:21:24.333107 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3441/7027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:24 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:25.355792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:25.356398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:25.363954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:25.364435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:25.364869 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:25.365590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:25.366047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:25.366471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:25.499071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:25.507717 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b3f1f7da-90ec-4939-bd13-0464644ae066 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.155810 Oct 31 16:21:25.508309 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3587/7028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:25 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:26.531696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:26.532311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:26.539286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:26.539789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:26.540243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:26.540952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:26.541459 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:26.541906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:26.672702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:26.681621 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f8b24967-3039-4532-9476-17990efd612d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.153903 Oct 31 16:21:26.682204 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3442/7029] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:26 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:27.705971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:27.706609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:27.713511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:27.713999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:27.714439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:27.715130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:27.715600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:27.716024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:27.845655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:27.854940 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b6e577d-8f7a-4fab-ae62-a3b6f8501643 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.153421 Oct 31 16:21:27.855532 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3588/7030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:27 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:28.878730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:28.879314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:28.886058 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:28.886551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:28.886996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:28.887692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:28.888160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:28.888594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:29.022865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:29.031059 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-12ed7127-16ab-4aa2-83ad-4838633ad60a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.156409 Oct 31 16:21:29.031635 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3443/7031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:28 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:30.055244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:30.055860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:30.062760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:30.063253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:30.063703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:30.064481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:30.064949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:30.065419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:30.197152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:30.206139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3df36173-d467-4de1-8329-5d9b435767fb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.154840 Oct 31 16:21:30.206740 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3589/7032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:30 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:31.229511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:31.230133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:31.237696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:31.238189 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:31.238639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:31.239339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:31.239839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:31.240275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:31.370998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:31.379467 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-599a016c-052e-4cb5-94f6-9fcc4172d4a5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.153958 Oct 31 16:21:31.380040 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3444/7033] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:31 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:32.403717 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:32.404357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:32.411424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:32.411912 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:32.412354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:32.413054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:32.413554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:32.413984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:32.547331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:32.556231 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5001bc5f-b433-4412-9d26-82b44a0dc4d5 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.156689 Oct 31 16:21:32.556815 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3590/7034] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:32 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:33.580481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:33.581112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:33.588018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:33.588528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:33.588979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:33.589715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:33.590194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:33.590635 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:33.725279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:33.734341 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cbec2e31-ea41-47ad-8945-06b3eea37a4b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.157882 Oct 31 16:21:33.734933 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3445/7035] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:33 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:34.758763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:34.759416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:34.767086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:34.767484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:34.768420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:34.769450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:34.769911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:34.770341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:34.900260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:34.909107 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-79a7e72f-5da4-45ed-820a-9ab6e2f21746 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.153707 Oct 31 16:21:34.910072 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3591/7036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:34 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:35.933768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:35.934324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:35.942645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:35.943149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:35.943606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:35.944316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:35.944794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:35.945275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:36.074579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:36.083490 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c52ee976-6a9c-4b12-9b2c-ddfa47ea66b8 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.153840 Oct 31 16:21:36.084073 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3446/7037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:35 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:37.107233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:37.107770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:37.114557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:37.115048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:37.115481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:37.116165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:37.116615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:37.117036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:37.248826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:37.257723 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0b9f732d-0d11-4dde-a58f-8044189c0416 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.154488 Oct 31 16:21:37.258307 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3592/7038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:37 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:38.281788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:38.282422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:38.289991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:38.290501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:38.290955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:38.291673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:38.292147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:38.292595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:38.426311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:38.434637 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70fd4ed3-e02d-440e-b145-53ba7ecc193f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.156854 Oct 31 16:21:38.435226 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3447/7039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:38 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:39.458772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:39.459476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:39.466089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:39.466584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:39.467027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:39.467732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:39.468194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:39.468627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:39.605277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:39.614357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3de5fbe1-c5c1-4c91-9bbc-4edfb1e494b3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.159495 Oct 31 16:21:39.614948 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3593/7040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:39 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:40.639409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:40.640037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:40.647776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:40.648312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:40.648768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:40.649508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:40.649988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:40.650430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:40.785958 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:40.794701 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-affbc137-6fd0-40a1-88ae-23c0a4f8a123 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1727 microversion: 2.1 time: 0.159372 Oct 31 16:21:40.795302 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3448/7041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:40 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:21:41.820442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:41.821099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:41.828023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:41.828506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:41.828936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:41.829669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:41.830125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:41.830574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:42.071932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:42.080160 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c09166ae-33e1-45e1-93cd-860e2b5e5203 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1726 microversion: 2.1 time: 0.264589 Oct 31 16:21:42.080751 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3594/7042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:41 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1726 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:42.241899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-82caee4c-310a-4bba-81ae-18d3666db7ec req-4b7a8b55-8198-418f-b175-f79e39bc535c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "name": "network-vif-unplugged", "status": "completed", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:21:42.252430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-82caee4c-310a-4bba-81ae-18d3666db7ec req-4b7a8b55-8198-418f-b175-f79e39bc535c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:42.253154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-82caee4c-310a-4bba-81ae-18d3666db7ec req-4b7a8b55-8198-418f-b175-f79e39bc535c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:42.253893 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-82caee4c-310a-4bba-81ae-18d3666db7ec req-4b7a8b55-8198-418f-b175-f79e39bc535c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:42.277833 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-82caee4c-310a-4bba-81ae-18d3666db7ec req-4b7a8b55-8198-418f-b175-f79e39bc535c service nova] Creating event network-vif-unplugged:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h2-858384-17 Oct 31 16:21:42.283296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-82caee4c-310a-4bba-81ae-18d3666db7ec req-4b7a8b55-8198-418f-b175-f79e39bc535c service nova] Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:21:42.295184 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-82caee4c-310a-4bba-81ae-18d3666db7ec req-4b7a8b55-8198-418f-b175-f79e39bc535c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057612 Oct 31 16:21:42.295802 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3449/7043] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:21:43.105006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:43.105747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:43.111879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:43.112432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:43.112812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:43.113530 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:43.113987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:43.114412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:43.313091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:43.322465 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec3ad7c4-a343-46c0-ba28-4847298285bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1726 microversion: 2.1 time: 0.221472 Oct 31 16:21:43.323029 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3595/7044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:43 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1726 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:44.323613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fc44b0c5-8919-462d-a4c0-9d4a4f035c71 req-234ee802-b136-45db-8b63-a80aea30a540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:21:44.334923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fc44b0c5-8919-462d-a4c0-9d4a4f035c71 req-234ee802-b136-45db-8b63-a80aea30a540 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:44.335347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fc44b0c5-8919-462d-a4c0-9d4a4f035c71 req-234ee802-b136-45db-8b63-a80aea30a540 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:44.336275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fc44b0c5-8919-462d-a4c0-9d4a4f035c71 req-234ee802-b136-45db-8b63-a80aea30a540 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:44.347557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:44.348412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:44.349419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fc44b0c5-8919-462d-a4c0-9d4a4f035c71 req-234ee802-b136-45db-8b63-a80aea30a540 service nova] Creating event network-changed:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h2-858384-17 Oct 31 16:21:44.354913 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-fc44b0c5-8919-462d-a4c0-9d4a4f035c71 req-234ee802-b136-45db-8b63-a80aea30a540 service nova] Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:21:44.355506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:44.356091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:44.356627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:44.357622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:44.358288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:44.358913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:44.367076 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fc44b0c5-8919-462d-a4c0-9d4a4f035c71 req-234ee802-b136-45db-8b63-a80aea30a540 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048547 Oct 31 16:21:44.368187 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3450/7045] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:21:44.660630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:44.670194 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eff9493e-c1b0-42b3-9bb4-fe9f7a10f9bc tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.327107 Oct 31 16:21:44.673439 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3596/7046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:44 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:21:45.701401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:45.702163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:45.709015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:45.709539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:45.709984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:45.710701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:45.711169 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:45.711603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:45.852319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:45.860700 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-35b36f2e-76e6-4105-80d4-f6fdccc01b5c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.164574 Oct 31 16:21:45.861312 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3451/7047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:45 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:46.931474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:46.932092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:46.938114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:46.938604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:46.939038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:46.939731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:46.940187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:46.940675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:47.074128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:47.083395 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6e39dae-c1da-4375-82cc-a0911a6d7107 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.201770 Oct 31 16:21:47.084085 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3597/7048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:46 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:48.107297 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:48.107926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:48.115142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:48.115645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:48.116095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:48.116845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:48.117345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:48.117783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:48.257213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:48.265553 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-201c6904-bc0e-4506-b5ef-eb9659f5dfa2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.162118 Oct 31 16:21:48.266137 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3452/7049] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:48 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:49.291107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:49.291720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:49.298505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:49.298984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:49.299417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:49.300103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:49.302086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:49.302464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:49.437868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:49.447061 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad7ed151-0b6f-4d8d-ac7c-f565b42cef57 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.160591 Oct 31 16:21:49.447639 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3598/7050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:49 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:50.471453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:50.472074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:50.475352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=33 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:50.480690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:50.481221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:50.481676 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:50.482392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:50.482864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:50.483306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:50.486179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:50.617554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:50.625784 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bde2f17d-a942-4f27-8cb0-646786770857 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.158282 Oct 31 16:21:50.626359 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3453/7051] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:50 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:51.650019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:51.650635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:51.653335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=29 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:51.658876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:51.659366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:51.660305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:51.661102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:51.661666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:51.662127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:51.664926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=85 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:21:51.793479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:51.802197 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-04e65d1c-ca87-4ea1-8484-64dcc166284a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.156193 Oct 31 16:21:51.802789 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3599/7052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:51 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:52.826547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:52.827181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:52.834252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:52.834688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:52.835149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:52.835844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:52.836314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:52.836752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:52.973201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:52.981554 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a1f6ad9e-a831-4df5-9e5e-48df395537ea tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.158910 Oct 31 16:21:52.982145 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3454/7053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:52 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:54.006574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:54.007215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:54.015045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:54.015702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:54.016177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:54.016874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:54.017372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:54.017800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:54.148043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:54.156293 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0fd0a64a-7531-4c1e-8169-97f0c7c77981 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.154348 Oct 31 16:21:54.156883 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3600/7054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:54 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:55.180559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:55.181217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:55.188042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:55.188541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:55.188992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:55.189721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:55.190191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:55.190632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:55.323865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:55.332254 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3081a246-f712-4e70-adc7-26d438689604 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1724 microversion: 2.1 time: 0.156297 Oct 31 16:21:55.332835 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3455/7055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:55 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:56.356541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:56.357264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:56.365407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.365899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.366332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.367025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.367479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.367910 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.510960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:56.520058 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-571bf5a1-dbfe-4f61-8a14-a5fa211b30f0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1721 microversion: 2.1 time: 0.167359 Oct 31 16:21:56.520686 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3601/7056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:56 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:56.543264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:21:56.543845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:56.550729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.551969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.552480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.553217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.553696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.554134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.594494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.594997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.595448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.596202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.596868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.597339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.619089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:21:56.624289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Getting quotas for user caa0eaf7405a4edaa9961792a2efdd0b and project 09059acc2c184f3aa6c27557d9ac4a98. Resources: {'cores', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:21:56.731342 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b4e504a0-5658-4a85-aea3-7b7a40666a7f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "POST /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/action" status: 202 len: 0 microversion: 2.1 time: 0.191641 Oct 31 16:21:56.731915 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3456/7057] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:21:56 2022] POST /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:21:56.740782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:56.741552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:56.747672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.748165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.748606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.749337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:56.749799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:56.750258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:56.952127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:56.961346 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52c3e6ba-7578-4ffb-b181-c524eb34355d tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.224877 Oct 31 16:21:56.962423 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3602/7058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:56 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:57.987744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:57.989049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:57.996048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:57.996541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:57.996984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:57.997714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:57.998178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:57.998611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:58.134848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:58.143094 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a0f28a4c-7959-4c09-803e-4098e9b8bafd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.160612 Oct 31 16:21:58.143667 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3457/7059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:57 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:21:58.357986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5beef115-bbc9-4c5e-a57d-2cc1c66e66b9 req-656299e7-1775-4cf8-ac89-760080468dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "name": "network-vif-plugged", "status": "completed", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:21:58.370742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5beef115-bbc9-4c5e-a57d-2cc1c66e66b9 req-656299e7-1775-4cf8-ac89-760080468dcb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:58.371223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5beef115-bbc9-4c5e-a57d-2cc1c66e66b9 req-656299e7-1775-4cf8-ac89-760080468dcb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:58.371662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5beef115-bbc9-4c5e-a57d-2cc1c66e66b9 req-656299e7-1775-4cf8-ac89-760080468dcb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:58.390306 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5beef115-bbc9-4c5e-a57d-2cc1c66e66b9 req-656299e7-1775-4cf8-ac89-760080468dcb service nova] Creating event network-vif-plugged:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h2-858384-17 Oct 31 16:21:58.396775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-5beef115-bbc9-4c5e-a57d-2cc1c66e66b9 req-656299e7-1775-4cf8-ac89-760080468dcb service nova] Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:21:58.412308 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5beef115-bbc9-4c5e-a57d-2cc1c66e66b9 req-656299e7-1775-4cf8-ac89-760080468dcb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057977 Oct 31 16:21:58.412939 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3603/7060] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:21:59.167241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:21:59.167898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:21:59.174654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:59.175202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:59.175683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:59.177087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:21:59.177629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:21:59.178068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:21:59.315830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:21:59.325370 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4c8a009c-4709-4b6e-9cc0-74cc11de80b2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.162009 Oct 31 16:21:59.327209 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3458/7061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:21:59 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:00.350344 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:00.351034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:00.358103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:00.358583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:00.359015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:00.359702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:00.360154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:00.360599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:00.495587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:00.503977 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ae812229-1545-4d64-b075-e9086b0435b6 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.157984 Oct 31 16:22:00.505179 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3604/7062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:00 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:01.528831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:01.530171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:01.537702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:01.538228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:01.538696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:01.539383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:01.539882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:01.540320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:01.677977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:01.686306 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a114d929-e8ff-4e6b-aa01-80a627491afd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.161375 Oct 31 16:22:01.686886 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3459/7063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:01 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:02.304801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-127d4941-2a3a-453b-9537-4a0a1c1a6a09 req-7b562c56-5891-4a2b-a163-63a62beebeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "name": "network-vif-unplugged", "status": "completed", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:02.314464 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-127d4941-2a3a-453b-9537-4a0a1c1a6a09 req-7b562c56-5891-4a2b-a163-63a62beebeb9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:02.314945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-127d4941-2a3a-453b-9537-4a0a1c1a6a09 req-7b562c56-5891-4a2b-a163-63a62beebeb9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:02.315378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-127d4941-2a3a-453b-9537-4a0a1c1a6a09 req-7b562c56-5891-4a2b-a163-63a62beebeb9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:02.328669 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-127d4941-2a3a-453b-9537-4a0a1c1a6a09 req-7b562c56-5891-4a2b-a163-63a62beebeb9 service nova] Creating event network-vif-unplugged:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h1-858384-17 Oct 31 16:22:02.335769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-127d4941-2a3a-453b-9537-4a0a1c1a6a09 req-7b562c56-5891-4a2b-a163-63a62beebeb9 service nova] Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:22:02.347583 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-127d4941-2a3a-453b-9537-4a0a1c1a6a09 req-7b562c56-5891-4a2b-a163-63a62beebeb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106520 Oct 31 16:22:02.348547 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3605/7064] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:02.711686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:02.712366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:02.719339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:02.719846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:02.720480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:02.721238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:02.721719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:02.722331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:02.960741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:02.969313 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2d294053-a5f7-4a17-9419-419fc33fdc4f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.263007 Oct 31 16:22:02.969913 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3460/7065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:02 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:03.994922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:03.995617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:04.001845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:04.002328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:04.002796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:04.003482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:04.003934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:04.004355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:04.142870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:04.151497 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-278279e3-e740-4bb5-826e-a7c7e8f111eb tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.161798 Oct 31 16:22:04.152091 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3606/7066] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:03 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:04.365597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-f7aa1db5-6857-4163-b88b-708537b967c0 req-b555a06d-5d44-4530-8ac9-2ecbe04d0837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:04.375928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f7aa1db5-6857-4163-b88b-708537b967c0 req-b555a06d-5d44-4530-8ac9-2ecbe04d0837 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:04.376539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f7aa1db5-6857-4163-b88b-708537b967c0 req-b555a06d-5d44-4530-8ac9-2ecbe04d0837 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:04.377061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-f7aa1db5-6857-4163-b88b-708537b967c0 req-b555a06d-5d44-4530-8ac9-2ecbe04d0837 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:04.389251 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-f7aa1db5-6857-4163-b88b-708537b967c0 req-b555a06d-5d44-4530-8ac9-2ecbe04d0837 service nova] Creating event network-changed:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h1-858384-17 Oct 31 16:22:04.394657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-f7aa1db5-6857-4163-b88b-708537b967c0 req-b555a06d-5d44-4530-8ac9-2ecbe04d0837 service nova] Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:22:04.405893 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-f7aa1db5-6857-4163-b88b-708537b967c0 req-b555a06d-5d44-4530-8ac9-2ecbe04d0837 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044882 Oct 31 16:22:04.406508 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3461/7067] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:05.175690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:05.176216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:05.183207 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:05.183698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:05.184141 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:05.184846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:05.185345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:05.185779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:05.318943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:05.327559 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3075bdcb-d18c-4bb0-9005-b1cc6d205a9b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.155936 Oct 31 16:22:05.328148 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3607/7068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:05 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:06.353832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:06.354560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:06.361462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:06.362210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:06.362663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:06.363563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:06.364038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:06.364633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:06.502288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:06.511029 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-30aa9b91-d71e-47a4-9d1d-31124f9d652f tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.163388 Oct 31 16:22:06.511614 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3462/7069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:06 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:07.535509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:07.536674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:07.543779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:07.544263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:07.544696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:07.545417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:07.545872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:07.546292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:07.683265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:07.691661 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0f5a6e8-42ca-4d66-bc2e-2281b6b99831 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.160032 Oct 31 16:22:07.692256 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3608/7070] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:07 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:08.716750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:08.717481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:08.719541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:08.726692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:08.727198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:08.727656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:08.728372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:08.728861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:08.729324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:08.858389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:08.866803 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-57cd4865-f4b0-4790-8527-6ad664052313 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.154026 Oct 31 16:22:08.867408 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3463/7071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:08 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:09.892005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:09.892543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:09.900264 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:09.900750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:09.901216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:09.901925 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:09.902385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:09.902811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:10.035666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:10.044603 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-57ebb989-f485-4bd2-81b4-d56b98ba841a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.156602 Oct 31 16:22:10.045224 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3609/7072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:09 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:11.068442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:11.069005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:11.076030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:11.076530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:11.076978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:11.077705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:11.078171 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:11.078609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:11.214843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:11.223216 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70a8be0a-b116-4862-8a82-74e38d70d29e tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.158908 Oct 31 16:22:11.224727 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3464/7073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:11 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:12.248759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:12.249417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:12.257277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:12.257759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:12.258189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:12.258878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:12.259331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:12.259751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:12.395101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:12.403999 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-157c4747-ff33-4622-b226-b5dbfb22969b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.159125 Oct 31 16:22:12.404583 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3610/7074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:12 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:13.428011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:13.428632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:13.435852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:13.436361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:13.436811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:13.437547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:13.438018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:13.438453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:13.574894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:13.583580 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01399bc9-17c6-4eb5-95d3-c61285a3728a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.159492 Oct 31 16:22:13.584164 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3465/7075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:13 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:14.608186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:14.608799 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:14.615514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.615998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.616441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.617153 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:14.617608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:14.618032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:14.752697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:14.762473 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-46f5612c-bb99-42eb-9411-aa038334b3b7 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1720 microversion: 2.1 time: 0.158525 Oct 31 16:22:14.763057 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3611/7076] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:14 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:15.785559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:15.786194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:15.793442 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:15.793946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:15.794404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:15.795119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:15.795594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:15.796039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:15.929448 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:15.937677 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-837e0b0f-12ba-44f7-bddd-1892576fd072 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1713 microversion: 2.1 time: 0.156108 Oct 31 16:22:15.938267 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3466/7077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:15 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:15.960936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:15.961564 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:15.968237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:15.968716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:15.969169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:15.969855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:15.970310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:15.970729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.099867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:16.108097 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-400f2e63-7ecc-4ff6-b02c-745e329c5779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1713 microversion: 2.1 time: 0.151101 Oct 31 16:22:16.108675 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3612/7078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:15 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:16.132152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:16.132783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:16.138732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:16.139229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:16.139684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.140386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:16.140856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:16.141334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.143909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:16.276437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:16.284904 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3d101176-c29a-471a-957f-7f283f89666b tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1713 microversion: 2.1 time: 0.157475 Oct 31 16:22:16.285522 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3467/7079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:16 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1713 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:16.308851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:16.309315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:16.315203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:16.315696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:16.316145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.316848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:16.317341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:16.317774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.344482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:22:16.424286 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a04987eb-d483-48e9-93a6-ccc96a987cb2 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 204 len: 0 microversion: 2.1 time: 0.119162 Oct 31 16:22:16.424970 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3613/7080] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:22:16 2022] DELETE /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 16:22:16.434409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:16.435042 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:16.441157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:16.441665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:16.442113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.442820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:16.443888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:16.444598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:16.578417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:16.587003 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c4c6f7b-99b3-43b6-9ac3-12ec661762ec tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1719 microversion: 2.1 time: 0.157073 Oct 31 16:22:16.587581 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3468/7081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:16 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:17.611292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:17.611996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:17.619431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:17.619919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:17.620365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:17.621062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:17.621560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:17.621989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:17.754210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:17.756535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:17.764275 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3655282a-aaa8-473a-aa56-e84a5effedc3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1719 microversion: 2.1 time: 0.157265 Oct 31 16:22:17.764862 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3614/7082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:17 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:18.393818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5ebd8a9a-1cfd-464c-9ae6-f824acaf173f req-0ad67592-22d0-48c5-999b-31820db5a118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "name": "network-vif-plugged", "status": "completed", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:18.407621 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5ebd8a9a-1cfd-464c-9ae6-f824acaf173f req-0ad67592-22d0-48c5-999b-31820db5a118 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:18.408114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5ebd8a9a-1cfd-464c-9ae6-f824acaf173f req-0ad67592-22d0-48c5-999b-31820db5a118 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:18.408555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5ebd8a9a-1cfd-464c-9ae6-f824acaf173f req-0ad67592-22d0-48c5-999b-31820db5a118 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:18.421955 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5ebd8a9a-1cfd-464c-9ae6-f824acaf173f req-0ad67592-22d0-48c5-999b-31820db5a118 service nova] Creating event network-vif-plugged:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h1-858384-17 Oct 31 16:22:18.428379 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5ebd8a9a-1cfd-464c-9ae6-f824acaf173f req-0ad67592-22d0-48c5-999b-31820db5a118 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038043 Oct 31 16:22:18.429303 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3469/7083] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:18.789435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:18.789965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:18.799275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:18.799822 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:18.800284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:18.801020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:18.801520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:18.801955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:18.871050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:18.892147 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e5ab8cb2-cacd-4c6c-aef5-7ac48d8cf7f3 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1652 microversion: 2.1 time: 0.107493 Oct 31 16:22:18.893911 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3615/7084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:18 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1652 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:19.165961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-ac3e81e9-8f65-4e15-a18f-302a3ca6f5b8 req-290742be-5ca3-41a4-931e-3651fa72406a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb", "name": "network-vif-deleted", "tag": "773d5c40-4751-46b5-84a3-bc720dd3ffc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:19.178969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ac3e81e9-8f65-4e15-a18f-302a3ca6f5b8 req-290742be-5ca3-41a4-931e-3651fa72406a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:19.179601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ac3e81e9-8f65-4e15-a18f-302a3ca6f5b8 req-290742be-5ca3-41a4-931e-3651fa72406a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:19.180219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-ac3e81e9-8f65-4e15-a18f-302a3ca6f5b8 req-290742be-5ca3-41a4-931e-3651fa72406a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:19.194277 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-ac3e81e9-8f65-4e15-a18f-302a3ca6f5b8 req-290742be-5ca3-41a4-931e-3651fa72406a service nova] Creating event network-vif-deleted:773d5c40-4751-46b5-84a3-bc720dd3ffc9 for instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb on n-h1-858384-17 Oct 31 16:22:19.203293 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-ac3e81e9-8f65-4e15-a18f-302a3ca6f5b8 req-290742be-5ca3-41a4-931e-3651fa72406a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043216 Oct 31 16:22:19.204199 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3470/7085] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:22:19.918549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:19.919154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:19.926070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:19.926554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:19.926983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:19.928375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:19.928788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:19.929234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:20.001313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:20.011203 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-19e25caf-f0de-48a5-9719-becbfabc8779 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1369 microversion: 2.1 time: 0.096456 Oct 31 16:22:20.011819 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3616/7086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:19 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:22:21.037837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:21.038567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:21.040849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:21.046649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:21.047157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:21.047617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:21.048340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:21.048818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:21.049293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:21.118530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:21.127262 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a18fe0de-741f-4162-80ec-16d99e512073 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1369 microversion: 2.1 time: 0.094040 Oct 31 16:22:21.127860 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3471/7087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:21 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:22.151201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:22.151813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:22.154808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:22.161279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:22.161857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:22.162391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:22.163093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:22.163580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:22.164001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:22.232030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:22.242236 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e40d74ff-e0c9-4212-9777-67611fd10093 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1369 microversion: 2.1 time: 0.094930 Oct 31 16:22:22.243222 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3617/7088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:22 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:23.266132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:23.266753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:23.274512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:23.275025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:23.275472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:23.276172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:23.276639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:23.277078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:23.342335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa0eaf7405a4edaa9961792a2efdd0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09059acc2c184f3aa6c27557d9ac4a98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:23.352667 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-88b48518-d539-4db6-9eab-7d2fd83e35bd tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 200 len: 1369 microversion: 2.1 time: 0.090362 Oct 31 16:22:23.353278 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3472/7089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:23 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:22:24.377101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:24.377732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:24.384903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:24.385420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:24.385860 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:24.386553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:24.387012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:24.387438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:24.401565 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb HTTP/1.1 Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb'} Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:24.403213 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-279c90fc-4c43-47ec-a02a-848347719e8c tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 404 len: 111 microversion: 2.1 time: 0.031807 Oct 31 16:22:24.408229 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3618/7090] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:24 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:24.466716 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:24.468902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:24.476178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:24.476672 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:24.477117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:24.477834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:24.478302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:24.478734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:24.492295 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/os-volume_attachments HTTP/1.1 Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'server_id': '9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb'} Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:24.494061 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97046297-d66c-42c2-8ce3-62ea0f8818ac tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032896 Oct 31 16:22:24.498819 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3473/7091] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:22:24 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:27.823689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:27.824193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:27.831209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.831633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.832071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.832752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.833255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.833666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.847817 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb HTTP/1.1 Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb'} Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:27.849436 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d36eaa4f-f92d-46e0-bfeb-77b4eca7012a tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 404 len: 111 microversion: 2.1 time: 0.032120 Oct 31 16:22:27.853392 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3619/7092] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:22:27 2022] DELETE /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:27.860423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:27.861047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:27.868543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.869048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.869577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.870302 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.870773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.871211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.887319 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb HTTP/1.1 Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb'} Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:27.888911 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c7ffd023-7336-4f56-8dcb-12aa76249add tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb" status: 404 len: 111 microversion: 2.1 time: 0.034535 Oct 31 16:22:27.893228 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3474/7093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:27 2022] GET /compute/v2.1/servers/9b4268a6-73d0-4ce2-88dd-9eeb5245f8fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:27.899847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:27.900348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:27.907612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.908105 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.908537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.909333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.909787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.910211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.924921 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 HTTP/1.1 Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '6a8f5aeb-c505-4563-a605-8b0b2ae788d0'} Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:27.926987 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-51bd02f2-a731-4c3b-86a6-8c91fa510ae9 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 404 len: 111 microversion: 2.1 time: 0.032983 Oct 31 16:22:27.934700 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3620/7094] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:22:27 2022] DELETE /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:22:27.938195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:27.938833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 6a8f5aeb-c505-4563-a605-8b0b2ae788d0] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:27.945616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.946133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.946588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.947581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.948059 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.948503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.962721 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 HTTP/1.1 Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '6a8f5aeb-c505-4563-a605-8b0b2ae788d0'} Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:27.964298 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 6a8f5aeb-c505-4563-a605-8b0b2ae788d0 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c181f130-6150-4c66-abe1-f2466651d653 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0" status: 404 len: 111 microversion: 2.1 time: 0.032088 Oct 31 16:22:27.968360 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3475/7095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:27 2022] GET /compute/v2.1/servers/6a8f5aeb-c505-4563-a605-8b0b2ae788d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:27.974389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:27.974891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:27.980938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.981534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.981971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.982666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:27.983124 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:27.983548 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:27.997990 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e HTTP/1.1 Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '52aad2ab-1360-4586-9203-0556d835b50e'} Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:27.999539 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8adce82f-a83d-4343-96cd-865a15af99d0 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 404 len: 111 microversion: 2.1 time: 0.030473 Oct 31 16:22:28.003499 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3621/7096] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:22:27 2022] DELETE /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:28.010234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:28.010887 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: 52aad2ab-1360-4586-9203-0556d835b50e] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:28.017279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:28.017784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:28.018233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:28.018937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:28.019401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:28.019834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:28.035307 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e HTTP/1.1 Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '52aad2ab-1360-4586-9203-0556d835b50e'} Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:28.036866 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance 52aad2ab-1360-4586-9203-0556d835b50e could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98108922-70d2-41ed-9de6-6955f348d303 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e" status: 404 len: 111 microversion: 2.1 time: 0.032670 Oct 31 16:22:28.041986 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3476/7097] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:28 2022] GET /compute/v2.1/servers/52aad2ab-1360-4586-9203-0556d835b50e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:28.047751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:28.048322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:28.055068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:28.055650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:28.056159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:28.056918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:28.057472 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:28.057965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:28.072613 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf HTTP/1.1 Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf'} Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:28.074279 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db0a83b2-ab09-468f-9c6f-a47eaa3ccc07 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 404 len: 111 microversion: 2.1 time: 0.033518 Oct 31 16:22:28.078909 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3622/7098] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:22:28 2022] DELETE /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:22:28.086474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:28.087311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] [instance: f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:28.093245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:28.093742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:28.094191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:28.094884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:28.095349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:28.095781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:28.109658 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] HTTP exception thrown: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Request method failure captured: Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf HTTP/1.1 Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_TuFpJds2AhWYJ7eKS57iNRWsK6Tk3XoErqF7nKYTMtJBcfI9HVJvbK1Py-mESCutMZAAdTmwh1BOEHJwMBss4j12pMFNLhBfgq8jZ6hG27X4N2_xpsuxR9C3RgxCwLgP_wCCUS3LntwneNlh6XIBVOb3em5bteGd_SS--G0YIkKdo Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_09059acc2c184f3aa6c27557d9ac4a98", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/09059acc2c184f3aa6c27557d9ac4a98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/09059acc2c184f3aa6c27557d9ac4a98"}]}] Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 09059acc2c184f3aa6c27557d9ac4a98 Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServerActionsTestJSON-1704710302 Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: caa0eaf7405a4edaa9961792a2efdd0b Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServerActionsTestJSON-1704710302-project Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf'} Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:22:28.111244 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Returning 404 to user: Instance f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc10ed3a-28b6-4f94-8186-3f1c15cce012 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf" status: 404 len: 111 microversion: 2.1 time: 0.030161 Oct 31 16:22:28.115493 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3477/7099] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:28 2022] GET /compute/v2.1/servers/f554d4b2-fd7e-47c3-bc53-9bcccbf79ccf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 31 16:22:28.121894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-135262d7-2a7c-4b08-a6c2-d69b1a119e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] Calling method '.version_select at 0x7f16e5729550>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:28.146403 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-135262d7-2a7c-4b08-a6c2-d69b1a119e81 tempest-ServerActionsTestJSON-1704710302 tempest-ServerActionsTestJSON-1704710302-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205507471" status: 202 len: 0 microversion: 2.1 time: 0.028248 Oct 31 16:22:28.147026 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3623/7100] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Oct 31 16:22:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205507471 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:22:37.219263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-66829058", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "f4b784a4-325a-4cc9-9540-a72133bc3d95"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:37.276884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] validate_networks() for [('f4b784a4-325a-4cc9-9540-a72133bc3d95', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:22:38.080526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:22:38.080961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:22:38.081468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:22:38.081972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:22:38.082545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:22:38.092547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:38.093076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:38.093588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:38.094325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:38.094789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:38.095224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:38.103355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=37 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:38.115412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Getting quotas for project 7d4b660fe1674b4e82b8109d1a83088d. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:22:38.121049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Getting quotas for user 1b8e469c2e9242a48506ffc85ba62f7c and project 7d4b660fe1674b4e82b8109d1a83088d. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:22:38.134426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:22:38.136822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:22:38.186283 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-13f42112-6e2c-43e3-91c8-157122c2dc21 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.097561 Oct 31 16:22:38.186956 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3478/7101] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:22:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:22:38.199834 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-91db0a0d-4263-42a7-8ae6-2c8ce796a762 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:38.200557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-91db0a0d-4263-42a7-8ae6-2c8ce796a762 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:38.204485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=29 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:38.205737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:38.274719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-91db0a0d-4263-42a7-8ae6-2c8ce796a762 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:38.283141 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-91db0a0d-4263-42a7-8ae6-2c8ce796a762 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1215 microversion: 2.1 time: 0.088359 Oct 31 16:22:38.284105 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3624/7102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:38 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:39.308429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:39.309052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:39.315244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:39.315741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:39.316190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:39.316891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:39.317390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:39.317825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:39.391658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:39.401403 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-35394214-496c-4c1d-8304-ec60919302de tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1267 microversion: 2.1 time: 0.098389 Oct 31 16:22:39.401986 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3479/7103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:39 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:40.428085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:40.431233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:40.441327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:40.442511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:40.443128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:40.444527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:40.445178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:40.446116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:41.050624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:41.065772 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2da0ae9-e289-47f6-9c42-7130dd0cb707 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1315 microversion: 2.1 time: 0.644751 Oct 31 16:22:41.066589 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3625/7104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:40 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:41.423225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-411e602e-2e2a-412c-9e51-ed21c150c74c req-254ad67f-f7d5-4ac9-9654-a9fd2db4aa65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0da496a5-2bd5-44ba-b9d8-8bfcee865f16", "tag": "b9acb7f1-2869-4460-a6b9-3a63000c5750"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:41.442039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-411e602e-2e2a-412c-9e51-ed21c150c74c req-254ad67f-f7d5-4ac9-9654-a9fd2db4aa65 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:41.442545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-411e602e-2e2a-412c-9e51-ed21c150c74c req-254ad67f-f7d5-4ac9-9654-a9fd2db4aa65 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:41.443091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-411e602e-2e2a-412c-9e51-ed21c150c74c req-254ad67f-f7d5-4ac9-9654-a9fd2db4aa65 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:41.455418 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-411e602e-2e2a-412c-9e51-ed21c150c74c req-254ad67f-f7d5-4ac9-9654-a9fd2db4aa65 service nova] Creating event network-changed:b9acb7f1-2869-4460-a6b9-3a63000c5750 for instance 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 on n-h2-858384-17 Oct 31 16:22:41.462093 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-411e602e-2e2a-412c-9e51-ed21c150c74c req-254ad67f-f7d5-4ac9-9654-a9fd2db4aa65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043392 Oct 31 16:22:41.462875 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3480/7105] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:42.091911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:42.092562 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:42.099408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:42.099897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:42.100338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:42.101038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:42.101529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:42.101975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:42.233080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:42.240899 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-787e10c2-7ed0-415b-8314-8845bc9f3e36 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1315 microversion: 2.1 time: 0.153248 Oct 31 16:22:42.241512 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3626/7106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:42 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:43.266618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:43.267455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:43.274358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:43.274869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:43.275329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:43.276049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:43.276526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:43.276973 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:43.407273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:43.415189 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba1c753c-d25a-45ad-9cda-127fca7e29f6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1315 microversion: 2.1 time: 0.153745 Oct 31 16:22:43.415773 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3481/7107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:43 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:44.437911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:44.438522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:44.445055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:44.445928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:44.446453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:44.447232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:44.447898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:44.448710 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:44.591844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:44.600442 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7efaae80-d259-422f-ac0d-adafd474f7e6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1315 microversion: 2.1 time: 0.166872 Oct 31 16:22:44.601032 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3627/7108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:44 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:45.626021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:45.626656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:45.633841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:45.634560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:45.635017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:45.635734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:45.636208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:45.636654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:45.768966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:45.776725 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f33b66a1-4e6c-4e88-b010-a4945e73e203 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1315 microversion: 2.1 time: 0.155814 Oct 31 16:22:45.777358 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3482/7109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:45 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:46.465622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-e8ccfc5e-fbba-4516-ae3c-5264675797e2 req-2237ac50-944d-4bca-bf36-bee3abf30e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da496a5-2bd5-44ba-b9d8-8bfcee865f16", "name": "network-vif-plugged", "status": "completed", "tag": "b9acb7f1-2869-4460-a6b9-3a63000c5750"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:46.476407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e8ccfc5e-fbba-4516-ae3c-5264675797e2 req-2237ac50-944d-4bca-bf36-bee3abf30e86 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:46.477209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e8ccfc5e-fbba-4516-ae3c-5264675797e2 req-2237ac50-944d-4bca-bf36-bee3abf30e86 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:46.477477 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-e8ccfc5e-fbba-4516-ae3c-5264675797e2 req-2237ac50-944d-4bca-bf36-bee3abf30e86 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:46.488886 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-e8ccfc5e-fbba-4516-ae3c-5264675797e2 req-2237ac50-944d-4bca-bf36-bee3abf30e86 service nova] Creating event network-vif-plugged:b9acb7f1-2869-4460-a6b9-3a63000c5750 for instance 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 on n-h2-858384-17 Oct 31 16:22:46.494532 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-e8ccfc5e-fbba-4516-ae3c-5264675797e2 req-2237ac50-944d-4bca-bf36-bee3abf30e86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033239 Oct 31 16:22:46.495321 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3628/7110] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:46.801861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:46.802519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:46.810178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:46.810681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:46.811138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:46.811910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:46.812387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:46.812832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:46.952300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:46.960223 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fd7de95f-49b9-46b4-bab1-db64b66f4bc1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1315 microversion: 2.1 time: 0.162323 Oct 31 16:22:46.960834 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3483/7111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:46 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:47.984779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:47.985499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:47.991669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:47.992148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:47.992581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:47.993733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:47.994325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:47.994752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:48.125146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:48.132803 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6897e69-941c-4dc5-8e8a-28be41f6d774 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1503 microversion: 2.1 time: 0.153244 Oct 31 16:22:48.134203 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3629/7112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:47 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:48.193203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1734603193", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "f4b784a4-325a-4cc9-9540-a72133bc3d95"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:48.203340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:48.204136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:48.250095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] validate_networks() for [('f4b784a4-325a-4cc9-9540-a72133bc3d95', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:22:48.615016 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:22:48.615456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:22:48.615944 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:22:48.616369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:22:48.616794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:22:48.627019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:48.627519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:48.627969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:48.628707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:48.629206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:48.629657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:48.646494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Getting quotas for project 7d4b660fe1674b4e82b8109d1a83088d. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:22:48.652141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Getting quotas for user 1b8e469c2e9242a48506ffc85ba62f7c and project 7d4b660fe1674b4e82b8109d1a83088d. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:22:48.664298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:22:48.667551 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:22:48.714458 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-68391bcd-d98c-4e74-b36d-7454471de42e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525067 Oct 31 16:22:48.715529 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3484/7113] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:22:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:22:48.728087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-82db15d6-d595-4a31-87f4-c37987591890 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:48.728920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-82db15d6-d595-4a31-87f4-c37987591890 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:48.737558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:48.791663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-82db15d6-d595-4a31-87f4-c37987591890 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:48.798578 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-82db15d6-d595-4a31-87f4-c37987591890 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1217 microversion: 2.1 time: 0.075630 Oct 31 16:22:48.799186 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3630/7114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:48 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:49.824050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:49.824669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:49.831855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:49.832608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:49.833177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:49.834143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:49.834765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:49.835178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:49.907251 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:49.915172 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a849f3ee-66c3-4edb-877a-55628e8ae3e0 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1287 microversion: 2.1 time: 0.096864 Oct 31 16:22:49.916731 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3485/7115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:49 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:50.939067 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:50.939895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:50.948958 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:50.949559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:50.950103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:50.950813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:50.951277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:50.951708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:51.092808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:51.100910 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cf5d69e1-eda9-4ae1-b9d6-1436fe73ba65 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1317 microversion: 2.1 time: 0.165767 Oct 31 16:22:51.101540 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3631/7116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:50 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:51.140336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-58caf700-e629-4420-9fda-70fabca52518 req-2c510839-49e1-407d-8568-cf849ba4c567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a391504-4fd3-4a19-9d46-2937a22e9c43", "tag": "11c4b6a2-5b8c-4a7f-811b-ca1b37d9e281"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:51.147092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:51.162782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-58caf700-e629-4420-9fda-70fabca52518 req-2c510839-49e1-407d-8568-cf849ba4c567 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:51.163294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-58caf700-e629-4420-9fda-70fabca52518 req-2c510839-49e1-407d-8568-cf849ba4c567 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:51.163747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-58caf700-e629-4420-9fda-70fabca52518 req-2c510839-49e1-407d-8568-cf849ba4c567 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:51.177537 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-58caf700-e629-4420-9fda-70fabca52518 req-2c510839-49e1-407d-8568-cf849ba4c567 service nova] Creating event network-changed:11c4b6a2-5b8c-4a7f-811b-ca1b37d9e281 for instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 on n-h1-858384-17 Oct 31 16:22:51.183638 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-58caf700-e629-4420-9fda-70fabca52518 req-2c510839-49e1-407d-8568-cf849ba4c567 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047351 Oct 31 16:22:51.184262 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3486/7117] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:52.125380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:52.125989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:52.132804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:52.133330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:52.133776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:52.134476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:52.134927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:52.135352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:52.269759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:52.279136 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b6d437a-55a2-4cc5-9887-cf426bd43ee4 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1317 microversion: 2.1 time: 0.157659 Oct 31 16:22:52.279734 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3632/7118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:52 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:53.303231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:53.303980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:53.311002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:53.311509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:53.311961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:53.312679 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:53.313175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:53.313624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:53.451533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:53.459274 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b0e524c-d144-4be3-b906-dc14221e7264 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1317 microversion: 2.1 time: 0.161236 Oct 31 16:22:53.459847 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3487/7119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:53 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:54.482742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:54.483352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:54.490086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:54.490570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:54.490998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:54.495558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:54.495558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:54.495558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:54.635438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:54.643407 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6788a64c-5e4d-493d-aed4-3414fe56da05 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1317 microversion: 2.1 time: 0.164596 Oct 31 16:22:54.644000 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3633/7120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:54 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:22:55.669185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:55.669816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:55.676810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:55.677349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:55.677797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:55.678503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:55.678967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:55.679403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:55.808097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:55.815694 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-71b892bd-1b29-4263-8608-e5d4ed4700cc tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1317 microversion: 2.1 time: 0.151431 Oct 31 16:22:55.816268 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3488/7121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:55 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:56.524282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-6ee13036-aeb4-4828-8f09-a84e143dea9b req-b738f2ac-4254-4133-80c7-3ce5ed6ce77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a391504-4fd3-4a19-9d46-2937a22e9c43", "name": "network-vif-plugged", "status": "completed", "tag": "11c4b6a2-5b8c-4a7f-811b-ca1b37d9e281"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:22:56.535208 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6ee13036-aeb4-4828-8f09-a84e143dea9b req-b738f2ac-4254-4133-80c7-3ce5ed6ce77a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:56.535823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6ee13036-aeb4-4828-8f09-a84e143dea9b req-b738f2ac-4254-4133-80c7-3ce5ed6ce77a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:56.536331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-6ee13036-aeb4-4828-8f09-a84e143dea9b req-b738f2ac-4254-4133-80c7-3ce5ed6ce77a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:56.547972 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-6ee13036-aeb4-4828-8f09-a84e143dea9b req-b738f2ac-4254-4133-80c7-3ce5ed6ce77a service nova] Creating event network-vif-plugged:11c4b6a2-5b8c-4a7f-811b-ca1b37d9e281 for instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 on n-h1-858384-17 Oct 31 16:22:56.553211 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-6ee13036-aeb4-4828-8f09-a84e143dea9b req-b738f2ac-4254-4133-80c7-3ce5ed6ce77a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032717 Oct 31 16:22:56.553818 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3634/7122] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:22:56.838869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:56.839499 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:56.846404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:56.846908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:56.847391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:56.848102 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:56.848578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:56.849019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:56.981509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:56.989245 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-29b0e199-5d2c-4ae1-bae2-7a54c4d7aae1 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1317 microversion: 2.1 time: 0.154423 Oct 31 16:22:56.989829 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3489/7123] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:56 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:58.014945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:58.015650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:58.024002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:58.024560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:58.025333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:58.026087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:58.026552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:58.026982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:58.157655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:58.165500 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0d086d4-a891-4421-bb07-d73ec312927e tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1505 microversion: 2.1 time: 0.155025 Oct 31 16:22:58.166092 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3635/7124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:58 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:22:58.188414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:58.188970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:58.195856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:58.196361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:58.197494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:58.198209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:58.198689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:58.199405 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:58.228336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:22:58.307031 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a7a8aca0-670f-4e86-b6de-26ac495421ee tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 204 len: 0 microversion: 2.1 time: 0.121557 Oct 31 16:22:58.307809 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3490/7125] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:22:58 2022] DELETE /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:22:58.315930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:58.316536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:58.323187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:58.323674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:58.324367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:58.325074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:58.325578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:58.326005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:58.470968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:58.479111 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6343e07a-74e5-4bb3-931f-26b5f53085ea tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1511 microversion: 2.1 time: 0.167089 Oct 31 16:22:58.479721 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3636/7126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:58 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:22:59.503654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:22:59.504372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:22:59.506345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:59.507201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:22:59.513754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:59.514250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:59.514700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:59.515401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:22:59.515866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:22:59.516301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:22:59.736354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:22:59.744771 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0a960b12-1095-4c4d-a966-c14dea60f69f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 200 len: 1511 microversion: 2.1 time: 0.245355 Oct 31 16:22:59.745430 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3491/7127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:22:59 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:00.079497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d27243ba-b8f2-417e-9b73-60e04840d181 req-6d46218e-72e4-44a3-9e88-c3ff516ce367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a391504-4fd3-4a19-9d46-2937a22e9c43", "name": "network-vif-deleted", "tag": "11c4b6a2-5b8c-4a7f-811b-ca1b37d9e281"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:00.089210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:00.092705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d27243ba-b8f2-417e-9b73-60e04840d181 req-6d46218e-72e4-44a3-9e88-c3ff516ce367 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:00.093218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d27243ba-b8f2-417e-9b73-60e04840d181 req-6d46218e-72e4-44a3-9e88-c3ff516ce367 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:00.093881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d27243ba-b8f2-417e-9b73-60e04840d181 req-6d46218e-72e4-44a3-9e88-c3ff516ce367 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:00.108455 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d27243ba-b8f2-417e-9b73-60e04840d181 req-6d46218e-72e4-44a3-9e88-c3ff516ce367 service nova] Creating event network-vif-deleted:11c4b6a2-5b8c-4a7f-811b-ca1b37d9e281 for instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 on n-h1-858384-17 Oct 31 16:23:00.114029 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d27243ba-b8f2-417e-9b73-60e04840d181 req-6d46218e-72e4-44a3-9e88-c3ff516ce367 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040417 Oct 31 16:23:00.114898 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3637/7128] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:23:00.768531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:00.769177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:00.776024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:00.776518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:00.776967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:00.777698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:00.778166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:00.778601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:00.792346 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] HTTP exception thrown: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Request method failure captured: Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 HTTP/1.1 Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_ZM1XsymmwBWwguikYaSs5Q6BAeFFQye87T3P1SacrEI1HMACikvNZ2b6p8OkpfZtavlrjZMI-12M7dK3hEXDNYT9en3o9N6CP2-LK4pMu42pRusoHmODOBWTZVkFKwsU0KqzuhE4kwTPSp281U9xqM5-G1rAPRrfvPGwbqBo0ek-4 Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d4b660fe1674b4e82b8109d1a83088d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d4b660fe1674b4e82b8109d1a83088d"}]}] Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 1b8e469c2e9242a48506ffc85ba62f7c Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '8a391504-4fd3-4a19-9d46-2937a22e9c43'} Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:00.794131 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Returning 404 to user: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-186cae31-1d68-4001-80fb-5a5ba85a6378 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 404 len: 111 microversion: 2.1 time: 0.030952 Oct 31 16:23:00.801414 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3492/7129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:00 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:23:00.805167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:00.805924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:00.812805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:00.813218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:00.813752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:00.814348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:00.814809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:00.815252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:00.946841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:00.955049 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-69cbb675-7c1d-4bd4-8958-55bcc0175ea6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1503 microversion: 2.1 time: 0.154156 Oct 31 16:23:00.955643 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3638/7130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:00 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:00.979049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fad36c65-f5aa-4af5-ad4e-8af30a73cd13 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:00.981450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fad36c65-f5aa-4af5-ad4e-8af30a73cd13 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: f30f9a49-dece-498d-a434-f7f8b78b1a9c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:00.986876 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-fad36c65-f5aa-4af5-ad4e-8af30a73cd13 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] HTTP exception thrown: Instance f30f9a49-dece-498d-a434-f7f8b78b1a9c could not be found. Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fad36c65-f5aa-4af5-ad4e-8af30a73cd13 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Request method failure captured: Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/f30f9a49-dece-498d-a434-f7f8b78b1a9c/action HTTP/1.1 Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 32 Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_ZM1XsymmwBWwguikYaSs5Q6BAeFFQye87T3P1SacrEI1HMACikvNZ2b6p8OkpfZtavlrjZMI-12M7dK3hEXDNYT9en3o9N6CP2-LK4pMu42pRusoHmODOBWTZVkFKwsU0KqzuhE4kwTPSp281U9xqM5-G1rAPRrfvPGwbqBo0ek-4 Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d4b660fe1674b4e82b8109d1a83088d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d4b660fe1674b4e82b8109d1a83088d"}]}] Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 1b8e469c2e9242a48506ffc85ba62f7c Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: {"resize": {"flavorRef": "452"}} Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance f30f9a49-dece-498d-a434-f7f8b78b1a9c could not be found. Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'f30f9a49-dece-498d-a434-f7f8b78b1a9c', 'body': {'resize': {'flavorRef': '452'}}} Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30f9a49-dece-498d-a434-f7f8b78b1a9c could not be found. Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:23:00.988445 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30f9a49-dece-498d-a434-f7f8b78b1a9c could not be found. Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30f9a49-dece-498d-a434-f7f8b78b1a9c could not be found. Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fad36c65-f5aa-4af5-ad4e-8af30a73cd13 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Returning 404 to user: Instance f30f9a49-dece-498d-a434-f7f8b78b1a9c could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fad36c65-f5aa-4af5-ad4e-8af30a73cd13 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "POST /compute/v2.1/servers/f30f9a49-dece-498d-a434-f7f8b78b1a9c/action" status: 404 len: 111 microversion: 2.1 time: 0.015752 Oct 31 16:23:00.992859 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3493/7131] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:23:00 2022] POST /compute/v2.1/servers/f30f9a49-dece-498d-a434-f7f8b78b1a9c/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:23:00.998381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:00.998998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:01.004930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.005523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.005963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.006660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.007118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.007549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.139247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:01.147061 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e8f990f6-ac48-496a-a386-7ca32aab5652 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1503 microversion: 2.1 time: 0.152586 Oct 31 16:23:01.147645 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3639/7132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:00 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:01.170830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:01.171450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:01.178279 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.178772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.179220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.179908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.180381 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.180815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.314237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:01.322609 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4eaef074-3ed4-4f85-9d79-4cf478b38d3d tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1503 microversion: 2.1 time: 0.154993 Oct 31 16:23:01.323183 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3494/7133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:01 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:01.345954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "7525b57b-6b52-4f01-99b6-ae90af7e1b9d"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:01.348179 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:01.354196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.354683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.355120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.355865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.356321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.356755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.386092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:01.390885 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] HTTP exception thrown: Flavor 7525b57b-6b52-4f01-99b6-ae90af7e1b9d could not be found. Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Request method failure captured: Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: request: POST /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16/action HTTP/1.1 Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 65 Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_ZM1XsymmwBWwguikYaSs5Q6BAeFFQye87T3P1SacrEI1HMACikvNZ2b6p8OkpfZtavlrjZMI-12M7dK3hEXDNYT9en3o9N6CP2-LK4pMu42pRusoHmODOBWTZVkFKwsU0KqzuhE4kwTPSp281U9xqM5-G1rAPRrfvPGwbqBo0ek-4 Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d4b660fe1674b4e82b8109d1a83088d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d4b660fe1674b4e82b8109d1a83088d"}]}] Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1b8e469c2e9242a48506ffc85ba62f7c Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: {"resize": {"flavorRef": "7525b57b-6b52-4f01-99b6-ae90af7e1b9d"}} Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: exception: Flavor 7525b57b-6b52-4f01-99b6-ae90af7e1b9d could not be found. Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '0da496a5-2bd5-44ba-b9d8-8bfcee865f16', 'body': {'resize': {'flavorRef': '7525b57b-6b52-4f01-99b6-ae90af7e1b9d'}}} Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4201, in resize Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:23:01.392788 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 7525b57b-6b52-4f01-99b6-ae90af7e1b9d could not be found. Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 7525b57b-6b52-4f01-99b6-ae90af7e1b9d could not be found. Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 7525b57b-6b52-4f01-99b6-ae90af7e1b9d could not be found. Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Returning 400 to user: Flavor 7525b57b-6b52-4f01-99b6-ae90af7e1b9d could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9eca1223-fb43-41cb-ae33-26c934ca07cb tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "POST /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16/action" status: 400 len: 107 microversion: 2.1 time: 0.052419 Oct 31 16:23:01.397064 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3640/7134] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:23:01 2022] POST /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 16:23:01.403539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:01.404164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:01.410029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.410527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.410971 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.411671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.412138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.412574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.541199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:01.548901 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61ce8142-d267-465d-9151-23e037df3372 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1503 microversion: 2.1 time: 0.149774 Oct 31 16:23:01.549516 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3495/7135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:01 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:01.572769 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:01.573403 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:01.579666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.580148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.580583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.581405 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.581861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.582279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.716620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:01.724301 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2dc71acb-ba7a-45b9-8a20-38835a180fe8 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1503 microversion: 2.1 time: 0.155973 Oct 31 16:23:01.724877 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3641/7136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:01 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:01.747326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-082ce3e1-425d-49f0-a384-5bfc7216fe79 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-082ce3e1-425d-49f0-a384-5bfc7216fe79 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Request method failure captured: Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: request: POST /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16/action HTTP/1.1 Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 29 Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_ZM1XsymmwBWwguikYaSs5Q6BAeFFQye87T3P1SacrEI1HMACikvNZ2b6p8OkpfZtavlrjZMI-12M7dK3hEXDNYT9en3o9N6CP2-LK4pMu42pRusoHmODOBWTZVkFKwsU0KqzuhE4kwTPSp281U9xqM5-G1rAPRrfvPGwbqBo0ek-4 Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d4b660fe1674b4e82b8109d1a83088d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d4b660fe1674b4e82b8109d1a83088d"}]}] Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 1b8e469c2e9242a48506ffc85ba62f7c Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: {"resize": {"flavorRef": ""}} Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '0da496a5-2bd5-44ba-b9d8-8bfcee865f16', 'body': {'resize': {'flavorRef': ''}}} Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise error Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi '' Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.750978 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-082ce3e1-425d-49f0-a384-5bfc7216fe79 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-082ce3e1-425d-49f0-a384-5bfc7216fe79 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "POST /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16/action" status: 400 len: 113 microversion: 2.1 time: 0.009928 Oct 31 16:23:01.755824 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3496/7137] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:23:01 2022] POST /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 31 16:23:01.761322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:01.761929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:01.767768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.768250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.768681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.769399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.769854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.770278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.898700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:01.906392 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3f0af6bb-aef7-4eeb-9d5f-c13323af57bf tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1503 microversion: 2.1 time: 0.149443 Oct 31 16:23:01.906961 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3642/7138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:01 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:01.933348 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:01.933868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:01.940920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.941460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.941909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.942620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.943088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.943523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.957544 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] HTTP exception thrown: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Request method failure captured: Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 HTTP/1.1 Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_ZM1XsymmwBWwguikYaSs5Q6BAeFFQye87T3P1SacrEI1HMACikvNZ2b6p8OkpfZtavlrjZMI-12M7dK3hEXDNYT9en3o9N6CP2-LK4pMu42pRusoHmODOBWTZVkFKwsU0KqzuhE4kwTPSp281U9xqM5-G1rAPRrfvPGwbqBo0ek-4 Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d4b660fe1674b4e82b8109d1a83088d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d4b660fe1674b4e82b8109d1a83088d"}]}] Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 1b8e469c2e9242a48506ffc85ba62f7c Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '8a391504-4fd3-4a19-9d46-2937a22e9c43'} Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:23:01.959101 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Returning 404 to user: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7134a4dd-5570-4471-8f96-59f67fd30e52 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 404 len: 111 microversion: 2.1 time: 0.032619 Oct 31 16:23:01.963770 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3497/7139] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:23:01 2022] DELETE /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:23:01.969591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:01.970235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 8a391504-4fd3-4a19-9d46-2937a22e9c43] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:01.976128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.976611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.977048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.977762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:01.978276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:01.978702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:01.992557 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] HTTP exception thrown: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Request method failure captured: Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 HTTP/1.1 Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_ZM1XsymmwBWwguikYaSs5Q6BAeFFQye87T3P1SacrEI1HMACikvNZ2b6p8OkpfZtavlrjZMI-12M7dK3hEXDNYT9en3o9N6CP2-LK4pMu42pRusoHmODOBWTZVkFKwsU0KqzuhE4kwTPSp281U9xqM5-G1rAPRrfvPGwbqBo0ek-4 Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d4b660fe1674b4e82b8109d1a83088d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d4b660fe1674b4e82b8109d1a83088d"}]}] Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1b8e469c2e9242a48506ffc85ba62f7c Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '8a391504-4fd3-4a19-9d46-2937a22e9c43'} Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:01.995301 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Returning 404 to user: Instance 8a391504-4fd3-4a19-9d46-2937a22e9c43 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e533b905-353a-43df-8f8b-51cb65367739 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43" status: 404 len: 111 microversion: 2.1 time: 0.031114 Oct 31 16:23:01.999990 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3643/7140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:01 2022] GET /compute/v2.1/servers/8a391504-4fd3-4a19-9d46-2937a22e9c43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:23:02.006225 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:02.006747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:02.013427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:02.013952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:02.014394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:02.015114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:02.015586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:02.016028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:02.042336 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:23:02.045096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:02.120241 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d6d5d69c-70e0-42de-958e-7446ffd98830 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 204 len: 0 microversion: 2.1 time: 0.117807 Oct 31 16:23:02.121027 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3498/7141] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:23:02 2022] DELETE /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:23:02.129950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:02.130561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:02.137798 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:02.138280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:02.138713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:02.139398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:02.139932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:02.140252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:02.272277 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:02.280789 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df683793-e615-4928-98bf-4920e0333015 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1509 microversion: 2.1 time: 0.155637 Oct 31 16:23:02.281419 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3644/7142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:02 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:03.304480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:03.305278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:03.312931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:03.313478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:03.313918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:03.314628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:03.315101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:03.315540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:03.453747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:03.461561 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7d7d19c6-b799-4a50-b7ed-40565cf8d1b9 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1509 microversion: 2.1 time: 0.161434 Oct 31 16:23:03.462156 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3499/7143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:03 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:04.056305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-cb3a464f-88ed-4506-9a87-945ca2abf84f req-1273f9b0-2e2b-40be-812d-4fbe496855c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0da496a5-2bd5-44ba-b9d8-8bfcee865f16", "name": "network-vif-deleted", "tag": "b9acb7f1-2869-4460-a6b9-3a63000c5750"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:04.068280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cb3a464f-88ed-4506-9a87-945ca2abf84f req-1273f9b0-2e2b-40be-812d-4fbe496855c1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:04.068757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cb3a464f-88ed-4506-9a87-945ca2abf84f req-1273f9b0-2e2b-40be-812d-4fbe496855c1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:04.069237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cb3a464f-88ed-4506-9a87-945ca2abf84f req-1273f9b0-2e2b-40be-812d-4fbe496855c1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:04.087123 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cb3a464f-88ed-4506-9a87-945ca2abf84f req-1273f9b0-2e2b-40be-812d-4fbe496855c1 service nova] Creating event network-vif-deleted:b9acb7f1-2869-4460-a6b9-3a63000c5750 for instance 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 on n-h2-858384-17 Oct 31 16:23:04.093920 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-cb3a464f-88ed-4506-9a87-945ca2abf84f req-1273f9b0-2e2b-40be-812d-4fbe496855c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041326 Oct 31 16:23:04.094544 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3645/7144] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:23:04.484979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:04.485641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:04.492421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:04.492920 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:04.493403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:04.494113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:04.494582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:04.495022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:04.526786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:04.527283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:04.527743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:04.528206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lazy-loading 'fault' on Instance uuid 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:23:04.568610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8e469c2e9242a48506ffc85ba62f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4b660fe1674b4e82b8109d1a83088d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:04.577252 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e1d09e0f-3dd3-40ac-ac85-6440d7a8cbe6 tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 200 len: 1305 microversion: 2.1 time: 0.096202 Oct 31 16:23:04.578131 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3500/7145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:04 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:05.603801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:05.604515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] [instance: 0da496a5-2bd5-44ba-b9d8-8bfcee865f16] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:05.610699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:05.611183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:05.611623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:05.612321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:05.612781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:05.613239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:05.617372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=100 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:05.627636 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] HTTP exception thrown: Instance 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 could not be found. Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Request method failure captured: Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 HTTP/1.1 Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_ZM1XsymmwBWwguikYaSs5Q6BAeFFQye87T3P1SacrEI1HMACikvNZ2b6p8OkpfZtavlrjZMI-12M7dK3hEXDNYT9en3o9N6CP2-LK4pMu42pRusoHmODOBWTZVkFKwsU0KqzuhE4kwTPSp281U9xqM5-G1rAPRrfvPGwbqBo0ek-4 Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7d4b660fe1674b4e82b8109d1a83088d", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7d4b660fe1674b4e82b8109d1a83088d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7d4b660fe1674b4e82b8109d1a83088d"}]}] Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 7d4b660fe1674b4e82b8109d1a83088d Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2074801857 Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 1b8e469c2e9242a48506ffc85ba62f7c Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-ServersNegativeTestJSON-2074801857-project Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 could not be found. Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '0da496a5-2bd5-44ba-b9d8-8bfcee865f16'} Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 could not be found. Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 could not be found. Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:23:05.629315 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 could not be found. Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] Returning 404 to user: Instance 0da496a5-2bd5-44ba-b9d8-8bfcee865f16 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-61fe5d77-c0a8-45c8-a4f4-e40676c5616f tempest-ServersNegativeTestJSON-2074801857 tempest-ServersNegativeTestJSON-2074801857-project] 10.222.0.20 "GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16" status: 404 len: 111 microversion: 2.1 time: 0.032983 Oct 31 16:23:05.634627 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3646/7146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:05 2022] GET /compute/v2.1/servers/0da496a5-2bd5-44ba-b9d8-8bfcee865f16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:23:36.685079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:36.685793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:36.687136 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:23:36.687293 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 31 16:23:36.863007 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c02c8eaa-4515-40e6-af1a-b6865b688c6c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Action: 'create', calling method: .version_select at 0x7f16e0ea41f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1517877508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPM8BkcdX4CzQArRiStIAbNn5sovmvqGwYqg7Wx7l6+c74MWnLYihfoU+b+MT7+oUwcg45EyzSwWTPHn8at7nu+QBNUdjUuiuUTdwq4lvAnY4kLpJRfiohqcIkOjrtB9fQ=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:36.886318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c02c8eaa-4515-40e6-af1a-b6865b688c6c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:23:36.892990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c02c8eaa-4515-40e6-af1a-b6865b688c6c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for user fa3db58d82084cee9e1bf8d4216a635b and project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:23:36.924333 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c02c8eaa-4515-40e6-af1a-b6865b688c6c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.244650 Oct 31 16:23:36.924961 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3501/7147] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:23:36 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:23:36.983695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2085016200", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1517877508", "networks": [{"uuid": "9a19c012-2320-4cba-b052-17c873e8cb62"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:36.993906 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:23:36.994089 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:23:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 31 16:23:36.995234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=52 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:37.053088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] validate_networks() for [('9a19c012-2320-4cba-b052-17c873e8cb62', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:23:37.545629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:23:37.546131 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:23:37.546612 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:23:37.547024 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:23:37.547439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:23:37.556569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:37.557075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:37.557531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:37.558287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:37.559469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:37.559907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:37.578302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:23:37.583700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for user fa3db58d82084cee9e1bf8d4216a635b and project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:23:37.596019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:23:37.598362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:23:37.646090 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-22bae627-9b02-4200-b97a-a4cdd6cb8724 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666403 Oct 31 16:23:37.646917 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3647/7148] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:23:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:23:37.658473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6cf77b29-e601-4510-b8b5-420a14f84952 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:37.659111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6cf77b29-e601-4510-b8b5-420a14f84952 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:37.720166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6cf77b29-e601-4510-b8b5-420a14f84952 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:37.727862 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6cf77b29-e601-4510-b8b5-420a14f84952 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1263 microversion: 2.1 time: 0.073496 Oct 31 16:23:37.728451 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3502/7149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:37 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1263 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:23:38.753532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:38.754148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:38.761218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:38.762300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:38.762741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:38.763457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:38.763955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:38.764334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:38.974949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:38.985527 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c3fba4a2-8458-451a-b798-dea601125e87 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1323 microversion: 2.1 time: 0.236888 Oct 31 16:23:38.986115 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3648/7150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:38 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1323 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:40.010408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:40.011866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:40.019873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:40.020519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:40.021074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:40.021950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:40.022525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:40.023941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:40.175491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:40.184280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9507dbf3-9c04-4b01-9a15-a466e511d7c8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1363 microversion: 2.1 time: 0.178524 Oct 31 16:23:40.197716 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3503/7151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:40 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:40.501083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-934158f1-f7a4-4182-87ca-e591f8a4d4dc req-d56b9186-8933-4c06-8d35-e8cb954aa0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20cd9be6-fdb2-4615-9010-1ed586fc575c", "tag": "f5d04eca-72da-4c6f-bbea-2c72c00bb1b5"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:40.513577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-934158f1-f7a4-4182-87ca-e591f8a4d4dc req-d56b9186-8933-4c06-8d35-e8cb954aa0fb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:40.514063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-934158f1-f7a4-4182-87ca-e591f8a4d4dc req-d56b9186-8933-4c06-8d35-e8cb954aa0fb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:40.514500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-934158f1-f7a4-4182-87ca-e591f8a4d4dc req-d56b9186-8933-4c06-8d35-e8cb954aa0fb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:40.526918 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-934158f1-f7a4-4182-87ca-e591f8a4d4dc req-d56b9186-8933-4c06-8d35-e8cb954aa0fb service nova] Creating event network-changed:f5d04eca-72da-4c6f-bbea-2c72c00bb1b5 for instance 20cd9be6-fdb2-4615-9010-1ed586fc575c on n-h2-858384-17 Oct 31 16:23:40.532625 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-934158f1-f7a4-4182-87ca-e591f8a4d4dc req-d56b9186-8933-4c06-8d35-e8cb954aa0fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035357 Oct 31 16:23:40.533273 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3649/7152] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:23:41.209858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:41.210530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:41.219340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:41.219849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:41.220306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:41.221024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:41.221523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:41.221962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:41.355936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:41.363564 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9978de03-ce50-41bd-8024-5bbe929afabd tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1363 microversion: 2.1 time: 0.158394 Oct 31 16:23:41.364140 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3504/7153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:41 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:42.388979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:42.389755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:42.396718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:42.397488 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:42.398169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:42.398953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:42.399623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:42.400076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:42.541944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:42.550221 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b550c1c5-b941-4ac3-aadc-50d3a26bf2e2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1363 microversion: 2.1 time: 0.166721 Oct 31 16:23:42.551094 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3650/7154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:42 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:43.574143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:43.575506 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:43.582771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:43.583275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:43.583724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:43.584441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:43.584916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:43.585384 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:43.715445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:43.723111 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6dfd7963-8de9-4ee0-bfb0-373b88216d07 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1363 microversion: 2.1 time: 0.152977 Oct 31 16:23:43.723695 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3505/7155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:43 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:44.746932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:44.747743 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:44.755663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:44.756183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:44.756627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:44.757808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:44.758274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:44.758708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:44.909795 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:44.917607 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c501492-cb35-4b8e-b8ed-1b787916a698 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1363 microversion: 2.1 time: 0.175137 Oct 31 16:23:44.918781 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3651/7156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:44 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:45.942654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:45.943191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:45.950301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:45.950804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:45.951259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:45.951969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:45.952700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:45.953162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:46.089656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:46.097963 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bed109e9-deb2-4a63-b66e-2d2e901ccb4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1363 microversion: 2.1 time: 0.159325 Oct 31 16:23:46.098552 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3506/7157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:45 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:46.768919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-53924782-ce1c-4f3d-951d-e7d357adf97c req-7deb5095-08e3-4a17-bd98-d2477125d8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20cd9be6-fdb2-4615-9010-1ed586fc575c", "name": "network-vif-plugged", "status": "completed", "tag": "f5d04eca-72da-4c6f-bbea-2c72c00bb1b5"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:46.779916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-53924782-ce1c-4f3d-951d-e7d357adf97c req-7deb5095-08e3-4a17-bd98-d2477125d8e8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:46.780937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-53924782-ce1c-4f3d-951d-e7d357adf97c req-7deb5095-08e3-4a17-bd98-d2477125d8e8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:46.781412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-53924782-ce1c-4f3d-951d-e7d357adf97c req-7deb5095-08e3-4a17-bd98-d2477125d8e8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:46.793348 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-53924782-ce1c-4f3d-951d-e7d357adf97c req-7deb5095-08e3-4a17-bd98-d2477125d8e8 service nova] Creating event network-vif-plugged:f5d04eca-72da-4c6f-bbea-2c72c00bb1b5 for instance 20cd9be6-fdb2-4615-9010-1ed586fc575c on n-h2-858384-17 Oct 31 16:23:46.798874 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-53924782-ce1c-4f3d-951d-e7d357adf97c req-7deb5095-08e3-4a17-bd98-d2477125d8e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 Oct 31 16:23:46.799499 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3652/7158] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:23:47.122299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:47.122836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:47.129759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:47.130260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:47.130710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:47.131413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:47.131882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:47.132319 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:47.262485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:47.270130 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e5775006-55e1-463e-88db-539942b3a150 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1363 microversion: 2.1 time: 0.152437 Oct 31 16:23:47.270717 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3507/7159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:47 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:48.290643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:48.291435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:48.297624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:48.298323 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:48.305451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:48.305876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:48.306317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:48.307008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:48.307469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:48.307896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:48.443030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:48.452088 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c89bfa66-b979-4a03-81c4-fe116161fbbb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1556 microversion: 2.1 time: 0.162420 Oct 31 16:23:48.452946 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3653/7160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:48 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:48.474899 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:23:48.475553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:48.477444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:23:48.483629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:48.484133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:48.484590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:48.485331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:48.485807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:48.486249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:48.618888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:23:48.627669 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5326a56-859c-4320-9b25-31b3e26d5c0d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1556 microversion: 2.1 time: 0.156658 Oct 31 16:23:48.628255 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3508/7161] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:23:48 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:23:50.294216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-04fccc99-db00-49a2-a955-ba04b7d9ff7b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1df3e497-d694-40e2-a496-2556304d9256"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:23:50.296549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-04fccc99-db00-49a2-a955-ba04b7d9ff7b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:23:50.303362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04fccc99-db00-49a2-a955-ba04b7d9ff7b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:50.303848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04fccc99-db00-49a2-a955-ba04b7d9ff7b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:50.304282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04fccc99-db00-49a2-a955-ba04b7d9ff7b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:50.304971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04fccc99-db00-49a2-a955-ba04b7d9ff7b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:23:50.305457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04fccc99-db00-49a2-a955-ba04b7d9ff7b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:23:50.305881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-04fccc99-db00-49a2-a955-ba04b7d9ff7b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:23:50.545848 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-04fccc99-db00-49a2-a955-ba04b7d9ff7b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "POST /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255677 Oct 31 16:23:50.546460 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3654/7162] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 16:23:50 2022] POST /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:01.263659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:01.264175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:01.266216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:01.266967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=36 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:01.272690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:01.273215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:01.273663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:01.274363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:01.274827 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:01.275265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:01.360552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lazy-loading 'services' on Instance uuid 20cd9be6-fdb2-4615-9010-1ed586fc575c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:24:01.432226 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cce4ca26-88e8-4ed4-a0bf-c7922b218390 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments/1df3e497-d694-40e2-a496-2556304d9256" status: 202 len: 0 microversion: 2.1 time: 0.173343 Oct 31 16:24:01.432813 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3509/7163] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:24:01 2022] DELETE /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments/1df3e497-d694-40e2-a496-2556304d9256 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:24:01.440667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:01.441496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:01.446049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3005e1f2-55d3-481e-8722-d768940064f7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:01.448561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3005e1f2-55d3-481e-8722-d768940064f7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:01.459457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3005e1f2-55d3-481e-8722-d768940064f7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:01.460209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3005e1f2-55d3-481e-8722-d768940064f7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:01.460662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3005e1f2-55d3-481e-8722-d768940064f7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:01.461507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3005e1f2-55d3-481e-8722-d768940064f7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:01.461977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3005e1f2-55d3-481e-8722-d768940064f7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:01.462442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3005e1f2-55d3-481e-8722-d768940064f7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:01.496480 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3005e1f2-55d3-481e-8722-d768940064f7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058502 Oct 31 16:24:01.497757 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3655/7164] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:01 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:02.511093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9e43d7b-d711-48a9-a27b-c85e7b49733d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:02.514177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9e43d7b-d711-48a9-a27b-c85e7b49733d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:02.520616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9e43d7b-d711-48a9-a27b-c85e7b49733d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:02.521119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9e43d7b-d711-48a9-a27b-c85e7b49733d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:02.521592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9e43d7b-d711-48a9-a27b-c85e7b49733d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:02.522306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9e43d7b-d711-48a9-a27b-c85e7b49733d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:02.522777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9e43d7b-d711-48a9-a27b-c85e7b49733d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:02.523218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9e43d7b-d711-48a9-a27b-c85e7b49733d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:02.553662 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9e43d7b-d711-48a9-a27b-c85e7b49733d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047703 Oct 31 16:24:02.554237 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3510/7165] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:02 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:03.566263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d6ad66a9-b2f2-4f65-b795-4f33a67f4c65 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:03.568423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d6ad66a9-b2f2-4f65-b795-4f33a67f4c65 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:03.576589 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6ad66a9-b2f2-4f65-b795-4f33a67f4c65 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:03.577086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6ad66a9-b2f2-4f65-b795-4f33a67f4c65 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:03.577551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6ad66a9-b2f2-4f65-b795-4f33a67f4c65 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:03.578261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6ad66a9-b2f2-4f65-b795-4f33a67f4c65 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:03.578977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6ad66a9-b2f2-4f65-b795-4f33a67f4c65 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:03.579401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d6ad66a9-b2f2-4f65-b795-4f33a67f4c65 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:03.610204 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d6ad66a9-b2f2-4f65-b795-4f33a67f4c65 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047897 Oct 31 16:24:03.610782 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3656/7166] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:03 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:04.624472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ae37c183-f874-426c-bcdb-d6b03ceb122e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:04.626898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ae37c183-f874-426c-bcdb-d6b03ceb122e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:04.633961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae37c183-f874-426c-bcdb-d6b03ceb122e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:04.634477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae37c183-f874-426c-bcdb-d6b03ceb122e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:04.634939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae37c183-f874-426c-bcdb-d6b03ceb122e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:04.635756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae37c183-f874-426c-bcdb-d6b03ceb122e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:04.636137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae37c183-f874-426c-bcdb-d6b03ceb122e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:04.636641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ae37c183-f874-426c-bcdb-d6b03ceb122e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:04.668962 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ae37c183-f874-426c-bcdb-d6b03ceb122e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049815 Oct 31 16:24:04.669843 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3511/7167] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:04 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:05.681729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0e2dfe19-0c1b-4dcc-9a7b-f1b4e837e94b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:05.684055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0e2dfe19-0c1b-4dcc-9a7b-f1b4e837e94b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:05.690945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e2dfe19-0c1b-4dcc-9a7b-f1b4e837e94b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:05.691431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e2dfe19-0c1b-4dcc-9a7b-f1b4e837e94b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:05.691871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e2dfe19-0c1b-4dcc-9a7b-f1b4e837e94b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:05.692598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e2dfe19-0c1b-4dcc-9a7b-f1b4e837e94b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:05.693059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e2dfe19-0c1b-4dcc-9a7b-f1b4e837e94b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:05.693513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0e2dfe19-0c1b-4dcc-9a7b-f1b4e837e94b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:05.726778 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0e2dfe19-0c1b-4dcc-9a7b-f1b4e837e94b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049021 Oct 31 16:24:05.727414 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3657/7168] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:05 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:06.738446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52fc2ef0-b036-4d82-8b44-dc5ba05d876d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:06.740634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52fc2ef0-b036-4d82-8b44-dc5ba05d876d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:06.747464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52fc2ef0-b036-4d82-8b44-dc5ba05d876d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:06.748053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52fc2ef0-b036-4d82-8b44-dc5ba05d876d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:06.748505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52fc2ef0-b036-4d82-8b44-dc5ba05d876d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:06.749230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52fc2ef0-b036-4d82-8b44-dc5ba05d876d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:06.749706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52fc2ef0-b036-4d82-8b44-dc5ba05d876d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:06.750144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52fc2ef0-b036-4d82-8b44-dc5ba05d876d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:06.782751 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52fc2ef0-b036-4d82-8b44-dc5ba05d876d tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048396 Oct 31 16:24:06.783313 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3512/7169] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:06 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 16:24:06.794565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:06.795072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:06.801811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:06.802297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:06.802731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:06.803415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:06.803868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:06.804286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:06.887815 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] HTTP exception thrown: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c is not attached to volume 1df3e497-d694-40e2-a496-2556304d9256 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Request method failure captured: Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments/1df3e497-d694-40e2-a496-2556304d9256 HTTP/1.1 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_aD0IqvQow0tzdBjBSxed8Npydo3CIUBO-851FtcTaTDyocBWZS84lfpfY9tNO4xLqUjT95yeWkpJywXV5kYWtCBxBwLOvs-HbpLk-pm5fsasfSvM_gIVhRQCWZBlBgLFuLNeH0RzAuOxIegBBKmr_HZY3vLdkGg7xJX0PUMcD14TE Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ecad30ba3344eabbb784c841fff47fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ecad30ba3344eabbb784c841fff47fb"}]}] Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: fa3db58d82084cee9e1bf8d4216a635b Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c is not attached to volume 1df3e497-d694-40e2-a496-2556304d9256 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': '20cd9be6-fdb2-4615-9010-1ed586fc575c', 'id': '1df3e497-d694-40e2-a496-2556304d9256'} Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1df3e497-d694-40e2-a496-2556304d9256. Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c is not attached to volume 1df3e497-d694-40e2-a496-2556304d9256 Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:24:06.922475 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:24:06.927138 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:24:06.927138 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:24:06.927138 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c is not attached to volume 1df3e497-d694-40e2-a496-2556304d9256 Oct 31 16:24:06.927138 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:06.927138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Returning 404 to user: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c is not attached to volume 1df3e497-d694-40e2-a496-2556304d9256 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:24:06.927138 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-938ebbaf-f346-44f1-a401-289e3aadfa3c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments/1df3e497-d694-40e2-a496-2556304d9256" status: 404 len: 154 microversion: 2.1 time: 0.133588 Oct 31 16:24:06.927138 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3658/7170] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:24:06 2022] DELETE /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c/os-volume_attachments/1df3e497-d694-40e2-a496-2556304d9256 => generated 154 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:24:10.271164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:10.271744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:10.279158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:10.279688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:10.280123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:10.280936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:10.281432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:10.281869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:10.309982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:24:10.391853 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4aa8b2e1-381b-4bf0-a77b-9e66de0c4920 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 204 len: 0 microversion: 2.1 time: 0.124254 Oct 31 16:24:10.395998 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3513/7171] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:24:10 2022] DELETE /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:24:10.401308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:10.401844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:10.409825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:10.410310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:10.410741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:10.411482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:10.411942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:10.412363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:10.545570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:10.553426 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe1b2905-aec1-4441-a5bd-0dbebde17e0b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1562 microversion: 2.1 time: 0.156046 Oct 31 16:24:10.554304 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3659/7172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:10 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:11.579604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:11.580329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:11.587264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:11.587765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:11.588213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:11.588925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:11.589426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:11.589868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:11.720844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:11.728805 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1cf56959-e09e-44f6-9a16-9034e7e76396 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1562 microversion: 2.1 time: 0.154938 Oct 31 16:24:11.729427 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3514/7173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:11 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:12.589076 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3d9e6820-907a-40b6-95d4-f26af39db14a req-7feb1c55-e53c-4bf9-b9b1-04a71d66e256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20cd9be6-fdb2-4615-9010-1ed586fc575c", "name": "network-vif-deleted", "tag": "f5d04eca-72da-4c6f-bbea-2c72c00bb1b5"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:12.603932 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3d9e6820-907a-40b6-95d4-f26af39db14a req-7feb1c55-e53c-4bf9-b9b1-04a71d66e256 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:12.604410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3d9e6820-907a-40b6-95d4-f26af39db14a req-7feb1c55-e53c-4bf9-b9b1-04a71d66e256 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:12.604833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3d9e6820-907a-40b6-95d4-f26af39db14a req-7feb1c55-e53c-4bf9-b9b1-04a71d66e256 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:12.618682 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3d9e6820-907a-40b6-95d4-f26af39db14a req-7feb1c55-e53c-4bf9-b9b1-04a71d66e256 service nova] Creating event network-vif-deleted:f5d04eca-72da-4c6f-bbea-2c72c00bb1b5 for instance 20cd9be6-fdb2-4615-9010-1ed586fc575c on n-h2-858384-17 Oct 31 16:24:12.625942 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3d9e6820-907a-40b6-95d4-f26af39db14a req-7feb1c55-e53c-4bf9-b9b1-04a71d66e256 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046347 Oct 31 16:24:12.626574 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3660/7174] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:12.752736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:12.753413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:12.760249 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:12.760756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:12.761244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:12.761965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:12.762444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:12.762894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:12.795619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:12.796208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:12.796665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:12.797156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lazy-loading 'fault' on Instance uuid 20cd9be6-fdb2-4615-9010-1ed586fc575c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:24:12.838807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:12.846914 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8e602271-7584-4961-9f4c-5e00931be478 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 200 len: 1353 microversion: 2.1 time: 0.098268 Oct 31 16:24:12.847499 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3515/7175] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:12 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 1353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:13.874655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:13.875368 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 20cd9be6-fdb2-4615-9010-1ed586fc575c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:13.881694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:13.882174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:13.882790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:13.883486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:13.883935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:13.884352 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:13.899087 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] HTTP exception thrown: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c could not be found. Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Request method failure captured: Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c HTTP/1.1 Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_aD0IqvQow0tzdBjBSxed8Npydo3CIUBO-851FtcTaTDyocBWZS84lfpfY9tNO4xLqUjT95yeWkpJywXV5kYWtCBxBwLOvs-HbpLk-pm5fsasfSvM_gIVhRQCWZBlBgLFuLNeH0RzAuOxIegBBKmr_HZY3vLdkGg7xJX0PUMcD14TE Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ecad30ba3344eabbb784c841fff47fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ecad30ba3344eabbb784c841fff47fb"}]}] Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: fa3db58d82084cee9e1bf8d4216a635b Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c could not be found. Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '20cd9be6-fdb2-4615-9010-1ed586fc575c'} Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c could not be found. Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c could not be found. Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:24:13.900733 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c could not be found. Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Returning 404 to user: Instance 20cd9be6-fdb2-4615-9010-1ed586fc575c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2c4511c9-a076-43e4-b7b4-2fc9f87f57a6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c" status: 404 len: 111 microversion: 2.1 time: 0.034210 Oct 31 16:24:13.905971 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3661/7176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:13 2022] GET /compute/v2.1/servers/20cd9be6-fdb2-4615-9010-1ed586fc575c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:24:13.911581 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9fd71eba-23be-46ba-9c45-51557459911a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '.version_select at 0x7f16e041d310>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:13.933371 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9fd71eba-23be-46ba-9c45-51557459911a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1517877508" status: 202 len: 0 microversion: 2.1 time: 0.025442 Oct 31 16:24:13.933991 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3516/7177] 10.222.0.20 () {58 vars in 1278 bytes} [Mon Oct 31 16:24:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1517877508 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:24:13.949996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b77e955c-9756-472f-bbe0-ea986a744997 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Action: 'create', calling method: .version_select at 0x7f16e158b550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-629148524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsgasNUH13qL6YaWgI3FuvP/dRlrDwj4hegfM2Lkj0JqnfBZZnfP99WU3i7x2+5BmZP1k6pQ4zEKWVPX90R6wiGmWzfpddXhKOE7oRBX1gedKm9RWTpKPEtC7n+HxAUUQ=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:13.967611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-b77e955c-9756-472f-bbe0-ea986a744997 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:24:13.972804 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-b77e955c-9756-472f-bbe0-ea986a744997 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for user fa3db58d82084cee9e1bf8d4216a635b and project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:24:13.998793 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b77e955c-9756-472f-bbe0-ea986a744997 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.052665 Oct 31 16:24:13.999462 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3662/7178] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:24:13 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:14.050960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-359405141", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-629148524", "networks": [{"uuid": "9a19c012-2320-4cba-b052-17c873e8cb62"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:14.105993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] validate_networks() for [('9a19c012-2320-4cba-b052-17c873e8cb62', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:24:14.484222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:24:14.484661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:24:14.485164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:24:14.485645 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:24:14.486013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:24:14.495200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:14.495694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:14.496138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:14.496873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:14.497366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:14.497811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:14.514785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:24:14.519939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for user fa3db58d82084cee9e1bf8d4216a635b and project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:24:14.532391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:24:14.534712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:24:14.582548 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a8102c6b-36d3-4698-8d10-9a27e741cbae tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535447 Oct 31 16:24:14.583212 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3517/7179] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:24:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:24:14.595380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0160be65-072f-43fa-9296-5ce67451a343 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:14.595995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0160be65-072f-43fa-9296-5ce67451a343 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:14.652995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0160be65-072f-43fa-9296-5ce67451a343 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:14.660495 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0160be65-072f-43fa-9296-5ce67451a343 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1261 microversion: 2.1 time: 0.069788 Oct 31 16:24:14.661078 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3663/7180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:14 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:15.688894 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:15.690330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:15.698158 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:15.698911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:15.699354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:15.700246 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:15.700718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:15.701345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:15.872892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:15.880749 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d01668ab-b46b-4402-adbd-b1764ffdd696 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1321 microversion: 2.1 time: 0.198142 Oct 31 16:24:15.881363 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3518/7181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:15 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:16.903962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:16.904701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:16.912515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:16.913014 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:16.913483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:16.914187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:16.914644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:16.915070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:17.056578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-eb607c30-97ce-4917-8e63-347765453e54 req-6a0c5ae7-4c4c-4bd8-8c9e-7975ed9543c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b667c10-3889-47ed-ac06-e534998f2481", "tag": "90792f50-c748-4e6e-9840-614ff7fdfc42"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:17.068604 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-eb607c30-97ce-4917-8e63-347765453e54 req-6a0c5ae7-4c4c-4bd8-8c9e-7975ed9543c0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:17.069161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-eb607c30-97ce-4917-8e63-347765453e54 req-6a0c5ae7-4c4c-4bd8-8c9e-7975ed9543c0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:17.069819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-eb607c30-97ce-4917-8e63-347765453e54 req-6a0c5ae7-4c4c-4bd8-8c9e-7975ed9543c0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:17.088069 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-eb607c30-97ce-4917-8e63-347765453e54 req-6a0c5ae7-4c4c-4bd8-8c9e-7975ed9543c0 service nova] Creating event network-changed:90792f50-c748-4e6e-9840-614ff7fdfc42 for instance 8b667c10-3889-47ed-ac06-e534998f2481 on n-h1-858384-17 Oct 31 16:24:17.094576 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-eb607c30-97ce-4917-8e63-347765453e54 req-6a0c5ae7-4c4c-4bd8-8c9e-7975ed9543c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041005 Oct 31 16:24:17.095447 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3519/7182] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:17.128506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:17.137515 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3531e5aa-2ff9-4bca-b9e3-616f586659bf tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1361 microversion: 2.1 time: 0.237534 Oct 31 16:24:17.138279 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3664/7183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:16 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:18.163118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:18.163830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:18.170034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:18.170532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:18.170978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:18.172318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:18.172779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:18.173257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:18.689678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:18.698441 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56e89e2d-5c94-4e61-85ee-5a43d3b362d5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1361 microversion: 2.1 time: 0.540370 Oct 31 16:24:18.699035 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3520/7184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:18 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1361 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:19.722410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:19.723028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:19.729974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:19.730466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:19.730926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:19.731629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:19.732090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:19.732519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:19.864690 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:19.872482 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca76062f-a1a0-47dd-a62c-37a3f8131701 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1361 microversion: 2.1 time: 0.154620 Oct 31 16:24:19.873068 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3665/7185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:19 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:20.842767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-802cc5f0-1382-424b-8dd2-a1c74ec5fa3e req-4016e487-763c-455b-9450-14fc4acb99c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b667c10-3889-47ed-ac06-e534998f2481", "name": "network-vif-plugged", "status": "completed", "tag": "90792f50-c748-4e6e-9840-614ff7fdfc42"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:20.853987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-802cc5f0-1382-424b-8dd2-a1c74ec5fa3e req-4016e487-763c-455b-9450-14fc4acb99c7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:20.854487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-802cc5f0-1382-424b-8dd2-a1c74ec5fa3e req-4016e487-763c-455b-9450-14fc4acb99c7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:20.854930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-802cc5f0-1382-424b-8dd2-a1c74ec5fa3e req-4016e487-763c-455b-9450-14fc4acb99c7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:20.867726 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-802cc5f0-1382-424b-8dd2-a1c74ec5fa3e req-4016e487-763c-455b-9450-14fc4acb99c7 service nova] Creating event network-vif-plugged:90792f50-c748-4e6e-9840-614ff7fdfc42 for instance 8b667c10-3889-47ed-ac06-e534998f2481 on n-h1-858384-17 Oct 31 16:24:20.872685 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-802cc5f0-1382-424b-8dd2-a1c74ec5fa3e req-4016e487-763c-455b-9450-14fc4acb99c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033949 Oct 31 16:24:20.873337 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3521/7186] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:20.899362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:20.900103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:20.908689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:20.909513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:20.910222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:20.911220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:20.911871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:20.912531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:21.052034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:21.060980 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b49d0a1f-f9cb-4e95-87b9-791d7f77c89b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1361 microversion: 2.1 time: 0.168273 Oct 31 16:24:21.061597 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3666/7187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:20 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:22.085976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:22.086697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:22.092927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:22.094078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:22.094579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:22.095287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:22.095766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:22.096212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:22.227090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:22.235043 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c217842f-668a-4473-b60b-ad91691128c3 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1553 microversion: 2.1 time: 0.154334 Oct 31 16:24:22.235635 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3522/7188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:22 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:22.257339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:22.257955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:22.264796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:22.265814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:22.266267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:22.266957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:22.267421 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:22.267855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:22.400420 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:22.409040 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e9895e8c-c7d6-4b34-a17f-55f3160cc069 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1553 microversion: 2.1 time: 0.155584 Oct 31 16:24:22.409678 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3667/7189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:22 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:23.905560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec14fbe4-044c-4efb-9238-0dbcfe0bd197 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19263b15-e55d-4a18-81a7-499ebdf64f11"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:23.908812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec14fbe4-044c-4efb-9238-0dbcfe0bd197 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:23.915734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec14fbe4-044c-4efb-9238-0dbcfe0bd197 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:23.916242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec14fbe4-044c-4efb-9238-0dbcfe0bd197 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:23.916702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec14fbe4-044c-4efb-9238-0dbcfe0bd197 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:23.917441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec14fbe4-044c-4efb-9238-0dbcfe0bd197 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:23.917921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec14fbe4-044c-4efb-9238-0dbcfe0bd197 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:23.918396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec14fbe4-044c-4efb-9238-0dbcfe0bd197 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:24.150645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec14fbe4-044c-4efb-9238-0dbcfe0bd197 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "POST /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248980 Oct 31 16:24:24.151384 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3523/7190] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 16:24:23 2022] POST /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:34.862424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:34.863057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:34.865702 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:34.866395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:34.867028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=58 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:34.873158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:34.873648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:34.874086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:34.874781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:34.875237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:34.875664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:34.957010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lazy-loading 'services' on Instance uuid 8b667c10-3889-47ed-ac06-e534998f2481 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:24:35.027791 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-059dc5ce-f591-4f04-ad0d-93b91e9ef899 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments/19263b15-e55d-4a18-81a7-499ebdf64f11" status: 202 len: 0 microversion: 2.1 time: 0.169647 Oct 31 16:24:35.028462 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3668/7191] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:24:34 2022] DELETE /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments/19263b15-e55d-4a18-81a7-499ebdf64f11 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:24:35.034874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:35.035759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:35.037760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:35.038547 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:35.043398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98a9b4c9-efe9-409e-a4c1-671d7e64734f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:35.046219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98a9b4c9-efe9-409e-a4c1-671d7e64734f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:35.057012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a9b4c9-efe9-409e-a4c1-671d7e64734f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:35.057610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a9b4c9-efe9-409e-a4c1-671d7e64734f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:35.058068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a9b4c9-efe9-409e-a4c1-671d7e64734f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:35.058812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a9b4c9-efe9-409e-a4c1-671d7e64734f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:35.059273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a9b4c9-efe9-409e-a4c1-671d7e64734f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:35.059715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98a9b4c9-efe9-409e-a4c1-671d7e64734f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:35.096351 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98a9b4c9-efe9-409e-a4c1-671d7e64734f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062846 Oct 31 16:24:35.096960 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3524/7192] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:35 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:36.110173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad012b0d-b6ec-406e-8ee0-f52f6dfed875 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:36.112705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad012b0d-b6ec-406e-8ee0-f52f6dfed875 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:36.119219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad012b0d-b6ec-406e-8ee0-f52f6dfed875 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:36.119708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad012b0d-b6ec-406e-8ee0-f52f6dfed875 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:36.120146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad012b0d-b6ec-406e-8ee0-f52f6dfed875 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:36.120843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad012b0d-b6ec-406e-8ee0-f52f6dfed875 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:36.121330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad012b0d-b6ec-406e-8ee0-f52f6dfed875 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:36.121776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad012b0d-b6ec-406e-8ee0-f52f6dfed875 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:36.153256 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad012b0d-b6ec-406e-8ee0-f52f6dfed875 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048208 Oct 31 16:24:36.153836 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3669/7193] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:36 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:37.166170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2602ce03-1ca0-4bba-9d8e-313136f185bb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:37.168305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2602ce03-1ca0-4bba-9d8e-313136f185bb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:37.175943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2602ce03-1ca0-4bba-9d8e-313136f185bb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:37.176453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2602ce03-1ca0-4bba-9d8e-313136f185bb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:37.176910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2602ce03-1ca0-4bba-9d8e-313136f185bb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:37.177657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2602ce03-1ca0-4bba-9d8e-313136f185bb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:37.178128 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2602ce03-1ca0-4bba-9d8e-313136f185bb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:37.178571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2602ce03-1ca0-4bba-9d8e-313136f185bb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:37.212216 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2602ce03-1ca0-4bba-9d8e-313136f185bb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050182 Oct 31 16:24:37.212792 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3525/7194] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:37 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:38.224409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-abb4ecf0-be15-4083-b94a-5b7ebe0ba564 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:38.226567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-abb4ecf0-be15-4083-b94a-5b7ebe0ba564 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:38.234092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abb4ecf0-be15-4083-b94a-5b7ebe0ba564 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:38.234582 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abb4ecf0-be15-4083-b94a-5b7ebe0ba564 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:38.235022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abb4ecf0-be15-4083-b94a-5b7ebe0ba564 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:38.236218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abb4ecf0-be15-4083-b94a-5b7ebe0ba564 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:38.236675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abb4ecf0-be15-4083-b94a-5b7ebe0ba564 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:38.237100 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-abb4ecf0-be15-4083-b94a-5b7ebe0ba564 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:38.267778 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-abb4ecf0-be15-4083-b94a-5b7ebe0ba564 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047437 Oct 31 16:24:38.268346 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3670/7195] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:38 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:39.280121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fcde3882-a6a3-4517-803b-e7ffd020038e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:39.283084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fcde3882-a6a3-4517-803b-e7ffd020038e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:39.290035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcde3882-a6a3-4517-803b-e7ffd020038e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:39.290548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcde3882-a6a3-4517-803b-e7ffd020038e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:39.290999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcde3882-a6a3-4517-803b-e7ffd020038e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:39.291780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcde3882-a6a3-4517-803b-e7ffd020038e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:39.292288 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcde3882-a6a3-4517-803b-e7ffd020038e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:39.293008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fcde3882-a6a3-4517-803b-e7ffd020038e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:39.324227 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fcde3882-a6a3-4517-803b-e7ffd020038e tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048167 Oct 31 16:24:39.324799 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3526/7196] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:39 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:40.337460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-885940c6-ba6a-42cf-b230-8e9f4930e876 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:40.339611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-885940c6-ba6a-42cf-b230-8e9f4930e876 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:40.347339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-885940c6-ba6a-42cf-b230-8e9f4930e876 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:40.347818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-885940c6-ba6a-42cf-b230-8e9f4930e876 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:40.348274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-885940c6-ba6a-42cf-b230-8e9f4930e876 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:40.348959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-885940c6-ba6a-42cf-b230-8e9f4930e876 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:40.349437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-885940c6-ba6a-42cf-b230-8e9f4930e876 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:40.349859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-885940c6-ba6a-42cf-b230-8e9f4930e876 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:40.378653 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-885940c6-ba6a-42cf-b230-8e9f4930e876 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045206 Oct 31 16:24:40.379212 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3671/7197] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:24:40 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 16:24:40.389980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:40.390493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:40.397936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:40.398431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:40.398878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:40.399573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:40.400045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:40.400481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:40.477765 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] HTTP exception thrown: Instance 8b667c10-3889-47ed-ac06-e534998f2481 is not attached to volume 19263b15-e55d-4a18-81a7-499ebdf64f11 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Request method failure captured: Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments/19263b15-e55d-4a18-81a7-499ebdf64f11 HTTP/1.1 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_aD0IqvQow0tzdBjBSxed8Npydo3CIUBO-851FtcTaTDyocBWZS84lfpfY9tNO4xLqUjT95yeWkpJywXV5kYWtCBxBwLOvs-HbpLk-pm5fsasfSvM_gIVhRQCWZBlBgLFuLNeH0RzAuOxIegBBKmr_HZY3vLdkGg7xJX0PUMcD14TE Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ecad30ba3344eabbb784c841fff47fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ecad30ba3344eabbb784c841fff47fb"}]}] Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: fa3db58d82084cee9e1bf8d4216a635b Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 8b667c10-3889-47ed-ac06-e534998f2481 is not attached to volume 19263b15-e55d-4a18-81a7-499ebdf64f11 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'server_id': '8b667c10-3889-47ed-ac06-e534998f2481', 'id': '19263b15-e55d-4a18-81a7-499ebdf64f11'} Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 19263b15-e55d-4a18-81a7-499ebdf64f11. Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b667c10-3889-47ed-ac06-e534998f2481 is not attached to volume 19263b15-e55d-4a18-81a7-499ebdf64f11 Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:24:40.479785 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:24:40.484108 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:24:40.484108 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:24:40.484108 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b667c10-3889-47ed-ac06-e534998f2481 is not attached to volume 19263b15-e55d-4a18-81a7-499ebdf64f11 Oct 31 16:24:40.484108 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:40.484108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Returning 404 to user: Instance 8b667c10-3889-47ed-ac06-e534998f2481 is not attached to volume 19263b15-e55d-4a18-81a7-499ebdf64f11 {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:24:40.484108 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-75f273e8-c060-440f-9acc-c271ed54c328 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments/19263b15-e55d-4a18-81a7-499ebdf64f11" status: 404 len: 154 microversion: 2.1 time: 0.095297 Oct 31 16:24:40.484108 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3527/7198] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:24:40 2022] DELETE /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481/os-volume_attachments/19263b15-e55d-4a18-81a7-499ebdf64f11 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:24:43.832796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:43.833388 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:43.839966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:43.840453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:43.840882 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:43.841614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:43.842064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:43.842479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:43.881528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:24:43.961641 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b369b3e-b3ac-44e6-92b3-3e44be3ab48c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 204 len: 0 microversion: 2.1 time: 0.133204 Oct 31 16:24:43.964606 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3672/7199] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:24:43 2022] DELETE /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:24:43.972411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:43.973044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:43.980236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:43.980742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:43.981285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:43.982018 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:43.982495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:43.982938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:44.122242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:44.130667 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cdba6472-4df8-452c-8482-6e6cca9d0c0c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1559 microversion: 2.1 time: 0.163007 Oct 31 16:24:44.131329 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3528/7200] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:43 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:45.155755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:45.156415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:45.164284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:45.164766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:45.165234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:45.165928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:45.166389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:45.166821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:45.297110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:45.305502 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d00749d0-820c-4580-a7ec-901f73d175ee tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1559 microversion: 2.1 time: 0.154156 Oct 31 16:24:45.306080 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3673/7201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:45 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:45.931838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-eb4ba91f-fa10-46c4-ae78-f22606475f1d req-7e16e626-928c-4c9f-a555-d06720fc9502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b667c10-3889-47ed-ac06-e534998f2481", "name": "network-vif-deleted", "tag": "90792f50-c748-4e6e-9840-614ff7fdfc42"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:45.953509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-eb4ba91f-fa10-46c4-ae78-f22606475f1d req-7e16e626-928c-4c9f-a555-d06720fc9502 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:45.954312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-eb4ba91f-fa10-46c4-ae78-f22606475f1d req-7e16e626-928c-4c9f-a555-d06720fc9502 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:45.954695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-eb4ba91f-fa10-46c4-ae78-f22606475f1d req-7e16e626-928c-4c9f-a555-d06720fc9502 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:45.969768 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-eb4ba91f-fa10-46c4-ae78-f22606475f1d req-7e16e626-928c-4c9f-a555-d06720fc9502 service nova] Creating event network-vif-deleted:90792f50-c748-4e6e-9840-614ff7fdfc42 for instance 8b667c10-3889-47ed-ac06-e534998f2481 on n-h1-858384-17 Oct 31 16:24:45.975116 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-eb4ba91f-fa10-46c4-ae78-f22606475f1d req-7e16e626-928c-4c9f-a555-d06720fc9502 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047639 Oct 31 16:24:45.975731 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3529/7202] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:46.330228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:46.330857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:46.338519 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:46.338930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:46.339273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:46.340040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:46.340503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:46.340934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:46.373191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:46.373615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:46.374062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:46.374514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lazy-loading 'fault' on Instance uuid 8b667c10-3889-47ed-ac06-e534998f2481 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:24:46.421205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:46.429431 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-df8a171c-7376-4510-b6c9-7a9ee41509bc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 200 len: 1351 microversion: 2.1 time: 0.103203 Oct 31 16:24:46.430029 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3674/7203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:46 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:47.457720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:47.458444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: 8b667c10-3889-47ed-ac06-e534998f2481] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:47.464906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:47.465440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:47.465892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:47.466620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:47.467090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:47.467528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:47.481819 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] HTTP exception thrown: Instance 8b667c10-3889-47ed-ac06-e534998f2481 could not be found. Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Request method failure captured: Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 HTTP/1.1 Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_aD0IqvQow0tzdBjBSxed8Npydo3CIUBO-851FtcTaTDyocBWZS84lfpfY9tNO4xLqUjT95yeWkpJywXV5kYWtCBxBwLOvs-HbpLk-pm5fsasfSvM_gIVhRQCWZBlBgLFuLNeH0RzAuOxIegBBKmr_HZY3vLdkGg7xJX0PUMcD14TE Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ecad30ba3344eabbb784c841fff47fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ecad30ba3344eabbb784c841fff47fb"}]}] Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: fa3db58d82084cee9e1bf8d4216a635b Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 8b667c10-3889-47ed-ac06-e534998f2481 could not be found. Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '8b667c10-3889-47ed-ac06-e534998f2481'} Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b667c10-3889-47ed-ac06-e534998f2481 could not be found. Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b667c10-3889-47ed-ac06-e534998f2481 could not be found. Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:24:47.483844 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b667c10-3889-47ed-ac06-e534998f2481 could not be found. Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Returning 404 to user: Instance 8b667c10-3889-47ed-ac06-e534998f2481 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-33a84417-8980-436f-b304-edfa987835c9 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481" status: 404 len: 111 microversion: 2.1 time: 0.034838 Oct 31 16:24:47.488651 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3530/7204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:47 2022] GET /compute/v2.1/servers/8b667c10-3889-47ed-ac06-e534998f2481 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:24:47.494512 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4a28d1c-c789-4431-82d7-db2e769a6765 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '.version_select at 0x7f16e0df6c10>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:47.515249 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4a28d1c-c789-4431-82d7-db2e769a6765 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-629148524" status: 202 len: 0 microversion: 2.1 time: 0.024562 Oct 31 16:24:47.515840 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3675/7205] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 16:24:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-629148524 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:24:47.533100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-90cd21d3-f065-42d9-b884-eea6a4ed98d8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Action: 'create', calling method: .version_select at 0x7f16e56228b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-436627855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrpAEqZ9xIrj5TmWjxJId1Mh4adPruurL2vkDzrex/YNsXEgsI1i7SxsCytivUjzXW4s0E/0c6uxZNVsGsl0O4pSaRo0uCjVvjBpuaemAU/sgmlsPu+KvIr/rXkhe0Mqw=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:47.548675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-90cd21d3-f065-42d9-b884-eea6a4ed98d8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:24:47.554554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-90cd21d3-f065-42d9-b884-eea6a4ed98d8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for user fa3db58d82084cee9e1bf8d4216a635b and project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:24:47.578443 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-90cd21d3-f065-42d9-b884-eea6a4ed98d8 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049162 Oct 31 16:24:47.579055 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3531/7206] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:24:47 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:47.640811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-686137068", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-436627855", "networks": [{"uuid": "9a19c012-2320-4cba-b052-17c873e8cb62"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:47.693982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] validate_networks() for [('9a19c012-2320-4cba-b052-17c873e8cb62', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:24:48.074943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:24:48.075364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:24:48.075864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:24:48.076268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:24:48.076675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:24:48.086032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:48.086504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:48.086935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:48.087649 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:48.088099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:48.088516 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:48.105827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:24:48.110934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Getting quotas for user fa3db58d82084cee9e1bf8d4216a635b and project 1ecad30ba3344eabbb784c841fff47fb. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:24:48.123585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:24:48.125890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:24:48.171181 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-181d60f2-7db2-4d8c-a660-ff3c3cd317e7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534444 Oct 31 16:24:48.171828 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3676/7207] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:24:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:24:48.184114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2c22076-1867-4696-8b4e-d423e07a4462 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:48.184900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2c22076-1867-4696-8b4e-d423e07a4462 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:48.243268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2c22076-1867-4696-8b4e-d423e07a4462 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:48.251094 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2c22076-1867-4696-8b4e-d423e07a4462 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1261 microversion: 2.1 time: 0.071115 Oct 31 16:24:48.251794 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3532/7208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:48 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:49.274909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:49.276201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:49.291324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:49.292361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:49.293312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:49.294626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:49.295654 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:49.296395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:49.371552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:49.381034 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1989d4a7-d762-496d-aadb-553da8d68cc6 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1331 microversion: 2.1 time: 0.109975 Oct 31 16:24:49.381666 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3677/7209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:49 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:50.404460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:50.405085 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:50.411730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:50.412232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:50.413025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:50.413822 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:50.414292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:50.414731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:50.602666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:50.610430 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a533f0ba-f856-4d23-b68d-37ba3a8da81f tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1361 microversion: 2.1 time: 0.210328 Oct 31 16:24:50.611019 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3533/7210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:50 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:50.673467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ec52b9ba-87ac-43a3-bf2c-089eadc48708 req-de6993be-b181-4599-b844-9b3b1f8e15fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22", "tag": "da06deb3-4832-495f-af0c-0984ff82d133"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:50.690409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ec52b9ba-87ac-43a3-bf2c-089eadc48708 req-de6993be-b181-4599-b844-9b3b1f8e15fb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:50.690901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ec52b9ba-87ac-43a3-bf2c-089eadc48708 req-de6993be-b181-4599-b844-9b3b1f8e15fb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:50.691330 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ec52b9ba-87ac-43a3-bf2c-089eadc48708 req-de6993be-b181-4599-b844-9b3b1f8e15fb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:50.703248 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ec52b9ba-87ac-43a3-bf2c-089eadc48708 req-de6993be-b181-4599-b844-9b3b1f8e15fb service nova] Creating event network-changed:da06deb3-4832-495f-af0c-0984ff82d133 for instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 on n-h1-858384-17 Oct 31 16:24:50.709279 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ec52b9ba-87ac-43a3-bf2c-089eadc48708 req-de6993be-b181-4599-b844-9b3b1f8e15fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039674 Oct 31 16:24:50.710154 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3678/7211] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:24:51.633713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:51.634344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:51.641245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:51.641746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:51.642200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:51.643711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:51.644335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:51.644778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:51.780809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:51.789238 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1ec8fc44-7b52-4967-9646-fee794924e7c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1361 microversion: 2.1 time: 0.159520 Oct 31 16:24:51.789831 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3534/7212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:51 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:52.812324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:52.813029 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:52.820190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:52.820681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:52.821118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:52.821849 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:52.822306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:52.822733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:52.961452 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:52.969434 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-49ccecba-5d62-46ed-9beb-e85cb848f29c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1361 microversion: 2.1 time: 0.161196 Oct 31 16:24:52.970197 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3679/7213] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:52 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:53.993867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:53.994475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:54.001382 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:54.001877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:54.002997 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:54.003695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:54.004159 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:54.004592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:54.135184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:54.142813 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e6a233f9-ca8c-4fe2-85f5-4b5494dc38b5 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1361 microversion: 2.1 time: 0.152850 Oct 31 16:24:54.143392 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3535/7214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:53 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:54.957817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-cc0e5f7c-6448-4fbe-aa99-dba947c18618 req-56cba1f7-8ed5-4635-8c12-c5347baef973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22", "name": "network-vif-plugged", "status": "completed", "tag": "da06deb3-4832-495f-af0c-0984ff82d133"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:54.968629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cc0e5f7c-6448-4fbe-aa99-dba947c18618 req-56cba1f7-8ed5-4635-8c12-c5347baef973 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:54.969114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cc0e5f7c-6448-4fbe-aa99-dba947c18618 req-56cba1f7-8ed5-4635-8c12-c5347baef973 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:54.969569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cc0e5f7c-6448-4fbe-aa99-dba947c18618 req-56cba1f7-8ed5-4635-8c12-c5347baef973 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:54.980813 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cc0e5f7c-6448-4fbe-aa99-dba947c18618 req-56cba1f7-8ed5-4635-8c12-c5347baef973 service nova] Creating event network-vif-plugged:da06deb3-4832-495f-af0c-0984ff82d133 for instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 on n-h1-858384-17 Oct 31 16:24:54.985632 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-cc0e5f7c-6448-4fbe-aa99-dba947c18618 req-56cba1f7-8ed5-4635-8c12-c5347baef973 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032346 Oct 31 16:24:54.986248 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3680/7215] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:24:55.165904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:55.166565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:55.173350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:55.173851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:55.174796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:55.175534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:55.176009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:55.176449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:55.308886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:55.317261 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-de2b3aa3-f0f9-420d-94d6-be3e7ea96adc tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1361 microversion: 2.1 time: 0.155336 Oct 31 16:24:55.317845 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3536/7216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:55 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:56.342163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:56.342983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:56.349093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:56.349608 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:56.350068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:56.350767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:56.351225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:56.351647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:56.482053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:56.490077 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3fe632a9-7ec7-491a-87d2-f656f80c1c02 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1554 microversion: 2.1 time: 0.153184 Oct 31 16:24:56.490661 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3681/7217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:56 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:56.513214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:24:56.513836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:56.521426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:56.521921 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:56.522367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:56.523066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:56.523531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:56.523963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:56.653045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:24:56.660946 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1c75cfe6-921f-4b72-81ac-94c2771a6b9c tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1554 microversion: 2.1 time: 0.151740 Oct 31 16:24:56.661561 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3537/7218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:24:56 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:24:58.156333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-853a98d8-5eb2-4cc1-99ab-1e8a51b3ea06 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a470a796-26b3-4947-9cb4-4208d12f6971"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:24:58.159217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-853a98d8-5eb2-4cc1-99ab-1e8a51b3ea06 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:24:58.162015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:58.162668 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:24:58.168866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853a98d8-5eb2-4cc1-99ab-1e8a51b3ea06 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:58.169378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853a98d8-5eb2-4cc1-99ab-1e8a51b3ea06 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:58.169811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853a98d8-5eb2-4cc1-99ab-1e8a51b3ea06 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:58.170494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853a98d8-5eb2-4cc1-99ab-1e8a51b3ea06 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:24:58.170942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853a98d8-5eb2-4cc1-99ab-1e8a51b3ea06 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:24:58.171369 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-853a98d8-5eb2-4cc1-99ab-1e8a51b3ea06 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:24:58.416812 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-853a98d8-5eb2-4cc1-99ab-1e8a51b3ea06 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "POST /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263854 Oct 31 16:24:58.416812 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3682/7219] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 16:24:58 2022] POST /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:09.139422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:09.139949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:09.142860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:09.143690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:09.144335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=64 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:09.150714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:09.151219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:09.151669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:09.152377 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:09.152845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:09.153311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:09.233392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lazy-loading 'services' on Instance uuid c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:25:09.307507 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1c25f29-b8aa-48a5-a950-a19cc5bbc889 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments/a470a796-26b3-4947-9cb4-4208d12f6971" status: 202 len: 0 microversion: 2.1 time: 0.171789 Oct 31 16:25:09.308130 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3538/7220] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:25:09 2022] DELETE /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments/a470a796-26b3-4947-9cb4-4208d12f6971 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:25:09.314545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:09.315596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:09.320089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e624a5ab-22b7-4ac9-80d5-142e10d9e508 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:09.322470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e624a5ab-22b7-4ac9-80d5-142e10d9e508 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:09.331468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e624a5ab-22b7-4ac9-80d5-142e10d9e508 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:09.331984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e624a5ab-22b7-4ac9-80d5-142e10d9e508 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:09.332678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e624a5ab-22b7-4ac9-80d5-142e10d9e508 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:09.333399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e624a5ab-22b7-4ac9-80d5-142e10d9e508 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:09.333862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e624a5ab-22b7-4ac9-80d5-142e10d9e508 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:09.334303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e624a5ab-22b7-4ac9-80d5-142e10d9e508 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:09.367772 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e624a5ab-22b7-4ac9-80d5-142e10d9e508 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055093 Oct 31 16:25:09.368353 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3683/7221] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:25:09 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:10.382413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dc32a395-3819-4649-a7fd-842c35236f27 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:10.384792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dc32a395-3819-4649-a7fd-842c35236f27 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:10.391184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc32a395-3819-4649-a7fd-842c35236f27 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:10.391685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc32a395-3819-4649-a7fd-842c35236f27 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:10.392132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc32a395-3819-4649-a7fd-842c35236f27 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:10.392843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc32a395-3819-4649-a7fd-842c35236f27 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:10.393345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc32a395-3819-4649-a7fd-842c35236f27 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:10.393784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dc32a395-3819-4649-a7fd-842c35236f27 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:10.424756 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dc32a395-3819-4649-a7fd-842c35236f27 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048320 Oct 31 16:25:10.426117 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3539/7222] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:25:10 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:11.437431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a81d0f9d-9d76-4394-9249-db2700bb74a2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:11.439788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a81d0f9d-9d76-4394-9249-db2700bb74a2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:11.447424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81d0f9d-9d76-4394-9249-db2700bb74a2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.447946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81d0f9d-9d76-4394-9249-db2700bb74a2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.448394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81d0f9d-9d76-4394-9249-db2700bb74a2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.449095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81d0f9d-9d76-4394-9249-db2700bb74a2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:11.449584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81d0f9d-9d76-4394-9249-db2700bb74a2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:11.450010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a81d0f9d-9d76-4394-9249-db2700bb74a2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:11.481618 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a81d0f9d-9d76-4394-9249-db2700bb74a2 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048268 Oct 31 16:25:11.482209 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3684/7223] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:25:11 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:12.494532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a583d1e4-50f3-4bb1-9cc9-9d8e941142c4 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:12.496987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a583d1e4-50f3-4bb1-9cc9-9d8e941142c4 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:12.504331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a583d1e4-50f3-4bb1-9cc9-9d8e941142c4 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:12.504841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a583d1e4-50f3-4bb1-9cc9-9d8e941142c4 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:12.505485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a583d1e4-50f3-4bb1-9cc9-9d8e941142c4 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:12.506231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a583d1e4-50f3-4bb1-9cc9-9d8e941142c4 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:12.506773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a583d1e4-50f3-4bb1-9cc9-9d8e941142c4 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:12.507224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a583d1e4-50f3-4bb1-9cc9-9d8e941142c4 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:12.544289 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a583d1e4-50f3-4bb1-9cc9-9d8e941142c4 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053842 Oct 31 16:25:12.549398 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3540/7224] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:25:12 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:13.556514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-98f72cb7-3f17-4046-b1f0-245ac5babaa7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:13.558712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-98f72cb7-3f17-4046-b1f0-245ac5babaa7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:13.570639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f72cb7-3f17-4046-b1f0-245ac5babaa7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:13.571139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f72cb7-3f17-4046-b1f0-245ac5babaa7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:13.571616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f72cb7-3f17-4046-b1f0-245ac5babaa7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:13.572337 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f72cb7-3f17-4046-b1f0-245ac5babaa7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:13.572930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f72cb7-3f17-4046-b1f0-245ac5babaa7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:13.573390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-98f72cb7-3f17-4046-b1f0-245ac5babaa7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:13.606216 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-98f72cb7-3f17-4046-b1f0-245ac5babaa7 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053672 Oct 31 16:25:13.606803 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3685/7225] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:25:13 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:14.619317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-53311903-6290-4a32-adf7-f7b283e54f67 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:14.621572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-53311903-6290-4a32-adf7-f7b283e54f67 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:14.629095 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53311903-6290-4a32-adf7-f7b283e54f67 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:14.629969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53311903-6290-4a32-adf7-f7b283e54f67 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:14.630428 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53311903-6290-4a32-adf7-f7b283e54f67 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:14.631148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53311903-6290-4a32-adf7-f7b283e54f67 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:14.631669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53311903-6290-4a32-adf7-f7b283e54f67 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:14.632115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-53311903-6290-4a32-adf7-f7b283e54f67 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:14.664789 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-53311903-6290-4a32-adf7-f7b283e54f67 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049541 Oct 31 16:25:14.665390 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3541/7226] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:25:14 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 16:25:14.678349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:14.681729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:14.689239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:14.689732 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:14.690166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:14.691586 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:14.692203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:14.692634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:14.768311 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] HTTP exception thrown: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 is not attached to volume a470a796-26b3-4947-9cb4-4208d12f6971 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Request method failure captured: Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments/a470a796-26b3-4947-9cb4-4208d12f6971 HTTP/1.1 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_aD0IqvQow0tzdBjBSxed8Npydo3CIUBO-851FtcTaTDyocBWZS84lfpfY9tNO4xLqUjT95yeWkpJywXV5kYWtCBxBwLOvs-HbpLk-pm5fsasfSvM_gIVhRQCWZBlBgLFuLNeH0RzAuOxIegBBKmr_HZY3vLdkGg7xJX0PUMcD14TE Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ecad30ba3344eabbb784c841fff47fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ecad30ba3344eabbb784c841fff47fb"}]}] Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: fa3db58d82084cee9e1bf8d4216a635b Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 is not attached to volume a470a796-26b3-4947-9cb4-4208d12f6971 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': 'c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22', 'id': 'a470a796-26b3-4947-9cb4-4208d12f6971'} Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a470a796-26b3-4947-9cb4-4208d12f6971. Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 is not attached to volume a470a796-26b3-4947-9cb4-4208d12f6971 Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:14.769964 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:14.774238 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:14.774238 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:14.774238 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 is not attached to volume a470a796-26b3-4947-9cb4-4208d12f6971 Oct 31 16:25:14.774238 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:14.774238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Returning 404 to user: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 is not attached to volume a470a796-26b3-4947-9cb4-4208d12f6971 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:14.774238 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c66f4f47-74eb-439b-a514-1a33a65df498 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments/a470a796-26b3-4947-9cb4-4208d12f6971" status: 404 len: 154 microversion: 2.1 time: 0.098179 Oct 31 16:25:14.774238 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3686/7227] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:25:14 2022] DELETE /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22/os-volume_attachments/a470a796-26b3-4947-9cb4-4208d12f6971 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:18.120984 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:18.121688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:18.129818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:18.130317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:18.130766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:18.131511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:18.132465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:18.132909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:18.160374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:25:18.240967 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-acd47343-ef64-4608-8a2c-55a207aaaf71 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 204 len: 0 microversion: 2.1 time: 0.123559 Oct 31 16:25:18.242345 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3542/7228] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:25:18 2022] DELETE /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 31 16:25:18.250465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:18.250995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:18.262831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:18.263314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:18.263746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:18.264440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:18.264893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:18.265343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:18.402108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:18.410583 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b00a8630-5494-42cc-8f06-f389f492addb tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1560 microversion: 2.1 time: 0.164262 Oct 31 16:25:18.411284 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3687/7229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:18 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:25:19.435483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:19.436213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:19.443315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:19.443823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:19.444275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:19.444989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:19.445493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:19.445946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:19.583077 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:19.590898 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73795165-b9b5-4107-b040-78fd35874f8b tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1560 microversion: 2.1 time: 0.159820 Oct 31 16:25:19.591486 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3543/7230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:19 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:20.251036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-787947fd-6488-4990-92f8-77771dfff066 req-a56adb9f-876c-453f-b7cb-435ea1f87824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22", "name": "network-vif-deleted", "tag": "da06deb3-4832-495f-af0c-0984ff82d133"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:20.271020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-787947fd-6488-4990-92f8-77771dfff066 req-a56adb9f-876c-453f-b7cb-435ea1f87824 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:20.271791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-787947fd-6488-4990-92f8-77771dfff066 req-a56adb9f-876c-453f-b7cb-435ea1f87824 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:20.272219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-787947fd-6488-4990-92f8-77771dfff066 req-a56adb9f-876c-453f-b7cb-435ea1f87824 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:20.286691 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-787947fd-6488-4990-92f8-77771dfff066 req-a56adb9f-876c-453f-b7cb-435ea1f87824 service nova] Creating event network-vif-deleted:da06deb3-4832-495f-af0c-0984ff82d133 for instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 on n-h1-858384-17 Oct 31 16:25:20.292232 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-787947fd-6488-4990-92f8-77771dfff066 req-a56adb9f-876c-453f-b7cb-435ea1f87824 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045478 Oct 31 16:25:20.292843 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3688/7231] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:20.615113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:20.615738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:20.622817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:20.623332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:20.623778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:20.624511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:20.624982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:20.625450 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:20.667881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:20.668375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:20.668823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:20.669312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lazy-loading 'fault' on Instance uuid c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:25:20.717491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa3db58d82084cee9e1bf8d4216a635b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecad30ba3344eabbb784c841fff47fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:20.726726 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00f79879-fbd5-474b-b2c7-549d6e2f0409 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 200 len: 1351 microversion: 2.1 time: 0.116570 Oct 31 16:25:20.727428 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3544/7232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:20 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:21.751841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:21.752543 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] [instance: c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:21.759754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:21.760250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:21.760693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:21.761467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:21.761928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:21.762359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:21.775849 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] HTTP exception thrown: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 could not be found. Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Request method failure captured: Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 HTTP/1.1 Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_aD0IqvQow0tzdBjBSxed8Npydo3CIUBO-851FtcTaTDyocBWZS84lfpfY9tNO4xLqUjT95yeWkpJywXV5kYWtCBxBwLOvs-HbpLk-pm5fsasfSvM_gIVhRQCWZBlBgLFuLNeH0RzAuOxIegBBKmr_HZY3vLdkGg7xJX0PUMcD14TE Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1ecad30ba3344eabbb784c841fff47fb", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1ecad30ba3344eabbb784c841fff47fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1ecad30ba3344eabbb784c841fff47fb"}]}] Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 1ecad30ba3344eabbb784c841fff47fb Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-53812758 Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: fa3db58d82084cee9e1bf8d4216a635b Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestEncryptedCinderVolumes-53812758-project Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 could not be found. Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22'} Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 could not be found. Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 could not be found. Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:25:21.777493 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 could not be found. Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Returning 404 to user: Instance c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-52cfeec2-9e20-4289-9a33-512dedc2ed4a tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22" status: 404 len: 111 microversion: 2.1 time: 0.032219 Oct 31 16:25:21.782444 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3689/7233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:21 2022] GET /compute/v2.1/servers/c2399e1d-5dc7-46ab-bd25-8a8e2fde5f22 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:25:21.788487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-42bcaa0c-5434-4c53-adb4-87178dc55709 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] Calling method '.version_select at 0x7f16e5622ee0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:21.808538 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-42bcaa0c-5434-4c53-adb4-87178dc55709 tempest-TestEncryptedCinderVolumes-53812758 tempest-TestEncryptedCinderVolumes-53812758-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-436627855" status: 202 len: 0 microversion: 2.1 time: 0.024513 Oct 31 16:25:21.809140 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3545/7234] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Oct 31 16:25:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-436627855 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:25:49.459009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f4fece83-59f0-4def-8f30-0c3863085c08 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'create', calling method: .version_select at 0x7f16e158bee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-500194241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1n0S18ycZaNOn0fWITBCWoKOWxs2+2jqTNZOU77FSPqcRxeMY9qn1IK2JoZtMhu0kl0b0l7VeLJepEKI4PTfVx+nmJkWY107HmKPIR7Mn04qQbXhg3hlqEcQxD8Agr+w=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:49.465220 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=14 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:49.465875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=34 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:49.478861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f4fece83-59f0-4def-8f30-0c3863085c08 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Getting quotas for project ee01403283bd42c28d5da06a2e64f666. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:25:49.484490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-f4fece83-59f0-4def-8f30-0c3863085c08 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Getting quotas for user 845d302e6ad74867a57206becd7117ba and project ee01403283bd42c28d5da06a2e64f666. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:25:49.509394 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f4fece83-59f0-4def-8f30-0c3863085c08 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054584 Oct 31 16:25:49.510001 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3690/7235] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:25:49 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:25:49.561193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-965083716", "imageRef": "f404af17-0409-4103-9da8-edda20a38ba3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-500194241", "networks": [{"uuid": "756c6d3a-8e33-49ac-8211-c3f5396a0fb2"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:25:49.571834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:49.572501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:25:49.618366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] validate_networks() for [('756c6d3a-8e33-49ac-8211-c3f5396a0fb2', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:25:49.991891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:25:49.992325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:25:49.992809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:25:49.993255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:25:49.993731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:25:50.002471 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.002964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.003414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.004146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:50.004608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:50.005043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:50.022885 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Getting quotas for project ee01403283bd42c28d5da06a2e64f666. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:25:50.028151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Getting quotas for user 845d302e6ad74867a57206becd7117ba and project ee01403283bd42c28d5da06a2e64f666. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:25:50.044026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:25:50.047148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f404af17-0409-4103-9da8-edda20a38ba3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:25:50.107408 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-662324ac-c1d8-4d5a-adcf-550122a82f98 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550112 Oct 31 16:25:50.108076 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3546/7236] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:25:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:25:50.119555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-53c49f1b-ed60-489b-91aa-9a436df05a58 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:50.120177 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-53c49f1b-ed60-489b-91aa-9a436df05a58 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:50.175587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-53c49f1b-ed60-489b-91aa-9a436df05a58 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:50.183543 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-53c49f1b-ed60-489b-91aa-9a436df05a58 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1257 microversion: 2.1 time: 0.068119 Oct 31 16:25:50.184108 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3691/7237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:50 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:51.208897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:51.210648 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:51.218215 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:51.218848 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:51.219623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:51.220579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:51.221114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:51.222364 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:51.293891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:51.302177 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6fe019af-bc02-4815-8b41-64d36e728850 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1317 microversion: 2.1 time: 0.098191 Oct 31 16:25:51.302791 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3547/7238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:51 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1317 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:52.326946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:52.328239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:52.337047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:52.337661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:52.338174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:52.338971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:52.339506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:52.340007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:52.521821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:52.530631 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ad94a18d-01ef-4307-88b4-d5ee9213d2ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.207730 Oct 31 16:25:52.531228 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3692/7239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:52 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:53.555641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:53.557292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:53.564773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:53.565615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:53.566299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:53.567498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:53.568193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:53.568835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:53.723173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:53.738542 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-00a72c6c-9eda-49f4-8168-8e0b58430a3e tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.186715 Oct 31 16:25:53.739802 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3548/7240] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:53 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:54.764265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:54.764902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:54.771978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:54.772542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:54.772985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:54.773699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:54.774187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:54.774625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:54.916159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:54.924283 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78e9b7ab-030d-40f0-a433-8024c51c0b74 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.163954 Oct 31 16:25:54.924875 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3693/7241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:54 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:55.949526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:55.950264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:55.957895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:55.958398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:55.958854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:55.960072 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:55.960732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:55.961203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:56.121509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:56.129658 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01a4ebb8-8a40-493d-94c7-70d323e0c33f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.184750 Oct 31 16:25:56.130427 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3549/7242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:55 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:57.153810 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:57.154487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:57.161532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:57.161952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:57.162383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:57.163071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:57.163522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:57.163943 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:57.324939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:57.334779 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-897bc3e3-91ef-45ac-83a2-80fe7b7c4b26 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.184551 Oct 31 16:25:57.335627 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3694/7243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:57 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:58.360031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:58.360725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:58.367845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:58.368456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:58.369431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:58.370149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:58.370628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:58.371073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:58.548052 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:58.557101 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-39dd7117-12c2-4900-b90b-ba18ee612b0d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.200233 Oct 31 16:25:58.568106 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3550/7244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:58 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:25:59.582555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:25:59.584040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:25:59.591435 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:59.591921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:59.592361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:59.593090 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:25:59.593745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:25:59.594346 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:25:59.826842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:25:59.835009 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d780f77c-cd2d-4f28-89ca-41d64e3beaac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.257408 Oct 31 16:25:59.835633 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3695/7245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:25:59 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:00.293380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:00.294214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:00.419193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-bf66833d-e4c2-431d-94f3-13b2ff703fb9 req-9a68d57c-6f3d-463f-8d21-26ef0f5bc58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02961c19-ff27-4d5b-8f60-4796ea766926", "tag": "2eaf6f7d-71cb-4381-af73-93d8dd0e81d3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:00.428948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bf66833d-e4c2-431d-94f3-13b2ff703fb9 req-9a68d57c-6f3d-463f-8d21-26ef0f5bc58e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:00.429474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bf66833d-e4c2-431d-94f3-13b2ff703fb9 req-9a68d57c-6f3d-463f-8d21-26ef0f5bc58e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:00.429915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-bf66833d-e4c2-431d-94f3-13b2ff703fb9 req-9a68d57c-6f3d-463f-8d21-26ef0f5bc58e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:00.440870 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-bf66833d-e4c2-431d-94f3-13b2ff703fb9 req-9a68d57c-6f3d-463f-8d21-26ef0f5bc58e service nova] Creating event network-changed:2eaf6f7d-71cb-4381-af73-93d8dd0e81d3 for instance 02961c19-ff27-4d5b-8f60-4796ea766926 on n-h2-858384-17 Oct 31 16:26:00.446025 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-bf66833d-e4c2-431d-94f3-13b2ff703fb9 req-9a68d57c-6f3d-463f-8d21-26ef0f5bc58e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159008 Oct 31 16:26:00.446631 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3551/7246] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:26:00.858336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:00.858942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:00.860791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:00.867363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:00.867854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:00.868290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:00.868992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:00.869787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:00.870229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:01.002185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:01.010587 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-857b7955-bbf0-4fe1-9233-305a710f3abe tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.155439 Oct 31 16:26:01.011215 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3696/7247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:00 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:26:02.036538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:02.037293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:02.044518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:02.045022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:02.045495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:02.046203 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:02.046674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:02.047109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:02.182719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:02.190800 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50f9f4f4-1285-4db5-88a4-3eeca947b58f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.160525 Oct 31 16:26:02.191408 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3552/7248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:02 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:03.215162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:03.215780 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:03.222839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:03.223360 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:03.223797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:03.224498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:03.224951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:03.225526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:03.358282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:03.366754 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-92d9b1f5-95f9-4648-bde3-68b7ad0e7d5f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.155920 Oct 31 16:26:03.367556 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3697/7249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:03 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:04.390689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:04.391320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:04.398236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:04.398734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:04.399186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:04.399889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:04.400454 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:04.401026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:04.531241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:04.538932 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16fb07c7-55b9-407c-bb0f-6fbda70544bb tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.152197 Oct 31 16:26:04.539512 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3553/7250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:04 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:05.367009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-c57db144-c4b0-415c-a353-bf52edf77a37 req-570fc888-98f8-4cc4-a58d-834f9be9ede9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02961c19-ff27-4d5b-8f60-4796ea766926", "name": "network-vif-plugged", "status": "completed", "tag": "2eaf6f7d-71cb-4381-af73-93d8dd0e81d3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:05.376514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c57db144-c4b0-415c-a353-bf52edf77a37 req-570fc888-98f8-4cc4-a58d-834f9be9ede9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:05.376976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c57db144-c4b0-415c-a353-bf52edf77a37 req-570fc888-98f8-4cc4-a58d-834f9be9ede9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:05.377436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-c57db144-c4b0-415c-a353-bf52edf77a37 req-570fc888-98f8-4cc4-a58d-834f9be9ede9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:05.388950 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-c57db144-c4b0-415c-a353-bf52edf77a37 req-570fc888-98f8-4cc4-a58d-834f9be9ede9 service nova] Creating event network-vif-plugged:2eaf6f7d-71cb-4381-af73-93d8dd0e81d3 for instance 02961c19-ff27-4d5b-8f60-4796ea766926 on n-h2-858384-17 Oct 31 16:26:05.393942 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-c57db144-c4b0-415c-a353-bf52edf77a37 req-570fc888-98f8-4cc4-a58d-834f9be9ede9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094777 Oct 31 16:26:05.394523 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3698/7251] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:05.563529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:05.564292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:05.571133 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:05.571641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:05.572100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:05.573687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:05.574170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:05.574618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:05.710639 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:05.718848 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f0835f17-67b4-45f6-b85a-b92c722414e2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.159356 Oct 31 16:26:05.719442 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3554/7252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:05 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:06.743787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:06.744593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:06.750846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:06.751319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:06.751764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:06.752466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:06.752927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:06.753389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:06.896223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:06.904760 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fafdb631-c1d9-42a9-b731-8f0756fd60d9 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1357 microversion: 2.1 time: 0.166221 Oct 31 16:26:06.905365 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3699/7253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:06 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:07.927981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:07.928573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:07.935791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:07.936296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:07.936754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:07.937586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:07.938069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:07.938512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:08.070873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:08.078891 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea94ad05-5f8a-4519-92a9-78eee3cf8598 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1546 microversion: 2.1 time: 0.154934 Oct 31 16:26:08.079472 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3555/7254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:07 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:08.101987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:08.102628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:08.110304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:08.110791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:08.111226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:08.111923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:08.112378 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:08.112805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:08.242607 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:08.250377 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8c57c124-62d6-484b-b95e-41c31e3c6d6d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1546 microversion: 2.1 time: 0.152233 Oct 31 16:26:08.250954 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3700/7255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:08 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:08.272708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:08.278082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:08.278865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Searching by: {'deleted': False, 'project_id': 'ee01403283bd42c28d5da06a2e64f666'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 16:26:08.284084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:08.284568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:08.285011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:08.285771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:08.286233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:08.286666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:08.309816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 16:26:08.336566 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-efb8d6dc-04d9-4161-8ea6-9d996ab4d32d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067608 Oct 31 16:26:08.337186 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3556/7256] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 16:26:08 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:08.349901 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:08.350518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:08.356599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:08.357091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:08.357568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:08.358262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:08.358729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:08.359166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:08.489884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:08.498181 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e439eb9b-f240-4fef-b632-908abfd26f85 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1546 microversion: 2.1 time: 0.152329 Oct 31 16:26:08.498765 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3701/7257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:08 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:10.046019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8113b6b1-5d6a-41ca-844c-66a3fbc6aa6a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f58af904-735c-42da-8cbc-cb66af8d0c1c"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:10.048441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8113b6b1-5d6a-41ca-844c-66a3fbc6aa6a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:10.055311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8113b6b1-5d6a-41ca-844c-66a3fbc6aa6a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:10.055815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8113b6b1-5d6a-41ca-844c-66a3fbc6aa6a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:10.056264 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8113b6b1-5d6a-41ca-844c-66a3fbc6aa6a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:10.056969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8113b6b1-5d6a-41ca-844c-66a3fbc6aa6a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:10.057474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8113b6b1-5d6a-41ca-844c-66a3fbc6aa6a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:10.057919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8113b6b1-5d6a-41ca-844c-66a3fbc6aa6a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:10.295464 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8113b6b1-5d6a-41ca-844c-66a3fbc6aa6a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253675 Oct 31 16:26:10.296078 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3557/7258] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 16:26:10 2022] POST /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:23.341591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:23.342199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:23.344367 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:23.345017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=56 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:23.351907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:23.352537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:23.352974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:23.353688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:23.354136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:23.354555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:23.485962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:23.494054 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cbaab006-52b8-4051-9f47-f91b8e17fd80 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1592 microversion: 2.1 time: 0.156890 Oct 31 16:26:23.494641 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3702/7259] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:23 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1592 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:25.165115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e44a7c97-52b6-4dd1-8579-bf10d5d678e9 req-13e5a8db-d4b2-421b-a4ea-1b463579cafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02961c19-ff27-4d5b-8f60-4796ea766926", "tag": "2eaf6f7d-71cb-4381-af73-93d8dd0e81d3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:25.172090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:25.172851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:25.173947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:26:25.181609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e44a7c97-52b6-4dd1-8579-bf10d5d678e9 req-13e5a8db-d4b2-421b-a4ea-1b463579cafc service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:25.182452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e44a7c97-52b6-4dd1-8579-bf10d5d678e9 req-13e5a8db-d4b2-421b-a4ea-1b463579cafc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:25.182879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e44a7c97-52b6-4dd1-8579-bf10d5d678e9 req-13e5a8db-d4b2-421b-a4ea-1b463579cafc service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:25.197439 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e44a7c97-52b6-4dd1-8579-bf10d5d678e9 req-13e5a8db-d4b2-421b-a4ea-1b463579cafc service nova] Creating event network-changed:2eaf6f7d-71cb-4381-af73-93d8dd0e81d3 for instance 02961c19-ff27-4d5b-8f60-4796ea766926 on n-h2-858384-17 Oct 31 16:26:25.202743 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e44a7c97-52b6-4dd1-8579-bf10d5d678e9 req-13e5a8db-d4b2-421b-a4ea-1b463579cafc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042430 Oct 31 16:26:25.203369 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3558/7260] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:26:26.323765 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-651446719"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:26.324292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:26.331948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:26.332456 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:26.332884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:26.333614 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:26.334355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:26.334786 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:26.472495 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Adding security group 51b674d1-7615-4bcf-88e2-dd8e7d1a9201 to port 2eaf6f7d-71cb-4381-af73-93d8dd0e81d3 Oct 31 16:26:26.784122 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-765d1f10-ced4-4b5f-95a1-3498313b2362 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/action" status: 202 len: 0 microversion: 2.1 time: 0.464305 Oct 31 16:26:26.784753 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3703/7261] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:26:26 2022] POST /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:26:26.794662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:26:26.795607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:26:26.804011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:26.804527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:26.804985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:26.805925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:26.806652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:26.807105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:26.962649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:26:26.972835 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa3040ed-01a5-4ffd-9005-0c2492c8de92 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1756 microversion: 2.1 time: 0.183551 Oct 31 16:26:26.973465 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3559/7262] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:26:26 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:26:27.218437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-83204647-a7f1-4f60-b14d-3533313bb208 req-0458aba7-02f8-4e10-ac42-5effd5b1aada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02961c19-ff27-4d5b-8f60-4796ea766926", "tag": "2eaf6f7d-71cb-4381-af73-93d8dd0e81d3"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:26:27.227946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-83204647-a7f1-4f60-b14d-3533313bb208 req-0458aba7-02f8-4e10-ac42-5effd5b1aada service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:26:27.228461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-83204647-a7f1-4f60-b14d-3533313bb208 req-0458aba7-02f8-4e10-ac42-5effd5b1aada service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:26:27.228902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-83204647-a7f1-4f60-b14d-3533313bb208 req-0458aba7-02f8-4e10-ac42-5effd5b1aada service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:26:27.240504 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-83204647-a7f1-4f60-b14d-3533313bb208 req-0458aba7-02f8-4e10-ac42-5effd5b1aada service nova] Creating event network-changed:2eaf6f7d-71cb-4381-af73-93d8dd0e81d3 for instance 02961c19-ff27-4d5b-8f60-4796ea766926 on n-h2-858384-17 Oct 31 16:26:27.245533 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-83204647-a7f1-4f60-b14d-3533313bb208 req-0458aba7-02f8-4e10-ac42-5effd5b1aada service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031400 Oct 31 16:26:27.246153 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3704/7263] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:28:05.988002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:05.988791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:05.990884 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:28:05.991070 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:28:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/action (ip 10.222.0.20) !!! Oct 31 16:28:05.998408 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-335e6915-ebcc-476d-b1ae-9c9aee8af5ee tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:28:06.000659 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-335e6915-ebcc-476d-b1ae-9c9aee8af5ee tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:06.014299 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-335e6915-ebcc-476d-b1ae-9c9aee8af5ee tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:06.014811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-335e6915-ebcc-476d-b1ae-9c9aee8af5ee tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:06.015270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-335e6915-ebcc-476d-b1ae-9c9aee8af5ee tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:06.015992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-335e6915-ebcc-476d-b1ae-9c9aee8af5ee tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:06.016473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-335e6915-ebcc-476d-b1ae-9c9aee8af5ee tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:06.016923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-335e6915-ebcc-476d-b1ae-9c9aee8af5ee tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:06.089347 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-335e6915-ebcc-476d-b1ae-9c9aee8af5ee tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/action" status: 202 len: 0 microversion: 2.1 time: 0.102974 Oct 31 16:28:06.090150 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3560/7264] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:28:05 2022] POST /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:28:06.098194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:06.098946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:28:06.100190 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:28:06.100327 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 (ip 10.222.0.20) !!! Oct 31 16:28:06.101447 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:28:06.101589 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:28:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 (ip 10.222.0.20) !!! Oct 31 16:28:06.108585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:06.109413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:06.118070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:06.118560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:06.119001 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:06.119708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:06.120168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:06.120598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:06.351038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:06.359269 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-879d527a-1601-4d40-838b-45337136eea8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1758 microversion: 2.1 time: 0.264564 Oct 31 16:28:06.359854 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3705/7265] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:06 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1758 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:28:07.383702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:28:07.384431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:28:07.391702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:07.392210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:07.393212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:07.394088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:28:07.394567 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:28:07.395013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:28:07.544939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:28:07.553819 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-84c6143a-3ef2-4d23-9f6c-d15727dc67c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1756 microversion: 2.1 time: 0.174541 Oct 31 16:28:07.554427 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3561/7266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:28:07 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:21.985374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:21.986043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:21.990263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-651446719"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:21.990796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:21.998560 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:21.999167 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:21.999712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:22.000529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:22.001093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:22.001660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:22.200528 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Removing security group 51b674d1-7615-4bcf-88e2-dd8e7d1a9201 from port 2eaf6f7d-71cb-4381-af73-93d8dd0e81d3 Oct 31 16:29:22.505961 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6d58bd74-afcd-4a31-aa0e-626b464661f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/action" status: 202 len: 0 microversion: 2.1 time: 0.522481 Oct 31 16:29:22.506802 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3706/7267] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:29:21 2022] POST /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:29:22.518257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6dfb5ef9-598f-421c-bd8e-f23563611df7 req-987a78e7-0554-45e3-b726-e34d73066979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02961c19-ff27-4d5b-8f60-4796ea766926", "tag": "2eaf6f7d-71cb-4381-af73-93d8dd0e81d3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:22.528832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:22.529906 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:22.532213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6dfb5ef9-598f-421c-bd8e-f23563611df7 req-987a78e7-0554-45e3-b726-e34d73066979 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:22.532949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6dfb5ef9-598f-421c-bd8e-f23563611df7 req-987a78e7-0554-45e3-b726-e34d73066979 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:22.533967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6dfb5ef9-598f-421c-bd8e-f23563611df7 req-987a78e7-0554-45e3-b726-e34d73066979 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:22.548745 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6dfb5ef9-598f-421c-bd8e-f23563611df7 req-987a78e7-0554-45e3-b726-e34d73066979 service nova] Creating event network-changed:2eaf6f7d-71cb-4381-af73-93d8dd0e81d3 for instance 02961c19-ff27-4d5b-8f60-4796ea766926 on n-h2-858384-17 Oct 31 16:29:22.554989 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6dfb5ef9-598f-421c-bd8e-f23563611df7 req-987a78e7-0554-45e3-b726-e34d73066979 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041785 Oct 31 16:29:22.556356 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3562/7268] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:23.917660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:23.918228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:23.924247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:23.924727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:23.925180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:23.925865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:23.926320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:23.926741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:24.010338 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lazy-loading 'services' on Instance uuid 02961c19-ff27-4d5b-8f60-4796ea766926 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:29:24.081889 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [b64aa500-3dcf-4bc5-b785-9731a24fef13] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:29:24.575633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-37bf3849-a0f0-4106-a9e9-4ea91d3546d7 req-189a7b95-27b6-4a31-afec-f10becced5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02961c19-ff27-4d5b-8f60-4796ea766926", "tag": "2eaf6f7d-71cb-4381-af73-93d8dd0e81d3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:24.585643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-37bf3849-a0f0-4106-a9e9-4ea91d3546d7 req-189a7b95-27b6-4a31-afec-f10becced5f9 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:24.586167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-37bf3849-a0f0-4106-a9e9-4ea91d3546d7 req-189a7b95-27b6-4a31-afec-f10becced5f9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:24.586614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-37bf3849-a0f0-4106-a9e9-4ea91d3546d7 req-189a7b95-27b6-4a31-afec-f10becced5f9 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:24.599195 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-37bf3849-a0f0-4106-a9e9-4ea91d3546d7 req-189a7b95-27b6-4a31-afec-f10becced5f9 service nova] Creating event network-changed:2eaf6f7d-71cb-4381-af73-93d8dd0e81d3 for instance 02961c19-ff27-4d5b-8f60-4796ea766926 on n-h2-858384-17 Oct 31 16:29:24.605833 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-37bf3849-a0f0-4106-a9e9-4ea91d3546d7 req-189a7b95-27b6-4a31-afec-f10becced5f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035064 Oct 31 16:29:24.606471 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3563/7269] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:29:25.089671 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [b64aa500-3dcf-4bc5-b785-9731a24fef13] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54248. Oct 31 16:29:25.093677 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6a9c8d04-f4de-4efe-9730-913700f84429 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "DELETE /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments/f58af904-735c-42da-8cbc-cb66af8d0c1c" status: 202 len: 0 microversion: 2.1 time: 1.181685 Oct 31 16:29:25.094307 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3707/7270] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:29:23 2022] DELETE /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments/f58af904-735c-42da-8cbc-cb66af8d0c1c => generated 0 bytes in 1183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:29:25.105398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fbe92156-c654-4627-9592-75c3554ab97d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:25.108522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fbe92156-c654-4627-9592-75c3554ab97d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:25.116076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbe92156-c654-4627-9592-75c3554ab97d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:25.116760 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbe92156-c654-4627-9592-75c3554ab97d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:25.117516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbe92156-c654-4627-9592-75c3554ab97d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:25.118232 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbe92156-c654-4627-9592-75c3554ab97d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:25.119081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbe92156-c654-4627-9592-75c3554ab97d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:25.119768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fbe92156-c654-4627-9592-75c3554ab97d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:25.153434 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fbe92156-c654-4627-9592-75c3554ab97d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054319 Oct 31 16:29:25.154033 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3564/7271] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:29:25 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:26.168598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3ed14587-ad91-4249-831b-4ad5179af568 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:26.171013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3ed14587-ad91-4249-831b-4ad5179af568 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:26.178049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed14587-ad91-4249-831b-4ad5179af568 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:26.178544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed14587-ad91-4249-831b-4ad5179af568 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:26.178995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed14587-ad91-4249-831b-4ad5179af568 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:26.179783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed14587-ad91-4249-831b-4ad5179af568 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:26.180249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed14587-ad91-4249-831b-4ad5179af568 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:26.181252 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3ed14587-ad91-4249-831b-4ad5179af568 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:26.211356 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3ed14587-ad91-4249-831b-4ad5179af568 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048732 Oct 31 16:29:26.211975 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3708/7272] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:29:26 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:27.223781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-96d6a927-54c7-4314-b6d1-9f591d9304a7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:27.226040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-96d6a927-54c7-4314-b6d1-9f591d9304a7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:27.234287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d6a927-54c7-4314-b6d1-9f591d9304a7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:27.234793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d6a927-54c7-4314-b6d1-9f591d9304a7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:27.235240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d6a927-54c7-4314-b6d1-9f591d9304a7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:27.235964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d6a927-54c7-4314-b6d1-9f591d9304a7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:27.236458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d6a927-54c7-4314-b6d1-9f591d9304a7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:27.236896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-96d6a927-54c7-4314-b6d1-9f591d9304a7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:27.269027 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-96d6a927-54c7-4314-b6d1-9f591d9304a7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049195 Oct 31 16:29:27.269565 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3565/7273] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:29:27 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:28.281677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09bc47c0-6a93-4a0d-90b6-2b3c25343982 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:28.283970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09bc47c0-6a93-4a0d-90b6-2b3c25343982 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:28.291243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bc47c0-6a93-4a0d-90b6-2b3c25343982 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:28.291727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bc47c0-6a93-4a0d-90b6-2b3c25343982 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:28.292162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bc47c0-6a93-4a0d-90b6-2b3c25343982 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:28.292862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bc47c0-6a93-4a0d-90b6-2b3c25343982 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:28.293356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bc47c0-6a93-4a0d-90b6-2b3c25343982 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:28.293781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09bc47c0-6a93-4a0d-90b6-2b3c25343982 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:28.328208 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09bc47c0-6a93-4a0d-90b6-2b3c25343982 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050486 Oct 31 16:29:28.328677 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3709/7274] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:29:28 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:29.341768 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ec571259-f98e-4610-9eec-d060330cc2b5 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:29.344061 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ec571259-f98e-4610-9eec-d060330cc2b5 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:29.350936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec571259-f98e-4610-9eec-d060330cc2b5 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:29.351439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec571259-f98e-4610-9eec-d060330cc2b5 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:29.351890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec571259-f98e-4610-9eec-d060330cc2b5 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:29.352709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec571259-f98e-4610-9eec-d060330cc2b5 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:29.353314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec571259-f98e-4610-9eec-d060330cc2b5 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:29.353758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ec571259-f98e-4610-9eec-d060330cc2b5 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:29.384717 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ec571259-f98e-4610-9eec-d060330cc2b5 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Oct 31 16:29:29.385331 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3566/7275] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:29:29 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:30.397831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01d43d28-ffdd-4476-a556-a358c961af79 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:30.400063 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-01d43d28-ffdd-4476-a556-a358c961af79 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:30.406921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01d43d28-ffdd-4476-a556-a358c961af79 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:30.407433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01d43d28-ffdd-4476-a556-a358c961af79 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:30.407870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01d43d28-ffdd-4476-a556-a358c961af79 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:30.408567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01d43d28-ffdd-4476-a556-a358c961af79 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:30.409026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01d43d28-ffdd-4476-a556-a358c961af79 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:30.409479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01d43d28-ffdd-4476-a556-a358c961af79 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:30.438566 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01d43d28-ffdd-4476-a556-a358c961af79 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044826 Oct 31 16:29:30.439137 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3710/7276] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:29:30 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 16:29:30.450008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:30.450523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:30.457366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:30.457868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:30.458321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:30.459028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:30.459503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:30.459949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:30.671625 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] HTTP exception thrown: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 is not attached to volume f58af904-735c-42da-8cbc-cb66af8d0c1c Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Request method failure captured: Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: request: DELETE /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments/f58af904-735c-42da-8cbc-cb66af8d0c1c HTTP/1.1 Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_b-teYLLNV32XSq2Ky3XtfDCwMpxJ9pMIsudBOzv4w9Q7JoWO5oxmEXZOhHiQFCEjI-Q8B0Ei2r1AF7BCPwQ4kfPQu1bwWTU8UqNIRygBwScOkhDFjA6o3xuFYkVxpNBYywS3UlNW1lUvf-QPSKE_Rkao7RebnlcFbwfuSUj68xtWw Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: ee01403283bd42c28d5da06a2e64f666 Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee01403283bd42c28d5da06a2e64f666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee01403283bd42c28d5da06a2e64f666", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee01403283bd42c28d5da06a2e64f666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee01403283bd42c28d5da06a2e64f666"}]}] Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: ee01403283bd42c28d5da06a2e64f666 Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestMinimumBasicScenario-36136235-project Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 845d302e6ad74867a57206becd7117ba Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestMinimumBasicScenario-36136235-project Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 is not attached to volume f58af904-735c-42da-8cbc-cb66af8d0c1c Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'server_id': '02961c19-ff27-4d5b-8f60-4796ea766926', 'id': 'f58af904-735c-42da-8cbc-cb66af8d0c1c'} Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f58af904-735c-42da-8cbc-cb66af8d0c1c. Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 is not attached to volume f58af904-735c-42da-8cbc-cb66af8d0c1c Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:29:30.673354 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:29:30.678186 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:29:30.678186 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:29:30.678186 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 is not attached to volume f58af904-735c-42da-8cbc-cb66af8d0c1c Oct 31 16:29:30.678186 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:30.678186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Returning 404 to user: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 is not attached to volume f58af904-735c-42da-8cbc-cb66af8d0c1c {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:29:30.678186 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-48e1698f-43fd-4262-b59e-e92d3fdff86f tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "DELETE /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments/f58af904-735c-42da-8cbc-cb66af8d0c1c" status: 404 len: 154 microversion: 2.1 time: 0.229061 Oct 31 16:29:30.678186 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3567/7277] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:29:30 2022] DELETE /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926/os-volume_attachments/f58af904-735c-42da-8cbc-cb66af8d0c1c => generated 154 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:29:33.932726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:33.933266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:33.940305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:33.940797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:33.941278 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:33.941978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:33.942437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:33.942868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:33.969436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:29:34.047889 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cb455cc2-0578-44c4-abbf-dde46b425b54 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "DELETE /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 204 len: 0 microversion: 2.1 time: 0.118559 Oct 31 16:29:34.048630 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3711/7278] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:29:33 2022] DELETE /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:29:34.056981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:34.058310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:34.069726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:34.070239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:34.070840 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:34.072220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:34.072695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:34.073380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:34.212669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:34.221173 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f927cdc2-7ad5-4113-a02d-81afb65b1974 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1552 microversion: 2.1 time: 0.168623 Oct 31 16:29:34.221771 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3568/7279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:34 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:29:35.244879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:35.245686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:35.253297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:35.253792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:35.254235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:35.254936 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:35.255399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:35.255827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:35.386018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:35.393713 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2db839b1-43b6-4c85-ba38-4a006ad86f01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1552 microversion: 2.1 time: 0.153279 Oct 31 16:29:35.394291 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3712/7280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:35 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:36.350869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fda92c45-a09e-4668-aea8-f9fd1c5e6829 req-7af86aef-77ca-471d-b861-4f52456b21b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02961c19-ff27-4d5b-8f60-4796ea766926", "name": "network-vif-deleted", "tag": "2eaf6f7d-71cb-4381-af73-93d8dd0e81d3"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:36.362469 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fda92c45-a09e-4668-aea8-f9fd1c5e6829 req-7af86aef-77ca-471d-b861-4f52456b21b2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:36.363242 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fda92c45-a09e-4668-aea8-f9fd1c5e6829 req-7af86aef-77ca-471d-b861-4f52456b21b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:36.363694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fda92c45-a09e-4668-aea8-f9fd1c5e6829 req-7af86aef-77ca-471d-b861-4f52456b21b2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:36.377220 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fda92c45-a09e-4668-aea8-f9fd1c5e6829 req-7af86aef-77ca-471d-b861-4f52456b21b2 service nova] Creating event network-vif-deleted:2eaf6f7d-71cb-4381-af73-93d8dd0e81d3 for instance 02961c19-ff27-4d5b-8f60-4796ea766926 on n-h2-858384-17 Oct 31 16:29:36.382573 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fda92c45-a09e-4668-aea8-f9fd1c5e6829 req-7af86aef-77ca-471d-b861-4f52456b21b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035517 Oct 31 16:29:36.383186 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3569/7281] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:36.418535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:36.419144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:36.426238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:36.426723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:36.427641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:36.428674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:36.429228 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:36.429960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:36.465429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:36.465919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:36.466379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:36.467066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lazy-loading 'fault' on Instance uuid 02961c19-ff27-4d5b-8f60-4796ea766926 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:29:36.509079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:36.517044 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-460a6757-d1e1-429f-a51c-61134cec2ae4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 200 len: 1347 microversion: 2.1 time: 0.103044 Oct 31 16:29:36.517905 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3713/7282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:36 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 1347 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:37.542619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:37.543333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 02961c19-ff27-4d5b-8f60-4796ea766926] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:37.549461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:37.549952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:37.550434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:37.551129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:37.551596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:37.552056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:37.565957 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] HTTP exception thrown: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 could not be found. Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Request method failure captured: Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 HTTP/1.1 Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_b-teYLLNV32XSq2Ky3XtfDCwMpxJ9pMIsudBOzv4w9Q7JoWO5oxmEXZOhHiQFCEjI-Q8B0Ei2r1AF7BCPwQ4kfPQu1bwWTU8UqNIRygBwScOkhDFjA6o3xuFYkVxpNBYywS3UlNW1lUvf-QPSKE_Rkao7RebnlcFbwfuSUj68xtWw Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: ee01403283bd42c28d5da06a2e64f666 Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee01403283bd42c28d5da06a2e64f666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee01403283bd42c28d5da06a2e64f666", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee01403283bd42c28d5da06a2e64f666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee01403283bd42c28d5da06a2e64f666"}]}] Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: ee01403283bd42c28d5da06a2e64f666 Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestMinimumBasicScenario-36136235-project Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: 845d302e6ad74867a57206becd7117ba Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestMinimumBasicScenario-36136235-project Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 could not be found. Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '02961c19-ff27-4d5b-8f60-4796ea766926'} Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 could not be found. Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 could not be found. Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:29:37.567594 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 could not be found. Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Returning 404 to user: Instance 02961c19-ff27-4d5b-8f60-4796ea766926 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f6776390-d9d6-4417-b02f-26e460ed8619 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926" status: 404 len: 111 microversion: 2.1 time: 0.032103 Oct 31 16:29:37.572817 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3570/7283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:37 2022] GET /compute/v2.1/servers/02961c19-ff27-4d5b-8f60-4796ea766926 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:29:37.577753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-085bb8bd-d938-4e92-a321-ed6ecd464fac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '.version_select at 0x7f16e55a1430>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:37.601550 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-085bb8bd-d938-4e92-a321-ed6ecd464fac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-500194241" status: 202 len: 0 microversion: 2.1 time: 0.027505 Oct 31 16:29:37.602132 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3714/7284] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 16:29:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-500194241 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:29:46.677049 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aac20518-6076-41ab-bed5-c49cb048fe4d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'create', calling method: .version_select at 0x7f16e0f513a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-584383764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOAqQ/tvOlwlDu4Ru4FEI2w+scxPBoBNjtZcTHbaO/xbvj9j/62MU/nvwueklLv4BTZB8n4kzpDscsJENjH91xdmpAUcG1mJVcJ0S+e4MZ3N3Mb/gtrbNvEi2BHVjw5hA=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:46.684444 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:29:46.684603 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:29:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Oct 31 16:29:46.698704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-aac20518-6076-41ab-bed5-c49cb048fe4d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Getting quotas for project ee01403283bd42c28d5da06a2e64f666. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:29:46.703833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-aac20518-6076-41ab-bed5-c49cb048fe4d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Getting quotas for user 845d302e6ad74867a57206becd7117ba and project ee01403283bd42c28d5da06a2e64f666. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:29:46.729957 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aac20518-6076-41ab-bed5-c49cb048fe4d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056814 Oct 31 16:29:46.730570 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3571/7285] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:29:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:29:46.781431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:46.786700 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-326632742", "imageRef": "871dae3d-4a8e-42b5-b0e7-0c48e96e4910", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-584383764", "networks": [{"uuid": "756c6d3a-8e33-49ac-8211-c3f5396a0fb2"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:29:46.840518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] validate_networks() for [('756c6d3a-8e33-49ac-8211-c3f5396a0fb2', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:29:47.273262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:29:47.273688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:29:47.274157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:29:47.274565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:29:47.274975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:29:47.284716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:47.285229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:47.285663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:47.286389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:47.286839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:47.287260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:47.304172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Getting quotas for project ee01403283bd42c28d5da06a2e64f666. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:29:47.310023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Getting quotas for user 845d302e6ad74867a57206becd7117ba and project ee01403283bd42c28d5da06a2e64f666. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:29:47.322039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:29:47.324282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='871dae3d-4a8e-42b5-b0e7-0c48e96e4910',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:29:47.371733 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ca2549d0-ea6a-478a-af18-2b01e7dbe612 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592782 Oct 31 16:29:47.372432 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3715/7286] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:29:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:29:47.383847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-92537bc6-4a0d-464c-8a30-f17d9717caa6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:47.384572 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-92537bc6-4a0d-464c-8a30-f17d9717caa6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:47.438228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-92537bc6-4a0d-464c-8a30-f17d9717caa6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:47.445089 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-92537bc6-4a0d-464c-8a30-f17d9717caa6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1257 microversion: 2.1 time: 0.065253 Oct 31 16:29:47.445712 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3572/7287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:47 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:48.468520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9489b0b7-e4f9-4869-af23-0011f48b7675 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:48.469189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9489b0b7-e4f9-4869-af23-0011f48b7675 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:48.528789 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9489b0b7-e4f9-4869-af23-0011f48b7675 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:48.535852 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9489b0b7-e4f9-4869-af23-0011f48b7675 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1257 microversion: 2.1 time: 0.072056 Oct 31 16:29:48.536442 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3716/7288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:48 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:49.560470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-56e94fbd-3a29-4a69-8e69-b167b11d077b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:49.561100 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-56e94fbd-3a29-4a69-8e69-b167b11d077b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:49.563293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=38 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:49.619576 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-56e94fbd-3a29-4a69-8e69-b167b11d077b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:49.628975 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-56e94fbd-3a29-4a69-8e69-b167b11d077b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1257 microversion: 2.1 time: 0.072850 Oct 31 16:29:49.630478 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3573/7289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:49 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1257 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:50.655335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67b748e8-401d-4d9f-b16e-d9c4404dd5ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:50.655947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67b748e8-401d-4d9f-b16e-d9c4404dd5ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:50.710230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-67b748e8-401d-4d9f-b16e-d9c4404dd5ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:50.717750 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67b748e8-401d-4d9f-b16e-d9c4404dd5ad tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1257 microversion: 2.1 time: 0.066957 Oct 31 16:29:50.718329 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3717/7290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:50 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:51.741181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:51.741833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:51.748282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:51.748775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:51.749243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:51.749946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:51.750418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:51.750852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:51.810866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:51.818460 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-73770acf-61c6-42d8-a91d-4412e6c1b912 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1261 microversion: 2.1 time: 0.081295 Oct 31 16:29:51.819034 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3574/7291] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:51 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:52.843983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:52.844545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:52.856166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:52.861865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:52.862361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:52.862800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:52.863506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:52.864023 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:52.864373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:52.931662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:52.941173 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a12a5ffd-3767-4c9d-aea7-9fccd213277b tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1315 microversion: 2.1 time: 0.101722 Oct 31 16:29:52.941622 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3718/7292] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:52 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1315 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:53.976844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:53.977747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:53.986867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:53.987427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:53.987955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:53.988823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:53.989401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:53.989852 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:54.138720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:54.147161 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6782fb92-2ba1-43d6-9eac-3c9a03cd9e97 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.184392 Oct 31 16:29:54.155570 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3575/7293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:53 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:55.174152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:55.175429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:55.183003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:55.184073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:55.184840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:55.185588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:55.186045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:55.186473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:55.330956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:55.338898 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f36a7390-8ab7-4eaa-8a8c-3ae03f4ca8ce tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.171586 Oct 31 16:29:55.339853 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3719/7294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:55 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:56.363330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:56.364060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:56.366684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:56.373620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:56.374089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:56.374553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:56.375378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:56.375908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:56.376609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:56.524861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:56.537740 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0ee50ab2-ed37-4daa-a242-5adb58f85266 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.178204 Oct 31 16:29:56.538533 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3576/7295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:56 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:57.566569 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:57.568154 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:57.571408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:29:57.583676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:57.584185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:57.585703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:57.586551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:57.587188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:57.589034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:57.757557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:57.767449 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b857847-3d83-43ae-b1a0-e59973c1e8d4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.210496 Oct 31 16:29:57.768328 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3720/7296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:57 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:29:58.791987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:29:58.793605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:29:58.800736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:58.801268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:58.801719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:58.802435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:29:58.802902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:29:58.803341 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:29:58.972518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:29:58.984281 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2f08afff-6c90-4bd0-a52d-aea63991e714 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.195538 Oct 31 16:29:58.986230 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3577/7297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:29:58 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:00.008361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:00.009052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:00.017161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:00.017659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:00.018099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:00.018807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:00.019271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:00.019695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:00.158317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:00.166027 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e63d9d7-6190-43cc-9871-6e1bf97ab8ac tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.161589 Oct 31 16:30:00.166607 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3721/7298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:00 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:01.190449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:01.191101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:01.192948 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:01.199412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:01.199911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:01.200353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:01.201065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:01.201566 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:01.202002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:01.401467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:01.410175 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b60105c0-f5b4-4430-88a9-c351fc2060a6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.223602 Oct 31 16:30:01.410760 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3578/7299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:01 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:01.460176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=10 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:01.520712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-b66244d4-9dca-4570-951a-43d2f7ff611e req-927eb136-8c17-4143-b78b-fe9d226a6817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091ca938-59fd-46fe-9683-ea6b9ee799b4", "tag": "5efce3c8-2109-403c-9cfc-44613b72a55e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:30:01.530686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b66244d4-9dca-4570-951a-43d2f7ff611e req-927eb136-8c17-4143-b78b-fe9d226a6817 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:01.531215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b66244d4-9dca-4570-951a-43d2f7ff611e req-927eb136-8c17-4143-b78b-fe9d226a6817 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:01.531580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-b66244d4-9dca-4570-951a-43d2f7ff611e req-927eb136-8c17-4143-b78b-fe9d226a6817 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:01.544229 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-b66244d4-9dca-4570-951a-43d2f7ff611e req-927eb136-8c17-4143-b78b-fe9d226a6817 service nova] Creating event network-changed:5efce3c8-2109-403c-9cfc-44613b72a55e for instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 on n-h1-858384-17 Oct 31 16:30:01.549571 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-b66244d4-9dca-4570-951a-43d2f7ff611e req-927eb136-8c17-4143-b78b-fe9d226a6817 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094357 Oct 31 16:30:01.550188 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3722/7300] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:30:02.435649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:02.436310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:02.443256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:02.443758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:02.444211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:02.444915 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:02.445414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:02.445865 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:02.576257 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:02.584302 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3b35bf4f-88d7-4a30-800e-27934aeaeeb7 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.153165 Oct 31 16:30:02.584877 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3579/7301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:02 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:03.608227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:03.608931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:03.616115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:03.616603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:03.617045 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:03.617788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:03.618253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:03.618686 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:03.779508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:03.787705 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8770205e-ea9e-41e0-8d57-9606706f8661 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.184289 Oct 31 16:30:03.788305 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3723/7302] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:03 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:04.812190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:04.812736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:04.819748 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:04.820253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:04.820704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:04.821440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:04.821919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:04.822360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:04.954587 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:04.962264 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1420e898-641a-4a14-bf2f-45deb96e16df tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.155133 Oct 31 16:30:04.962842 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3580/7303] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:04 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:05.986353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:05.986883 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:05.993758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:05.994247 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:05.994716 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:05.995424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:05.995890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:05.996318 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:06.128377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:06.135981 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a518a283-345c-4648-bce8-c1dab3011d01 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.153643 Oct 31 16:30:06.136710 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3724/7304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:05 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:06.467656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-292ddd8e-8b85-4e27-965f-30cb5a217c43 req-4bafa0dc-6f0e-45c7-bb32-5d744a9b2a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091ca938-59fd-46fe-9683-ea6b9ee799b4", "name": "network-vif-plugged", "status": "completed", "tag": "5efce3c8-2109-403c-9cfc-44613b72a55e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:30:06.479423 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-292ddd8e-8b85-4e27-965f-30cb5a217c43 req-4bafa0dc-6f0e-45c7-bb32-5d744a9b2a83 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:06.479917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-292ddd8e-8b85-4e27-965f-30cb5a217c43 req-4bafa0dc-6f0e-45c7-bb32-5d744a9b2a83 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:06.480912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-292ddd8e-8b85-4e27-965f-30cb5a217c43 req-4bafa0dc-6f0e-45c7-bb32-5d744a9b2a83 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:06.492391 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-292ddd8e-8b85-4e27-965f-30cb5a217c43 req-4bafa0dc-6f0e-45c7-bb32-5d744a9b2a83 service nova] Creating event network-vif-plugged:5efce3c8-2109-403c-9cfc-44613b72a55e for instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 on n-h1-858384-17 Oct 31 16:30:06.497512 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-292ddd8e-8b85-4e27-965f-30cb5a217c43 req-4bafa0dc-6f0e-45c7-bb32-5d744a9b2a83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034394 Oct 31 16:30:06.498196 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3581/7305] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:30:07.159712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:07.160359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:07.167204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:07.168314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:07.168764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:07.169499 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:07.169963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:07.170394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:07.301159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:07.310195 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2623dd5-5c03-4a11-8ca5-b0b77739c27d tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1357 microversion: 2.1 time: 0.154680 Oct 31 16:30:07.310794 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3725/7306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:07 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:08.334668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:08.335425 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:08.343478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:08.343985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:08.344449 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:08.345222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:08.345702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:08.346150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:08.474956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:08.483631 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ccc9df80-0258-44c6-9e52-22f7ac652e5c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1545 microversion: 2.1 time: 0.153847 Oct 31 16:30:08.484227 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3582/7307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:08 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:08.507078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:08.507714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:08.514868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:08.515362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:08.515808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:08.516523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:08.516972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:08.517442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:08.649306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:08.657966 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25139f4a-8311-4572-86c5-00b498b548bc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1545 microversion: 2.1 time: 0.154746 Oct 31 16:30:08.658555 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3726/7308] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:08 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1545 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:08.680496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:08.685402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:08.686186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Searching by: {'deleted': False, 'project_id': 'ee01403283bd42c28d5da06a2e64f666'} {{(pid=120588) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 31 16:30:08.691415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:08.691907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:08.692378 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:08.693105 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:08.693594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:08.694028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:08.717860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.multi_cell_list [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120588) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 31 16:30:08.744338 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-55be00ea-a4ca-4bdb-88a3-f3d713cef755 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067687 Oct 31 16:30:08.744918 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3583/7309] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Oct 31 16:30:08 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:30:08.756742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:08.757431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:08.763400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:08.763885 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:08.764322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:08.765013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:08.765494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:08.765921 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:08.894695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:08.902503 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0a610c0-baa2-4569-a65b-1a922ae85eb4 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1545 microversion: 2.1 time: 0.149549 Oct 31 16:30:08.903090 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3727/7310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:08 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1545 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:10.426045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-073a046d-a30a-4464-b90c-7f8dae5d72c0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b552a7c-ebe5-4a6f-8a49-76100d015a80"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:30:10.428335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-073a046d-a30a-4464-b90c-7f8dae5d72c0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:10.435136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-073a046d-a30a-4464-b90c-7f8dae5d72c0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:10.435632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-073a046d-a30a-4464-b90c-7f8dae5d72c0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:10.436078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-073a046d-a30a-4464-b90c-7f8dae5d72c0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:10.436773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-073a046d-a30a-4464-b90c-7f8dae5d72c0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:10.437268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-073a046d-a30a-4464-b90c-7f8dae5d72c0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:10.437703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-073a046d-a30a-4464-b90c-7f8dae5d72c0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:10.683961 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-073a046d-a30a-4464-b90c-7f8dae5d72c0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261067 Oct 31 16:30:10.684662 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3584/7311] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Oct 31 16:30:10 2022] POST /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:30:21.465685 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:21.466300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:21.469071 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:30:21.469885 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:30:21.470467 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=19 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:21.471123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=58 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:21.477020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:21.477544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:21.477981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:21.478676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:21.479170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:21.479601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:21.611907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:21.620261 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d0423909-58e6-4c40-80e2-da14d126242c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1591 microversion: 2.1 time: 0.159047 Oct 31 16:30:21.621244 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3728/7312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:21 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1591 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:23.217154 n-d-858384-17 devstack@n-api.service[120588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9df96b43-1b68-4fd4-bacb-dc8215b59e09] AMQP server on 10.222.0.20:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Oct 31 16:30:23.218032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:23.218888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=17 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:23.219803 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:23.225340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e703c059-7fff-4eb1-9ce7-c6eda11de174 req-8fea7da0-ce81-4b6a-95ae-f5dec207f941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091ca938-59fd-46fe-9683-ea6b9ee799b4", "tag": "5efce3c8-2109-403c-9cfc-44613b72a55e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:30:23.239854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e703c059-7fff-4eb1-9ce7-c6eda11de174 req-8fea7da0-ce81-4b6a-95ae-f5dec207f941 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:23.240550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e703c059-7fff-4eb1-9ce7-c6eda11de174 req-8fea7da0-ce81-4b6a-95ae-f5dec207f941 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:23.241193 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e703c059-7fff-4eb1-9ce7-c6eda11de174 req-8fea7da0-ce81-4b6a-95ae-f5dec207f941 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:23.253378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e703c059-7fff-4eb1-9ce7-c6eda11de174 req-8fea7da0-ce81-4b6a-95ae-f5dec207f941 service nova] Creating event network-changed:5efce3c8-2109-403c-9cfc-44613b72a55e for instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 on n-h1-858384-17 Oct 31 16:30:23.260037 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e703c059-7fff-4eb1-9ce7-c6eda11de174 req-8fea7da0-ce81-4b6a-95ae-f5dec207f941 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045376 Oct 31 16:30:23.261037 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3585/7313] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:30:24.327694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1753123066"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:30:24.328345 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:24.336359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:24.336859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:24.337331 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:24.338047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:24.338507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:24.338933 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:24.356889 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54560. Oct 31 16:30:24.361904 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54558. Oct 31 16:30:24.473586 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.network.security_group_api [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Adding security group ed160d85-182d-4345-b767-89e510605bbe to port 5efce3c8-2109-403c-9cfc-44613b72a55e Oct 31 16:30:24.788657 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0204c6c2-5127-4409-8ca6-2291e2e8e625 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/action" status: 202 len: 0 microversion: 2.1 time: 0.465039 Oct 31 16:30:24.789494 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3729/7314] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:30:24 2022] POST /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:30:24.800076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:24.800789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:24.809889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:24.810401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:24.810846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:24.811556 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:24.812020 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:24.812453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:24.816247 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] [9df96b43-1b68-4fd4-bacb-dc8215b59e09] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 54564. Oct 31 16:30:24.965411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:24.975056 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fc9068e6-c432-4b25-a285-08b4d9bdd710 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1757 microversion: 2.1 time: 0.180485 Oct 31 16:30:24.975582 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3586/7315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:24 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:25.276704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ceacb87d-9022-48ba-9332-24309adf73e4 req-8c91dda2-b1e6-4565-a322-b1ffde76cee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091ca938-59fd-46fe-9683-ea6b9ee799b4", "tag": "5efce3c8-2109-403c-9cfc-44613b72a55e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:30:25.286482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ceacb87d-9022-48ba-9332-24309adf73e4 req-8c91dda2-b1e6-4565-a322-b1ffde76cee6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:25.286967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ceacb87d-9022-48ba-9332-24309adf73e4 req-8c91dda2-b1e6-4565-a322-b1ffde76cee6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:25.287433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ceacb87d-9022-48ba-9332-24309adf73e4 req-8c91dda2-b1e6-4565-a322-b1ffde76cee6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:25.298705 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ceacb87d-9022-48ba-9332-24309adf73e4 req-8c91dda2-b1e6-4565-a322-b1ffde76cee6 service nova] Creating event network-changed:5efce3c8-2109-403c-9cfc-44613b72a55e for instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 on n-h1-858384-17 Oct 31 16:30:25.303807 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ceacb87d-9022-48ba-9332-24309adf73e4 req-8c91dda2-b1e6-4565-a322-b1ffde76cee6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030819 Oct 31 16:30:25.304423 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3730/7316] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:30:39.988614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:39.989313 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=8 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:40.036372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e6b96096-d6e3-4e65-a6dc-5318d2ec9060 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:30:40.038794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e6b96096-d6e3-4e65-a6dc-5318d2ec9060 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:40.044728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6b96096-d6e3-4e65-a6dc-5318d2ec9060 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:40.045266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6b96096-d6e3-4e65-a6dc-5318d2ec9060 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:40.045725 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6b96096-d6e3-4e65-a6dc-5318d2ec9060 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:40.046434 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6b96096-d6e3-4e65-a6dc-5318d2ec9060 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:40.046910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6b96096-d6e3-4e65-a6dc-5318d2ec9060 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:40.047355 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e6b96096-d6e3-4e65-a6dc-5318d2ec9060 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:40.120342 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e6b96096-d6e3-4e65-a6dc-5318d2ec9060 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/action" status: 202 len: 0 microversion: 2.1 time: 0.137132 Oct 31 16:30:40.120965 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3587/7317] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:30:39 2022] POST /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:30:40.128092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:40.128824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:30:40.133032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:40.133775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:40.142183 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:40.142667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:40.143098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:40.143803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:40.144265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:40.144684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:40.295055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:40.303642 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3bfadfac-7a84-4eab-94dd-58edd62921ff tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1749 microversion: 2.1 time: 0.177480 Oct 31 16:30:40.304240 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3731/7318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:40 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1749 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:30:41.329150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:41.329806 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:41.336028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:41.336531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:41.336990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:41.337724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:41.338199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:41.338641 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:41.482554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:41.491670 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89a5ea85-8a8b-4704-994e-6594b3ecd7f8 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1754 microversion: 2.1 time: 0.168386 Oct 31 16:30:41.492258 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3588/7319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:41 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:30:42.516016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:42.516641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:42.524644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:42.525160 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:42.525606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:42.526319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:42.526783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:42.527219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:42.674998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:42.683195 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ce684ae0-fc6d-451b-a300-ff5b9352cb89 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1754 microversion: 2.1 time: 0.171756 Oct 31 16:30:42.683769 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3732/7320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:42 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:43.707829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:43.708456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:43.715385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:43.715877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:43.716325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:43.717025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:43.717521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:43.718614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:43.864664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:43.872836 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e231399b-57ce-4dd4-8ab4-7ecb7ac70e6c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1754 microversion: 2.1 time: 0.168962 Oct 31 16:30:43.873669 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3589/7321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:43 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:44.896143 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:44.896687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:44.903944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:44.904450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:44.904894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:44.906172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:44.906677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:44.907109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:45.058653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:45.067038 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ea05339a-fb43-4e77-b719-758c95deb189 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1754 microversion: 2.1 time: 0.174902 Oct 31 16:30:45.067622 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3733/7322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:44 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:46.091735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:46.092358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:46.100106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:46.100600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:46.101047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:46.101779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:46.102244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:46.102681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:46.250305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:46.258813 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd4b0576-b3a6-4c4c-89d5-d176353a5822 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1754 microversion: 2.1 time: 0.171213 Oct 31 16:30:46.259674 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3590/7323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:46 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:47.282897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:47.283505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:47.290383 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:47.290863 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:47.291295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:47.291986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:47.292437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:47.292856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:47.434327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:47.443675 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7605ca4d-fe75-4a01-a0f6-cc93d3f0c9c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1754 microversion: 2.1 time: 0.164819 Oct 31 16:30:47.444267 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3734/7324] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:47 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:48.467495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:48.468135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:48.475192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:48.475688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:48.476135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:48.476831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:48.477328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:48.477767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:48.621481 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:48.630416 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-23826626-3b96-4cb6-b55d-9094b3bb24dc tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1754 microversion: 2.1 time: 0.166947 Oct 31 16:30:48.630991 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3591/7325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:48 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:49.654737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:49.655353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:49.662952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:49.663442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:49.663877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:49.664570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:49.665055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:49.665506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:49.807546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:49.816286 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-24379ebf-68d3-47c3-9791-4bbe1ca5c0c2 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1754 microversion: 2.1 time: 0.165501 Oct 31 16:30:49.816867 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3735/7326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:49 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:50.840788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:50.841352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:50.848733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:50.849267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:50.849712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:50.850412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:50.850878 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:50.851314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:50.996772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:51.005999 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1fe6ba75-5f34-4b3c-9279-4d1bafd40a0a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1754 microversion: 2.1 time: 0.169335 Oct 31 16:30:51.006592 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3592/7327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:50 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:30:52.031377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:30:52.032797 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:30:52.039753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:52.040240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:52.040695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:52.041492 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:30:52.042021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:30:52.042466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:30:52.189300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:30:52.197574 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b2c97ec-3397-4e8b-a74a-7457eaaa9f00 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1757 microversion: 2.1 time: 0.170170 Oct 31 16:30:52.198157 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3736/7328] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:30:52 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:31:24.369191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1753123066"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:31:24.369833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:24.371930 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=12 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:24.372613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:24.378474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:24.379134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:24.379591 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:24.380305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:24.380781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:24.381263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:24.509039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.network.security_group_api [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Removing security group ed160d85-182d-4345-b767-89e510605bbe from port 5efce3c8-2109-403c-9cfc-44613b72a55e Oct 31 16:31:24.812861 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d4e95a61-a265-450f-876b-043a29dc6b7a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "POST /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/action" status: 202 len: 0 microversion: 2.1 time: 0.447606 Oct 31 16:31:24.816755 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3593/7329] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:31:24 2022] POST /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/action => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:31:24.823245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-22dabf08-d4c8-448c-9c92-884572c38578 req-6545c508-fbb8-4430-86ed-e85a7cb8e4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091ca938-59fd-46fe-9683-ea6b9ee799b4", "tag": "5efce3c8-2109-403c-9cfc-44613b72a55e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:31:24.835513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:24.836217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=36 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:24.853618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22dabf08-d4c8-448c-9c92-884572c38578 req-6545c508-fbb8-4430-86ed-e85a7cb8e4e2 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:24.854103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22dabf08-d4c8-448c-9c92-884572c38578 req-6545c508-fbb8-4430-86ed-e85a7cb8e4e2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:24.854534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-22dabf08-d4c8-448c-9c92-884572c38578 req-6545c508-fbb8-4430-86ed-e85a7cb8e4e2 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:24.866476 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-22dabf08-d4c8-448c-9c92-884572c38578 req-6545c508-fbb8-4430-86ed-e85a7cb8e4e2 service nova] Creating event network-changed:5efce3c8-2109-403c-9cfc-44613b72a55e for instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 on n-h1-858384-17 Oct 31 16:31:24.872372 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-22dabf08-d4c8-448c-9c92-884572c38578 req-6545c508-fbb8-4430-86ed-e85a7cb8e4e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053111 Oct 31 16:31:24.873398 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3737/7330] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:26.300262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:26.300783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:26.309919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:26.310309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:26.310764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:26.311485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:26.311960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:26.312395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:26.358026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-661516b4-f98d-47db-b15a-6a8eb207d17c req-536e23f5-ee15-44f6-bde9-6d5b721d9403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091ca938-59fd-46fe-9683-ea6b9ee799b4", "tag": "5efce3c8-2109-403c-9cfc-44613b72a55e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:31:26.369165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-661516b4-f98d-47db-b15a-6a8eb207d17c req-536e23f5-ee15-44f6-bde9-6d5b721d9403 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:26.369648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-661516b4-f98d-47db-b15a-6a8eb207d17c req-536e23f5-ee15-44f6-bde9-6d5b721d9403 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:26.370073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-661516b4-f98d-47db-b15a-6a8eb207d17c req-536e23f5-ee15-44f6-bde9-6d5b721d9403 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:26.381679 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-661516b4-f98d-47db-b15a-6a8eb207d17c req-536e23f5-ee15-44f6-bde9-6d5b721d9403 service nova] Creating event network-changed:5efce3c8-2109-403c-9cfc-44613b72a55e for instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 on n-h1-858384-17 Oct 31 16:31:26.386861 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-661516b4-f98d-47db-b15a-6a8eb207d17c req-536e23f5-ee15-44f6-bde9-6d5b721d9403 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084308 Oct 31 16:31:26.387833 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3738/7331] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:26.408750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lazy-loading 'services' on Instance uuid 091ca938-59fd-46fe-9683-ea6b9ee799b4 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:31:26.484967 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cf384771-fbd6-4e16-8753-2a3cafdd9e66 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "DELETE /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments/1b552a7c-ebe5-4a6f-8a49-76100d015a80" status: 202 len: 0 microversion: 2.1 time: 0.189904 Oct 31 16:31:26.485619 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3594/7332] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:31:26 2022] DELETE /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments/1b552a7c-ebe5-4a6f-8a49-76100d015a80 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:31:26.501448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-dd8836ef-966d-46ee-8fb8-7f0685324da0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:26.506483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-dd8836ef-966d-46ee-8fb8-7f0685324da0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:26.522394 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd8836ef-966d-46ee-8fb8-7f0685324da0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:26.523238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd8836ef-966d-46ee-8fb8-7f0685324da0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:26.524159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd8836ef-966d-46ee-8fb8-7f0685324da0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:26.525142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd8836ef-966d-46ee-8fb8-7f0685324da0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:26.525691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd8836ef-966d-46ee-8fb8-7f0685324da0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:26.526194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-dd8836ef-966d-46ee-8fb8-7f0685324da0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:26.573906 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-dd8836ef-966d-46ee-8fb8-7f0685324da0 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083597 Oct 31 16:31:26.574516 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3739/7333] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:31:26 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:27.589316 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-acd46bc9-948f-4a95-b3a8-f215c7ee416a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:27.591838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-acd46bc9-948f-4a95-b3a8-f215c7ee416a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:27.599387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd46bc9-948f-4a95-b3a8-f215c7ee416a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:27.599882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd46bc9-948f-4a95-b3a8-f215c7ee416a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:27.600332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd46bc9-948f-4a95-b3a8-f215c7ee416a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:27.601046 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd46bc9-948f-4a95-b3a8-f215c7ee416a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:27.601542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd46bc9-948f-4a95-b3a8-f215c7ee416a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:27.601981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-acd46bc9-948f-4a95-b3a8-f215c7ee416a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:27.631896 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-acd46bc9-948f-4a95-b3a8-f215c7ee416a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048404 Oct 31 16:31:27.632473 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3595/7334] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:31:27 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:28.644123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6652a566-a7b9-441a-98a6-1d1c150583db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:28.646322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6652a566-a7b9-441a-98a6-1d1c150583db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:28.657396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6652a566-a7b9-441a-98a6-1d1c150583db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:28.657884 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6652a566-a7b9-441a-98a6-1d1c150583db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:28.658320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6652a566-a7b9-441a-98a6-1d1c150583db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:28.659017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6652a566-a7b9-441a-98a6-1d1c150583db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:28.659778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6652a566-a7b9-441a-98a6-1d1c150583db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:28.660206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6652a566-a7b9-441a-98a6-1d1c150583db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:28.689520 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6652a566-a7b9-441a-98a6-1d1c150583db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049375 Oct 31 16:31:28.690111 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3740/7335] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:31:28 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:29.703034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd8589b2-a060-4f9e-aeb4-53108dd37fc6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:29.705318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd8589b2-a060-4f9e-aeb4-53108dd37fc6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:29.712247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8589b2-a060-4f9e-aeb4-53108dd37fc6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:29.712750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8589b2-a060-4f9e-aeb4-53108dd37fc6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:29.713230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8589b2-a060-4f9e-aeb4-53108dd37fc6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:29.713949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8589b2-a060-4f9e-aeb4-53108dd37fc6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:29.714430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8589b2-a060-4f9e-aeb4-53108dd37fc6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:29.714874 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd8589b2-a060-4f9e-aeb4-53108dd37fc6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:29.750029 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd8589b2-a060-4f9e-aeb4-53108dd37fc6 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051104 Oct 31 16:31:29.750618 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3596/7336] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:31:29 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:30.762738 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9b526825-f53b-41af-ab4a-3465410ad114 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:30.764914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9b526825-f53b-41af-ab4a-3465410ad114 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:30.772457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b526825-f53b-41af-ab4a-3465410ad114 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:30.772934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b526825-f53b-41af-ab4a-3465410ad114 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:30.773390 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b526825-f53b-41af-ab4a-3465410ad114 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:30.774075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b526825-f53b-41af-ab4a-3465410ad114 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:30.774529 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b526825-f53b-41af-ab4a-3465410ad114 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:30.774952 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9b526825-f53b-41af-ab4a-3465410ad114 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:30.804954 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9b526825-f53b-41af-ab4a-3465410ad114 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046189 Oct 31 16:31:30.805566 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3741/7337] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:31:30 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:31.817703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-507fc90f-7449-4603-8f9e-208592321e9a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:31.819924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-507fc90f-7449-4603-8f9e-208592321e9a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:31.826700 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-507fc90f-7449-4603-8f9e-208592321e9a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:31.827237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-507fc90f-7449-4603-8f9e-208592321e9a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:31.827633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-507fc90f-7449-4603-8f9e-208592321e9a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:31.828326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-507fc90f-7449-4603-8f9e-208592321e9a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:31.828789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-507fc90f-7449-4603-8f9e-208592321e9a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:31.829247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-507fc90f-7449-4603-8f9e-208592321e9a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:31.858345 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-507fc90f-7449-4603-8f9e-208592321e9a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044793 Oct 31 16:31:31.858914 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3597/7338] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Oct 31 16:31:31 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 31 16:31:31.870262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:31.870783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:31.877523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:31.877998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:31.878552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:31.879242 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:31.879689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:31.880118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:31.953652 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] HTTP exception thrown: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 is not attached to volume 1b552a7c-ebe5-4a6f-8a49-76100d015a80 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Request method failure captured: Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: request: DELETE /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments/1b552a7c-ebe5-4a6f-8a49-76100d015a80 HTTP/1.1 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_b-teYLLNV32XSq2Ky3XtfDCwMpxJ9pMIsudBOzv4w9Q7JoWO5oxmEXZOhHiQFCEjI-Q8B0Ei2r1AF7BCPwQ4kfPQu1bwWTU8UqNIRygBwScOkhDFjA6o3xuFYkVxpNBYywS3UlNW1lUvf-QPSKE_Rkao7RebnlcFbwfuSUj68xtWw Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: ee01403283bd42c28d5da06a2e64f666 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee01403283bd42c28d5da06a2e64f666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee01403283bd42c28d5da06a2e64f666", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee01403283bd42c28d5da06a2e64f666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee01403283bd42c28d5da06a2e64f666"}]}] Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: ee01403283bd42c28d5da06a2e64f666 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestMinimumBasicScenario-36136235-project Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 845d302e6ad74867a57206becd7117ba Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestMinimumBasicScenario-36136235-project Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 is not attached to volume 1b552a7c-ebe5-4a6f-8a49-76100d015a80 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'server_id': '091ca938-59fd-46fe-9683-ea6b9ee799b4', 'id': '1b552a7c-ebe5-4a6f-8a49-76100d015a80'} Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1b552a7c-ebe5-4a6f-8a49-76100d015a80. Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 is not attached to volume 1b552a7c-ebe5-4a6f-8a49-76100d015a80 Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:31:31.955296 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:31:31.960535 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:31:31.960535 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:31:31.960535 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 is not attached to volume 1b552a7c-ebe5-4a6f-8a49-76100d015a80 Oct 31 16:31:31.960535 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:31.960535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Returning 404 to user: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 is not attached to volume 1b552a7c-ebe5-4a6f-8a49-76100d015a80 {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:31:31.960535 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed0d0bed-fa49-4c78-9818-814847f92c4a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "DELETE /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments/1b552a7c-ebe5-4a6f-8a49-76100d015a80" status: 404 len: 154 microversion: 2.1 time: 0.090530 Oct 31 16:31:31.960535 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3742/7339] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Oct 31 16:31:31 2022] DELETE /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4/os-volume_attachments/1b552a7c-ebe5-4a6f-8a49-76100d015a80 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:31:35.212238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:35.212753 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:35.219855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:35.220346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:35.220821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:35.221542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:35.222009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:35.223124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:35.253603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:31:35.335899 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ce3128a2-1932-4205-80a5-56e11c709b3c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "DELETE /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 204 len: 0 microversion: 2.1 time: 0.127022 Oct 31 16:31:35.336652 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3598/7340] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:31:35 2022] DELETE /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:31:35.345879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:35.346494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:35.355260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:35.355753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:35.356186 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:35.356909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:35.357389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:35.357819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:35.492737 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:35.500691 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a2633fd8-3857-4e45-ac6f-ee401449ab3a tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1551 microversion: 2.1 time: 0.159187 Oct 31 16:31:35.501293 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3743/7341] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:35 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:31:36.526078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:36.526860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:36.533759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:36.534258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:36.534851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:36.535560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:36.536030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:36.536468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:36.667652 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:36.675982 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-411ad09b-1569-4f19-8e5c-d844c01a77c1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1551 microversion: 2.1 time: 0.153618 Oct 31 16:31:36.676568 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3599/7342] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:36 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:37.385365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-d93a3d98-d986-45aa-a72e-dbde8c00ee56 req-da62358c-6760-49d9-95e4-ce62c00b22aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091ca938-59fd-46fe-9683-ea6b9ee799b4", "name": "network-vif-deleted", "tag": "5efce3c8-2109-403c-9cfc-44613b72a55e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:31:37.398518 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d93a3d98-d986-45aa-a72e-dbde8c00ee56 req-da62358c-6760-49d9-95e4-ce62c00b22aa service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:37.398996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d93a3d98-d986-45aa-a72e-dbde8c00ee56 req-da62358c-6760-49d9-95e4-ce62c00b22aa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:37.399432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-d93a3d98-d986-45aa-a72e-dbde8c00ee56 req-da62358c-6760-49d9-95e4-ce62c00b22aa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:37.413655 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-d93a3d98-d986-45aa-a72e-dbde8c00ee56 req-da62358c-6760-49d9-95e4-ce62c00b22aa service nova] Creating event network-vif-deleted:5efce3c8-2109-403c-9cfc-44613b72a55e for instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 on n-h1-858384-17 Oct 31 16:31:37.419048 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-d93a3d98-d986-45aa-a72e-dbde8c00ee56 req-da62358c-6760-49d9-95e4-ce62c00b22aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037735 Oct 31 16:31:37.419662 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3744/7343] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:37.699980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:37.700609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:37.708062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:37.708256 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:37.708795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:37.709447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:37.709924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:37.710366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:37.744367 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:37.745094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:37.745740 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:37.746211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lazy-loading 'fault' on Instance uuid 091ca938-59fd-46fe-9683-ea6b9ee799b4 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:31:37.794923 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845d302e6ad74867a57206becd7117ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee01403283bd42c28d5da06a2e64f666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:37.804889 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2fcd9a05-ed24-481d-94fa-82cf652ef9f1 tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 200 len: 1347 microversion: 2.1 time: 0.108677 Oct 31 16:31:37.805708 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3600/7344] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:37 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 1347 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:38.829089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:38.829775 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] [instance: 091ca938-59fd-46fe-9683-ea6b9ee799b4] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:38.837541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:38.838032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:38.838509 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:38.839206 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:38.839666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:38.840094 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:38.854466 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] HTTP exception thrown: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 could not be found. Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Request method failure captured: Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 HTTP/1.1 Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_b-teYLLNV32XSq2Ky3XtfDCwMpxJ9pMIsudBOzv4w9Q7JoWO5oxmEXZOhHiQFCEjI-Q8B0Ei2r1AF7BCPwQ4kfPQu1bwWTU8UqNIRygBwScOkhDFjA6o3xuFYkVxpNBYywS3UlNW1lUvf-QPSKE_Rkao7RebnlcFbwfuSUj68xtWw Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: ee01403283bd42c28d5da06a2e64f666 Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee01403283bd42c28d5da06a2e64f666"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ee01403283bd42c28d5da06a2e64f666", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ee01403283bd42c28d5da06a2e64f666"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ee01403283bd42c28d5da06a2e64f666"}]}] Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: ee01403283bd42c28d5da06a2e64f666 Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestMinimumBasicScenario-36136235 Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestMinimumBasicScenario-36136235-project Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 845d302e6ad74867a57206becd7117ba Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestMinimumBasicScenario-36136235-project Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 could not be found. Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '091ca938-59fd-46fe-9683-ea6b9ee799b4'} Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 could not be found. Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 could not be found. Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:31:38.856084 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 could not be found. Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Returning 404 to user: Instance 091ca938-59fd-46fe-9683-ea6b9ee799b4 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4227bcea-c82c-48ae-99e7-3bbc3d0846db tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4" status: 404 len: 111 microversion: 2.1 time: 0.032732 Oct 31 16:31:38.861054 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3745/7345] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:38 2022] GET /compute/v2.1/servers/091ca938-59fd-46fe-9683-ea6b9ee799b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:31:38.866464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9ef73ae0-ac86-47f3-941e-fa9f4fe7563c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] Calling method '.version_select at 0x7f16e1462d30>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:38.885324 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9ef73ae0-ac86-47f3-941e-fa9f4fe7563c tempest-TestMinimumBasicScenario-36136235 tempest-TestMinimumBasicScenario-36136235-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-584383764" status: 202 len: 0 microversion: 2.1 time: 0.022887 Oct 31 16:31:38.885904 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3601/7346] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Oct 31 16:31:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-584383764 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:31:48.057340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f5a0ada-5c68-4cad-bde4-13644381f5a8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: .version_select at 0x7f16e0e5a8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-676379720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHow6B8rI+5jhU3apJxO138bOLMST4zZa5bSATDNkYzD63qDpd9V0dHia90PnSG8YAqZ9MxPugQ2i6stCjID2fOcaLDVlfQu2hNdnC5OQC/LfCwNvNn4WHixTzVJsggIuQ=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:31:48.073430 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-7f5a0ada-5c68-4cad-bde4-13644381f5a8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:31:48.078520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-7f5a0ada-5c68-4cad-bde4-13644381f5a8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:31:48.104674 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f5a0ada-5c68-4cad-bde4-13644381f5a8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.213999 Oct 31 16:31:48.105317 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3746/7347] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:31:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:53.937358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-367529504", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "66a4da3d-f5bd-4fb4-9610-b36da074fadd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-676379720", "security_groups": [{"name": "tempest-secgroup-smoke-1246599219"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:31:53.965026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:53.965988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:54.084975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] validate_networks() for [('66a4da3d-f5bd-4fb4-9610-b36da074fadd', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:31:54.559536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:31:54.560186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:31:54.560683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:31:54.561113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:31:54.561629 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:31:54.572194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:54.572706 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:54.573240 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:54.573949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:54.574430 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:54.574876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:54.593320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:31:54.599491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:31:54.613516 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:31:54.616420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:31:54.666463 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c5e1dbc2-db59-45d2-a73a-814cebb38759 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.733146 Oct 31 16:31:54.668292 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3602/7348] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:31:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:31:54.676217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=38 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:54.683271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f335bd71-9b1f-4406-a8cb-bbf329b3f211 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:54.684138 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f335bd71-9b1f-4406-a8cb-bbf329b3f211 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:54.742781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f335bd71-9b1f-4406-a8cb-bbf329b3f211 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:54.751505 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f335bd71-9b1f-4406-a8cb-bbf329b3f211 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1265 microversion: 2.1 time: 0.076058 Oct 31 16:31:54.752696 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3747/7349] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:54 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:55.778305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:55.779091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:55.785819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:55.786974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:55.787509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:55.788238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:55.788714 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:55.789376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:55.858546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:55.867317 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-07e93950-7673-41fe-a314-b14231d26798 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1317 microversion: 2.1 time: 0.093862 Oct 31 16:31:55.867937 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3603/7350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:55 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1317 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:56.891283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:56.891886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:56.895677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:31:56.900924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:56.901454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:56.901889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:56.902596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:56.903051 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:56.903480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:57.145616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:57.155072 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-09740045-b76a-466b-9b95-bca192924763 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1391 microversion: 2.1 time: 0.267903 Oct 31 16:31:57.155757 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3748/7351] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:56 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1391 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:57.878496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-63f1ddfc-3e35-4cd8-80b2-095e98b9d0e7 req-beb29a4f-6982-4b41-abac-ea15f36513f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7", "tag": "245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:31:57.889791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-63f1ddfc-3e35-4cd8-80b2-095e98b9d0e7 req-beb29a4f-6982-4b41-abac-ea15f36513f5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:57.890552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-63f1ddfc-3e35-4cd8-80b2-095e98b9d0e7 req-beb29a4f-6982-4b41-abac-ea15f36513f5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:57.892013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-63f1ddfc-3e35-4cd8-80b2-095e98b9d0e7 req-beb29a4f-6982-4b41-abac-ea15f36513f5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:57.904299 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-63f1ddfc-3e35-4cd8-80b2-095e98b9d0e7 req-beb29a4f-6982-4b41-abac-ea15f36513f5 service nova] Creating event network-changed:245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd for instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 on n-h2-858384-17 Oct 31 16:31:57.909744 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-63f1ddfc-3e35-4cd8-80b2-095e98b9d0e7 req-beb29a4f-6982-4b41-abac-ea15f36513f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035112 Oct 31 16:31:57.910371 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3604/7352] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:31:58.179842 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:58.180577 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:58.187792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:58.188284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:58.188726 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:58.189578 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:58.190040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:58.190465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:58.397382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:58.407142 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26273398-e4aa-4e6c-875f-1c79109e6e60 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1391 microversion: 2.1 time: 0.231325 Oct 31 16:31:58.407742 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3749/7353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:58 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:31:59.432119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:31:59.432994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:31:59.439726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:59.440241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:59.440692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:59.441456 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:31:59.441928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:31:59.442371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:31:59.584034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:31:59.592533 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-20a8128e-3c07-4c5c-a4b9-a40d9086548c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1391 microversion: 2.1 time: 0.165692 Oct 31 16:31:59.593146 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3605/7354] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:31:59 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:00.615892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:00.616524 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:00.623329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:00.623812 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:00.624246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:00.624931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:00.625409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:00.625836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:00.754593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:00.762343 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9e950e03-b8a3-4766-8e1f-849c7ad30b26 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1391 microversion: 2.1 time: 0.150398 Oct 31 16:32:00.762920 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3750/7355] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:00 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:01.785292 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:01.785946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:01.793519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:01.794014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:01.794461 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:01.795160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:01.795637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:01.796070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:01.928633 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:01.936519 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06bec14e-71a0-4850-bedd-6d3b90c79202 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1391 microversion: 2.1 time: 0.155216 Oct 31 16:32:01.937109 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3606/7356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:01 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:02.959375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:02.960366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:02.967059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:02.967521 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:02.967956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:02.968644 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:02.969096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:02.969546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:03.088636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3792b4a1-df97-4606-b135-8ce90d57a65b req-b3be3bbc-fa17-4cb3-b360-c809988fb4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7", "name": "network-vif-plugged", "status": "completed", "tag": "245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:03.099458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3792b4a1-df97-4606-b135-8ce90d57a65b req-b3be3bbc-fa17-4cb3-b360-c809988fb4f4 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:03.100037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3792b4a1-df97-4606-b135-8ce90d57a65b req-b3be3bbc-fa17-4cb3-b360-c809988fb4f4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:03.101212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3792b4a1-df97-4606-b135-8ce90d57a65b req-b3be3bbc-fa17-4cb3-b360-c809988fb4f4 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:03.112564 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3792b4a1-df97-4606-b135-8ce90d57a65b req-b3be3bbc-fa17-4cb3-b360-c809988fb4f4 service nova] Creating event network-vif-plugged:245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd for instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 on n-h2-858384-17 Oct 31 16:32:03.113664 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:03.118645 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3792b4a1-df97-4606-b135-8ce90d57a65b req-b3be3bbc-fa17-4cb3-b360-c809988fb4f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101374 Oct 31 16:32:03.119268 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3607/7357] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:32:03.122463 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b21d8332-556d-489e-8c53-b948c217ec97 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1391 microversion: 2.1 time: 0.167017 Oct 31 16:32:03.123042 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3751/7358] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:02 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:04.147244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:04.148190 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:04.154810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:04.155321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:04.155807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:04.156527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:04.157006 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:04.157484 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:04.291084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:04.298798 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e8fc36e0-4402-4d55-851e-4df600647073 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1391 microversion: 2.1 time: 0.156868 Oct 31 16:32:04.299375 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3608/7359] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:04 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:05.322866 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:05.323511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:05.326857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:32:05.332165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:05.332653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:05.333091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:05.333818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:05.334285 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:05.334847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:05.555225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:05.564547 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-88fea78c-3715-4e49-aaa7-05c1c064748c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1563 microversion: 2.1 time: 0.245594 Oct 31 16:32:05.577161 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3752/7360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:05 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:05.588285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:05.588924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:05.591005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:32:05.591707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:32:05.599502 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:05.600014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:05.601106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:05.601900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:05.602390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:05.602838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:05.771140 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:05.782357 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-27f4ea4d-4411-44bc-a5a4-b3d715c1a18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1563 microversion: 2.1 time: 0.198039 Oct 31 16:32:05.793919 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3609/7361] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:05 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1563 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:07.797816 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-fab7b618-66e6-4585-be88-bab521229487 req-5bd75a96-f51d-479b-87b7-6f4b8037eaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7", "tag": "245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:07.805625 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:07.806234 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:07.808669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fab7b618-66e6-4585-be88-bab521229487 req-5bd75a96-f51d-479b-87b7-6f4b8037eaa5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:07.809352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fab7b618-66e6-4585-be88-bab521229487 req-5bd75a96-f51d-479b-87b7-6f4b8037eaa5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:07.809983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-fab7b618-66e6-4585-be88-bab521229487 req-5bd75a96-f51d-479b-87b7-6f4b8037eaa5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:07.813376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:07.813861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:07.814498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:07.815194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:07.815650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:07.816072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:07.822206 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-fab7b618-66e6-4585-be88-bab521229487 req-5bd75a96-f51d-479b-87b7-6f4b8037eaa5 service nova] Creating event network-changed:245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd for instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 on n-h2-858384-17 Oct 31 16:32:07.827389 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-fab7b618-66e6-4585-be88-bab521229487 req-5bd75a96-f51d-479b-87b7-6f4b8037eaa5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033174 Oct 31 16:32:07.828512 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3610/7362] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:32:08.047556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:08.058713 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-af0c49ae-31ac-4de8-ba33-7468686a8bdf tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1563 microversion: 2.1 time: 0.268712 Oct 31 16:32:08.059600 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3753/7363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:07 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1563 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:32:31.322640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:32:31.323395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=38 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:32:31.327770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c240c549-5333-4d28-8db9-0724420f301a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:31.330057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c240c549-5333-4d28-8db9-0724420f301a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:31.337702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c240c549-5333-4d28-8db9-0724420f301a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:31.338199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c240c549-5333-4d28-8db9-0724420f301a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:31.338646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c240c549-5333-4d28-8db9-0724420f301a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:31.339343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c240c549-5333-4d28-8db9-0724420f301a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:31.339808 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c240c549-5333-4d28-8db9-0724420f301a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:31.340250 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c240c549-5333-4d28-8db9-0724420f301a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:31.395987 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c240c549-5333-4d28-8db9-0724420f301a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action" status: 200 len: 24564 microversion: 2.1 time: 0.075262 Oct 31 16:32:31.396595 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3611/7364] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:32:31 2022] POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action => generated 24564 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:32:42.394770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-957d7620-1014-4f75-bec7-e2574fdc103f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:42.395328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-957d7620-1014-4f75-bec7-e2574fdc103f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:42.397349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=11 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:32:42.398111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=36 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:32:42.404506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-957d7620-1014-4f75-bec7-e2574fdc103f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:42.404995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-957d7620-1014-4f75-bec7-e2574fdc103f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:42.405457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-957d7620-1014-4f75-bec7-e2574fdc103f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:42.406152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-957d7620-1014-4f75-bec7-e2574fdc103f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:42.406611 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-957d7620-1014-4f75-bec7-e2574fdc103f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:42.407040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-957d7620-1014-4f75-bec7-e2574fdc103f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:42.473230 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-957d7620-1014-4f75-bec7-e2574fdc103f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action" status: 202 len: 0 microversion: 2.1 time: 0.082531 Oct 31 16:32:42.473867 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3754/7365] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:32:42 2022] POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:32:42.484154 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:42.484926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:42.488101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:32:42.488796 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:32:42.497349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:42.497859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:42.498314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:42.499030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:42.499504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:42.499945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:42.637577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:42.645619 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16ad98a7-0e18-4a0e-98af-5017944b7451 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1687 microversion: 2.1 time: 0.165755 Oct 31 16:32:42.646429 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3612/7366] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:42 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:43.669871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:43.670571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:43.677773 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:43.678261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:43.678692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:43.679934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:43.680692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:43.681156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:43.816170 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:43.824833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-893419e1-4272-4ad5-b589-f6f57fc3121c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1667 microversion: 2.1 time: 0.159351 Oct 31 16:32:43.825469 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3755/7367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:43 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:44.923352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c9e9109d-3e91-48db-8476-87eb77042a6d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:44.925574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c9e9109d-3e91-48db-8476-87eb77042a6d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:44.932964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e9109d-3e91-48db-8476-87eb77042a6d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:44.933500 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e9109d-3e91-48db-8476-87eb77042a6d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:44.933979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e9109d-3e91-48db-8476-87eb77042a6d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:44.934704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e9109d-3e91-48db-8476-87eb77042a6d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:44.935174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e9109d-3e91-48db-8476-87eb77042a6d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:44.935612 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9e9109d-3e91-48db-8476-87eb77042a6d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:45.001862 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c9e9109d-3e91-48db-8476-87eb77042a6d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action" status: 200 len: 32636 microversion: 2.1 time: 0.082438 Oct 31 16:32:45.002544 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3613/7368] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:32:44 2022] POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action => generated 32636 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:32:45.015271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-017362c1-4349-43d7-b568-ea2c4641169a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:45.015805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-017362c1-4349-43d7-b568-ea2c4641169a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:45.022862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-017362c1-4349-43d7-b568-ea2c4641169a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:45.023928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-017362c1-4349-43d7-b568-ea2c4641169a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:45.024380 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-017362c1-4349-43d7-b568-ea2c4641169a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:45.025191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-017362c1-4349-43d7-b568-ea2c4641169a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:45.025659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-017362c1-4349-43d7-b568-ea2c4641169a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:45.026092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-017362c1-4349-43d7-b568-ea2c4641169a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:45.094514 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-017362c1-4349-43d7-b568-ea2c4641169a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action" status: 202 len: 0 microversion: 2.1 time: 0.083038 Oct 31 16:32:45.098466 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3756/7369] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:32:45 2022] POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:32:45.105617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:45.106417 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:45.114252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:45.114809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:45.115287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:45.116115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:45.116751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:45.118403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:45.262318 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:45.270694 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea197430-c988-4bff-bfb5-fb00e1747620 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1674 microversion: 2.1 time: 0.170619 Oct 31 16:32:45.271741 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3614/7370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:45 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:46.297701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:46.298398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:46.304719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:46.305440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:46.305879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:46.306580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:46.307037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:46.307465 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:46.441965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:46.450551 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-68799684-8928-4fb8-b619-ea1d3ba7c33c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1682 microversion: 2.1 time: 0.157987 Oct 31 16:32:46.451126 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3757/7371] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:46 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:46.549844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-48e9be61-fec5-4ee2-902a-2ddc595f5e4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:46.551979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-48e9be61-fec5-4ee2-902a-2ddc595f5e4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:46.559823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e9be61-fec5-4ee2-902a-2ddc595f5e4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:46.560325 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e9be61-fec5-4ee2-902a-2ddc595f5e4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:46.560772 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e9be61-fec5-4ee2-902a-2ddc595f5e4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:46.561521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e9be61-fec5-4ee2-902a-2ddc595f5e4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:46.561995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e9be61-fec5-4ee2-902a-2ddc595f5e4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:46.562438 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-48e9be61-fec5-4ee2-902a-2ddc595f5e4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:46.618955 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-48e9be61-fec5-4ee2-902a-2ddc595f5e4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action" status: 200 len: 38412 microversion: 2.1 time: 0.073151 Oct 31 16:32:46.619610 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3615/7372] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:32:46 2022] POST /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7/action => generated 38412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:32:47.870673 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:47.871185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:47.873658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-586e0bbe-94fb-475f-ad70-29fdad11bc54 req-b57cef6e-e096-40ab-a744-a4a4816e0d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7", "tag": "245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:47.878375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:47.878951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:47.879441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:47.880211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:47.880730 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:47.881433 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:47.886588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-586e0bbe-94fb-475f-ad70-29fdad11bc54 req-b57cef6e-e096-40ab-a744-a4a4816e0d3e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:47.887098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-586e0bbe-94fb-475f-ad70-29fdad11bc54 req-b57cef6e-e096-40ab-a744-a4a4816e0d3e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:47.887723 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-586e0bbe-94fb-475f-ad70-29fdad11bc54 req-b57cef6e-e096-40ab-a744-a4a4816e0d3e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:47.900454 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-586e0bbe-94fb-475f-ad70-29fdad11bc54 req-b57cef6e-e096-40ab-a744-a4a4816e0d3e service nova] Creating event network-changed:245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd for instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 on n-h2-858384-17 Oct 31 16:32:47.905959 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-586e0bbe-94fb-475f-ad70-29fdad11bc54 req-b57cef6e-e096-40ab-a744-a4a4816e0d3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036440 Oct 31 16:32:47.906907 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3616/7373] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:32:47.909508 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:32:47.992089 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5943e2ed-fa93-48f8-bc0f-986619575a73 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 204 len: 0 microversion: 2.1 time: 0.125373 Oct 31 16:32:47.993421 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3758/7374] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:32:47 2022] DELETE /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:32:48.002675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:48.003686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:48.011483 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:48.012075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:48.012584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:48.013588 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:48.014057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:48.014496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:48.157436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:48.165378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-142fbe8b-adc6-41fe-a6f6-045e7e1b4b48 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1688 microversion: 2.1 time: 0.167441 Oct 31 16:32:48.165967 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3617/7375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:47 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:32:49.190995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:49.191627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:49.199062 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:49.199546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:49.199982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:49.200674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:49.201164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:49.201583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:49.331603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:49.340037 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-80bf850e-4967-4827-9d8a-6fd5eb8b5e33 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1688 microversion: 2.1 time: 0.153383 Oct 31 16:32:49.340616 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3759/7376] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:49 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:50.195807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-745300f9-4808-40f0-8a6d-03d0fdceaeb2 req-2eebcb5a-0aea-4ddc-875e-47a146484813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7", "name": "network-vif-deleted", "tag": "245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:50.206901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-745300f9-4808-40f0-8a6d-03d0fdceaeb2 req-2eebcb5a-0aea-4ddc-875e-47a146484813 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:50.207407 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-745300f9-4808-40f0-8a6d-03d0fdceaeb2 req-2eebcb5a-0aea-4ddc-875e-47a146484813 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:50.207860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-745300f9-4808-40f0-8a6d-03d0fdceaeb2 req-2eebcb5a-0aea-4ddc-875e-47a146484813 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:50.225216 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-745300f9-4808-40f0-8a6d-03d0fdceaeb2 req-2eebcb5a-0aea-4ddc-875e-47a146484813 service nova] Creating event network-vif-deleted:245c7d4e-64a6-45f9-a4f3-bcb4f973f1fd for instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 on n-h2-858384-17 Oct 31 16:32:50.230459 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-745300f9-4808-40f0-8a6d-03d0fdceaeb2 req-2eebcb5a-0aea-4ddc-875e-47a146484813 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038869 Oct 31 16:32:50.231097 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3618/7377] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:32:50.366238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:50.367407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:50.373895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:50.374379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:50.374811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:50.375505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:50.375954 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:50.376372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:50.411172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:50.411580 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:50.412009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:50.412449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lazy-loading 'fault' on Instance uuid dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:32:50.454027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:32:50.462170 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f0342ba9-aec1-4262-a7d6-f22e15c66e28 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 200 len: 1355 microversion: 2.1 time: 0.100143 Oct 31 16:32:50.462757 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3760/7378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:50 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 1355 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:32:51.486584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:51.487310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:32:51.494389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:51.494883 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:51.495327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:51.496286 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:32:51.496757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:32:51.497214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:32:51.510836 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] HTTP exception thrown: Instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 could not be found. Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Request method failure captured: Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 HTTP/1.1 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_hz3HqGqUMBA7l8WlI3urtWwde2ch7t18CBrYyVPADnk9d_jMs1F5Zadr2RhKCcp_rTzfSg5jbgfqa_f_1OzONAFeCLE4a9qoDdh_fAX3zFq24eIipwwSTMflCI8V6bJpviH1qQuXWjc6cEyxsfCOsZcrNifB3bHjhU2o2Kj-hENKs Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb37334ce8814f89adcd5d997f26cf31", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb37334ce8814f89adcd5d997f26cf31"}]}] Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c1bc5f1af2c24c8ea5544ea690ae0115 Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 could not be found. Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': 'dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7'} Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 could not be found. Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 could not be found. Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:32:51.512446 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 could not be found. Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Returning 404 to user: Instance dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-70158f11-602d-4e84-92a8-bf30a3f3ce30 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7" status: 404 len: 111 microversion: 2.1 time: 0.031686 Oct 31 16:32:51.517374 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3619/7379] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:32:51 2022] GET /compute/v2.1/servers/dfab1a46-f8bf-4ddc-b9f7-a4d18d9a02e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:32:54.939155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-70a43e96-7dc3-4fd6-90a2-792ab35cda57 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '.version_select at 0x7f16e01b04c0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:32:54.962776 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-70a43e96-7dc3-4fd6-90a2-792ab35cda57 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-676379720" status: 202 len: 0 microversion: 2.1 time: 0.027760 Oct 31 16:32:54.963378 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3761/7380] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 31 16:32:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-676379720 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:32:54.990776 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9f9e0a7f-a052-4083-9df3-cafd1c660af3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: .version_select at 0x7f16e5762280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-798100992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU0N67mPnkzsr00nwfB/e0QOjJZM+CAgv3+jX7DZHD33BAuJ3HQqnLU0vl5gKVFvvGZA43GElk+fr0EJG7uNj09UOBUSq6+sDZTVXJC/KLYmlVegtmqQsb+zaJEWb4jKg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:32:55.008345 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9f9e0a7f-a052-4083-9df3-cafd1c660af3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:32:55.013758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9f9e0a7f-a052-4083-9df3-cafd1c660af3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:32:55.037615 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9f9e0a7f-a052-4083-9df3-cafd1c660af3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050705 Oct 31 16:32:55.038799 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3620/7381] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:32:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:00.181781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1165846578", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "2a4e0e54-61bc-4b27-bb99-f9b6d9cafb12"}], "key_name": "tempest-TestNetworkAdvancedServerOps-798100992", "security_groups": [{"name": "tempest-secgroup-smoke-18907493"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:00.295493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] validate_networks() for [('2a4e0e54-61bc-4b27-bb99-f9b6d9cafb12', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:33:00.458598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:00.704792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:33:00.705237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:33:00.705711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:33:00.706185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:33:00.706596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:33:00.715756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:00.717703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:00.718358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:00.719096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:00.719550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:00.719971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:00.738491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:33:00.744531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:33:00.756829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:33:00.759364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:33:00.806287 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [fc2f6b7a-ce58-46a2-9f12-ce7613328a99] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 31 16:33:01.813811 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [fc2f6b7a-ce58-46a2-9f12-ce7613328a99] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 55018. Oct 31 16:33:01.817829 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-33cc7180-400b-4e80-b569-24dbc5d4c98b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.641264 Oct 31 16:33:01.818592 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3762/7382] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:33:00 2022] POST /compute/v2.1/servers => generated 404 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:33:01.828186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=32 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:01.832952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb128f1a-602f-4b62-bf4f-3cab00a77850 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:01.833813 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb128f1a-602f-4b62-bf4f-3cab00a77850 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:01.896571 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb128f1a-602f-4b62-bf4f-3cab00a77850 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:01.904285 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb128f1a-602f-4b62-bf4f-3cab00a77850 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1266 microversion: 2.1 time: 0.078229 Oct 31 16:33:01.904881 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3621/7383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:01 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:02.929095 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:02.930089 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:02.937202 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:02.937694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:02.938199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:02.939009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:02.939551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:02.940189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:03.019927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:03.029523 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-45064b33-ce89-4c27-b755-38a874062a7b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1326 microversion: 2.1 time: 0.105257 Oct 31 16:33:03.030410 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3763/7384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:02 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:04.055636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:04.056216 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:04.063093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:04.063601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:04.064057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:04.064778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:04.065289 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:04.065733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:04.268237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:04.276313 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-692536da-3384-471b-856e-953bc7b5d928 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1390 microversion: 2.1 time: 0.225443 Oct 31 16:33:04.276911 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3622/7385] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:04 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1390 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:04.642262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5a2ee442-8743-40ea-bdb1-869ca1db6a99 req-03dc59c7-9d77-4ba0-b514-b0fb959a0a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55883d20-5b4b-48cf-b7ff-8ab73b12152c", "tag": "61820a00-7585-415d-9194-e22a812c89b1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:04.655927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5a2ee442-8743-40ea-bdb1-869ca1db6a99 req-03dc59c7-9d77-4ba0-b514-b0fb959a0a70 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:04.656778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5a2ee442-8743-40ea-bdb1-869ca1db6a99 req-03dc59c7-9d77-4ba0-b514-b0fb959a0a70 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:04.657449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5a2ee442-8743-40ea-bdb1-869ca1db6a99 req-03dc59c7-9d77-4ba0-b514-b0fb959a0a70 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:04.670294 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5a2ee442-8743-40ea-bdb1-869ca1db6a99 req-03dc59c7-9d77-4ba0-b514-b0fb959a0a70 service nova] Creating event network-changed:61820a00-7585-415d-9194-e22a812c89b1 for instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c on n-h1-858384-17 Oct 31 16:33:04.675768 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5a2ee442-8743-40ea-bdb1-869ca1db6a99 req-03dc59c7-9d77-4ba0-b514-b0fb959a0a70 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038036 Oct 31 16:33:04.676560 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3764/7386] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:05.300353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:05.300988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:05.308540 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:05.309050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:05.309585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:05.310311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:05.310835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:05.311227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:05.440585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:05.448693 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b4c59f13-952d-4f8e-80c2-46d505670760 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1390 microversion: 2.1 time: 0.152418 Oct 31 16:33:05.449305 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3623/7387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:05 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:06.473691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:06.474306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:06.481266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:06.481747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:06.482180 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:06.482870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:06.483334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:06.483761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:06.617243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:06.625161 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b55f749-cd62-4c2f-881a-84c3378441e7 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1390 microversion: 2.1 time: 0.156993 Oct 31 16:33:06.625732 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3765/7388] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:06 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:07.650204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:07.650836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:07.658358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:07.658868 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:07.659328 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:07.660045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:07.660521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:07.660963 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:08.168683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:08.176407 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e35155d8-d5ae-447f-a34c-23410972a50e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1390 microversion: 2.1 time: 0.531034 Oct 31 16:33:08.176981 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3624/7389] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:07 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1390 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:09.200823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:09.201460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:09.208741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:09.209261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:09.209704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:09.210412 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:09.211087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:09.211790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:09.351791 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:09.360413 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-25d762ae-61d1-4d0a-92e3-64c20bfd7b2c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1390 microversion: 2.1 time: 0.163608 Oct 31 16:33:09.361729 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3766/7390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:09 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:10.386464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:10.387125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:10.394033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:10.394535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:10.394987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:10.395692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:10.396175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:10.396618 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:10.526766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:10.534522 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d5a368e7-0b83-4c2f-a15b-ea5c04380df2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1390 microversion: 2.1 time: 0.154518 Oct 31 16:33:10.535106 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3625/7391] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:10 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:11.355740 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-de59f5b3-c7c3-4f92-8df1-2ee814fc6bd2 req-d1a0d71c-9296-44ce-9233-3ecb12de2bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55883d20-5b4b-48cf-b7ff-8ab73b12152c", "name": "network-vif-plugged", "status": "completed", "tag": "61820a00-7585-415d-9194-e22a812c89b1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:11.362520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:11.363203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:11.370484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-de59f5b3-c7c3-4f92-8df1-2ee814fc6bd2 req-d1a0d71c-9296-44ce-9233-3ecb12de2bd5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:11.370967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-de59f5b3-c7c3-4f92-8df1-2ee814fc6bd2 req-d1a0d71c-9296-44ce-9233-3ecb12de2bd5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:11.371398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-de59f5b3-c7c3-4f92-8df1-2ee814fc6bd2 req-d1a0d71c-9296-44ce-9233-3ecb12de2bd5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:11.383811 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-de59f5b3-c7c3-4f92-8df1-2ee814fc6bd2 req-d1a0d71c-9296-44ce-9233-3ecb12de2bd5 service nova] Creating event network-vif-plugged:61820a00-7585-415d-9194-e22a812c89b1 for instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c on n-h1-858384-17 Oct 31 16:33:11.388756 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-de59f5b3-c7c3-4f92-8df1-2ee814fc6bd2 req-d1a0d71c-9296-44ce-9233-3ecb12de2bd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037628 Oct 31 16:33:11.389426 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3767/7392] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:33:11.558274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:11.558901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:11.565829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:11.566334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:11.566784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:11.567495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:11.567964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:11.568402 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:11.703907 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:11.711641 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aa0c5725-9dc5-4191-9a30-ea7fec7d83b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1390 microversion: 2.1 time: 0.158003 Oct 31 16:33:11.712235 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3626/7393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:11 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:12.737545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:12.738270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:12.740205 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:12.746116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:12.746615 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:12.747093 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:12.747800 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:12.748295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:12.748729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:12.886978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:12.894932 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ecbcf9aa-42f1-44c0-b84c-cb5df28d1b94 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1562 microversion: 2.1 time: 0.162481 Oct 31 16:33:12.895531 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3768/7394] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:12 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:12.917555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:12.918219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:12.920161 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:12.921954 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:12.927721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:12.928228 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:12.928685 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:12.929933 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:12.930413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:12.931021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:13.067266 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:13.076554 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-107ce6ae-1c8e-4b57-93d4-d1fb78032dad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1562 microversion: 2.1 time: 0.162889 Oct 31 16:33:13.077148 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3627/7395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:12 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:14.672302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:14.673187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:14.674187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-87ad673f-2513-4525-bc9e-571b45760b0f req-0890a48c-3cdb-4a4c-930e-ef140e38aedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55883d20-5b4b-48cf-b7ff-8ab73b12152c", "tag": "61820a00-7585-415d-9194-e22a812c89b1"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:14.680136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:14.681142 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:14.682085 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:14.683481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:14.684442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:14.685268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-87ad673f-2513-4525-bc9e-571b45760b0f req-0890a48c-3cdb-4a4c-930e-ef140e38aedf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:14.685413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:14.685767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-87ad673f-2513-4525-bc9e-571b45760b0f req-0890a48c-3cdb-4a4c-930e-ef140e38aedf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:14.686210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-87ad673f-2513-4525-bc9e-571b45760b0f req-0890a48c-3cdb-4a4c-930e-ef140e38aedf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:14.698426 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-87ad673f-2513-4525-bc9e-571b45760b0f req-0890a48c-3cdb-4a4c-930e-ef140e38aedf service nova] Creating event network-changed:61820a00-7585-415d-9194-e22a812c89b1 for instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c on n-h1-858384-17 Oct 31 16:33:14.703732 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-87ad673f-2513-4525-bc9e-571b45760b0f req-0890a48c-3cdb-4a4c-930e-ef140e38aedf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033820 Oct 31 16:33:14.704630 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3628/7396] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:33:14.833913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:14.842011 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6b96a1de-bb04-4687-b5ab-b77ad0c612f5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1562 microversion: 2.1 time: 0.174092 Oct 31 16:33:14.842772 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3769/7397] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:14 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:36.095069 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cec97b71-3079-4d7e-80f6-87f16f0dd36c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:36.097651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cec97b71-3079-4d7e-80f6-87f16f0dd36c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:36.099951 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:36.100614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=38 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:36.106826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec97b71-3079-4d7e-80f6-87f16f0dd36c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:36.107329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec97b71-3079-4d7e-80f6-87f16f0dd36c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:36.107783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec97b71-3079-4d7e-80f6-87f16f0dd36c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:36.108494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec97b71-3079-4d7e-80f6-87f16f0dd36c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:36.108968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec97b71-3079-4d7e-80f6-87f16f0dd36c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:36.109529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cec97b71-3079-4d7e-80f6-87f16f0dd36c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:36.160794 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cec97b71-3079-4d7e-80f6-87f16f0dd36c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c/action" status: 200 len: 24566 microversion: 2.1 time: 0.070079 Oct 31 16:33:36.161540 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3629/7398] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:33:36 2022] POST /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c/action => generated 24566 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:33:47.127898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f03d6117-a785-48db-af12-efdb7842040d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:33:47.130169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f03d6117-a785-48db-af12-efdb7842040d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:47.132200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:47.133096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=36 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:47.138898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f03d6117-a785-48db-af12-efdb7842040d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:47.139386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f03d6117-a785-48db-af12-efdb7842040d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:47.139828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f03d6117-a785-48db-af12-efdb7842040d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:47.140525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f03d6117-a785-48db-af12-efdb7842040d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:47.140985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f03d6117-a785-48db-af12-efdb7842040d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:47.141451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f03d6117-a785-48db-af12-efdb7842040d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:47.215222 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f03d6117-a785-48db-af12-efdb7842040d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c/action" status: 202 len: 0 microversion: 2.1 time: 0.091286 Oct 31 16:33:47.216063 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3770/7399] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:33:47 2022] POST /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:33:47.224860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:47.225615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:47.230329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:47.231041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:33:47.235966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:47.236513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:47.236975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:47.237727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:47.238207 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:47.238654 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:47.466871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:47.475079 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bb775ae4-53fe-46ff-8b49-42395502fc68 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1672 microversion: 2.1 time: 0.254694 Oct 31 16:33:47.475865 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3630/7400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:47 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:48.502973 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:48.503660 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:48.509843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:48.510327 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:48.510757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:48.511437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:48.511889 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:48.512311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:48.643961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:48.651625 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5f500304-47f7-4833-b189-474ef65c13ac tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.154068 Oct 31 16:33:48.652210 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3771/7401] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:48 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:49.675977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:49.676596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:49.684631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:49.685141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:49.685597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:49.686296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:49.686797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:49.687234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:49.818844 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:49.827245 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-775568bd-9b0a-4a57-ae6e-98c6f2e02114 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.155177 Oct 31 16:33:49.827821 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3631/7402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:49 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:50.851273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:50.851975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:50.858787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:50.859300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:50.859736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:50.860432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:50.860886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:50.861361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:50.992096 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:50.999894 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4c5f7b1b-afd1-4006-b977-13bca13ea7ed tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.152900 Oct 31 16:33:51.000452 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3772/7403] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:50 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:52.025029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:52.025690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:52.032476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:52.032978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:52.033468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:52.034179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:52.034649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:52.035091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:52.172360 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:52.180717 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fe789552-d65c-4bbc-96af-dccc83bbcceb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.160585 Oct 31 16:33:52.181328 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3632/7404] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:52 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:53.205270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:53.205875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:53.213258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:53.213739 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:53.214176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:53.214857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:53.215308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:53.215729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:53.350127 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:53.357901 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a89801c5-e5c5-4062-8a47-43197aceada6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.156601 Oct 31 16:33:53.358474 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3773/7405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:53 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:54.382014 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:54.382673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:54.389623 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:54.390118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:54.390569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:54.391268 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:54.391738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:54.392175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:54.528104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:54.535805 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4a2850eb-9455-484b-9634-ce192445b534 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.157753 Oct 31 16:33:54.536382 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3633/7406] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:54 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:55.560385 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:55.561541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:55.568019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:55.568505 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:55.568939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:55.569725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:55.570246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:55.570658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:55.708655 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:55.716534 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9887b3a3-93c9-4707-9287-a15a5df73383 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.160039 Oct 31 16:33:55.717149 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3774/7407] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:55 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:56.819789 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:56.820439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:56.826974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:56.827464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:56.827962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:56.828607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:56.829073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:56.829539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:56.963745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:56.971564 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-baa57a37-caf0-4516-aa06-6de846644fe8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.155697 Oct 31 16:33:56.972416 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3634/7408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:56 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:57.995945 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:57.996571 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:58.003450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:58.003928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:58.004362 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:58.005043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:58.005539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:58.005959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:58.141944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:58.150385 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-94933426-38ae-4207-85c6-b8b2ff236414 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.158430 Oct 31 16:33:58.150959 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3775/7409] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:57 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:33:59.174545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:33:59.175195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:33:59.183493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:59.183998 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:59.184451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:59.185183 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:33:59.185667 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:33:59.186104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:33:59.318401 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:33:59.326476 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c1f94a9-48db-4047-bbf8-f7a1b92726ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.155883 Oct 31 16:33:59.327063 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3635/7410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:33:59 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:00.349373 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:00.349985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:00.356900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:00.357423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:00.357857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:00.358541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:00.358995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:00.359418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:00.490057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:00.498480 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e78a2108-891e-46c7-8f04-9c346dcab9df tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.153283 Oct 31 16:34:00.499061 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3776/7411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:00 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:01.521989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:01.522611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:01.530086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:01.530580 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:01.531030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:01.531728 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:01.532200 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:01.532636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:01.663632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:01.671469 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3a81cdbd-98a3-49e1-9793-8c65140ca485 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.153422 Oct 31 16:34:01.672058 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3636/7412] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:01 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:02.696788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:02.697364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:02.704145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:02.704624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:02.705054 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:02.705761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:02.706215 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:02.706635 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:02.839025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:02.847173 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c079e0a2-774c-4c40-82d6-0e6182b94ae8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1677 microversion: 2.1 time: 0.154881 Oct 31 16:34:02.847795 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3777/7413] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:02 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:03.872150 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:03.872771 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:03.879656 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:03.880153 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:03.880601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:03.881333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:03.881800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:03.882347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:04.018664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:04.026419 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01289639-3579-42b1-ab08-3a622ab573a1 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1680 microversion: 2.1 time: 0.158475 Oct 31 16:34:04.027003 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3637/7414] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:03 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:28.214693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e997117-1131-49d3-a409-5460e8bed5ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:28.216893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e997117-1131-49d3-a409-5460e8bed5ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:28.219070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=16 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:28.219747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:28.226020 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e997117-1131-49d3-a409-5460e8bed5ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:28.227151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e997117-1131-49d3-a409-5460e8bed5ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:28.227597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e997117-1131-49d3-a409-5460e8bed5ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:28.228300 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e997117-1131-49d3-a409-5460e8bed5ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:28.228794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e997117-1131-49d3-a409-5460e8bed5ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:28.229284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e997117-1131-49d3-a409-5460e8bed5ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:28.285003 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e997117-1131-49d3-a409-5460e8bed5ec tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c/action" status: 200 len: 68975 microversion: 2.1 time: 0.074429 Oct 31 16:34:28.285733 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3778/7415] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:34:28 2022] POST /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c/action => generated 68975 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:34:35.683545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:35.689575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-de027b83-0a80-4fb1-8036-ec2a82a70c20 req-da9cd882-81f9-49b6-a978-dfda3faa48f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55883d20-5b4b-48cf-b7ff-8ab73b12152c", "tag": "61820a00-7585-415d-9194-e22a812c89b1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:35.690055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:35.692260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=16 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:35.693168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=48 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:35.699253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:35.699785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:35.700237 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:35.700927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-de027b83-0a80-4fb1-8036-ec2a82a70c20 req-da9cd882-81f9-49b6-a978-dfda3faa48f0 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:35.701062 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:35.701437 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-de027b83-0a80-4fb1-8036-ec2a82a70c20 req-da9cd882-81f9-49b6-a978-dfda3faa48f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:35.701552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:35.701870 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-de027b83-0a80-4fb1-8036-ec2a82a70c20 req-da9cd882-81f9-49b6-a978-dfda3faa48f0 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:35.701991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:35.714761 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-de027b83-0a80-4fb1-8036-ec2a82a70c20 req-da9cd882-81f9-49b6-a978-dfda3faa48f0 service nova] Creating event network-changed:61820a00-7585-415d-9194-e22a812c89b1 for instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c on n-h1-858384-17 Oct 31 16:34:35.720228 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-de027b83-0a80-4fb1-8036-ec2a82a70c20 req-da9cd882-81f9-49b6-a978-dfda3faa48f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034658 Oct 31 16:34:35.721165 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3779/7416] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:35.735261 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:34:35.820638 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f5ef4a55-5d86-44b2-9f10-17064c42922f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 204 len: 0 microversion: 2.1 time: 0.141111 Oct 31 16:34:35.821913 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3638/7417] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:34:35 2022] DELETE /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:34:35.831055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:35.832038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:35.840782 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:35.841621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:35.842306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:35.843240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:35.843919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:35.844601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:36.064902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:36.073531 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2b1bef63-1f04-40d0-bae0-46f8227c92ae tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1686 microversion: 2.1 time: 0.247177 Oct 31 16:34:36.074116 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3780/7418] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:35 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1686 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:37.098872 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:37.099597 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:37.106585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:37.107090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:37.107549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:37.108262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:37.108738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:37.109211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:37.389094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:37.397237 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6d6bd0fc-ee9a-4df0-96a9-d00cae274d18 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1686 microversion: 2.1 time: 0.302849 Oct 31 16:34:37.397905 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3639/7419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:37 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1686 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:37.987376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ea41ace2-6d44-4bab-9e05-0fba45705d8e req-ff5b6d75-f98d-4dd3-90e6-1e826db92973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55883d20-5b4b-48cf-b7ff-8ab73b12152c", "name": "network-vif-deleted", "tag": "61820a00-7585-415d-9194-e22a812c89b1"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:37.999996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ea41ace2-6d44-4bab-9e05-0fba45705d8e req-ff5b6d75-f98d-4dd3-90e6-1e826db92973 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:38.000470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ea41ace2-6d44-4bab-9e05-0fba45705d8e req-ff5b6d75-f98d-4dd3-90e6-1e826db92973 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:38.000898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ea41ace2-6d44-4bab-9e05-0fba45705d8e req-ff5b6d75-f98d-4dd3-90e6-1e826db92973 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:38.011385 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ea41ace2-6d44-4bab-9e05-0fba45705d8e req-ff5b6d75-f98d-4dd3-90e6-1e826db92973 service nova] Creating event network-vif-deleted:61820a00-7585-415d-9194-e22a812c89b1 for instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c on n-h1-858384-17 Oct 31 16:34:38.016188 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ea41ace2-6d44-4bab-9e05-0fba45705d8e req-ff5b6d75-f98d-4dd3-90e6-1e826db92973 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032547 Oct 31 16:34:38.016791 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3781/7420] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:38.423876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:38.424465 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:38.432833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:38.433416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:38.433889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:38.434607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:38.435104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:38.435538 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:38.468817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:38.469349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:38.469800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:38.470254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lazy-loading 'fault' on Instance uuid 55883d20-5b4b-48cf-b7ff-8ab73b12152c {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:34:38.513534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:38.521094 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-72785a3d-0976-4cd7-8c70-ec1a808fa8ca tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 200 len: 1356 microversion: 2.1 time: 0.101784 Oct 31 16:34:38.521771 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3640/7421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:38 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:39.546887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:39.547597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 55883d20-5b4b-48cf-b7ff-8ab73b12152c] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:39.553788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:39.554276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:39.554721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:39.555416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:39.555878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:39.556305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:39.573357 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] HTTP exception thrown: Instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c could not be found. Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Request method failure captured: Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c HTTP/1.1 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_hz3HqGqUMBA7l8WlI3urtWwde2ch7t18CBrYyVPADnk9d_jMs1F5Zadr2RhKCcp_rTzfSg5jbgfqa_f_1OzONAFeCLE4a9qoDdh_fAX3zFq24eIipwwSTMflCI8V6bJpviH1qQuXWjc6cEyxsfCOsZcrNifB3bHjhU2o2Kj-hENKs Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb37334ce8814f89adcd5d997f26cf31", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb37334ce8814f89adcd5d997f26cf31"}]}] Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c1bc5f1af2c24c8ea5544ea690ae0115 Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c could not be found. Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '55883d20-5b4b-48cf-b7ff-8ab73b12152c'} Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c could not be found. Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c could not be found. Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:34:39.575022 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c could not be found. Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Returning 404 to user: Instance 55883d20-5b4b-48cf-b7ff-8ab73b12152c could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-be97da3e-7121-48e0-b6a1-0d591119dd03 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c" status: 404 len: 111 microversion: 2.1 time: 0.034854 Oct 31 16:34:39.579646 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3782/7422] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:39 2022] GET /compute/v2.1/servers/55883d20-5b4b-48cf-b7ff-8ab73b12152c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:34:42.620504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c022c0c-9ef8-44d4-948d-436070b4bb3a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '.version_select at 0x7f16e0fb0c10>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:42.643154 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c022c0c-9ef8-44d4-948d-436070b4bb3a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-798100992" status: 202 len: 0 microversion: 2.1 time: 0.027498 Oct 31 16:34:42.647325 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3641/7423] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 31 16:34:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-798100992 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 31 16:34:42.672651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1b781b54-58d1-44f1-8dda-ca59c90e9f6a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: .version_select at 0x7f16e14cb9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2052201051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzD/W2zsVf/u3c+bFYNfgWEv0pggtAFz/YBHW9+NWjvK9NRKBSs1zdXKvFV/gmoOya0r7bBlOb4Zj2/fFEgj87OuyEb9LmgpmJetdTFQmZZcClqjOACnZ7nNA8IMa9k4A=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:42.689762 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-1b781b54-58d1-44f1-8dda-ca59c90e9f6a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:34:42.697201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-1b781b54-58d1-44f1-8dda-ca59c90e9f6a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:34:42.721537 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1b781b54-58d1-44f1-8dda-ca59c90e9f6a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052775 Oct 31 16:34:42.722171 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3783/7424] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:34:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:48.318886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-277860485", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "0634df5b-6e25-47d0-bee1-0a228f44c4fa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2052201051", "security_groups": [{"name": "tempest-secgroup-smoke-1138862481"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:48.331389 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:34:48.331612 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:34:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Oct 31 16:34:48.449192 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] validate_networks() for [('0634df5b-6e25-47d0-bee1-0a228f44c4fa', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:34:48.518939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:48.864961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:34:48.865432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:34:48.865917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:34:48.866335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:34:48.866801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:34:48.876263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:48.876758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:48.877247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:48.877979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:48.878819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:48.879601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:48.897697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:34:48.903074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:34:48.916675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:34:48.919198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:34:48.968968 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fec508d6-63ce-47d7-b8dd-ea2cc798b9b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.653973 Oct 31 16:34:48.969691 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3642/7425] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:34:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:34:48.982495 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-44a64c03-3fc7-4846-b6d2-53d92d77c995 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:48.983026 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-44a64c03-3fc7-4846-b6d2-53d92d77c995 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:49.039115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-44a64c03-3fc7-4846-b6d2-53d92d77c995 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:49.046661 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-44a64c03-3fc7-4846-b6d2-53d92d77c995 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1266 microversion: 2.1 time: 0.069117 Oct 31 16:34:49.047274 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3784/7426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:48 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:50.072552 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:50.073222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:50.082167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:50.083199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:50.084067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:50.085071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:50.086329 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:50.086846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:50.200888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:50.212713 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a2ae0748-b794-474b-a9f0-32b3d3079223 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1326 microversion: 2.1 time: 0.145967 Oct 31 16:34:50.213498 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3643/7427] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:50 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1326 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:51.235920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:51.236523 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:51.248643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=16 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:51.252478 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:51.254781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:51.255536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:51.259117 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:51.259684 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:51.260489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:51.435862 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:51.449651 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e2532d49-90fe-4ce5-ab17-640db6b1320a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1392 microversion: 2.1 time: 0.217488 Oct 31 16:34:51.465972 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3785/7428] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:51 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:51.810474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e9152cae-6662-47d5-8f2c-57dda4cd5a8c req-f3188cdc-0928-42bc-98c5-53404b57db5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7720e064-44f9-4e98-ad0a-8ad34b6d8fc5", "tag": "8239aef7-b6fc-4226-84df-22630bfb43fb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:51.822294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e9152cae-6662-47d5-8f2c-57dda4cd5a8c req-f3188cdc-0928-42bc-98c5-53404b57db5a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:51.823177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e9152cae-6662-47d5-8f2c-57dda4cd5a8c req-f3188cdc-0928-42bc-98c5-53404b57db5a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:51.823843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e9152cae-6662-47d5-8f2c-57dda4cd5a8c req-f3188cdc-0928-42bc-98c5-53404b57db5a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:51.837875 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e9152cae-6662-47d5-8f2c-57dda4cd5a8c req-f3188cdc-0928-42bc-98c5-53404b57db5a service nova] Creating event network-changed:8239aef7-b6fc-4226-84df-22630bfb43fb for instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 on n-h2-858384-17 Oct 31 16:34:51.843085 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e9152cae-6662-47d5-8f2c-57dda4cd5a8c req-f3188cdc-0928-42bc-98c5-53404b57db5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041086 Oct 31 16:34:51.843697 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3644/7429] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:52.475397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:52.476010 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:52.482898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:52.483389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:52.483831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:52.484550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:52.484991 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:52.485458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:52.620064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:52.627883 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1e030fa9-ce67-47a8-879c-96906463a376 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1392 microversion: 2.1 time: 0.156741 Oct 31 16:34:52.628524 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3786/7430] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:52 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:53.655092 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:53.655830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:53.662619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:53.663117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:53.663674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:53.665115 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:53.665608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:53.666048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:53.894301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:53.903066 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e0c3db6b-6be1-42b5-b534-24a1daa9fbbb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1392 microversion: 2.1 time: 0.254597 Oct 31 16:34:53.903758 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3645/7431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:53 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:54.927372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:54.927891 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:54.935039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:54.935531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:54.935975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:54.936681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:54.937165 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:54.937597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:55.066489 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:55.075052 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ec6f6887-0ea3-43c2-a3bf-433f2ef8ab0a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1392 microversion: 2.1 time: 0.151727 Oct 31 16:34:55.075667 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3787/7432] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:54 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:55.935272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-798c53d9-68cd-4c1f-9908-10398e07c7b3 req-3d089b7e-ead9-4459-ade2-21d91c3f09b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7720e064-44f9-4e98-ad0a-8ad34b6d8fc5", "name": "network-vif-plugged", "status": "completed", "tag": "8239aef7-b6fc-4226-84df-22630bfb43fb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:34:55.945694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-798c53d9-68cd-4c1f-9908-10398e07c7b3 req-3d089b7e-ead9-4459-ade2-21d91c3f09b8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:55.946956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-798c53d9-68cd-4c1f-9908-10398e07c7b3 req-3d089b7e-ead9-4459-ade2-21d91c3f09b8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:55.947413 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-798c53d9-68cd-4c1f-9908-10398e07c7b3 req-3d089b7e-ead9-4459-ade2-21d91c3f09b8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:55.959033 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-798c53d9-68cd-4c1f-9908-10398e07c7b3 req-3d089b7e-ead9-4459-ade2-21d91c3f09b8 service nova] Creating event network-vif-plugged:8239aef7-b6fc-4226-84df-22630bfb43fb for instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 on n-h2-858384-17 Oct 31 16:34:55.964679 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-798c53d9-68cd-4c1f-9908-10398e07c7b3 req-3d089b7e-ead9-4459-ade2-21d91c3f09b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033574 Oct 31 16:34:55.965329 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3646/7433] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:34:56.098657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:56.099209 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:56.106365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:56.106856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:56.107301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:56.108172 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:56.108447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:56.108874 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:56.246395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:56.254219 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c40ed3ac-b0f5-4188-ada6-d7e288d66207 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1392 microversion: 2.1 time: 0.159819 Oct 31 16:34:56.254800 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3788/7434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:56 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:57.279054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:57.279761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:57.285891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:57.286388 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:57.286836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:57.287573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:57.288040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:57.288474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:57.429369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:57.437309 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-422ced62-8b54-4747-896b-60a2cedd72f0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1392 microversion: 2.1 time: 0.163993 Oct 31 16:34:57.437920 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3647/7435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:57 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:58.460959 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:58.461598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:58.465192 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:34:58.471301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:58.471788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:58.472226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:58.473214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:58.473677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:58.474130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:58.606448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:58.614388 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f5453f3-09ea-4567-a2dc-bc9615a7bd67 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1563 microversion: 2.1 time: 0.157342 Oct 31 16:34:58.615020 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3789/7436] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:58 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:34:58.638545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:34:58.639178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:34:58.646505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:58.647017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:58.647474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:58.648184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:34:58.648663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:34:58.649113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:34:58.780992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:34:58.788707 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3572db83-fcf0-4122-a911-ad26c819ad83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1563 microversion: 2.1 time: 0.154638 Oct 31 16:34:58.789308 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3648/7437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:34:58 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:00.387037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:00.387956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:00.389387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:00.390497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:00.394126 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:00.396082 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:00.396597 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:00.397169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:00.397941 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:00.398399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:00.398828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:00.451241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2c554c43-f42f-4e80-b201-9f171bfbd75f req-e6a06314-36f7-4b44-acda-c7e26a4246ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7720e064-44f9-4e98-ad0a-8ad34b6d8fc5", "tag": "8239aef7-b6fc-4226-84df-22630bfb43fb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:00.461386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2c554c43-f42f-4e80-b201-9f171bfbd75f req-e6a06314-36f7-4b44-acda-c7e26a4246ae service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:00.462172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2c554c43-f42f-4e80-b201-9f171bfbd75f req-e6a06314-36f7-4b44-acda-c7e26a4246ae service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:00.462903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2c554c43-f42f-4e80-b201-9f171bfbd75f req-e6a06314-36f7-4b44-acda-c7e26a4246ae service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:00.474944 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2c554c43-f42f-4e80-b201-9f171bfbd75f req-e6a06314-36f7-4b44-acda-c7e26a4246ae service nova] Creating event network-changed:8239aef7-b6fc-4226-84df-22630bfb43fb for instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 on n-h2-858384-17 Oct 31 16:35:00.481229 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2c554c43-f42f-4e80-b201-9f171bfbd75f req-e6a06314-36f7-4b44-acda-c7e26a4246ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096612 Oct 31 16:35:00.482397 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3649/7438] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:35:00.546261 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:00.554152 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f9a68292-66e3-4cb3-9964-b651fb766460 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1563 microversion: 2.1 time: 0.172115 Oct 31 16:35:00.569769 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3790/7439] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:00 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1563 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:23.806247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:23.807009 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=32 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:23.812586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9d2e393d-0271-490d-9684-29e827149872 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:23.814897 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9d2e393d-0271-490d-9684-29e827149872 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:23.822356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d2e393d-0271-490d-9684-29e827149872 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:23.823460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d2e393d-0271-490d-9684-29e827149872 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:23.823908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d2e393d-0271-490d-9684-29e827149872 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:23.824608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d2e393d-0271-490d-9684-29e827149872 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:23.825075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d2e393d-0271-490d-9684-29e827149872 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:23.825534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9d2e393d-0271-490d-9684-29e827149872 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:23.882049 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9d2e393d-0271-490d-9684-29e827149872 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5/action" status: 200 len: 24567 microversion: 2.1 time: 0.077484 Oct 31 16:35:23.882643 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3650/7440] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:35:23 2022] POST /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5/action => generated 24567 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:35:34.815814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:34.818098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:34.820211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:34.820909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=36 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:34.827069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:34.827553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:34.828083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:34.828825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:34.829250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:34.829674 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:34.933312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:34.939550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Old instance type m1.heat2, new instance type m1.heat {{(pid=120587) resize /opt/stack/nova/nova/compute/api.py:4221}} Oct 31 16:35:34.945963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:35:34.946377 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:35:34.946839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:35:34.947240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:35:34.947643 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:35:35.010097 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-528c17f6-97d3-4687-b3f6-df1387aec7a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5/action" status: 202 len: 0 microversion: 2.1 time: 0.198334 Oct 31 16:35:35.011262 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3791/7441] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:35:34 2022] POST /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:35:35.020270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:35.021263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:35.023950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:35.024605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:35:35.030787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:35.031294 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:35.031763 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:35.032472 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:35.032947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:35.033511 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:35.177477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:35.185650 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd37b56e-bdc4-4fa1-af12-338919c73459 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1690 microversion: 2.1 time: 0.169670 Oct 31 16:35:35.186242 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3651/7442] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:35 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:36.209584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:36.210122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:36.218639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:36.219132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:36.219576 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:36.220288 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:36.220752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:36.221211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:36.360723 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:36.368678 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29a28dfe-f703-4b0d-922a-fed04a3fc0ad tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1690 microversion: 2.1 time: 0.163310 Oct 31 16:35:36.369284 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3792/7443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:36 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:37.392087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:37.392739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:37.399614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:37.400112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:37.400562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:37.402098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:37.402718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:37.403164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:37.538050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:37.546693 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5cc26f4b-97f1-4404-baa6-cc5c6ef6a039 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.158618 Oct 31 16:35:37.547261 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3652/7444] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:37 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:38.571801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:38.572441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:38.579446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:38.579942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:38.580384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:38.581087 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:38.581573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:38.582005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:38.711699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:38.719833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-88c97129-ad62-468f-bcc6-50a33316062d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.152070 Oct 31 16:35:38.720414 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3793/7445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:38 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:39.743895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:39.744520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:39.751609 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:39.752109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:39.752555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:39.753304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:39.753775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:39.754213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:39.892798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:39.901789 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c680259b-fe88-49f3-81b9-bb9870fe7ff5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.161152 Oct 31 16:35:39.902410 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3653/7446] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:39 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:40.926120 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:40.926681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:40.933993 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:40.934475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:40.934904 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:40.935628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:40.936081 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:40.936503 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:41.067086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:41.075586 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-813a9f49-80b2-4ead-b828-ea84a6a7fbe5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.153421 Oct 31 16:35:41.076169 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3794/7447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:40 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:35:42.100075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:42.100698 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:42.107660 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:42.108163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:42.108614 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:42.109347 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:42.109817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:42.110262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:42.244610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:42.252455 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f2bcacd3-d2d3-4ad4-8f29-d8125218e3e0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.156517 Oct 31 16:35:42.253056 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3654/7448] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:42 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:43.275753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:43.276987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:43.283767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:43.284245 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:43.284675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:43.285389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:43.285840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:43.286259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:43.423290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:43.430982 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0435730c-50fc-4838-af9c-c61af658b519 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.159096 Oct 31 16:35:43.431561 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3795/7449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:43 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:44.454560 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:44.455323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:44.462307 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:44.462882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:44.463419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:44.464195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:44.464736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:44.465269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:44.601039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:44.609956 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bd462f94-aba6-4870-8fff-172f704c6895 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.159354 Oct 31 16:35:44.610542 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3655/7450] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:44 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:45.634603 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:45.635212 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:45.643159 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:45.643645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:45.644080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:45.644774 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:45.645259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:45.645688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:45.776401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:45.784108 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-adef1c50-9c7e-440e-a652-cced861bbf0f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.153386 Oct 31 16:35:45.784685 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3796/7451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:45 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:46.807677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:46.808368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:46.815331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:46.815851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:46.816300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:46.817005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:46.817496 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:46.817937 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:46.957142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:46.965063 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6b1568e7-199b-443e-8bc8-56ea503b18f8 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.161400 Oct 31 16:35:46.965670 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3656/7452] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:46 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:47.989164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:47.989748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:47.996906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:47.997425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:47.997861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:47.998552 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:47.999009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:47.999432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:48.136301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:48.144135 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fe5e2626-6ad0-4ab3-97eb-5a4d6baad9f3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.159081 Oct 31 16:35:48.144720 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3797/7453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:47 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:49.168702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:49.169363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:49.176168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:49.176663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:49.177111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:49.177831 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:49.178303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:49.178738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:49.312658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:49.320481 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-19e1ba5c-7f8b-4089-a3ac-74968a13e74f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.156314 Oct 31 16:35:49.321063 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3657/7454] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:49 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:50.344357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:50.344956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:50.352072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:50.352567 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:50.353007 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:50.353731 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:50.354696 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:50.355129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:50.486838 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:50.494539 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4825187c-cbf7-4518-97b5-1ef1fbd6a998 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.154117 Oct 31 16:35:50.495823 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3798/7455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:50 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:51.519267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:51.519890 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:51.526737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:51.527239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:51.527688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:51.528391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:51.528858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:51.529320 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:51.666121 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:51.673889 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-968b32ab-94c3-421e-846a-dd440ab36a24 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.158583 Oct 31 16:35:51.674477 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3658/7456] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:51 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:52.698819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:52.699348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:52.706828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:52.707361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:52.707831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:52.708565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:52.709021 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:52.709470 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:52.838036 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:52.846366 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f3ea340a-c9ea-441d-88a9-888af352446d tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.152014 Oct 31 16:35:52.846940 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3799/7457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:52 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:35:53.870557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:53.871091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:53.878166 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:53.878663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:53.879110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:53.879809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:53.880281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:53.880717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:54.013715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:54.021372 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-66b846d1-4ff6-4f7c-9b56-cbd5d76b487b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1695 microversion: 2.1 time: 0.154975 Oct 31 16:35:54.021946 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3659/7458] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:53 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:35:54.863240 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-031f3a21-7bdf-4fac-b723-c69f4527b49d req-fe9f4c1a-c995-4f46-bc0b-d569f83a5feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7720e064-44f9-4e98-ad0a-8ad34b6d8fc5", "name": "network-vif-unplugged", "status": "completed", "tag": "8239aef7-b6fc-4226-84df-22630bfb43fb"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:54.873522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-031f3a21-7bdf-4fac-b723-c69f4527b49d req-fe9f4c1a-c995-4f46-bc0b-d569f83a5feb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:54.874042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-031f3a21-7bdf-4fac-b723-c69f4527b49d req-fe9f4c1a-c995-4f46-bc0b-d569f83a5feb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:54.874486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-031f3a21-7bdf-4fac-b723-c69f4527b49d req-fe9f4c1a-c995-4f46-bc0b-d569f83a5feb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:54.886555 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-031f3a21-7bdf-4fac-b723-c69f4527b49d req-fe9f4c1a-c995-4f46-bc0b-d569f83a5feb service nova] Creating event network-vif-unplugged:8239aef7-b6fc-4226-84df-22630bfb43fb for instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 on n-h1-858384-17 Oct 31 16:35:54.891978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [req-031f3a21-7bdf-4fac-b723-c69f4527b49d req-fe9f4c1a-c995-4f46-bc0b-d569f83a5feb service nova] Instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:35:54.903772 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-031f3a21-7bdf-4fac-b723-c69f4527b49d req-fe9f4c1a-c995-4f46-bc0b-d569f83a5feb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044492 Oct 31 16:35:54.904516 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3800/7459] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:55.046494 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:55.047152 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:55.053779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:55.054280 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:55.054758 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:55.055470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:55.055938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:55.056373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:55.205147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:55.213309 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3f61652a-4292-4935-a01a-8c1b29d1f18a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1694 microversion: 2.1 time: 0.171623 Oct 31 16:35:55.215497 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3660/7460] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:55 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:56.241376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:56.242075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:56.248692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:56.249211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:56.249647 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:56.250339 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:56.250792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:56.251217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:56.385006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:56.393043 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-84427972-027c-4ac2-b845-358eac0dffba tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1692 microversion: 2.1 time: 0.156974 Oct 31 16:35:56.393659 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3801/7461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:56 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:56.919343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b2f40ce3-60da-4278-92eb-ff3bb68d5bc5 req-08ba0b37-e594-44f5-a717-e1af3f4684e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7720e064-44f9-4e98-ad0a-8ad34b6d8fc5", "tag": "8239aef7-b6fc-4226-84df-22630bfb43fb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:56.929640 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b2f40ce3-60da-4278-92eb-ff3bb68d5bc5 req-08ba0b37-e594-44f5-a717-e1af3f4684e3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:56.930127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b2f40ce3-60da-4278-92eb-ff3bb68d5bc5 req-08ba0b37-e594-44f5-a717-e1af3f4684e3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:56.930563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b2f40ce3-60da-4278-92eb-ff3bb68d5bc5 req-08ba0b37-e594-44f5-a717-e1af3f4684e3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:56.942749 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b2f40ce3-60da-4278-92eb-ff3bb68d5bc5 req-08ba0b37-e594-44f5-a717-e1af3f4684e3 service nova] Creating event network-changed:8239aef7-b6fc-4226-84df-22630bfb43fb for instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 on n-h1-858384-17 Oct 31 16:35:56.948528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [req-b2f40ce3-60da-4278-92eb-ff3bb68d5bc5 req-08ba0b37-e594-44f5-a717-e1af3f4684e3 service nova] Instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-858384-17', 'n-h2-858384-17'} {{(pid=120588) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5940}} Oct 31 16:35:56.959572 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b2f40ce3-60da-4278-92eb-ff3bb68d5bc5 req-08ba0b37-e594-44f5-a717-e1af3f4684e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044186 Oct 31 16:35:56.960172 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3661/7462] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:35:57.418031 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:57.418768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:57.426221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:57.426837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:57.427424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:57.428231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:57.428790 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:57.429374 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:57.618811 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:57.627630 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b006fb8c-2296-43b1-a815-2d519cf08f25 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1692 microversion: 2.1 time: 0.214501 Oct 31 16:35:57.628449 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3802/7463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:57 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1692 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:58.653507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:58.654227 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:58.660366 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:58.660867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:58.661344 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:58.662060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:58.662533 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:58.662977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:58.799371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:58.807280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e7f45c2-cd74-41b7-a40d-a962ae1b21b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1689 microversion: 2.1 time: 0.160077 Oct 31 16:35:58.807874 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3662/7464] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:58 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:58.830496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c48a5a70-5b35-4bc0-9968-fedd648cfc77 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:35:58.831055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c48a5a70-5b35-4bc0-9968-fedd648cfc77 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:58.837766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c48a5a70-5b35-4bc0-9968-fedd648cfc77 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:58.838250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c48a5a70-5b35-4bc0-9968-fedd648cfc77 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:58.839316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c48a5a70-5b35-4bc0-9968-fedd648cfc77 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:58.840107 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c48a5a70-5b35-4bc0-9968-fedd648cfc77 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:58.840565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c48a5a70-5b35-4bc0-9968-fedd648cfc77 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:58.840989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c48a5a70-5b35-4bc0-9968-fedd648cfc77 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:58.900139 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c48a5a70-5b35-4bc0-9968-fedd648cfc77 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5/action" status: 204 len: 0 microversion: 2.1 time: 0.073229 Oct 31 16:35:58.900764 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3803/7465] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:35:58 2022] POST /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:35:58.910162 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:58.911081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:58.917611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:58.918114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:58.918800 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:58.919599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:58.920031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:58.920532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:59.133333 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:59.142188 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f23019d6-1dd8-4249-b2bc-ff68f52d5b69 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1689 microversion: 2.1 time: 0.236111 Oct 31 16:35:59.142786 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3663/7466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:58 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1689 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:35:59.165844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:35:59.166473 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:35:59.173201 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:59.173715 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:59.174176 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:59.174898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:35:59.175351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:35:59.175772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:35:59.314532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:35:59.322515 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7335ff65-ff2a-4d6a-8121-b09f7ff4236c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1689 microversion: 2.1 time: 0.160990 Oct 31 16:35:59.323784 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3804/7467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:35:59 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:00.347593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:00.348269 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:00.355761 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:00.356498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:00.356950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:00.357699 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:00.358170 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:00.358606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:00.500172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:00.507972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26cc7116-932e-4b83-8b15-fa5e0c11aea5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1681 microversion: 2.1 time: 0.164363 Oct 31 16:36:00.508558 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3664/7468] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:00 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:02.206517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-ffc6eca1-6c5e-4a94-a124-740db4729fd8 req-9791b434-29e2-4824-92e0-2d10497761b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7720e064-44f9-4e98-ad0a-8ad34b6d8fc5", "name": "network-vif-plugged", "status": "completed", "tag": "8239aef7-b6fc-4226-84df-22630bfb43fb"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:02.217760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ffc6eca1-6c5e-4a94-a124-740db4729fd8 req-9791b434-29e2-4824-92e0-2d10497761b6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:02.218357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ffc6eca1-6c5e-4a94-a124-740db4729fd8 req-9791b434-29e2-4824-92e0-2d10497761b6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:02.218828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-ffc6eca1-6c5e-4a94-a124-740db4729fd8 req-9791b434-29e2-4824-92e0-2d10497761b6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:02.232137 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-ffc6eca1-6c5e-4a94-a124-740db4729fd8 req-9791b434-29e2-4824-92e0-2d10497761b6 service nova] Creating event network-vif-plugged:8239aef7-b6fc-4226-84df-22630bfb43fb for instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 on n-h1-858384-17 Oct 31 16:36:02.237651 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-ffc6eca1-6c5e-4a94-a124-740db4729fd8 req-9791b434-29e2-4824-92e0-2d10497761b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035026 Oct 31 16:36:02.238314 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3805/7469] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:36:22.696310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6a9ac4e0-073d-4d47-8172-37d46f77c922 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:22.698605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6a9ac4e0-073d-4d47-8172-37d46f77c922 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:22.701530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=28 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:22.702199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=82 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:22.707778 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a9ac4e0-073d-4d47-8172-37d46f77c922 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:22.708270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a9ac4e0-073d-4d47-8172-37d46f77c922 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:22.708715 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a9ac4e0-073d-4d47-8172-37d46f77c922 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:22.709446 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a9ac4e0-073d-4d47-8172-37d46f77c922 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:22.709911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a9ac4e0-073d-4d47-8172-37d46f77c922 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:22.710363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6a9ac4e0-073d-4d47-8172-37d46f77c922 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:22.762511 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6a9ac4e0-073d-4d47-8172-37d46f77c922 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5/action" status: 200 len: 24560 microversion: 2.1 time: 0.069973 Oct 31 16:36:22.763202 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3665/7470] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:36:22 2022] POST /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5/action => generated 24560 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:36:29.997711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:29.998296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:30.000091 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c7593174-98e5-41ed-b6e2-2e394dd983bf req-fdd96524-820c-4e2b-8239-c772d297dbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7720e064-44f9-4e98-ad0a-8ad34b6d8fc5", "tag": "8239aef7-b6fc-4226-84df-22630bfb43fb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:30.002246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=34 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:30.003115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:30.014198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c7593174-98e5-41ed-b6e2-2e394dd983bf req-fdd96524-820c-4e2b-8239-c772d297dbd8 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:30.014429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:30.014794 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c7593174-98e5-41ed-b6e2-2e394dd983bf req-fdd96524-820c-4e2b-8239-c772d297dbd8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:30.014914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:30.015330 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c7593174-98e5-41ed-b6e2-2e394dd983bf req-fdd96524-820c-4e2b-8239-c772d297dbd8 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:30.015455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:30.016048 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:30.016540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:30.016971 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:30.028438 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c7593174-98e5-41ed-b6e2-2e394dd983bf req-fdd96524-820c-4e2b-8239-c772d297dbd8 service nova] Creating event network-changed:8239aef7-b6fc-4226-84df-22630bfb43fb for instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 on n-h1-858384-17 Oct 31 16:36:30.034046 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c7593174-98e5-41ed-b6e2-2e394dd983bf req-fdd96524-820c-4e2b-8239-c772d297dbd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038899 Oct 31 16:36:30.034777 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3666/7471] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:36:30.046837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:36:30.146557 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd63be6a-f398-4271-a40a-8e8226690257 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 204 len: 0 microversion: 2.1 time: 0.153789 Oct 31 16:36:30.148276 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3806/7472] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:36:29 2022] DELETE /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:36:30.156855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:30.157615 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:30.164255 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:30.164756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:30.165238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:30.165960 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:30.166431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:30.166873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:30.311210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:30.319397 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f868e03a-51b2-4884-94b7-ff0f52571ff6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1687 microversion: 2.1 time: 0.166699 Oct 31 16:36:30.319990 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3667/7473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:30 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:31.344949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:31.345688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:31.354283 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:31.355335 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:31.355777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:31.356645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:31.357108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:31.357566 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:31.562511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:31.575325 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c963c2d1-32db-4bc7-a7ea-dfc2dc99d244 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 200 len: 1687 microversion: 2.1 time: 0.234602 Oct 31 16:36:31.576399 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3807/7474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:31 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 1687 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:32.051882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-8130aea3-15a9-4571-b33b-2b8c5a6a81f0 req-c2e6d6e1-9f0e-47c4-a6bc-18f23a3b8c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7720e064-44f9-4e98-ad0a-8ad34b6d8fc5", "name": "network-vif-deleted", "tag": "8239aef7-b6fc-4226-84df-22630bfb43fb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:32.065624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8130aea3-15a9-4571-b33b-2b8c5a6a81f0 req-c2e6d6e1-9f0e-47c4-a6bc-18f23a3b8c00 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:32.066125 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8130aea3-15a9-4571-b33b-2b8c5a6a81f0 req-c2e6d6e1-9f0e-47c4-a6bc-18f23a3b8c00 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:32.066599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-8130aea3-15a9-4571-b33b-2b8c5a6a81f0 req-c2e6d6e1-9f0e-47c4-a6bc-18f23a3b8c00 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:32.077119 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-8130aea3-15a9-4571-b33b-2b8c5a6a81f0 req-c2e6d6e1-9f0e-47c4-a6bc-18f23a3b8c00 service nova] Creating event network-vif-deleted:8239aef7-b6fc-4226-84df-22630bfb43fb for instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 on n-h1-858384-17 Oct 31 16:36:32.082153 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-8130aea3-15a9-4571-b33b-2b8c5a6a81f0 req-c2e6d6e1-9f0e-47c4-a6bc-18f23a3b8c00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034434 Oct 31 16:36:32.082765 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3668/7475] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:36:32.599747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:32.600353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:32.607592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:32.608070 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:32.608500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:32.609219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:32.609672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:32.610092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:32.623427 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] HTTP exception thrown: Instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 could not be found. Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Request method failure captured: Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 HTTP/1.1 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_hz3HqGqUMBA7l8WlI3urtWwde2ch7t18CBrYyVPADnk9d_jMs1F5Zadr2RhKCcp_rTzfSg5jbgfqa_f_1OzONAFeCLE4a9qoDdh_fAX3zFq24eIipwwSTMflCI8V6bJpviH1qQuXWjc6cEyxsfCOsZcrNifB3bHjhU2o2Kj-hENKs Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb37334ce8814f89adcd5d997f26cf31", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb37334ce8814f89adcd5d997f26cf31"}]}] Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: c1bc5f1af2c24c8ea5544ea690ae0115 Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 could not be found. Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '7720e064-44f9-4e98-ad0a-8ad34b6d8fc5'} Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 could not be found. Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 could not be found. Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:36:32.625043 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 could not be found. Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Returning 404 to user: Instance 7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7dc2621-0d48-4e8e-9ca2-fa7ef81f62a9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5" status: 404 len: 111 microversion: 2.1 time: 0.031155 Oct 31 16:36:32.630358 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3808/7476] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:32 2022] GET /compute/v2.1/servers/7720e064-44f9-4e98-ad0a-8ad34b6d8fc5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:36:35.999399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c838771-eaa4-4d42-b4cd-20f66ab581ea tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '.version_select at 0x7f16e56ad670>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:36.021464 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c838771-eaa4-4d42-b4cd-20f66ab581ea tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2052201051" status: 202 len: 0 microversion: 2.1 time: 0.026805 Oct 31 16:36:36.022081 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3669/7477] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Oct 31 16:36:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2052201051 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:36:36.046856 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7dc5e1e0-a0dd-42f0-a433-9cbe31a0dc6a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: .version_select at 0x7f16e02b4280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-905325465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGXRbSlefw50CMcIPPxK9bnYX6P3cXHKLYOmpq1nhAIDn4Hr6DnA6wzzrlVmS2/lslZ6bJc2o4ESaBUau6GWLOqoSNadnyRHpw6KITQO4wD2XtdbzMeRE5ELU/5eS6iYQ=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:36.067712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-7dc5e1e0-a0dd-42f0-a433-9cbe31a0dc6a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:36:36.072963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-7dc5e1e0-a0dd-42f0-a433-9cbe31a0dc6a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:36:36.096883 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7dc5e1e0-a0dd-42f0-a433-9cbe31a0dc6a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054703 Oct 31 16:36:36.097533 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3809/7478] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:36:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:36:41.854287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1844711512", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "cb5354a3-70cf-4508-aa4b-8370e5c5fb68"}], "key_name": "tempest-TestNetworkAdvancedServerOps-905325465", "security_groups": [{"name": "tempest-secgroup-smoke-17228034"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:41.987718 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] validate_networks() for [('cb5354a3-70cf-4508-aa4b-8370e5c5fb68', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:36:42.072056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:42.442210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:36:42.442866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:36:42.443536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:36:42.444131 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:36:42.444867 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:36:42.457628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:42.458522 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:42.459241 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:42.460184 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:42.460820 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:42.461462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:42.492520 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:36:42.499622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:36:42.514358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:36:42.516999 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:36:42.571134 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-481462d4-c58a-4356-88aa-f3ea0d7d481e tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.721831 Oct 31 16:36:42.578910 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3670/7479] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:36:41 2022] POST /compute/v2.1/servers => generated 404 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:36:42.588574 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29451e04-3f52-4d3d-8c86-ae9bae1ce923 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:42.590136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-29451e04-3f52-4d3d-8c86-ae9bae1ce923 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:42.620475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:42.664995 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-29451e04-3f52-4d3d-8c86-ae9bae1ce923 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:42.674692 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29451e04-3f52-4d3d-8c86-ae9bae1ce923 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1266 microversion: 2.1 time: 0.092928 Oct 31 16:36:42.675981 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3810/7480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:42 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:43.700482 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:43.701111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:43.711745 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:43.712391 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:43.712856 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:43.713624 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:43.714270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:43.715025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:43.830925 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:43.842940 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f52dd3a4-b45b-4286-aaf8-be0282f43c21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1326 microversion: 2.1 time: 0.147470 Oct 31 16:36:43.844268 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3671/7481] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:43 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1326 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:44.868270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:44.868875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:44.877627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:44.878379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:44.878835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:44.879528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:44.879983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:44.880408 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:45.027787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:45.045213 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-11139128-6070-479b-b9df-258aefdcb4aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1390 microversion: 2.1 time: 0.179622 Oct 31 16:36:45.046055 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3811/7482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:44 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1390 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:45.347708 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3d88d87f-7327-4661-a1cf-00bd8a85bf77 req-43b6f585-1c50-4629-85c3-7953cb27add7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5157a62d-1832-44af-97cc-5ecf6fb9a653", "tag": "71eca641-78ae-48b7-b533-d1b812c022fa"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:45.366498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3d88d87f-7327-4661-a1cf-00bd8a85bf77 req-43b6f585-1c50-4629-85c3-7953cb27add7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:45.375380 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3d88d87f-7327-4661-a1cf-00bd8a85bf77 req-43b6f585-1c50-4629-85c3-7953cb27add7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:45.376332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3d88d87f-7327-4661-a1cf-00bd8a85bf77 req-43b6f585-1c50-4629-85c3-7953cb27add7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:45.389588 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3d88d87f-7327-4661-a1cf-00bd8a85bf77 req-43b6f585-1c50-4629-85c3-7953cb27add7 service nova] Creating event network-changed:71eca641-78ae-48b7-b533-d1b812c022fa for instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 on n-h2-858384-17 Oct 31 16:36:45.395061 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3d88d87f-7327-4661-a1cf-00bd8a85bf77 req-43b6f585-1c50-4629-85c3-7953cb27add7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051291 Oct 31 16:36:45.396445 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3672/7483] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:36:46.069785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:46.070398 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:46.078055 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:46.078720 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:46.079275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:46.080097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:46.080657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:46.081237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:46.219372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:46.227355 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ed2dd212-3109-4caf-96fa-27b1426eae89 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1390 microversion: 2.1 time: 0.161981 Oct 31 16:36:46.227940 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3812/7484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:46 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:47.251846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:47.252563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:47.259914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:47.260419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:47.260880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:47.261658 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:47.262123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:47.262735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:47.403132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:47.410960 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7987a3ca-238d-4d70-9889-7b6bf95463e2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1390 microversion: 2.1 time: 0.164617 Oct 31 16:36:47.411653 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3673/7485] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:47 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:48.482434 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:48.483133 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:48.489182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:48.489871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:48.490305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:48.491002 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:48.491461 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:48.491886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:48.626924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:48.634806 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9f3b08ef-e9dc-4e33-8ab6-51a423f01df6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1390 microversion: 2.1 time: 0.204559 Oct 31 16:36:48.635389 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3813/7486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:48 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1390 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:49.659466 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:49.660094 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:49.666946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:49.667663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:49.668236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:49.668950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:49.669453 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:49.669904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:49.802793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:49.810681 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dbe810e5-460d-49a0-bc7f-b797b257c960 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1390 microversion: 2.1 time: 0.155249 Oct 31 16:36:49.811280 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3674/7487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:49 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:50.492663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9989e5b6-7dd7-4697-bf12-0c8c9f984737 req-75e6b003-328d-432e-ae16-68d9292805f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5157a62d-1832-44af-97cc-5ecf6fb9a653", "name": "network-vif-plugged", "status": "completed", "tag": "71eca641-78ae-48b7-b533-d1b812c022fa"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:50.503721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9989e5b6-7dd7-4697-bf12-0c8c9f984737 req-75e6b003-328d-432e-ae16-68d9292805f7 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:50.504203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9989e5b6-7dd7-4697-bf12-0c8c9f984737 req-75e6b003-328d-432e-ae16-68d9292805f7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:50.504631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9989e5b6-7dd7-4697-bf12-0c8c9f984737 req-75e6b003-328d-432e-ae16-68d9292805f7 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:50.516047 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9989e5b6-7dd7-4697-bf12-0c8c9f984737 req-75e6b003-328d-432e-ae16-68d9292805f7 service nova] Creating event network-vif-plugged:71eca641-78ae-48b7-b533-d1b812c022fa for instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 on n-h2-858384-17 Oct 31 16:36:50.521018 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9989e5b6-7dd7-4697-bf12-0c8c9f984737 req-75e6b003-328d-432e-ae16-68d9292805f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032372 Oct 31 16:36:50.521674 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3814/7488] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:36:50.834431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:50.835063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:50.842594 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:50.843098 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:50.843553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:50.844265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:50.844742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:50.845211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:50.975799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:50.984299 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f688b085-3375-48eb-bb15-3129bfe737fb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1390 microversion: 2.1 time: 0.153842 Oct 31 16:36:50.984891 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3675/7489] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:50 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:52.008455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:52.009182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:52.016230 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:52.016721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:52.017189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:52.017892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:52.018354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:52.018817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:52.154969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:52.162859 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-cbf6b8c7-bae3-4c9e-bd5c-ba20409265db tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1563 microversion: 2.1 time: 0.159614 Oct 31 16:36:52.163443 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3815/7490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:52 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:52.187194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:52.187823 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:52.194910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:52.195447 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:52.195896 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:52.196606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:52.197076 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:52.197546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:52.335223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:52.343075 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9e407a99-4498-46d6-a3a7-a9afa812db87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1563 microversion: 2.1 time: 0.160526 Oct 31 16:36:52.343666 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3676/7491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:52 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:36:54.316291 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:36:54.317593 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:36:54.318814 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-dc3653a0-e325-40d9-b09e-229bd4e9f00d req-05a2f1dc-97c0-4a25-856d-dc5ba6b8c472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5157a62d-1832-44af-97cc-5ecf6fb9a653", "tag": "71eca641-78ae-48b7-b533-d1b812c022fa"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:36:54.320796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:54.326550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:54.327236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:54.327985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:54.328483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:54.328934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:54.329306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:36:54.329712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:54.330136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:54.330563 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:54.336000 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dc3653a0-e325-40d9-b09e-229bd4e9f00d req-05a2f1dc-97c0-4a25-856d-dc5ba6b8c472 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:36:54.336532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dc3653a0-e325-40d9-b09e-229bd4e9f00d req-05a2f1dc-97c0-4a25-856d-dc5ba6b8c472 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:36:54.336980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-dc3653a0-e325-40d9-b09e-229bd4e9f00d req-05a2f1dc-97c0-4a25-856d-dc5ba6b8c472 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:36:54.351398 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-dc3653a0-e325-40d9-b09e-229bd4e9f00d req-05a2f1dc-97c0-4a25-856d-dc5ba6b8c472 service nova] Creating event network-changed:71eca641-78ae-48b7-b533-d1b812c022fa for instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 on n-h2-858384-17 Oct 31 16:36:54.357050 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-dc3653a0-e325-40d9-b09e-229bd4e9f00d req-05a2f1dc-97c0-4a25-856d-dc5ba6b8c472 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042566 Oct 31 16:36:54.358224 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3677/7492] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:36:54.470913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:36:54.479585 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6a4f2441-e815-4931-8f96-62fc3aa96477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1563 microversion: 2.1 time: 0.167258 Oct 31 16:36:54.480577 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3816/7493] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:36:54 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:17.752127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=36 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:17.757265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-50f38eb1-70a1-4836-b899-ab76c0ec533b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:17.759577 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-50f38eb1-70a1-4836-b899-ab76c0ec533b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:17.766365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f38eb1-70a1-4836-b899-ab76c0ec533b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:17.766877 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f38eb1-70a1-4836-b899-ab76c0ec533b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:17.767332 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f38eb1-70a1-4836-b899-ab76c0ec533b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:17.768043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f38eb1-70a1-4836-b899-ab76c0ec533b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:17.768521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f38eb1-70a1-4836-b899-ab76c0ec533b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:17.768967 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-50f38eb1-70a1-4836-b899-ab76c0ec533b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:17.825428 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-50f38eb1-70a1-4836-b899-ab76c0ec533b tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action" status: 200 len: 24576 microversion: 2.1 time: 0.075141 Oct 31 16:37:17.826293 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3678/7494] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:37:17 2022] POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action => generated 24576 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:37:28.747222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7b9633f3-98d4-46c2-afab-35a910159c90 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:28.749656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:28.750355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=32 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:28.756258 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b9633f3-98d4-46c2-afab-35a910159c90 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:28.756747 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b9633f3-98d4-46c2-afab-35a910159c90 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:28.757224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7b9633f3-98d4-46c2-afab-35a910159c90 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:28.782787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7b9633f3-98d4-46c2-afab-35a910159c90 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Going to try to stop instance {{(pid=120587) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 31 16:37:28.823439 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7b9633f3-98d4-46c2-afab-35a910159c90 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action" status: 202 len: 0 microversion: 2.1 time: 0.080594 Oct 31 16:37:28.824228 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3817/7495] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:37:28 2022] POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:37:28.834202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:28.834927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:28.837573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:28.838514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=4 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:37:28.845774 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:28.846390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:28.846892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:28.847847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:28.848331 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:28.848787 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:28.992992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:29.000928 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c9f80d13-fdcd-4966-8bd8-9a9e8d15a586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1692 microversion: 2.1 time: 0.172053 Oct 31 16:37:29.001521 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3679/7496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:28 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:30.026466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:30.027152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:30.033772 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:30.034248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:30.034677 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:30.035365 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:30.035817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:30.036235 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:30.174468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:30.182193 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bc37a041-0efa-4f4e-8c5e-8f84650e81b0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1692 microversion: 2.1 time: 0.160986 Oct 31 16:37:30.182769 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3818/7497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:30 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:31.206113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:31.206746 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:31.213626 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:31.214135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:31.214598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:31.215311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:31.215782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:31.216230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:31.358721 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:31.366540 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-da020fcd-e6e6-46a5-93ab-08fafc0714c0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1692 microversion: 2.1 time: 0.164406 Oct 31 16:37:31.367119 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3680/7498] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:31 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:32.392232 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:32.392836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:32.399553 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:32.400032 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:32.400466 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:32.401175 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:32.401630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:32.402052 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:32.535017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:32.542771 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05480fce-7bc0-4088-b92f-06226723a3c3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1692 microversion: 2.1 time: 0.154513 Oct 31 16:37:32.543428 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3819/7499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:32 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:37:33.567001 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:33.567561 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:33.574586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:33.575089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:33.575542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:33.576252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:33.576724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:33.577185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:33.708943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:33.717216 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dd4c02c7-5386-4ded-be78-f9f68a5b85aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1692 microversion: 2.1 time: 0.154218 Oct 31 16:37:33.717796 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3681/7500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:33 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:34.741846 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:34.742457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:34.750058 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:34.750540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:34.750972 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:34.751659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:34.752110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:34.752533 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:34.886406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:34.894253 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-da81b8fb-731f-4a2b-aca8-e7cec9434231 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1692 microversion: 2.1 time: 0.156385 Oct 31 16:37:34.894825 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3820/7501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:34 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:35.920738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:35.921342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:35.928164 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:35.928665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:35.929117 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:35.929850 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:35.930324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:35.930767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:36.065555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:36.073272 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-99b8bda0-260f-4617-8cb4-a5fa5bec29b6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1692 microversion: 2.1 time: 0.156593 Oct 31 16:37:36.073857 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3682/7502] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:35 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:37.096286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:37.096827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:37.103852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:37.104333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:37.104767 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:37.105986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:37.106448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:37.106865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:37.237922 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:37.245739 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e9eda568-a362-4da1-acb5-8562dbb8b9ee tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1692 microversion: 2.1 time: 0.153416 Oct 31 16:37:37.246468 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3821/7503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:37 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:38.269987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:38.270643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:38.278359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:38.279017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:38.279477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:38.280201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:38.280677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:38.281122 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:38.415262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:38.423270 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6396a899-b020-44d4-ae0a-7612a94cecd3 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1692 microversion: 2.1 time: 0.157299 Oct 31 16:37:38.423871 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3683/7504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:38 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:39.446496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:39.447084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:39.455042 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:39.455520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:39.455948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:39.456633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:39.457086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:39.457528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:39.592802 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:39.600936 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-26b88e35-8694-4a93-944d-58f3687e1a4f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1669 microversion: 2.1 time: 0.158321 Oct 31 16:37:39.601633 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3822/7505] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:39 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:40.694903 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-067b836b-a080-4c00-9d71-c45f255a51d9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:40.697185 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-067b836b-a080-4c00-9d71-c45f255a51d9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:40.705047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067b836b-a080-4c00-9d71-c45f255a51d9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:40.705578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067b836b-a080-4c00-9d71-c45f255a51d9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:40.706028 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067b836b-a080-4c00-9d71-c45f255a51d9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:40.706750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067b836b-a080-4c00-9d71-c45f255a51d9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:40.707206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067b836b-a080-4c00-9d71-c45f255a51d9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:40.707643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-067b836b-a080-4c00-9d71-c45f255a51d9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:40.768100 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-067b836b-a080-4c00-9d71-c45f255a51d9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action" status: 200 len: 36925 microversion: 2.1 time: 0.077031 Oct 31 16:37:40.768745 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3684/7506] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:37:40 2022] POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action => generated 36925 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:37:40.781415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-62fdc0bf-df0b-496b-a1e0-06d586e45069 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:37:40.789583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62fdc0bf-df0b-496b-a1e0-06d586e45069 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:40.790071 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62fdc0bf-df0b-496b-a1e0-06d586e45069 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:40.790510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-62fdc0bf-df0b-496b-a1e0-06d586e45069 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:40.816157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-62fdc0bf-df0b-496b-a1e0-06d586e45069 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Going to try to start instance {{(pid=120587) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 31 16:37:40.859061 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-62fdc0bf-df0b-496b-a1e0-06d586e45069 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action" status: 202 len: 0 microversion: 2.1 time: 0.082314 Oct 31 16:37:40.859598 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3823/7507] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:37:40 2022] POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:37:40.868613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:40.869490 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:40.876839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:40.877432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:40.878008 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:40.878793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:40.879365 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:40.879832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:41.097684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:41.108713 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c1b6aa17-784f-4a93-9426-c59ae60286b2 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1678 microversion: 2.1 time: 0.244408 Oct 31 16:37:41.109400 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3685/7508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:40 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:37:42.135376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:37:42.136072 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:37:42.142225 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:42.142708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:42.143145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:42.143841 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:37:42.144297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:37:42.144729 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:37:42.275122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:37:42.283031 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fb411a46-08f0-4f16-9272-c0621609c359 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1682 microversion: 2.1 time: 0.153252 Oct 31 16:37:42.283643 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3824/7509] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:37:42 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:08.480884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8adf0b55-b302-4f9e-b060-ad44ccaab574 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:08.483751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8adf0b55-b302-4f9e-b060-ad44ccaab574 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:08.486513 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:08.487362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=40 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:08.493012 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8adf0b55-b302-4f9e-b060-ad44ccaab574 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:08.493606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8adf0b55-b302-4f9e-b060-ad44ccaab574 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:08.494053 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8adf0b55-b302-4f9e-b060-ad44ccaab574 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:08.494756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8adf0b55-b302-4f9e-b060-ad44ccaab574 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:08.495222 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8adf0b55-b302-4f9e-b060-ad44ccaab574 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:08.495661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8adf0b55-b302-4f9e-b060-ad44ccaab574 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:08.555011 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8adf0b55-b302-4f9e-b060-ad44ccaab574 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action" status: 200 len: 61483 microversion: 2.1 time: 0.077945 Oct 31 16:38:08.555675 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3686/7510] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:38:08 2022] POST /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653/action => generated 61483 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:38:15.592501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:15.593231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:15.595527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-855f975c-1fc8-49d4-b12b-809c2d668fc6 req-0a8532f7-f7ce-4270-b704-16e1b53a560a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5157a62d-1832-44af-97cc-5ecf6fb9a653", "tag": "71eca641-78ae-48b7-b533-d1b812c022fa"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:15.598781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=16 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:15.599591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:15.601426 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:38:15.601553 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:38:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 (ip 10.222.0.20) !!! Oct 31 16:38:15.604793 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:15.605320 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:15.605766 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:15.606776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:15.607238 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:15.607672 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:15.611495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-855f975c-1fc8-49d4-b12b-809c2d668fc6 req-0a8532f7-f7ce-4270-b704-16e1b53a560a service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:15.612145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-855f975c-1fc8-49d4-b12b-809c2d668fc6 req-0a8532f7-f7ce-4270-b704-16e1b53a560a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:15.612986 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-855f975c-1fc8-49d4-b12b-809c2d668fc6 req-0a8532f7-f7ce-4270-b704-16e1b53a560a service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:15.629594 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-855f975c-1fc8-49d4-b12b-809c2d668fc6 req-0a8532f7-f7ce-4270-b704-16e1b53a560a service nova] Creating event network-changed:71eca641-78ae-48b7-b533-d1b812c022fa for instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 on n-h2-858384-17 Oct 31 16:38:15.635672 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-855f975c-1fc8-49d4-b12b-809c2d668fc6 req-0a8532f7-f7ce-4270-b704-16e1b53a560a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044203 Oct 31 16:38:15.636565 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3687/7511] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:38:15.639407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:38:15.724004 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b191c0fe-321e-4cd8-a94b-198df2e2714a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 204 len: 0 microversion: 2.1 time: 0.135843 Oct 31 16:38:15.725304 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3825/7512] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:38:15 2022] DELETE /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:38:15.735717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:15.736474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:15.744080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:15.744600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:15.756143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:15.757528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:15.758300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:15.759669 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:15.946664 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:15.955516 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7802b5a-1690-48e9-9682-1aadefd3cc13 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1688 microversion: 2.1 time: 0.224925 Oct 31 16:38:15.956110 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3688/7513] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:15 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1688 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:38:16.982617 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:16.983395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:16.990406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:16.990892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:16.991324 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:16.992025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:16.992481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:16.992905 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:17.139129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:17.146852 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-17e1d361-4d35-4941-97b5-26c814a084d0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1688 microversion: 2.1 time: 0.170173 Oct 31 16:38:17.147435 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3826/7514] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:16 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:17.992766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a89885af-9840-485f-afb5-c1859b35e347 req-c764a3dd-96d2-40ad-bf46-68a91c51f931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5157a62d-1832-44af-97cc-5ecf6fb9a653", "name": "network-vif-deleted", "tag": "71eca641-78ae-48b7-b533-d1b812c022fa"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:18.003825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a89885af-9840-485f-afb5-c1859b35e347 req-c764a3dd-96d2-40ad-bf46-68a91c51f931 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:18.004526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a89885af-9840-485f-afb5-c1859b35e347 req-c764a3dd-96d2-40ad-bf46-68a91c51f931 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:18.004786 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a89885af-9840-485f-afb5-c1859b35e347 req-c764a3dd-96d2-40ad-bf46-68a91c51f931 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:18.016436 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a89885af-9840-485f-afb5-c1859b35e347 req-c764a3dd-96d2-40ad-bf46-68a91c51f931 service nova] Creating event network-vif-deleted:71eca641-78ae-48b7-b533-d1b812c022fa for instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 on n-h2-858384-17 Oct 31 16:38:18.021308 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a89885af-9840-485f-afb5-c1859b35e347 req-c764a3dd-96d2-40ad-bf46-68a91c51f931 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093487 Oct 31 16:38:18.021907 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3689/7515] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:38:18.171847 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:18.172460 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:18.179273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:18.179759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:18.180198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:18.180920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:18.181411 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:18.181836 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:18.214077 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:18.214570 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:18.215009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:18.215457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lazy-loading 'fault' on Instance uuid 5157a62d-1832-44af-97cc-5ecf6fb9a653 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:38:18.258547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:18.266714 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-175346f2-578c-4012-8c6a-504f313a5119 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 200 len: 1356 microversion: 2.1 time: 0.099372 Oct 31 16:38:18.267316 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3827/7516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:18 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:19.292346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:19.292972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 5157a62d-1832-44af-97cc-5ecf6fb9a653] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:19.299389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:19.299884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:19.300334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:19.301037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:19.301535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:19.301979 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:19.316113 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] HTTP exception thrown: Instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 could not be found. Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Request method failure captured: Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 HTTP/1.1 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_hz3HqGqUMBA7l8WlI3urtWwde2ch7t18CBrYyVPADnk9d_jMs1F5Zadr2RhKCcp_rTzfSg5jbgfqa_f_1OzONAFeCLE4a9qoDdh_fAX3zFq24eIipwwSTMflCI8V6bJpviH1qQuXWjc6cEyxsfCOsZcrNifB3bHjhU2o2Kj-hENKs Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb37334ce8814f89adcd5d997f26cf31", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb37334ce8814f89adcd5d997f26cf31"}]}] Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c1bc5f1af2c24c8ea5544ea690ae0115 Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 could not be found. Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '5157a62d-1832-44af-97cc-5ecf6fb9a653'} Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 could not be found. Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 could not be found. Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:38:19.318191 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 could not be found. Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Returning 404 to user: Instance 5157a62d-1832-44af-97cc-5ecf6fb9a653 could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-885fb256-d09b-4737-a1ab-a64060f68b93 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653" status: 404 len: 111 microversion: 2.1 time: 0.032842 Oct 31 16:38:19.323087 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3690/7517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:19 2022] GET /compute/v2.1/servers/5157a62d-1832-44af-97cc-5ecf6fb9a653 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:38:22.995280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-702d0629-7430-4f9a-9bef-4878990990ce tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '.version_select at 0x7f16e1991dc0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:23.018338 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-702d0629-7430-4f9a-9bef-4878990990ce tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-905325465" status: 202 len: 0 microversion: 2.1 time: 0.027811 Oct 31 16:38:23.019178 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3828/7518] 10.222.0.20 () {58 vars in 1281 bytes} [Mon Oct 31 16:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-905325465 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:38:23.051805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dac1c563-ab06-48ab-b97f-e9ee17e42900 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: .version_select at 0x7f16e563bca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1985558231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5x/ThdN6QWxqNUeST3jW6xOjohV6Xe+s6x7W9mzM0GBNV7k+jzfZ1PF/orHgEOJf0VST1OgszmNBGReuFB7aLVd/uzHaMuRDaBqdhl4/4927cOdUzTa2x3qUNNuHcfIg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:23.070230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-dac1c563-ab06-48ab-b97f-e9ee17e42900 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:38:23.076508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-dac1c563-ab06-48ab-b97f-e9ee17e42900 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:38:23.102871 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dac1c563-ab06-48ab-b97f-e9ee17e42900 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055329 Oct 31 16:38:23.103662 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3691/7519] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:38:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:38:28.672144 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1608268345", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "networks": [{"uuid": "bbadf0f6-a910-427a-aa04-02410491d132"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1985558231", "security_groups": [{"name": "tempest-secgroup-smoke-1084907454"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:28.682312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:28.811808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] validate_networks() for [('bbadf0f6-a910-427a-aa04-02410491d132', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:38:29.225967 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:38:29.226386 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:38:29.226858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:38:29.227267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:38:29.227678 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:38:29.237356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:29.237833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:29.238266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:29.238987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:29.239436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:29.239855 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:29.257309 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:38:29.263006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Getting quotas for user c1bc5f1af2c24c8ea5544ea690ae0115 and project fb37334ce8814f89adcd5d997f26cf31. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:38:29.275200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:38:29.277534 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:38:29.328657 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd5097f3-1af7-4697-b343-1a42bc5b4a2a tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.661724 Oct 31 16:38:29.329789 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3829/7520] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:38:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:38:29.338946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=16 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:29.344657 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d60fe4ad-aaaa-4632-88b3-56aec7b4b7a0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:29.346649 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d60fe4ad-aaaa-4632-88b3-56aec7b4b7a0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:29.427063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d60fe4ad-aaaa-4632-88b3-56aec7b4b7a0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:29.434879 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d60fe4ad-aaaa-4632-88b3-56aec7b4b7a0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1267 microversion: 2.1 time: 0.097801 Oct 31 16:38:29.435710 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3692/7521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:29 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:30.460371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:30.461097 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:30.472371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:30.472872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:30.473376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:30.474099 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:30.474585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:30.475016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:30.549000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:30.558391 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41c3f9e3-17d0-4a8a-8a05-b5337169221c tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1327 microversion: 2.1 time: 0.102879 Oct 31 16:38:30.559758 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3830/7522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:30 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:31.584622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:31.585651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:31.595156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:31.596021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:31.596524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:31.597462 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:31.597931 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:31.598595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:31.754214 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:31.762447 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1d8d3945-0cc7-4fcc-8b32-bb9f69a2e5f4 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1393 microversion: 2.1 time: 0.181505 Oct 31 16:38:31.763382 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3693/7523] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:31 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:32.073627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-011cbe88-c142-4a4a-9eb3-7012cb4dec7e req-0851de32-96b1-47e3-be98-7a0165dc1019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea", "tag": "e6f8659a-aec3-456d-96dc-0b32569f48cb"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:32.092701 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-011cbe88-c142-4a4a-9eb3-7012cb4dec7e req-0851de32-96b1-47e3-be98-7a0165dc1019 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:32.093281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-011cbe88-c142-4a4a-9eb3-7012cb4dec7e req-0851de32-96b1-47e3-be98-7a0165dc1019 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:32.093821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-011cbe88-c142-4a4a-9eb3-7012cb4dec7e req-0851de32-96b1-47e3-be98-7a0165dc1019 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:32.107765 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-011cbe88-c142-4a4a-9eb3-7012cb4dec7e req-0851de32-96b1-47e3-be98-7a0165dc1019 service nova] Creating event network-changed:e6f8659a-aec3-456d-96dc-0b32569f48cb for instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea on n-h2-858384-17 Oct 31 16:38:32.113072 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-011cbe88-c142-4a4a-9eb3-7012cb4dec7e req-0851de32-96b1-47e3-be98-7a0165dc1019 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043827 Oct 31 16:38:32.113720 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3831/7524] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:38:32.786818 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:32.787455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:32.794371 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:32.794870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:32.795327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:32.796038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:32.796514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:32.796964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:32.930182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:32.938616 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9c017567-0c04-4669-a312-791da042fc21 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1393 microversion: 2.1 time: 0.155989 Oct 31 16:38:32.939212 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3694/7525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:32 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:33.963253 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:33.963960 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:33.972281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:33.972777 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:33.973246 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:33.973955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:33.974417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:33.974848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:34.110948 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:34.118677 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-9fbe81c0-6ac2-4ae1-ab7c-fb37398a8349 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1393 microversion: 2.1 time: 0.159761 Oct 31 16:38:34.119267 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3832/7526] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:33 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1393 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:35.143065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:35.143810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:35.150785 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:35.151287 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:35.151736 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:35.152443 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:35.152956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:35.153424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:35.291805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:35.300438 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0bc837a9-f095-43a2-9cc6-65f9d38c9e8f tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1393 microversion: 2.1 time: 0.161198 Oct 31 16:38:35.301313 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3695/7527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:35 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:36.325310 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:36.326123 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:36.333174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:36.333661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:36.334092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:36.334808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:36.335260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:36.335681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:36.468823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:36.476760 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-eb308cd5-5683-4275-8a27-9dc058194622 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1393 microversion: 2.1 time: 0.156095 Oct 31 16:38:36.477364 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3833/7528] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:36 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:37.179537 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c5df3961-894e-4458-9846-d4f82b7b6731 req-b1cf85d0-37ba-4eb6-a9cd-ec397ad7fc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea", "name": "network-vif-plugged", "status": "completed", "tag": "e6f8659a-aec3-456d-96dc-0b32569f48cb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:37.191628 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c5df3961-894e-4458-9846-d4f82b7b6731 req-b1cf85d0-37ba-4eb6-a9cd-ec397ad7fc25 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:37.192087 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c5df3961-894e-4458-9846-d4f82b7b6731 req-b1cf85d0-37ba-4eb6-a9cd-ec397ad7fc25 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:37.192535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c5df3961-894e-4458-9846-d4f82b7b6731 req-b1cf85d0-37ba-4eb6-a9cd-ec397ad7fc25 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:37.203638 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c5df3961-894e-4458-9846-d4f82b7b6731 req-b1cf85d0-37ba-4eb6-a9cd-ec397ad7fc25 service nova] Creating event network-vif-plugged:e6f8659a-aec3-456d-96dc-0b32569f48cb for instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea on n-h2-858384-17 Oct 31 16:38:37.209028 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c5df3961-894e-4458-9846-d4f82b7b6731 req-b1cf85d0-37ba-4eb6-a9cd-ec397ad7fc25 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090263 Oct 31 16:38:37.209666 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3696/7529] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:38:37.501185 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:37.501792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:37.508630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:37.509112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:37.509573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:37.510257 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:37.510713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:37.511132 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:37.644296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:37.651855 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-70cfba2d-01da-4ccd-9be5-10ac20771c35 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1393 microversion: 2.1 time: 0.155303 Oct 31 16:38:37.652427 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3834/7530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:37 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:38.676678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:38.677418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:38.679350 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:38.686267 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:38.686849 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:38.687304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:38.688025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:38.688535 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:38.688987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:38.822113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:38.830795 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-075ceb6d-a682-49a3-8098-3e948b4a25aa tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1565 microversion: 2.1 time: 0.159381 Oct 31 16:38:38.831308 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3697/7531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:38 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:38.853526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:38.854168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:38.861341 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:38.861839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:38.862282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:38.862984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:38.863446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:38.863879 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:39.001401 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:39.009196 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0ab9a787-6daf-4b11-ab85-ed99be5ac3a6 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1565 microversion: 2.1 time: 0.159780 Oct 31 16:38:39.009785 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3835/7532] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:38 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:38:40.881888 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:38:40.882514 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:38:40.884768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-bae9a833-0de4-485f-a017-000c44327068 req-88f2aea4-de5b-4de1-8790-2e00505d985c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea", "tag": "e6f8659a-aec3-456d-96dc-0b32569f48cb"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:38:40.888982 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:40.890500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:40.891279 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:38:40.891590 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:40.892387 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:40.892836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:40.893705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:40.894173 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:40.894801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:40.899080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bae9a833-0de4-485f-a017-000c44327068 req-88f2aea4-de5b-4de1-8790-2e00505d985c service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:38:40.900008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bae9a833-0de4-485f-a017-000c44327068 req-88f2aea4-de5b-4de1-8790-2e00505d985c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:38:40.900626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-bae9a833-0de4-485f-a017-000c44327068 req-88f2aea4-de5b-4de1-8790-2e00505d985c service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:38:40.913169 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-bae9a833-0de4-485f-a017-000c44327068 req-88f2aea4-de5b-4de1-8790-2e00505d985c service nova] Creating event network-changed:e6f8659a-aec3-456d-96dc-0b32569f48cb for instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea on n-h2-858384-17 Oct 31 16:38:40.919614 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-bae9a833-0de4-485f-a017-000c44327068 req-88f2aea4-de5b-4de1-8790-2e00505d985c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038538 Oct 31 16:38:40.920458 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3836/7533] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:38:41.047129 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:38:41.055760 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8f0dabf0-2bb9-43d0-8bb5-7c8868281a56 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1565 microversion: 2.1 time: 0.177796 Oct 31 16:38:41.056455 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3698/7534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:38:40 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:04.314357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-75ea392e-85a9-4077-a130-93c312d73ae9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:04.316546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-75ea392e-85a9-4077-a130-93c312d73ae9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:04.318763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:04.319482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=36 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:04.326667 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75ea392e-85a9-4077-a130-93c312d73ae9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:04.327273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75ea392e-85a9-4077-a130-93c312d73ae9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:04.327741 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75ea392e-85a9-4077-a130-93c312d73ae9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:04.328449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75ea392e-85a9-4077-a130-93c312d73ae9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:04.328915 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75ea392e-85a9-4077-a130-93c312d73ae9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:04.329376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-75ea392e-85a9-4077-a130-93c312d73ae9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:04.391863 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-75ea392e-85a9-4077-a130-93c312d73ae9 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action" status: 200 len: 24549 microversion: 2.1 time: 0.082006 Oct 31 16:39:04.392556 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3837/7535] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:39:04 2022] POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action => generated 24549 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:39:15.384403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:15.385079 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:15.387108 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:15.387833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=32 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:15.393607 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:15.394113 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:15.394569 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:15.395276 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:15.395751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:15.396191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:15.419305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lazy-loading 'flavor' on Instance uuid 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:39:15.484190 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e69d07ec-b3c8-47ce-90ff-fbbce2cc59b5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action" status: 202 len: 0 microversion: 2.1 time: 0.103258 Oct 31 16:39:15.485313 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3699/7536] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:39:15 2022] POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:39:15.493994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:15.494692 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:15.497561 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:15.498531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:15.505878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:15.506351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:15.506785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:15.507485 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:15.507969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:15.508392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:15.645091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:15.652832 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a6da29c-cf3f-4c3f-84e4-b9165b6c9add tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1691 microversion: 2.1 time: 0.163532 Oct 31 16:39:15.653445 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3838/7537] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:15 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:16.679025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:16.679751 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:16.687988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:16.688495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:16.689011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:16.689756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:16.690234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:16.690741 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:16.830118 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:16.837911 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-58e70326-cf15-417a-a501-4da99ac40477 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1674 microversion: 2.1 time: 0.163270 Oct 31 16:39:16.838498 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3700/7538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:16 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:17.932892 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78396184-044f-4d24-82ad-c221b6e06b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:17.935040 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78396184-044f-4d24-82ad-c221b6e06b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:17.944596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78396184-044f-4d24-82ad-c221b6e06b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:17.945091 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78396184-044f-4d24-82ad-c221b6e06b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:17.945558 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78396184-044f-4d24-82ad-c221b6e06b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:17.946270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78396184-044f-4d24-82ad-c221b6e06b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:17.946783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78396184-044f-4d24-82ad-c221b6e06b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:17.947350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-78396184-044f-4d24-82ad-c221b6e06b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:18.012041 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78396184-044f-4d24-82ad-c221b6e06b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action" status: 200 len: 38304 microversion: 2.1 time: 0.082996 Oct 31 16:39:18.012733 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3839/7539] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:39:17 2022] POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action => generated 38304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:39:18.025349 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a70e7e67-050e-49a3-bcb9-11895ce42f87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:18.025902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a70e7e67-050e-49a3-bcb9-11895ce42f87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:18.033282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a70e7e67-050e-49a3-bcb9-11895ce42f87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:18.033826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a70e7e67-050e-49a3-bcb9-11895ce42f87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:18.034272 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a70e7e67-050e-49a3-bcb9-11895ce42f87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:18.034962 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a70e7e67-050e-49a3-bcb9-11895ce42f87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:18.035427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a70e7e67-050e-49a3-bcb9-11895ce42f87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:18.035861 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a70e7e67-050e-49a3-bcb9-11895ce42f87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:18.100286 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a70e7e67-050e-49a3-bcb9-11895ce42f87 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action" status: 202 len: 0 microversion: 2.1 time: 0.078653 Oct 31 16:39:18.100960 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3701/7540] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:39:18 2022] POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:39:18.110306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:18.110926 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:18.118259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:18.118784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:18.119217 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:18.119929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:18.120392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:18.120843 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:18.337840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:18.345888 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bd280318-6e52-4ccc-9156-174e4dcb9926 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1680 microversion: 2.1 time: 0.240101 Oct 31 16:39:18.346483 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3840/7541] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:18 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:19.371071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:19.371799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:19.379946 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:19.380455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:19.380912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:19.381692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:19.382335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:19.382779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:19.537862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:19.547725 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3dfc8d17-b46d-4c26-ae86-f764f3de3090 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1680 microversion: 2.1 time: 0.180869 Oct 31 16:39:19.548547 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3702/7542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:19 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:20.572471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:20.573084 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:20.579987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:20.580474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:20.580914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:20.581642 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:20.582108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:20.582525 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:20.716446 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:20.724828 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c1e8dd47-c218-4393-b284-603b962bd9eb tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1683 microversion: 2.1 time: 0.156323 Oct 31 16:39:20.725450 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3841/7543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:20 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:20.819124 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-52994fd1-1145-4f2c-8481-f95b6dad0b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:20.821474 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-52994fd1-1145-4f2c-8481-f95b6dad0b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:20.828168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52994fd1-1145-4f2c-8481-f95b6dad0b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:20.828613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52994fd1-1145-4f2c-8481-f95b6dad0b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:20.829065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52994fd1-1145-4f2c-8481-f95b6dad0b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:20.829799 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52994fd1-1145-4f2c-8481-f95b6dad0b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:20.830271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52994fd1-1145-4f2c-8481-f95b6dad0b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:20.830712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-52994fd1-1145-4f2c-8481-f95b6dad0b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:20.871365 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-52994fd1-1145-4f2c-8481-f95b6dad0b83 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action" status: 200 len: 38304 microversion: 2.1 time: 0.056253 Oct 31 16:39:20.872003 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3703/7544] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:39:20 2022] POST /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea/action => generated 38304 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 31 16:39:21.847596 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:21.848137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:21.850283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-cbd40cf1-d53a-4ab7-a756-f961936021af req-a43e1485-600f-4704-a076-00fea2d356fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea", "tag": "e6f8659a-aec3-456d-96dc-0b32569f48cb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:21.855479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:21.855965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:21.856683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:21.857480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:21.858006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:21.859011 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:21.861978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cbd40cf1-d53a-4ab7-a756-f961936021af req-a43e1485-600f-4704-a076-00fea2d356fb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:21.862470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cbd40cf1-d53a-4ab7-a756-f961936021af req-a43e1485-600f-4704-a076-00fea2d356fb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:21.862904 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-cbd40cf1-d53a-4ab7-a756-f961936021af req-a43e1485-600f-4704-a076-00fea2d356fb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:21.874927 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-cbd40cf1-d53a-4ab7-a756-f961936021af req-a43e1485-600f-4704-a076-00fea2d356fb service nova] Creating event network-changed:e6f8659a-aec3-456d-96dc-0b32569f48cb for instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea on n-h2-858384-17 Oct 31 16:39:21.880191 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-cbd40cf1-d53a-4ab7-a756-f961936021af req-a43e1485-600f-4704-a076-00fea2d356fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033912 Oct 31 16:39:21.880798 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3704/7545] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:39:21.891151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:39:21.978019 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-664a556d-6474-4f5e-8f9b-9281cb3c7da5 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 204 len: 0 microversion: 2.1 time: 0.132556 Oct 31 16:39:21.981119 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3842/7546] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:39:21 2022] DELETE /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:39:21.987898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:21.988627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:21.995841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:21.996665 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:21.997508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:21.998376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:21.998922 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:22.000234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:22.144767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:22.152702 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-416ee16b-ffe4-4530-a3fb-22b885b8faef tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1689 microversion: 2.1 time: 0.170416 Oct 31 16:39:22.153440 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3705/7547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:21 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:39:23.179148 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:23.179771 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:23.186585 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:23.187078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:23.187557 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:23.188211 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:23.188671 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:23.189101 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:23.325695 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:23.334262 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b31d6939-73e6-4a04-95ab-17b2cd2f6551 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1689 microversion: 2.1 time: 0.159522 Oct 31 16:39:23.334852 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3843/7548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:23 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:24.161892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d06505da-2f3f-421c-9e51-4bf970f643d5 req-91a5b255-0b3e-4abe-996a-4a0703f113e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea", "name": "network-vif-deleted", "tag": "e6f8659a-aec3-456d-96dc-0b32569f48cb"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:24.172847 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d06505da-2f3f-421c-9e51-4bf970f643d5 req-91a5b255-0b3e-4abe-996a-4a0703f113e1 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:24.173369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d06505da-2f3f-421c-9e51-4bf970f643d5 req-91a5b255-0b3e-4abe-996a-4a0703f113e1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:24.173815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d06505da-2f3f-421c-9e51-4bf970f643d5 req-91a5b255-0b3e-4abe-996a-4a0703f113e1 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:24.185330 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d06505da-2f3f-421c-9e51-4bf970f643d5 req-91a5b255-0b3e-4abe-996a-4a0703f113e1 service nova] Creating event network-vif-deleted:e6f8659a-aec3-456d-96dc-0b32569f48cb for instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea on n-h2-858384-17 Oct 31 16:39:24.191148 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d06505da-2f3f-421c-9e51-4bf970f643d5 req-91a5b255-0b3e-4abe-996a-4a0703f113e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032928 Oct 31 16:39:24.191759 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3706/7549] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:39:24.359549 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:24.360111 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:24.366961 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:24.367448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:24.367888 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:24.368584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:24.369047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:24.369507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:24.400416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:24.400902 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:24.401372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:24.401826 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lazy-loading 'fault' on Instance uuid 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:39:24.449037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1bc5f1af2c24c8ea5544ea690ae0115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb37334ce8814f89adcd5d997f26cf31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:24.457343 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-ac29d825-5aa7-4e70-a303-4c2e39014586 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 200 len: 1357 microversion: 2.1 time: 0.102397 Oct 31 16:39:24.457931 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3844/7550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:24 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 1357 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:25.484475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:25.485389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] [instance: 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:25.491611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:25.492106 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:25.492562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:25.493298 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:25.493777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:25.494223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:25.508550 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.wsgi [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] HTTP exception thrown: Instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea could not be found. Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Request method failure captured: Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: request: GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea HTTP/1.1 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: Accept: application/json Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: Accept-Encoding: identity Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: Connection: close Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: Content-Length: 0 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: Content-Type: application/json Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: Host: 10.222.0.20 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: Openstack-System-Scope: None Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: User-Agent: python-urllib3/1.26.12 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Auth-Token: gAAAAABjX_hz3HqGqUMBA7l8WlI3urtWwde2ch7t18CBrYyVPADnk9d_jMs1F5Zadr2RhKCcp_rTzfSg5jbgfqa_f_1OzONAFeCLE4a9qoDdh_fAX3zFq24eIipwwSTMflCI8V6bJpviH1qQuXWjc6cEyxsfCOsZcrNifB3bHjhU2o2Kj-hENKs Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Id: None Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Domain-Name: None Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Identity-Status: Confirmed Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Is-Admin-Project: True Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Id: default Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Domain-Name: Default Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Role: reader,member Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Roles: reader,member Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fb37334ce8814f89adcd5d997f26cf31", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fb37334ce8814f89adcd5d997f26cf31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fb37334ce8814f89adcd5d997f26cf31"}]}] Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Id: fb37334ce8814f89adcd5d997f26cf31 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1840350138 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-User: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Id: default Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Domain-Name: Default Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Id: c1bc5f1af2c24c8ea5544ea690ae0115 Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1840350138-project Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: method: > Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: exception: Instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea could not be found. Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: action_args: {'id': '8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea'} Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea could not be found. Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea could not be found. Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:39:25.510199 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea could not be found. Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: ERROR nova.api.openstack.wsgi Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Returning 404 to user: Instance 8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea could not be found. {{(pid=120588) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7877d1b2-b9a9-47b6-a686-5846bbd70785 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea" status: 404 len: 111 microversion: 2.1 time: 0.033161 Oct 31 16:39:25.516630 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3707/7551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:25 2022] GET /compute/v2.1/servers/8f0ee05a-d0bd-41ea-a5d2-45d64f1f83ea => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:39:28.548554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-edd65e61-2627-4884-b16f-8ccdb0f37db0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] Calling method '.version_select at 0x7f16e00fd0d0>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:28.571905 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-edd65e61-2627-4884-b16f-8ccdb0f37db0 tempest-TestNetworkAdvancedServerOps-1840350138 tempest-TestNetworkAdvancedServerOps-1840350138-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1985558231" status: 202 len: 0 microversion: 2.1 time: 0.027225 Oct 31 16:39:28.572876 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3845/7552] 10.222.0.20 () {58 vars in 1284 bytes} [Mon Oct 31 16:39:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1985558231 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:39:39.552798 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=18 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:39.553598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:39.745762 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9b5cb465-2af7-4582-bbb7-d525e58f4c4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Action: 'create', calling method: .version_select at 0x7f16e55a9f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1748160917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYsAa9lV+LUW/D6aWO1XCj2wZQBsZ8P0x6GzSZxgwIz7yo2jzBdjA0Kb00F0ksLXnPGz5rpAN9ZovporvGTP+2KpUdX+FK3vWvrUFi34wbpTN88Liu0PQ9K2fB6L5SrCg=="}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:39.765416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9b5cb465-2af7-4582-bbb7-d525e58f4c4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Getting quotas for project 29acf2fd219c4534932f17ec35b17e8a. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:39:39.771252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-9b5cb465-2af7-4582-bbb7-d525e58f4c4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Getting quotas for user 03e5d4b5beb7468abf83ea98dfc54bed and project 29acf2fd219c4534932f17ec35b17e8a. Resources: {'key_pairs'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:39:39.799203 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9b5cb465-2af7-4582-bbb7-d525e58f4c4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.252819 Oct 31 16:39:39.799989 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3708/7553] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:39:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:39:40.929840 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:40.931316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:40.935486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1465211278", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1748160917", "security_groups": [{"name": "tempest-secgroup-smoke-1255257294"}], "networks": [{"uuid": "ed58b562-5e1f-4ca4-b9df-210ca897e849"}]}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:41.183871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.network.neutron [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] validate_networks() for [('ed58b562-5e1f-4ca4-b9df-210ca897e849', None, None, None, None, None)] {{(pid=120587) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:39:41.583166 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Flavor limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:39:41.583592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Image limits 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:39:41.584066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Flavor pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:39:41.584474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Image pref 0:0:0 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:39:41.584887 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.virt.hardware [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:39:41.596620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:41.597114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:41.597820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:41.598781 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:41.599482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:41.599944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:41.619287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Getting quotas for project 29acf2fd219c4534932f17ec35b17e8a. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:39:41.625336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Getting quotas for user 03e5d4b5beb7468abf83ea98dfc54bed and project 29acf2fd219c4534932f17ec35b17e8a. Resources: {'cores', 'instances', 'ram'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:39:41.638639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Going to run 1 instances... {{(pid=120587) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:39:41.640989 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:39:41.690172 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5c5b6bf7-3d92-479e-bea9-b2ee6eb8e985 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762164 Oct 31 16:39:41.690999 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3846/7554] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:39:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:39:41.703889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-88f592c9-96af-4cfd-b293-d09e082eddd3 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:41.704415 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-88f592c9-96af-4cfd-b293-d09e082eddd3 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:41.880729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-88f592c9-96af-4cfd-b293-d09e082eddd3 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:41.888681 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-88f592c9-96af-4cfd-b293-d09e082eddd3 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1247 microversion: 2.1 time: 0.190120 Oct 31 16:39:41.901164 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3709/7555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:41 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1247 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:42.914957 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:42.915712 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:42.924407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:42.924955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:42.925453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:42.926296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:42.926854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:42.927376 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:43.019666 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:43.030120 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-05c76743-e63e-4361-b4f8-0bdf8eac4a05 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1299 microversion: 2.1 time: 0.120102 Oct 31 16:39:43.030760 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3847/7556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:42 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:44.055151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:44.055854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:44.066586 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:44.067431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:44.067949 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:44.068739 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:44.069420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:44.070030 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:44.301880 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:44.311128 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f53260bc-3740-4ff1-a9d8-af40403b2ac8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1373 microversion: 2.1 time: 0.260090 Oct 31 16:39:44.312382 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3710/7557] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:44 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1373 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:44.977760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3e836cd9-1a90-4ebb-beb4-2023b4d48c07 req-1d294cb7-80d2-4dc2-8a70-ab8845187f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ade863-9161-4f5e-b262-469c525e8ae1", "tag": "6e1f7d0b-03af-4964-8f29-fbfe76a67cc9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:45.003275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e836cd9-1a90-4ebb-beb4-2023b4d48c07 req-1d294cb7-80d2-4dc2-8a70-ab8845187f95 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:45.003758 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e836cd9-1a90-4ebb-beb4-2023b4d48c07 req-1d294cb7-80d2-4dc2-8a70-ab8845187f95 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:45.004188 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e836cd9-1a90-4ebb-beb4-2023b4d48c07 req-1d294cb7-80d2-4dc2-8a70-ab8845187f95 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:45.021085 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3e836cd9-1a90-4ebb-beb4-2023b4d48c07 req-1d294cb7-80d2-4dc2-8a70-ab8845187f95 service nova] Creating event network-changed:6e1f7d0b-03af-4964-8f29-fbfe76a67cc9 for instance a3ade863-9161-4f5e-b262-469c525e8ae1 on n-h2-858384-17 Oct 31 16:39:45.026853 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3e836cd9-1a90-4ebb-beb4-2023b4d48c07 req-1d294cb7-80d2-4dc2-8a70-ab8845187f95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055262 Oct 31 16:39:45.031612 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3848/7558] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:39:45.334598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:45.335735 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:45.344630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:45.345529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:45.346485 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:45.347555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:45.348324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:45.348616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:45.534908 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:45.543129 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03909d19-2eb9-4ac7-85ff-7af2f5aafbc2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1373 microversion: 2.1 time: 0.212219 Oct 31 16:39:45.543721 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3711/7559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:45 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1373 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:46.567976 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:46.568680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:46.575382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:46.575996 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:46.576540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:46.577934 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:46.578517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:46.579356 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:46.713442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:46.722593 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-14049786-5244-41db-aef8-1bcab74f415f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1373 microversion: 2.1 time: 0.159886 Oct 31 16:39:46.723188 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3849/7560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:46 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:47.746234 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:47.746864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:47.753733 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:47.754230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:47.754677 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:47.755376 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:47.755846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:47.756311 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:47.892687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:47.900316 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e974c707-573b-4059-9b2c-93f785300a67 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1373 microversion: 2.1 time: 0.157988 Oct 31 16:39:47.900897 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3712/7561] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:47 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:48.924152 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:48.924693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:48.931556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:48.932043 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:48.932481 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:48.933200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:48.933661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:48.934088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:49.074118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:49.082636 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f9c79aa5-be72-4389-a15f-d1bc51d9ac60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1373 microversion: 2.1 time: 0.162964 Oct 31 16:39:49.083236 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3850/7562] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:48 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:50.106622 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:50.107309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:50.115536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:50.116033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:50.116476 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:50.117198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:50.117666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:50.118099 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:50.248988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:50.256624 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-45c30bbd-bbe3-45b5-b2dd-fd7df69cc436 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1373 microversion: 2.1 time: 0.154206 Oct 31 16:39:50.257222 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3713/7563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:50 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:51.279968 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:51.280706 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:51.288169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:51.288658 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:51.289098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:51.289831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:51.290292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:51.290721 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:51.316742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-e5056b33-d89e-4f9f-9e0b-e61a071a870e req-5980a4a1-d87f-4360-afa1-ba1d065bbbbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ade863-9161-4f5e-b262-469c525e8ae1", "name": "network-vif-plugged", "status": "completed", "tag": "6e1f7d0b-03af-4964-8f29-fbfe76a67cc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:51.327600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e5056b33-d89e-4f9f-9e0b-e61a071a870e req-5980a4a1-d87f-4360-afa1-ba1d065bbbbf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:51.328218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e5056b33-d89e-4f9f-9e0b-e61a071a870e req-5980a4a1-d87f-4360-afa1-ba1d065bbbbf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:51.328964 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-e5056b33-d89e-4f9f-9e0b-e61a071a870e req-5980a4a1-d87f-4360-afa1-ba1d065bbbbf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:51.344675 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-e5056b33-d89e-4f9f-9e0b-e61a071a870e req-5980a4a1-d87f-4360-afa1-ba1d065bbbbf service nova] Creating event network-vif-plugged:6e1f7d0b-03af-4964-8f29-fbfe76a67cc9 for instance a3ade863-9161-4f5e-b262-469c525e8ae1 on n-h2-858384-17 Oct 31 16:39:51.350733 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-e5056b33-d89e-4f9f-9e0b-e61a071a870e req-5980a4a1-d87f-4360-afa1-ba1d065bbbbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037750 Oct 31 16:39:51.352427 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3714/7564] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:39:51.441688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:51.449664 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d33d45cf-6d67-4209-8439-d053d632eaa4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1373 microversion: 2.1 time: 0.173627 Oct 31 16:39:51.450258 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3851/7565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:51 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:52.470695 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:52.475969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:52.476619 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:52.483368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:52.483858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:52.484819 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:52.485616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:52.486083 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:52.486518 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:52.623939 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:52.632431 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9ac703e-fbc1-4cd2-95e7-3a63ed036b60 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1373 microversion: 2.1 time: 0.162721 Oct 31 16:39:52.633014 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3715/7566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:52 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:53.656661 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:53.657343 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:53.659333 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:53.660009 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:39:53.666727 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:53.667216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:53.667656 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:53.668354 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:53.668816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:53.669299 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:53.803531 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:53.811342 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fd2ee6f0-dd86-4562-8f32-01063b2f127b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1556 microversion: 2.1 time: 0.159244 Oct 31 16:39:53.811922 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3852/7567] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:53 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:53.834574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:39:53.835194 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:39:53.842950 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:53.843441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:53.843936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:53.844815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:53.845321 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:53.845757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:53.980035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:39:53.988590 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0366dcdd-c430-4f33-9f97-bd18693e8ccc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1556 microversion: 2.1 time: 0.157836 Oct 31 16:39:53.989198 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3716/7568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:39:53 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:39:55.609806 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9ef4e304-4958-443a-92dc-05fc4c3cc151 req-523bf326-1ada-4a9d-ace7-36a07ff3cd05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ade863-9161-4f5e-b262-469c525e8ae1", "tag": "6e1f7d0b-03af-4964-8f29-fbfe76a67cc9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:39:55.620134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9ef4e304-4958-443a-92dc-05fc4c3cc151 req-523bf326-1ada-4a9d-ace7-36a07ff3cd05 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:39:55.620691 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9ef4e304-4958-443a-92dc-05fc4c3cc151 req-523bf326-1ada-4a9d-ace7-36a07ff3cd05 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:39:55.621155 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9ef4e304-4958-443a-92dc-05fc4c3cc151 req-523bf326-1ada-4a9d-ace7-36a07ff3cd05 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:39:55.632926 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9ef4e304-4958-443a-92dc-05fc4c3cc151 req-523bf326-1ada-4a9d-ace7-36a07ff3cd05 service nova] Creating event network-changed:6e1f7d0b-03af-4964-8f29-fbfe76a67cc9 for instance a3ade863-9161-4f5e-b262-469c525e8ae1 on n-h2-858384-17 Oct 31 16:39:55.638042 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9ef4e304-4958-443a-92dc-05fc4c3cc151 req-523bf326-1ada-4a9d-ace7-36a07ff3cd05 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032475 Oct 31 16:39:55.638887 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3853/7569] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:41:51.538724 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:41:51.539339 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:41:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1/action (ip 10.222.0.20) !!! Oct 31 16:41:51.539976 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:51.540828 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=38 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:51.544802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:41:51.545373 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:51.554682 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:51.555180 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:51.555631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:51.556334 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:51.556810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:51.557398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:51.582067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lazy-loading 'flavor' on Instance uuid a3ade863-9161-4f5e-b262-469c525e8ae1 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:41:51.767831 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-950a8a8f-f39a-449f-a70d-d1ba12fddb91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "POST /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1/action" status: 202 len: 0 microversion: 2.1 time: 0.231677 Oct 31 16:41:51.768443 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3717/7570] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:41:51 2022] POST /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:41:51.775607 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:41:51.777711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:51.778447 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=36 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:41:51.784219 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:51.784924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:51.793659 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:51.794417 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:51.794852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:51.795554 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:51.796018 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:51.796441 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:51.933573 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:51.941332 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6dcfdef2-11d8-4043-ba24-e04387ec38a9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.167876 Oct 31 16:41:51.942446 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3854/7571] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:51 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:52.968542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:52.969223 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:52.977149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:52.977663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:52.978114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:52.979130 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:52.979602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:52.980065 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:53.116452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:53.124212 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-03c73322-d606-4079-8ac8-2c8a837e6bb4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.161013 Oct 31 16:41:53.124799 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3718/7572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:52 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:54.147984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:54.148575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:54.159199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:54.159683 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:54.160122 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:54.160814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:54.162016 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:54.162581 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:54.168695 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56000. Oct 31 16:41:54.295501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:54.303935 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-37082390-1d07-49c5-aaae-2964af5753dc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.160305 Oct 31 16:41:54.304516 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3855/7573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:54 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:55.327710 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:55.328346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:55.335017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:55.335536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:55.335991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:55.336712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:55.337213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:55.337663 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:55.468961 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:55.476960 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2bc0d729-1cdd-46ed-a73c-aa0710fb89e9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.153440 Oct 31 16:41:55.477579 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3719/7574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:55 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:56.500751 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:56.501410 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:56.508496 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:56.508982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:56.509450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:56.510146 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:56.510609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:56.511034 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:56.646632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:56.654386 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c7228646-71d3-4e0d-8389-18f020ac949d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.157715 Oct 31 16:41:56.654970 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3856/7575] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:56 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:57.678187 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:57.678767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:57.685631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:57.686126 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:57.686579 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:57.687273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:57.687765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:57.688196 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:57.821258 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:57.828942 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a6fa7c4d-a55f-4a0d-86b6-24dfa90c32d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.154800 Oct 31 16:41:57.829580 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3720/7576] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:57 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:41:58.855442 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:41:58.855975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:41:58.862805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:58.863290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:58.863975 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:58.864497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:41:58.865946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:41:58.866536 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:41:58.999125 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:41:59.007369 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b1f497e7-c8ee-4216-8db3-b3963a67ed0e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.156187 Oct 31 16:41:59.007950 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3857/7577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:41:58 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:00.031054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:00.031719 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:00.038765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:00.039271 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:00.039731 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:00.040439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:00.040917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:00.041395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:00.174859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:00.183835 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-fa6b7673-4b29-4e98-aa69-48199c490329 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.156756 Oct 31 16:42:00.184424 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3721/7578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:00 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:01.207620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:01.208900 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:01.215893 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:01.216372 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:01.216801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:01.217515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:01.217966 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:01.218387 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:01.357313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:01.365913 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-68c3e2ea-48f9-4df4-b0b7-a2d046e3c3c2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.162171 Oct 31 16:42:01.366699 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3858/7579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:01 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:02.389980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:02.390598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:02.398265 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:02.398775 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:02.399233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:02.399969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:02.400503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:02.400952 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:02.534141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:02.541992 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-388789fd-739d-4fa8-bda4-b11288147145 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1701 microversion: 2.1 time: 0.155928 Oct 31 16:42:02.542588 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3722/7580] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:02 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:03.567314 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:03.568053 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:03.574963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:03.575451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:03.575886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:03.576583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:03.577039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:03.577511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:03.707610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:03.716319 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b98c6ce5-ef0a-4738-ace9-993b63f5ccd1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1701 microversion: 2.1 time: 0.152936 Oct 31 16:42:03.716898 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3859/7581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:03 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:04.741238 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:04.741892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:04.749205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:04.749702 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:04.750146 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:04.750855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:04.751508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:04.751742 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:04.904834 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:04.912927 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-81d1459a-b76a-4afc-aa03-d19755f3443e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1696 microversion: 2.1 time: 0.176300 Oct 31 16:42:04.913846 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3723/7582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:04 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:05.939986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:05.942928 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:05.963999 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:05.964484 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:05.964946 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:05.965682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:05.966137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:05.966591 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:06.144301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:06.153862 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-74de9e26-dc5c-4016-8323-a9614629221d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1696 microversion: 2.1 time: 0.220268 Oct 31 16:42:06.154790 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3860/7583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:05 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1696 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:06.163912 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-2296bc74-744b-417d-8831-d04098906b4b req-894ae4e9-f5c4-4391-8e44-fd1f5b0c0967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ade863-9161-4f5e-b262-469c525e8ae1", "name": "network-vif-plugged", "status": "completed", "tag": "6e1f7d0b-03af-4964-8f29-fbfe76a67cc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:42:06.180043 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2296bc74-744b-417d-8831-d04098906b4b req-894ae4e9-f5c4-4391-8e44-fd1f5b0c0967 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:06.180810 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2296bc74-744b-417d-8831-d04098906b4b req-894ae4e9-f5c4-4391-8e44-fd1f5b0c0967 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:06.181467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-2296bc74-744b-417d-8831-d04098906b4b req-894ae4e9-f5c4-4391-8e44-fd1f5b0c0967 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:06.197885 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-2296bc74-744b-417d-8831-d04098906b4b req-894ae4e9-f5c4-4391-8e44-fd1f5b0c0967 service nova] Creating event network-vif-plugged:6e1f7d0b-03af-4964-8f29-fbfe76a67cc9 for instance a3ade863-9161-4f5e-b262-469c525e8ae1 on n-h2-858384-17 Oct 31 16:42:06.203518 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-2296bc74-744b-417d-8831-d04098906b4b req-894ae4e9-f5c4-4391-8e44-fd1f5b0c0967 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044545 Oct 31 16:42:06.204300 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3724/7584] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:42:07.180998 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:07.181829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:07.188987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:07.189568 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:07.190229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:07.191168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:07.191623 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:07.192248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:07.340876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:07.349215 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-463fc521-da6d-4ad2-8222-8a1449f0a650 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1696 microversion: 2.1 time: 0.173594 Oct 31 16:42:07.349820 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3861/7585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:07 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:08.376720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:08.377673 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:08.384738 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:08.385281 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:08.386033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:08.387074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:08.387684 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:08.388195 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:08.541528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:08.550172 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5ddbaaea-df86-49e1-8763-60d33ff60359 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1696 microversion: 2.1 time: 0.178591 Oct 31 16:42:08.551147 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3725/7586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:08 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:09.581476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:09.582173 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:09.590539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:09.590539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:09.590539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:09.590939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:09.591305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:09.591986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:09.735013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:09.743532 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a96c3298-a197-4b67-b11a-7ac81a7245ab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1696 microversion: 2.1 time: 0.166100 Oct 31 16:42:09.757314 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3862/7587] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:09 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:10.767782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:10.768526 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:10.776148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:10.776801 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:10.777245 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:10.777996 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:10.778651 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:10.779054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:10.930346 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:10.940931 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ccef4d11-5897-4eb4-a967-755eefbd6c82 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1696 microversion: 2.1 time: 0.177251 Oct 31 16:42:10.941764 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3726/7588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:10 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:11.965805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:11.966353 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:11.973316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:11.973828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:11.974918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:11.977075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:11.977075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:11.977075 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:12.147919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:12.156027 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-2f4c6252-f483-4190-a287-1ca5c8841c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1696 microversion: 2.1 time: 0.194352 Oct 31 16:42:12.165178 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3863/7589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:11 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:42:13.181024 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:13.181855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:13.189634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:13.190219 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:13.190743 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:13.191530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:13.192078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:13.192668 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:13.338137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:13.346066 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-bdd0945d-59e3-4f7f-a2d3-520ef716c5ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1696 microversion: 2.1 time: 0.170150 Oct 31 16:42:13.346658 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3727/7590] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:13 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:14.370425 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:14.371030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:14.377983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:14.378471 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:14.378903 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:14.379599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:14.380069 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:14.381251 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:14.515194 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:14.523182 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b4243991-445b-4aa0-a5b4-439a0e1c02bf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1678 microversion: 2.1 time: 0.156635 Oct 31 16:42:14.523979 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3864/7591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:14 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:15.547338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:15.547965 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:15.555352 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:15.555855 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:15.556312 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:15.557023 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:15.557528 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:15.557977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:15.695278 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:15.702965 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3c091df1-256d-475d-85f7-2162217fac91 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1678 microversion: 2.1 time: 0.159562 Oct 31 16:42:15.703553 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3728/7592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:15 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:16.726510 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:16.727116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:16.734204 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:16.734688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:16.735128 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:16.735818 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:16.736357 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:16.736792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:16.870881 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:16.878590 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6ea58d61-9b8a-4df9-945d-8b740ba8ae97 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1681 microversion: 2.1 time: 0.156272 Oct 31 16:42:16.879259 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3865/7593] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:16 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:16.903991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:42:16.904593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:16.911395 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:16.911886 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:16.912323 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:16.913015 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:16.913509 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:16.913942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:17.002793 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120588) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 16:42:17.075423 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a81d8c7d-4cc3-4122-a377-4dd827b80e52 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "POST /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1/action" status: 202 len: 0 microversion: 2.1 time: 0.175243 Oct 31 16:42:17.079167 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3729/7594] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:42:16 2022] POST /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:42:17.085931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:17.086541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:17.092792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:17.093317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:17.093752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:17.094440 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:17.094955 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:17.095305 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:17.231908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:17.240599 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-88d0d246-6758-47ad-b35e-f813e2a92ad1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1629 microversion: 2.1 time: 0.159733 Oct 31 16:42:17.241310 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3866/7595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:17 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1629 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:18.121782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a78b2409-fc49-466d-bf44-58b015a4fd9c req-dd89c08c-e9c3-4ac5-bd90-79279a367c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ade863-9161-4f5e-b262-469c525e8ae1", "name": "network-vif-unplugged", "status": "completed", "tag": "6e1f7d0b-03af-4964-8f29-fbfe76a67cc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:42:18.132525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a78b2409-fc49-466d-bf44-58b015a4fd9c req-dd89c08c-e9c3-4ac5-bd90-79279a367c1f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:18.132990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a78b2409-fc49-466d-bf44-58b015a4fd9c req-dd89c08c-e9c3-4ac5-bd90-79279a367c1f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:18.133727 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a78b2409-fc49-466d-bf44-58b015a4fd9c req-dd89c08c-e9c3-4ac5-bd90-79279a367c1f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:18.145452 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a78b2409-fc49-466d-bf44-58b015a4fd9c req-dd89c08c-e9c3-4ac5-bd90-79279a367c1f service nova] Creating event network-vif-unplugged:6e1f7d0b-03af-4964-8f29-fbfe76a67cc9 for instance a3ade863-9161-4f5e-b262-469c525e8ae1 on n-h1-858384-17 Oct 31 16:42:18.151721 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a78b2409-fc49-466d-bf44-58b015a4fd9c req-dd89c08c-e9c3-4ac5-bd90-79279a367c1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033580 Oct 31 16:42:18.152540 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3730/7596] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:42:18.265139 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:18.265761 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:18.273275 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:18.273759 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:18.274187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:18.274878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:18.275325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:18.275744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:18.423929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:18.432857 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c979f79-3654-4341-a848-0053e317947b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.171730 Oct 31 16:42:18.433724 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3867/7597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:18 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:19.290974 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3634416b-0f04-48fe-91a4-4b561290ffa5 req-9ae5c37e-caaa-464c-9687-91dcd5fc347f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ade863-9161-4f5e-b262-469c525e8ae1", "tag": "6e1f7d0b-03af-4964-8f29-fbfe76a67cc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:42:19.301011 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3634416b-0f04-48fe-91a4-4b561290ffa5 req-9ae5c37e-caaa-464c-9687-91dcd5fc347f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:19.301541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3634416b-0f04-48fe-91a4-4b561290ffa5 req-9ae5c37e-caaa-464c-9687-91dcd5fc347f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:19.302531 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3634416b-0f04-48fe-91a4-4b561290ffa5 req-9ae5c37e-caaa-464c-9687-91dcd5fc347f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:19.314904 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3634416b-0f04-48fe-91a4-4b561290ffa5 req-9ae5c37e-caaa-464c-9687-91dcd5fc347f service nova] Creating event network-changed:6e1f7d0b-03af-4964-8f29-fbfe76a67cc9 for instance a3ade863-9161-4f5e-b262-469c525e8ae1 on n-h1-858384-17 Oct 31 16:42:19.321527 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3634416b-0f04-48fe-91a4-4b561290ffa5 req-9ae5c37e-caaa-464c-9687-91dcd5fc347f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094303 Oct 31 16:42:19.322275 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3731/7598] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:42:19.459908 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:19.460537 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:19.467366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:19.467844 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:19.468284 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:19.468974 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:19.469453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:19.469871 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:19.604269 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:19.612411 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-43346715-b584-43b1-a4b3-4f8fccd667ed tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.156618 Oct 31 16:42:19.613082 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3868/7599] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:19 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:20.640040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:20.641765 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:20.652747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:20.653359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:20.653811 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:20.654524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:20.655002 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:20.655429 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:20.674574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:20.798703 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:20.808397 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d995ec89-fe0c-448c-95d1-26c4171dfe4d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.173619 Oct 31 16:42:20.809329 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3732/7600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:20 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:21.834216 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:21.834868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:21.837650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=31 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:21.843222 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:21.843719 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:21.844161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:21.844876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:21.845361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:21.845787 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:21.850061 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=91 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:22.011169 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:22.022127 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e0e90ee2-d024-4f6e-b0da-bab33e6f694f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.191469 Oct 31 16:42:22.023332 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3869/7601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:21 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:23.047411 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:23.049044 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:23.052833 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:42:23.058593 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:23.059392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:23.060213 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:23.061480 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:23.062243 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:23.062927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:23.218441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:23.226267 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0c8f01ff-a583-49c7-83d4-add808d24dc0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.184096 Oct 31 16:42:23.227042 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3733/7602] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:23 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:24.250650 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:24.251289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:24.258778 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:24.259266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:24.259704 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:24.260399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:24.260859 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:24.261317 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:24.404876 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:24.413223 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-15beaec7-d907-4faf-8f10-f11a2c04371b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.166537 Oct 31 16:42:24.413813 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3870/7603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:24 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:25.438779 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:25.439701 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:25.447501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:25.448005 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:25.448458 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:25.449199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:25.449744 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:25.450174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:25.604523 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:25.613607 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5898d114-221c-40e1-b79b-7d3ced6b26f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.179534 Oct 31 16:42:25.614325 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3734/7604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:25 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:26.639899 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:26.640547 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:26.648191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:26.648688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:26.649145 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:26.649853 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:26.652450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:26.652931 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:26.829281 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:26.839457 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-89aa5da9-403a-46bd-98f7-d2895cb3ce5c tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.203839 Oct 31 16:42:26.840569 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3871/7605] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:26 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:27.863918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:27.865452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:27.872769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:27.873303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:27.874582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:27.874582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:27.875295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:27.875432 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:28.119262 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:28.129823 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9e1f1ad6-224e-4113-b053-8c3f62970c38 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.269597 Oct 31 16:42:28.131342 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3735/7606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:27 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:42:29.155382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:29.155962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:29.162923 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:29.163397 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:29.163828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:29.164517 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:29.164970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:29.165538 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:29.296243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:29.304430 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d1731362-70fa-4b07-a891-9b2beee50bef tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.153045 Oct 31 16:42:29.305010 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3872/7607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:29 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:30.327990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:30.328613 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:30.336285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:30.336791 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:30.337275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:30.337988 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:30.338460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:30.338902 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:30.477730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:30.485647 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-9341450d-cb7b-4dea-b3dc-8268b382ede1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.161621 Oct 31 16:42:30.486232 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3736/7608] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:30 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:31.509670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:31.510276 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:31.517271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:31.517753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:31.518189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:31.518877 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:31.519332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:31.519753 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:31.651013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:31.658791 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-41b11205-e0f4-43f1-9681-71785830a968 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.153987 Oct 31 16:42:31.659363 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3873/7609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:31 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:32.683558 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:32.684097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:32.690914 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:32.691404 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:32.691846 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:32.692539 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:32.693670 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:32.694149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:32.825646 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:32.833368 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-b30ec4b0-9655-4189-9466-8a0327279b1f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.153811 Oct 31 16:42:32.834120 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3737/7610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:32 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:42:33.856714 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:33.857355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:33.864613 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:33.865359 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:33.865823 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:33.866520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:33.866984 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:33.867413 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:34.001821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:34.010111 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a3380d70-8bfe-496d-a20e-4a1a68523184 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.157580 Oct 31 16:42:34.010695 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3874/7611] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:33 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:34.193521 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-c40d5524-516e-4a68-b378-a4bd870f9005 req-1b6900cb-70c9-449b-a41d-08bf1a4280b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ade863-9161-4f5e-b262-469c525e8ae1", "name": "network-vif-plugged", "status": "completed", "tag": "6e1f7d0b-03af-4964-8f29-fbfe76a67cc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:42:34.205160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c40d5524-516e-4a68-b378-a4bd870f9005 req-1b6900cb-70c9-449b-a41d-08bf1a4280b3 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:34.205661 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c40d5524-516e-4a68-b378-a4bd870f9005 req-1b6900cb-70c9-449b-a41d-08bf1a4280b3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:34.207300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-c40d5524-516e-4a68-b378-a4bd870f9005 req-1b6900cb-70c9-449b-a41d-08bf1a4280b3 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:34.218010 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-c40d5524-516e-4a68-b378-a4bd870f9005 req-1b6900cb-70c9-449b-a41d-08bf1a4280b3 service nova] Creating event network-vif-plugged:6e1f7d0b-03af-4964-8f29-fbfe76a67cc9 for instance a3ade863-9161-4f5e-b262-469c525e8ae1 on n-h1-858384-17 Oct 31 16:42:34.223067 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-c40d5524-516e-4a68-b378-a4bd870f9005 req-1b6900cb-70c9-449b-a41d-08bf1a4280b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034059 Oct 31 16:42:34.223733 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3738/7612] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:42:35.034801 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:35.035419 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:35.042480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:35.042950 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:35.043389 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:35.044086 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:35.044550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:35.044980 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:35.179606 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:35.187504 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-fc38a247-044b-4183-b0b3-3b330180ffd6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1687 microversion: 2.1 time: 0.156724 Oct 31 16:42:35.188092 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3875/7613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:35 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:42:36.214127 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:42:36.214881 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:42:36.221141 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:36.221655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:36.222111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:36.222817 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:42:36.223296 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:42:36.223737 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:42:36.359683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:42:36.368382 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-97683bac-0348-49ed-8013-226c3ac2be74 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1674 microversion: 2.1 time: 0.160233 Oct 31 16:42:36.368972 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3739/7614] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:42:36 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:46.627624 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:46.628187 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:46.630191 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-6ae0db0a-84ab-47ab-8700-8ee4a4379f71 req-a33a5b59-9ebb-4933-b887-350bfdcb005d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ade863-9161-4f5e-b262-469c525e8ae1", "tag": "6e1f7d0b-03af-4964-8f29-fbfe76a67cc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:43:46.630752 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=13 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:46.631424 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=41 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:46.632348 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:43:46.632496 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:43:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 (ip 10.222.0.20) !!! Oct 31 16:43:46.637478 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=13 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:46.638530 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=40 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:43:46.639905 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:43:46.640038 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:43:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 31 16:43:46.643629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:46.644199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:46.644636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:46.646057 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:46.646539 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:46.647168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:46.650356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6ae0db0a-84ab-47ab-8700-8ee4a4379f71 req-a33a5b59-9ebb-4933-b887-350bfdcb005d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:46.651582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6ae0db0a-84ab-47ab-8700-8ee4a4379f71 req-a33a5b59-9ebb-4933-b887-350bfdcb005d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:46.652033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-6ae0db0a-84ab-47ab-8700-8ee4a4379f71 req-a33a5b59-9ebb-4933-b887-350bfdcb005d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:46.664150 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-6ae0db0a-84ab-47ab-8700-8ee4a4379f71 req-a33a5b59-9ebb-4933-b887-350bfdcb005d service nova] Creating event network-changed:6e1f7d0b-03af-4964-8f29-fbfe76a67cc9 for instance a3ade863-9161-4f5e-b262-469c525e8ae1 on n-h1-858384-17 Oct 31 16:43:46.669887 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-6ae0db0a-84ab-47ab-8700-8ee4a4379f71 req-a33a5b59-9ebb-4933-b887-350bfdcb005d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044529 Oct 31 16:43:46.670928 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3740/7615] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:43:46.683542 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Going to try to terminate instance {{(pid=120587) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:43:46.774386 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f3602f76-fc71-4afe-b3fb-4b6ea24bad06 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 204 len: 0 microversion: 2.1 time: 0.151486 Oct 31 16:43:46.775585 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3876/7616] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:43:46 2022] DELETE /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:43:46.786293 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:46.787295 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:46.793911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:46.794643 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:46.795284 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:46.796204 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:46.796854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:46.797503 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:46.951769 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:46.959872 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4b1d7553-85ca-4277-9c26-a427208de69b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.178748 Oct 31 16:43:46.960473 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3741/7617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:46 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:47.985845 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:47.986493 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:47.995725 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:47.996233 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:47.996651 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:47.997381 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:47.997839 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:47.998265 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:48.501763 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:43:48.509451 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a9d6b382-dbab-4ae6-9b32-07949aa0ed32 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 200 len: 1680 microversion: 2.1 time: 0.528071 Oct 31 16:43:48.510855 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3877/7618] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:47 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 1680 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:43:48.908802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-b3093943-3a73-4651-8fda-fccc13bbaa97 req-4dbc789f-fb76-4964-ad43-9b7ab4fa8f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ade863-9161-4f5e-b262-469c525e8ae1", "name": "network-vif-deleted", "tag": "6e1f7d0b-03af-4964-8f29-fbfe76a67cc9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:43:48.918955 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b3093943-3a73-4651-8fda-fccc13bbaa97 req-4dbc789f-fb76-4964-ad43-9b7ab4fa8f46 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:48.919573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b3093943-3a73-4651-8fda-fccc13bbaa97 req-4dbc789f-fb76-4964-ad43-9b7ab4fa8f46 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:48.920419 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-b3093943-3a73-4651-8fda-fccc13bbaa97 req-4dbc789f-fb76-4964-ad43-9b7ab4fa8f46 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:48.932531 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-b3093943-3a73-4651-8fda-fccc13bbaa97 req-4dbc789f-fb76-4964-ad43-9b7ab4fa8f46 service nova] Creating event network-vif-deleted:6e1f7d0b-03af-4964-8f29-fbfe76a67cc9 for instance a3ade863-9161-4f5e-b262-469c525e8ae1 on n-h1-858384-17 Oct 31 16:43:48.938122 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-b3093943-3a73-4651-8fda-fccc13bbaa97 req-4dbc789f-fb76-4964-ad43-9b7ab4fa8f46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095305 Oct 31 16:43:48.938785 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3742/7619] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:43:49.534402 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:49.535017 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: a3ade863-9161-4f5e-b262-469c525e8ae1] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:43:49.542745 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:49.543237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:49.543676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:49.544371 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:43:49.544831 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:43:49.545289 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:43:49.558998 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] HTTP exception thrown: Instance a3ade863-9161-4f5e-b262-469c525e8ae1 could not be found. Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Request method failure captured: Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 HTTP/1.1 Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_pGwFwHCJP3G92MPiYciRtyyBxZHZOM_fo-6Dv1eSvDdF7LCkqMWRVw4laFx0mvJq7YgDhdvDUjMe_LXZfP3NO8wQkR6BZFi5rwmNv1_SZwqzn5pE3-xfZwyyag9v3L144BMwLNtrxOu0d8AsRvduSeUek-e-iEPAPcrB1x2KEUKaM Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 29acf2fd219c4534932f17ec35b17e8a Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestShelveInstance-1058389335 Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29acf2fd219c4534932f17ec35b17e8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29acf2fd219c4534932f17ec35b17e8a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29acf2fd219c4534932f17ec35b17e8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29acf2fd219c4534932f17ec35b17e8a"}]}] Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestShelveInstance-1058389335 Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 29acf2fd219c4534932f17ec35b17e8a Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestShelveInstance-1058389335 Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestShelveInstance-1058389335-project Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 03e5d4b5beb7468abf83ea98dfc54bed Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestShelveInstance-1058389335-project Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance a3ade863-9161-4f5e-b262-469c525e8ae1 could not be found. Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'a3ade863-9161-4f5e-b262-469c525e8ae1'} Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ade863-9161-4f5e-b262-469c525e8ae1 could not be found. Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ade863-9161-4f5e-b262-469c525e8ae1 could not be found. Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:43:49.560669 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ade863-9161-4f5e-b262-469c525e8ae1 could not be found. Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Returning 404 to user: Instance a3ade863-9161-4f5e-b262-469c525e8ae1 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f895980-22f5-4a69-a75f-2514dba4f54b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1" status: 404 len: 111 microversion: 2.1 time: 0.031648 Oct 31 16:43:49.566267 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3878/7620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:43:49 2022] GET /compute/v2.1/servers/a3ade863-9161-4f5e-b262-469c525e8ae1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:43:49.723504 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-dee662bf-de62-4ecb-9fe2-860d9e92f0e2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '.version_select at 0x7f16e0e4da60>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:43:49.748508 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-dee662bf-de62-4ecb-9fe2-860d9e92f0e2 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1748160917" status: 202 len: 0 microversion: 2.1 time: 0.029356 Oct 31 16:43:49.749157 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3743/7621] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Oct 31 16:43:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1748160917 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:43:49.771455 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-29b660a4-905d-4968-9bb0-e6317ee70086 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Action: 'create', calling method: .version_select at 0x7f16e2c660d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1222551160", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInl8QABftXqzdvoIa544jOvXjGS/QCpjErkQWixtUacFcWmHsRc0ks9ec0ixY5oa01oJOy2MkA531VRccbRC0qZUA2URWw5qyG6AM2hu2qWnwjpkkUuHvqpTK+x9mnRqA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:43:49.787458 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-29b660a4-905d-4968-9bb0-e6317ee70086 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Getting quotas for project 29acf2fd219c4534932f17ec35b17e8a. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:43:49.792927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-29b660a4-905d-4968-9bb0-e6317ee70086 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Getting quotas for user 03e5d4b5beb7468abf83ea98dfc54bed and project 29acf2fd219c4534932f17ec35b17e8a. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:43:49.815318 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-29b660a4-905d-4968-9bb0-e6317ee70086 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.047841 Oct 31 16:43:49.815924 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3879/7622] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:43:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:44:05.966426 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=10 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:05.967374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:05.971642 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1930057458", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1222551160", "security_groups": [{"name": "tempest-secgroup-smoke-207881881"}], "networks": [{"uuid": "ed58b562-5e1f-4ca4-b9df-210ca897e849"}], "block_device_mapping_v2": [{"uuid": "232cfacd-cd26-48f1-bc10-1e80cec9f69d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:06.089709 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] validate_networks() for [('ed58b562-5e1f-4ca4-b9df-210ca897e849', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:44:06.801605 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:44:06.802050 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:44:06.802545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:44:06.802980 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:44:06.803409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:44:06.812557 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:06.813055 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:06.813541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:06.814283 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:06.814756 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:06.815198 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:06.836275 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Getting quotas for project 29acf2fd219c4534932f17ec35b17e8a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:44:06.841439 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Getting quotas for user 03e5d4b5beb7468abf83ea98dfc54bed and project 29acf2fd219c4534932f17ec35b17e8a. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:44:06.901056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:44:06.903338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='232cfacd-cd26-48f1-bc10-1e80cec9f69d',volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:44:07.028647 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-89044b53-4e21-4d3f-822e-fbfe4c2cd719 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.064039 Oct 31 16:44:07.029635 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3744/7623] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:44:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:44:07.039497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:07.040272 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=4 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:07.041005 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:07.046878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-78ef6a2a-02df-4b90-be72-75b36ea60c83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:07.047676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-78ef6a2a-02df-4b90-be72-75b36ea60c83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:07.107060 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-78ef6a2a-02df-4b90-be72-75b36ea60c83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:07.116197 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-78ef6a2a-02df-4b90-be72-75b36ea60c83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1089 microversion: 2.1 time: 0.078619 Oct 31 16:44:07.116857 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3880/7624] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:07 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1089 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:08.139864 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:08.140508 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:08.148759 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:08.149300 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:08.149764 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:08.150488 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:08.150969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:08.151414 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:08.226356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:08.235122 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-10146328-a3dc-4653-88d0-2ecd42b2c8d7 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1205 microversion: 2.1 time: 0.099097 Oct 31 16:44:08.236148 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3745/7625] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:08 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:09.258824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:09.259861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:09.267909 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:09.268532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:09.269263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:09.270137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:09.270698 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:09.271375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:09.425682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:09.435142 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f5c8a7f0-a41c-42cb-8fff-975e282e04fb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1272 microversion: 2.1 time: 0.180172 Oct 31 16:44:09.435730 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3881/7626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:09 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:09.539398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-38d557d1-7ba6-44f3-ab77-296e4c958d05 req-12961f5b-1d90-4530-9247-9ec11cb4a983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a62b20-0c09-4864-8f50-865cd7a7cd83", "tag": "886c310e-5a6d-4152-8ed9-033de01806e9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:09.552010 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-38d557d1-7ba6-44f3-ab77-296e4c958d05 req-12961f5b-1d90-4530-9247-9ec11cb4a983 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:09.552909 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-38d557d1-7ba6-44f3-ab77-296e4c958d05 req-12961f5b-1d90-4530-9247-9ec11cb4a983 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:09.553636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-38d557d1-7ba6-44f3-ab77-296e4c958d05 req-12961f5b-1d90-4530-9247-9ec11cb4a983 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:09.571123 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-38d557d1-7ba6-44f3-ab77-296e4c958d05 req-12961f5b-1d90-4530-9247-9ec11cb4a983 service nova] Creating event network-changed:886c310e-5a6d-4152-8ed9-033de01806e9 for instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 on n-h2-858384-17 Oct 31 16:44:09.579888 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-38d557d1-7ba6-44f3-ab77-296e4c958d05 req-12961f5b-1d90-4530-9247-9ec11cb4a983 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041510 Oct 31 16:44:09.580566 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3746/7627] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:44:10.458626 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:10.459295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:10.467423 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:10.468254 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:10.468807 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:10.470513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:10.471450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:10.471450 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:10.619226 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:10.638532 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0abaeac6-cf62-4bdc-8bab-e034442141f1 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1272 microversion: 2.1 time: 0.183681 Oct 31 16:44:10.639233 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3882/7628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:10 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:11.665475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:11.666116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:11.673525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:11.674039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:11.674495 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:11.675205 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:11.675675 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:11.676116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:11.812119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:11.820230 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-64582e18-7fc3-431c-958c-5945f8380275 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1272 microversion: 2.1 time: 0.160008 Oct 31 16:44:11.820814 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3747/7629] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:11 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:44:12.843303 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:12.843829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:12.851432 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:12.851920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:12.852361 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:12.853066 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:12.853550 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:12.853978 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:12.995065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:13.003961 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-1bc343cf-7cb2-4bae-82cb-2bfd4fda8c12 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1272 microversion: 2.1 time: 0.164655 Oct 31 16:44:13.004570 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3883/7630] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:12 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:14.029247 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:14.029777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:14.037368 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:14.037873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:14.038335 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:14.039054 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:14.039529 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:14.039972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:14.174047 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:14.181804 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d9442830-5643-4b9f-b493-36dbfd793567 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.156816 Oct 31 16:44:14.182388 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3748/7631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:14 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:15.205248 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:15.205953 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:15.212770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:15.213302 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:15.213744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:15.214436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:15.214897 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:15.215321 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:15.350526 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:15.358450 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d4c72ff7-297b-40f9-af79-01e78a82604b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.157367 Oct 31 16:44:15.359024 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3884/7632] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:15 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:16.382564 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:16.383304 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:16.390583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:16.391869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:16.392326 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:16.393039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:16.393542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:16.393987 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:16.527940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:16.535955 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5f5ed98f-952b-481f-b0c1-5bb36bca4864 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.157306 Oct 31 16:44:16.536550 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3749/7633] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:16 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:17.559631 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:17.560239 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:17.563713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:17.569312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:17.569803 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:17.570237 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:17.570937 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:17.571407 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:17.575867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:17.705416 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:17.713172 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-760acc3b-c8be-4bac-910c-55c46710f388 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.157413 Oct 31 16:44:17.713754 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3885/7634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:17 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:18.736444 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:18.737093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:18.739178 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:18.739873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:44:18.746132 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:18.746638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:18.747088 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:18.747843 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:18.748305 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:18.748712 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:18.888197 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:18.897650 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-01d705cc-ba43-4a2e-bd35-dad3832f98c0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.165276 Oct 31 16:44:18.898605 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3750/7635] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:18 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:19.927886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:19.928500 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:19.935498 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:19.935987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:19.936427 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:19.937158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:19.938106 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:19.938911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:20.074013 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:20.082406 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-67d008db-ab32-4c0b-98f4-b54bb2e1c823 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.158409 Oct 31 16:44:20.082993 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3886/7636] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:19 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:21.106343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:21.106969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:21.113420 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:21.113918 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:21.114369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:21.115074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:21.115543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:21.115985 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:21.256263 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:21.264011 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5df8bc22-e28e-44f9-9708-011047510aea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.162001 Oct 31 16:44:21.264607 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3751/7637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:21 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:22.287924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:22.288604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:22.295528 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:22.296019 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:22.296459 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:22.297221 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:22.297688 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:22.298118 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:22.431504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:22.440002 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-20ff02c4-c54f-44dd-b451-05dbb8faae73 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.155994 Oct 31 16:44:22.440584 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3887/7638] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:22 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:23.463112 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:23.463730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:23.471230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:23.471724 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:23.472201 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:23.472901 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:23.473396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:23.473832 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:23.605339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:23.613308 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-12a18f8f-47aa-4033-80d0-5836f71eaac4 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.154024 Oct 31 16:44:23.613894 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3752/7639] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:23 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:24.638199 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:24.638837 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:24.645865 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:24.646350 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:24.646788 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:24.647475 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:24.647929 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:24.648349 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:24.791088 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:24.800002 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-f3998386-9729-4886-8a4a-14d81454b70f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.166033 Oct 31 16:44:24.801153 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3888/7640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:24 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:24.804134 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-a0f18ca5-1677-4c57-bf0d-264c87969b27 req-28322aa2-b233-4839-9f37-94d253617e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a62b20-0c09-4864-8f50-865cd7a7cd83", "name": "network-vif-plugged", "status": "completed", "tag": "886c310e-5a6d-4152-8ed9-033de01806e9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:24.814372 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a0f18ca5-1677-4c57-bf0d-264c87969b27 req-28322aa2-b233-4839-9f37-94d253617e15 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:24.814873 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a0f18ca5-1677-4c57-bf0d-264c87969b27 req-28322aa2-b233-4839-9f37-94d253617e15 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:24.815322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-a0f18ca5-1677-4c57-bf0d-264c87969b27 req-28322aa2-b233-4839-9f37-94d253617e15 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:24.826911 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-a0f18ca5-1677-4c57-bf0d-264c87969b27 req-28322aa2-b233-4839-9f37-94d253617e15 service nova] Creating event network-vif-plugged:886c310e-5a6d-4152-8ed9-033de01806e9 for instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 on n-h2-858384-17 Oct 31 16:44:24.832658 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-a0f18ca5-1677-4c57-bf0d-264c87969b27 req-28322aa2-b233-4839-9f37-94d253617e15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092599 Oct 31 16:44:24.833232 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3753/7641] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:44:25.824873 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:25.825742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:25.833829 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:25.834316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:25.834750 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:25.835491 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:25.835949 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:25.836375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:25.981490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:25.990601 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-66eac34f-270d-4462-975d-eb99a1de6cab tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1260 microversion: 2.1 time: 0.170230 Oct 31 16:44:25.991320 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3889/7642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:25 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:27.017093 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:27.017845 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:27.024671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:27.025209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:27.025671 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:27.026416 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:27.026895 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:27.027343 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:27.161004 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:27.168921 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7c123b0e-71f8-4291-948d-efe2644a186d tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1443 microversion: 2.1 time: 0.156707 Oct 31 16:44:27.169541 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3754/7643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:27 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:27.192820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:44:27.193479 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:44:27.200174 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:27.200662 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:27.201102 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:27.201854 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:27.202316 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:27.202746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:27.333325 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:44:27.341181 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-55481347-21c1-4628-8315-5e12db50495b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1443 microversion: 2.1 time: 0.152200 Oct 31 16:44:27.341763 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3890/7644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:44:27 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:44:28.941114 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-52e4ee69-6422-4b90-8486-585c69f284bb req-3309a725-a2dc-4e9e-8773-fe3e9e8c52f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a62b20-0c09-4864-8f50-865cd7a7cd83", "tag": "886c310e-5a6d-4152-8ed9-033de01806e9"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:44:28.951565 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-52e4ee69-6422-4b90-8486-585c69f284bb req-3309a725-a2dc-4e9e-8773-fe3e9e8c52f5 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:44:28.952064 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-52e4ee69-6422-4b90-8486-585c69f284bb req-3309a725-a2dc-4e9e-8773-fe3e9e8c52f5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:44:28.952519 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-52e4ee69-6422-4b90-8486-585c69f284bb req-3309a725-a2dc-4e9e-8773-fe3e9e8c52f5 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:44:28.963732 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-52e4ee69-6422-4b90-8486-585c69f284bb req-3309a725-a2dc-4e9e-8773-fe3e9e8c52f5 service nova] Creating event network-changed:886c310e-5a6d-4152-8ed9-033de01806e9 for instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 on n-h2-858384-17 Oct 31 16:44:28.969344 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-52e4ee69-6422-4b90-8486-585c69f284bb req-3309a725-a2dc-4e9e-8773-fe3e9e8c52f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031719 Oct 31 16:44:28.970060 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3755/7645] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:46:26.139426 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:46:26.140393 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:46:26.141231 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=24 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:26.141956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=60 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:26.142945 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 31 16:46:26.143102 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:46:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83/action (ip 10.222.0.20) !!! Oct 31 16:46:26.144756 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:46:26.144922 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:46:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83/action (ip 10.222.0.20) !!! Oct 31 16:46:26.268857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:46:26.269418 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:26.276059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:26.276540 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:26.276969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:26.277679 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:26.278135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:26.278556 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:26.300878 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.objects.instance [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lazy-loading 'flavor' on Instance uuid c7a62b20-0c09-4864-8f50-865cd7a7cd83 {{(pid=120587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:46:26.374590 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-246ec579-41c6-4110-a192-aed435e2ef92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "POST /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83/action" status: 202 len: 0 microversion: 2.1 time: 0.236674 Oct 31 16:46:26.375181 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3891/7646] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:46:26 2022] POST /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:46:26.383186 n-d-858384-17 devstack@n-api.service[120588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9df96b43-1b68-4fd4-bacb-dc8215b59e09] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:46:26.384410 n-d-858384-17 devstack@n-api.service[120588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e1ce3f5-eb69-4b90-aba6-c95a507838b2] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:46:26.385057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:26.385882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=56 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:26.391301 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:26.391966 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:26.401662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:26.402174 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:26.402634 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:26.403353 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:26.403839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:26.404412 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:26.611994 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:26.620561 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-26ccc4ff-0199-4c1f-bde1-57c3389d84a6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.240893 Oct 31 16:46:26.621165 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3756/7647] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:26 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:27.649890 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:27.650598 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:27.661392 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:27.661947 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:27.662616 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:27.663857 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:27.664468 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:27.664898 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:27.672559 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56538. Oct 31 16:46:27.685074 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56536. Oct 31 16:46:27.869951 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:27.877954 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5adda057-aabc-4946-b8d0-d00445b31cde tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.235660 Oct 31 16:46:27.878547 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3892/7648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:27 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:28.902825 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:28.903383 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:28.913157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:28.913692 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:28.914145 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:28.914859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:28.915340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:28.915780 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:28.920505 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] [9df96b43-1b68-4fd4-bacb-dc8215b59e09] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56546. Oct 31 16:46:28.923501 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e1ce3f5-eb69-4b90-aba6-c95a507838b2] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 56548. Oct 31 16:46:29.051866 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:29.060498 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-4e4646f5-9161-4f96-b5d5-9baa810f0f76 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.161686 Oct 31 16:46:29.061080 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3757/7649] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:28 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:30.085718 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:30.086364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:30.093203 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:30.093689 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:30.094129 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:30.094821 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:30.095282 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:30.095708 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:30.232328 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:30.240159 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7c73f888-28d4-4e55-b12b-d2764ec6106a tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.159071 Oct 31 16:46:30.240750 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3893/7650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:30 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:31.264470 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:31.265090 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:31.272568 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:31.273057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:31.273525 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:31.274224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:31.274688 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:31.275120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:31.414067 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:31.421821 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-df21c6db-bd64-40a3-bcb0-cac168f2b728 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.161383 Oct 31 16:46:31.422401 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3758/7651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:31 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:32.446819 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:32.447449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:32.454163 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:32.454653 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:32.455080 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:32.455760 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:32.456210 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:32.456634 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:32.588911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:32.596659 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-b0be527c-3e05-42a9-9e08-6575014fa3fc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.154204 Oct 31 16:46:32.597263 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3894/7652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:32 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:33.621224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:33.621853 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:33.628554 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:33.629048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:33.629524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:33.630220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:33.630686 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:33.631123 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:33.763386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:33.771660 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c3bfc867-a1e2-4c22-861b-f651932f18ce tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.153885 Oct 31 16:46:33.772235 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3759/7653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:33 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:34.795757 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:34.796399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:34.804189 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:34.804670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:34.805108 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:34.805817 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:34.806273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:34.806699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:34.942867 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:34.950954 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-aadc3148-5e22-4dc9-b0f6-5b20db370825 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.159100 Oct 31 16:46:34.951537 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3895/7654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:34 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:35.974582 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:35.975217 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:35.982473 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:35.982977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:35.983435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:35.984142 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:35.984620 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:35.985063 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:36.120138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:36.128208 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-970b6336-ee67-4d56-bd0e-fdcf08f7cd92 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.157746 Oct 31 16:46:36.128816 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3760/7655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:35 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:46:37.153645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:37.154260 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:37.162487 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:37.162861 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:37.163304 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:37.164028 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:37.164494 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:37.164916 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:37.297197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:37.305736 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-002799b0-12de-4fd8-bbdf-e12b43efa219 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.156065 Oct 31 16:46:37.306311 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3896/7656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:37 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:38.328445 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:38.329096 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:38.335990 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:38.336505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:38.336975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:38.337696 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:38.338163 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:38.338598 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:38.467356 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:38.475891 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-6d2454bc-3192-4b4f-99b1-c455bea5ac20 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.151336 Oct 31 16:46:38.476482 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3761/7657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:38 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:39.500439 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:39.501047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:39.508501 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:39.508987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:39.509454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:39.510147 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:39.510604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:39.511027 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:39.649044 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:39.656943 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c061d26c-530a-431a-a23a-44118e6f2989 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.160494 Oct 31 16:46:39.657552 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3897/7658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:39 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:40.680119 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:40.680752 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:40.687631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:40.688135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:40.689306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:40.689306 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:40.689838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:40.690409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:40.837584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:40.845478 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-522053b6-e0bb-4236-8db7-f0221e760b83 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.169659 Oct 31 16:46:40.846061 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3762/7659] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:40 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:41.283078 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-da06641f-eb5e-40a5-a4c2-b83481fc5b9a req-7c1b8b2c-cec7-48cf-ae33-8cc4a70a660e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a62b20-0c09-4864-8f50-865cd7a7cd83", "name": "network-vif-unplugged", "status": "completed", "tag": "886c310e-5a6d-4152-8ed9-033de01806e9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:46:41.295243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-da06641f-eb5e-40a5-a4c2-b83481fc5b9a req-7c1b8b2c-cec7-48cf-ae33-8cc4a70a660e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:41.295733 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-da06641f-eb5e-40a5-a4c2-b83481fc5b9a req-7c1b8b2c-cec7-48cf-ae33-8cc4a70a660e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:41.296193 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-da06641f-eb5e-40a5-a4c2-b83481fc5b9a req-7c1b8b2c-cec7-48cf-ae33-8cc4a70a660e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:41.308140 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.compute.server_external_events [req-da06641f-eb5e-40a5-a4c2-b83481fc5b9a req-7c1b8b2c-cec7-48cf-ae33-8cc4a70a660e service nova] Unable to find a host for instance c7a62b20-0c09-4864-8f50-865cd7a7cd83. Dropping event network-vif-unplugged {{(pid=120587) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 31 16:46:41.309027 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-da06641f-eb5e-40a5-a4c2-b83481fc5b9a req-7c1b8b2c-cec7-48cf-ae33-8cc4a70a660e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029907 Oct 31 16:46:41.309919 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3898/7660] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 31 16:46:41.870754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:41.871309 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:41.878081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:41.878574 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:41.879017 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:41.879711 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:41.880176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:41.880616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:42.010019 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:42.017895 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-98340717-57f7-4fe6-84e2-badb3c1dff26 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1508 microversion: 2.1 time: 0.151107 Oct 31 16:46:42.018479 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3763/7661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:41 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:42.041680 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:46:42.042274 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:42.048083 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:42.048559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:42.048987 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:42.049699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:42.050151 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:42.050572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:42.133454 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120587) unshelve /opt/stack/nova/nova/compute/api.py:4594}} Oct 31 16:46:42.198242 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3871bc9a-daeb-4aab-aca7-eea03ee095a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "POST /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83/action" status: 202 len: 0 microversion: 2.1 time: 0.161134 Oct 31 16:46:42.198864 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3899/7662] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:46:42 2022] POST /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:46:42.206975 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:42.207603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:42.214435 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:42.214938 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:42.215390 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:42.216290 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:42.216945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:42.217545 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:42.361422 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:42.369897 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ba1099cd-7bf8-47f8-be3a-db6f71e2d808 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1516 microversion: 2.1 time: 0.166776 Oct 31 16:46:42.370475 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3764/7663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:42 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:46:43.393627 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:43.394244 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:43.400268 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:43.400783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:43.401263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:43.401962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:43.402422 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:43.402852 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:43.539474 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:43.547328 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-8b0c9e17-2208-463c-baac-a0cf23af17c6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1518 microversion: 2.1 time: 0.158614 Oct 31 16:46:43.561151 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3900/7664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:43 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:44.579610 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:44.580322 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:44.587544 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:44.588041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:44.588512 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:44.589253 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:44.589730 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:44.590206 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:44.727981 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:44.736761 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e5a7295f-97cf-4613-8cdf-2bf967200f9b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1518 microversion: 2.1 time: 0.168671 Oct 31 16:46:44.737375 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3765/7665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:44 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:45.765351 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:45.765985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:45.773334 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:45.774003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:45.774457 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:45.775196 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:45.775663 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:45.776098 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:45.918736 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:45.926717 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c16921ae-f486-48f7-86c0-009b833fd11b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1518 microversion: 2.1 time: 0.165405 Oct 31 16:46:45.927313 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3901/7666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:45 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:46.953608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:46.954209 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:46.961080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:46.961631 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:46.962089 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:46.962792 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:46.963285 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:46.963726 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:47.097550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:47.105666 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-427906a0-2b83-4bba-82e0-83cb5004fb37 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1518 microversion: 2.1 time: 0.156133 Oct 31 16:46:47.106257 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3766/7667] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:46 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:48.131808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:48.132449 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:48.140287 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:48.140776 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:48.141229 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:48.141924 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:48.142375 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:48.142805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:48.278336 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:48.286528 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0a0268a4-5f78-47fe-8aff-d100a07cb49e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.158664 Oct 31 16:46:48.287127 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3902/7668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:48 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:49.311136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:49.311807 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:49.318627 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:49.319655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:49.320233 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:49.320941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:49.321436 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:49.321876 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:49.453075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:49.461532 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1762b0a0-e382-4a59-a1c4-baa5eee65b47 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.154374 Oct 31 16:46:49.462110 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3767/7669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:49 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:50.485312 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:50.485942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:50.493161 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:50.493641 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:50.494068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:50.494754 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:50.495200 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:50.495629 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:50.631515 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:50.639708 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-08358859-6eff-4d40-bef7-891a35ebb3f5 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.158557 Oct 31 16:46:50.640297 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3903/7670] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:50 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:51.663809 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:51.664441 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:51.671403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:51.671910 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:51.672369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:51.673081 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:51.673583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:51.674029 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:51.806977 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:51.814691 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-0eb4153b-43b8-45a3-a11e-f89baf14bbfb tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.154923 Oct 31 16:46:51.815264 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3768/7671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:51 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:46:52.838965 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:52.839632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:52.846572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:52.847050 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:52.847482 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:52.848164 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:52.848618 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:52.849039 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:52.981913 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:52.989713 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f2cc097-f21a-46b2-b7d5-d4c00f42e1ac tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.155268 Oct 31 16:46:52.990286 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3904/7672] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:52 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:54.012477 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:54.013104 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:54.019992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:54.020491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:54.020943 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:54.021674 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:54.022157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:54.023176 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:54.154754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:54.162792 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-aff5abce-9f8f-4d5c-89bd-7198287fe6e8 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.154188 Oct 31 16:46:54.163720 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3769/7673] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:54 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:55.188693 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:55.189332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:55.196939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:55.197483 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:55.197914 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:55.198599 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:55.199049 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:55.199476 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:55.203504 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:55.334895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:55.343025 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-57afb9d9-1e75-49d5-b8d9-7ca0205fb1d6 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.158277 Oct 31 16:46:55.343625 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3905/7674] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:55 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:56.367497 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:56.368116 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:56.375826 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:56.376327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:56.376777 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:56.377517 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:56.377989 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:56.378427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:56.399942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=88 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:56.516972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:56.525280 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06f75763-825f-44db-b4e1-b46d704d942b tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.161714 Oct 31 16:46:56.525865 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3770/7675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:56 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:57.549015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:57.549630 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:57.552355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:57.558511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:57.559006 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:57.559676 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:57.560379 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:57.560825 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:57.565906 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:57.698301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:57.706137 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4f6c9f87-03fa-4a77-b5ce-adcafeaa4cea tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.161145 Oct 31 16:46:57.706734 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3906/7676] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:57 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:58.731148 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:58.732037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:58.734766 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=31 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:46:58.740393 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:58.740889 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:58.741375 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:58.742107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:58.742603 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:58.743135 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:58.872398 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:46:58.880196 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-1799847c-1d3a-44bc-acf2-ea840700fb56 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.153777 Oct 31 16:46:58.880780 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3771/7677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:58 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:46:59.389565 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9b5aeb02-7fee-4b5a-915d-ff780142795a req-d7927969-3468-41de-84b2-587cd896185e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a62b20-0c09-4864-8f50-865cd7a7cd83", "name": "network-vif-plugged", "status": "completed", "tag": "886c310e-5a6d-4152-8ed9-033de01806e9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:46:59.401059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b5aeb02-7fee-4b5a-915d-ff780142795a req-d7927969-3468-41de-84b2-587cd896185e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:59.401572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b5aeb02-7fee-4b5a-915d-ff780142795a req-d7927969-3468-41de-84b2-587cd896185e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:59.402008 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b5aeb02-7fee-4b5a-915d-ff780142795a req-d7927969-3468-41de-84b2-587cd896185e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:59.413172 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9b5aeb02-7fee-4b5a-915d-ff780142795a req-d7927969-3468-41de-84b2-587cd896185e service nova] Creating event network-vif-plugged:886c310e-5a6d-4152-8ed9-033de01806e9 for instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 on n-h2-858384-17 Oct 31 16:46:59.419062 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9b5aeb02-7fee-4b5a-915d-ff780142795a req-d7927969-3468-41de-84b2-587cd896185e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033216 Oct 31 16:46:59.419666 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3907/7678] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:46:59.904543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:46:59.905073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:46:59.911655 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:59.912167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:59.912592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:46:59.913327 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:46:59.913795 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:46:59.914229 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:47:00.049149 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:47:00.057075 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-d97a93b5-9b7e-4285-9e96-6826cc80bf93 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1574 microversion: 2.1 time: 0.156752 Oct 31 16:47:00.057682 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3772/7679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:46:59 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:47:01.082622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:47:01.083355 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:47:01.090329 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:47:01.090794 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:47:01.091223 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:47:01.091930 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:47:01.092384 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:47:01.092805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:47:01.228190 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:47:01.237104 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-bb18df91-1d14-4a5e-b9fb-af2159e8e4a0 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1561 microversion: 2.1 time: 0.159547 Oct 31 16:47:01.237730 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3908/7680] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:47:01 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:15.716065 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=5 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:15.716919 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=18 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:15.717066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:15.717802 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:15.721259 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:15.721928 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=14 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:15.723092 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:48:15.723250 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 (ip 10.222.0.20) !!! Oct 31 16:48:15.724522 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:48:15.724649 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 (ip 10.222.0.20) !!! Oct 31 16:48:15.725652 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:48:15.725980 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 (ip 10.222.0.20) !!! Oct 31 16:48:15.726490 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-af4db74e-cf81-497b-8eeb-3e1d88ac9269 req-be25b89d-c2a3-443e-8e4b-d771136b4911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7a62b20-0c09-4864-8f50-865cd7a7cd83", "tag": "886c310e-5a6d-4152-8ed9-033de01806e9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:48:15.739882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:15.740394 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:15.740839 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:15.741767 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:15.742403 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:15.743040 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:15.744872 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-af4db74e-cf81-497b-8eeb-3e1d88ac9269 req-be25b89d-c2a3-443e-8e4b-d771136b4911 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:15.745391 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-af4db74e-cf81-497b-8eeb-3e1d88ac9269 req-be25b89d-c2a3-443e-8e4b-d771136b4911 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:15.745824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-af4db74e-cf81-497b-8eeb-3e1d88ac9269 req-be25b89d-c2a3-443e-8e4b-d771136b4911 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:15.758570 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-af4db74e-cf81-497b-8eeb-3e1d88ac9269 req-be25b89d-c2a3-443e-8e4b-d771136b4911 service nova] Creating event network-changed:886c310e-5a6d-4152-8ed9-033de01806e9 for instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 on n-h2-858384-17 Oct 31 16:48:15.764496 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-af4db74e-cf81-497b-8eeb-3e1d88ac9269 req-be25b89d-c2a3-443e-8e4b-d771136b4911 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050014 Oct 31 16:48:15.765717 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3909/7681] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:48:15.771181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:48:15.856183 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-61e8bc87-12d3-4b2d-b0cf-c6449316e11e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 204 len: 0 microversion: 2.1 time: 0.143988 Oct 31 16:48:15.861175 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3773/7682] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:48:15 2022] DELETE /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:48:15.867191 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:15.867927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:15.874332 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:15.875628 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:15.876068 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:15.876779 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:15.877301 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:15.877703 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:16.023985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:16.032283 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-6dfcc1bb-0384-4649-b65a-eb7a844ef096 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.169591 Oct 31 16:48:16.032891 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3910/7683] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:15 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:48:17.057230 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:17.057972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:17.065467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:17.065972 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:17.066427 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:17.067156 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:17.067608 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:17.068048 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:17.225409 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:17.233721 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-06e05250-7675-470a-b04f-0cf067a433cf tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1567 microversion: 2.1 time: 0.180857 Oct 31 16:48:17.235170 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3774/7684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:17 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:18.152224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-48d9ff92-9cbf-491a-b5aa-f6d8aff50180 req-071545f8-8fab-4956-827b-493489ff2b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7a62b20-0c09-4864-8f50-865cd7a7cd83", "name": "network-vif-deleted", "tag": "886c310e-5a6d-4152-8ed9-033de01806e9"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:48:18.162938 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-48d9ff92-9cbf-491a-b5aa-f6d8aff50180 req-071545f8-8fab-4956-827b-493489ff2b1f service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:18.163469 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-48d9ff92-9cbf-491a-b5aa-f6d8aff50180 req-071545f8-8fab-4956-827b-493489ff2b1f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:18.163896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-48d9ff92-9cbf-491a-b5aa-f6d8aff50180 req-071545f8-8fab-4956-827b-493489ff2b1f service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:18.176024 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-48d9ff92-9cbf-491a-b5aa-f6d8aff50180 req-071545f8-8fab-4956-827b-493489ff2b1f service nova] Creating event network-vif-deleted:886c310e-5a6d-4152-8ed9-033de01806e9 for instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 on n-h2-858384-17 Oct 31 16:48:18.181214 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-48d9ff92-9cbf-491a-b5aa-f6d8aff50180 req-071545f8-8fab-4956-827b-493489ff2b1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088098 Oct 31 16:48:18.181825 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3911/7685] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:48:18.258452 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:18.259084 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:18.266934 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:18.267437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:18.267884 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:18.268600 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:18.269073 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:18.269542 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:18.332983 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:18.340883 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-ea41e024-eef3-4d83-97b0-ab5757017b88 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1220 microversion: 2.1 time: 0.086428 Oct 31 16:48:18.341703 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3775/7686] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:18 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:19.365622 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:19.366313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:19.372409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:19.372886 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:19.373364 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:19.374037 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:19.375073 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:19.375768 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:19.439396 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:19.447424 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4e167ba0-12db-40e3-b292-e9269eb8f60e tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1220 microversion: 2.1 time: 0.086875 Oct 31 16:48:19.448020 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3912/7687] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:19 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:20.472505 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:20.473177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:20.480357 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:20.480870 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:20.481358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:20.482086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:20.482562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:20.483260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:20.556022 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:20.568863 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7367efaf-2f71-47b7-92e6-8862235acf4f tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1220 microversion: 2.1 time: 0.100930 Oct 31 16:48:20.569516 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3776/7688] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:20 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:21.591982 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:21.592590 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:21.599633 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:21.600114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:21.600545 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:21.601286 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:21.602259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:21.602259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:21.666280 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:21.675658 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-99da0963-8a65-42a5-a0b3-9d908243aafc tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1220 microversion: 2.1 time: 0.087641 Oct 31 16:48:21.676249 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3913/7689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:21 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:22.699339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:22.699900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:22.707854 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:22.708359 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:22.708812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:22.709550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:22.710025 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:22.710467 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:22.746757 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:22.747835 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:22.748317 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:22.748978 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lazy-loading 'fault' on Instance uuid c7a62b20-0c09-4864-8f50-865cd7a7cd83 {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:48:22.794033 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e5d4b5beb7468abf83ea98dfc54bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29acf2fd219c4534932f17ec35b17e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:22.803383 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c6b6e90f-a100-466b-8ad4-559d6de9eb11 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 200 len: 1225 microversion: 2.1 time: 0.107974 Oct 31 16:48:22.804343 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3777/7690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:22 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:23.828255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:23.829319 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] [instance: c7a62b20-0c09-4864-8f50-865cd7a7cd83] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:23.836197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:23.836682 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:23.837116 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:23.837835 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:23.838290 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:23.838713 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:23.852445 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] HTTP exception thrown: Instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 could not be found. Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Request method failure captured: Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 HTTP/1.1 Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_pGwFwHCJP3G92MPiYciRtyyBxZHZOM_fo-6Dv1eSvDdF7LCkqMWRVw4laFx0mvJq7YgDhdvDUjMe_LXZfP3NO8wQkR6BZFi5rwmNv1_SZwqzn5pE3-xfZwyyag9v3L144BMwLNtrxOu0d8AsRvduSeUek-e-iEPAPcrB1x2KEUKaM Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 29acf2fd219c4534932f17ec35b17e8a Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestShelveInstance-1058389335 Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29acf2fd219c4534932f17ec35b17e8a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_29acf2fd219c4534932f17ec35b17e8a", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/29acf2fd219c4534932f17ec35b17e8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/29acf2fd219c4534932f17ec35b17e8a"}]}] Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestShelveInstance-1058389335 Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 29acf2fd219c4534932f17ec35b17e8a Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestShelveInstance-1058389335 Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestShelveInstance-1058389335-project Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 03e5d4b5beb7468abf83ea98dfc54bed Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestShelveInstance-1058389335-project Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 could not be found. Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'c7a62b20-0c09-4864-8f50-865cd7a7cd83'} Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 could not be found. Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 could not be found. Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:48:23.854136 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 could not be found. Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Returning 404 to user: Instance c7a62b20-0c09-4864-8f50-865cd7a7cd83 could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7d73d323-829e-4909-b75c-3b2ddac1c550 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83" status: 404 len: 111 microversion: 2.1 time: 0.031900 Oct 31 16:48:23.859896 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3914/7691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:23 2022] GET /compute/v2.1/servers/c7a62b20-0c09-4864-8f50-865cd7a7cd83 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:48:24.026697 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7ec5b287-8457-41fd-86b2-4f468671fac9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] Calling method '.version_select at 0x7f16e01c8ca0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:24.067248 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7ec5b287-8457-41fd-86b2-4f468671fac9 tempest-TestShelveInstance-1058389335 tempest-TestShelveInstance-1058389335-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1222551160" status: 202 len: 0 microversion: 2.1 time: 0.044605 Oct 31 16:48:24.068010 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3778/7692] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Oct 31 16:48:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1222551160 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 31 16:48:41.649583 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=12 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:41.650827 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=24 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:41.865527 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-23a35c83-5118-4623-af4f-d429e9895640 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Action: 'create', calling method: .version_select at 0x7f16e01d5430>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1066071693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZlVf1EOjbQpBbkp3pwBe/w2tCNkxj/HLVLMbSPfZnZAP74A959gw1A3h94Nm0OCS57vByceD+yV+LLAQbWgxsnm/DvSZpJ8NZxozyaNUObkOvyLaUAKM/AxKFu6RjgMA=="}} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:48:41.882894 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-23a35c83-5118-4623-af4f-d429e9895640 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Getting quotas for project 34ca506854ba46c58e0ed62f668add58. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:48:41.888480 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.quota [None req-23a35c83-5118-4623-af4f-d429e9895640 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Getting quotas for user 306a9bd806764e3a859221651cec0ada and project 34ca506854ba46c58e0ed62f668add58. Resources: {'key_pairs'} {{(pid=120587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:48:41.924883 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-23a35c83-5118-4623-af4f-d429e9895640 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.280158 Oct 31 16:48:41.931857 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3915/7693] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Oct 31 16:48:41 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:48:42.966369 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1177358051", "imageRef": "524d630e-d0c9-4d4c-9057-837f830c46f6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1066071693", "security_groups": [{"name": "tempest-secgroup-smoke-449006215"}], "networks": [{"uuid": "8b55f11c-4a21-4103-a289-971b0f6e8249"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:48:42.976498 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:42.977179 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:43.076177 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] validate_networks() for [('8b55f11c-4a21-4103-a289-971b0f6e8249', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:48:43.577212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:48:43.577936 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:48:43.579032 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:48:43.579157 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:48:43.579595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:48:43.589210 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:43.589717 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:43.590175 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:43.590917 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:43.591389 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:43.591837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:43.610666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Getting quotas for project 34ca506854ba46c58e0ed62f668add58. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:48:43.616510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Getting quotas for user 306a9bd806764e3a859221651cec0ada and project 34ca506854ba46c58e0ed62f668add58. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:48:43.630248 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:48:43.632617 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='524d630e-d0c9-4d4c-9057-837f830c46f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:48:43.685327 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-c35ad513-1308-4f81-b722-0a106262843c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.722733 Oct 31 16:48:43.686315 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3779/7694] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:48:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 31 16:48:43.700112 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3bc8a5c0-7a78-43cc-aa02-28a4d0a18f3d tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:43.700636 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3bc8a5c0-7a78-43cc-aa02-28a4d0a18f3d tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:43.768851 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3bc8a5c0-7a78-43cc-aa02-28a4d0a18f3d tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:43.777416 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3bc8a5c0-7a78-43cc-aa02-28a4d0a18f3d tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1249 microversion: 2.1 time: 0.083363 Oct 31 16:48:43.779377 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3916/7695] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:43 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:44.804397 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:44.804945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:44.811211 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:44.812315 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:44.812993 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:44.813747 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:44.814231 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:44.814681 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:44.879342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:44.887147 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5de0e979-1c27-421f-8595-06d3e0657b1a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1301 microversion: 2.1 time: 0.088392 Oct 31 16:48:44.887730 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3780/7696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:44 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:45.914227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:45.915438 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:45.923986 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:45.924927 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:45.925584 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:45.926648 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:45.927114 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:45.927544 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:46.105012 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:46.114538 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-d372203d-f753-4573-be3b-283dea0ed7a1 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1374 microversion: 2.1 time: 0.206774 Oct 31 16:48:46.115467 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3917/7697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:45 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:48:46.603713 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-d2fc3157-e8b0-44a3-a99e-5c26bbfd2a32 req-d9f2715d-805a-49f5-aa34-92c3217c362e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b7418c-aaea-4aaa-9bec-eeacd47e6cab", "tag": "a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:48:46.614837 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d2fc3157-e8b0-44a3-a99e-5c26bbfd2a32 req-d9f2715d-805a-49f5-aa34-92c3217c362e service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:46.615421 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d2fc3157-e8b0-44a3-a99e-5c26bbfd2a32 req-d9f2715d-805a-49f5-aa34-92c3217c362e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:46.616111 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-d2fc3157-e8b0-44a3-a99e-5c26bbfd2a32 req-d9f2715d-805a-49f5-aa34-92c3217c362e service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:46.627962 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-d2fc3157-e8b0-44a3-a99e-5c26bbfd2a32 req-d9f2715d-805a-49f5-aa34-92c3217c362e service nova] Creating event network-changed:a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2 for instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab on n-h2-858384-17 Oct 31 16:48:46.633013 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-d2fc3157-e8b0-44a3-a99e-5c26bbfd2a32 req-d9f2715d-805a-49f5-aa34-92c3217c362e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033031 Oct 31 16:48:46.633672 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3781/7698] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:48:47.140604 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:47.141451 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:47.148415 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:47.148918 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:47.149382 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:47.150110 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:47.150559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:47.150979 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:47.281920 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:47.290151 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-a707dc36-236a-42c4-a76f-fcf8d82a8307 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1374 microversion: 2.1 time: 0.154211 Oct 31 16:48:47.290838 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3918/7699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:47 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:48.316181 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:48.316815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:48.322968 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:48.323463 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:48.323911 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:48.324616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:48.325082 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:48.325666 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:48.881851 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:48.889388 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2d02e5af-1b6b-4738-9a33-3aa3101942a4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1374 microversion: 2.1 time: 0.578963 Oct 31 16:48:48.889994 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3782/7700] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:48 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1374 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:49.912546 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:49.913178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:49.920079 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:49.920559 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:49.920994 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:49.922601 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:49.923322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:49.923784 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:50.066259 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:50.074029 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-01eeaa9d-0d1c-4e97-af42-6850fe570b02 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1374 microversion: 2.1 time: 0.165527 Oct 31 16:48:50.074616 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3919/7701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:49 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:51.098086 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:51.098722 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:51.105616 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:51.106120 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:51.106573 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:51.107282 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:51.107754 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:51.108451 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:51.242838 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:51.250723 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-f9a046bf-c30e-4c4b-a882-4c3d7b3a5140 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1374 microversion: 2.1 time: 0.156540 Oct 31 16:48:51.251306 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3783/7702] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:51 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:51.865497 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-9b0b4791-67af-4625-b04d-0df0e662eadf req-8afd49e7-30df-4d32-ad68-152cc5688992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b7418c-aaea-4aaa-9bec-eeacd47e6cab", "name": "network-vif-plugged", "status": "completed", "tag": "a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:48:51.877486 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b0b4791-67af-4625-b04d-0df0e662eadf req-8afd49e7-30df-4d32-ad68-152cc5688992 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:51.877969 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b0b4791-67af-4625-b04d-0df0e662eadf req-8afd49e7-30df-4d32-ad68-152cc5688992 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:51.878399 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-9b0b4791-67af-4625-b04d-0df0e662eadf req-8afd49e7-30df-4d32-ad68-152cc5688992 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:51.889771 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-9b0b4791-67af-4625-b04d-0df0e662eadf req-8afd49e7-30df-4d32-ad68-152cc5688992 service nova] Creating event network-vif-plugged:a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2 for instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab on n-h2-858384-17 Oct 31 16:48:51.894867 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-9b0b4791-67af-4625-b04d-0df0e662eadf req-8afd49e7-30df-4d32-ad68-152cc5688992 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033111 Oct 31 16:48:51.895536 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3920/7703] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:48:52.273926 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:52.274468 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:52.281399 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:52.281892 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:52.282339 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:52.283034 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:52.283501 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:52.283940 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:52.418630 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:52.427016 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2cdafad8-7a49-493b-8157-12cc91d16373 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1374 microversion: 2.1 time: 0.157044 Oct 31 16:48:52.427607 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3784/7704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:52 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:48:53.453431 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:53.454156 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:53.460296 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:53.460770 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:53.461255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:53.462243 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:53.462694 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:53.463115 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:53.597366 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:53.607830 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-4a0b0386-0b6b-4fcd-8d90-ecf69589b0a8 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1559 microversion: 2.1 time: 0.159420 Oct 31 16:48:53.609182 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3921/7705] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:53 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:53.632693 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:48:53.633362 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:48:53.636202 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:53.636898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:53.642871 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:53.643374 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:53.643829 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:53.644541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:53.645013 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:53.645487 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:53.779632 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:48:53.787868 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-7e52fd28-4a00-474b-bf0c-44d2984519b0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1559 microversion: 2.1 time: 0.159250 Oct 31 16:48:53.788448 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3785/7706] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:48:53 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:48:55.424400 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-cbd1daeb-cf3d-4d56-9b61-fde7d6e6492e req-f2f5d91f-abe6-4dc9-84a4-117cff8a1bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b7418c-aaea-4aaa-9bec-eeacd47e6cab", "tag": "a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:48:55.429218 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=6 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:48:55.436059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cbd1daeb-cf3d-4d56-9b61-fde7d6e6492e req-f2f5d91f-abe6-4dc9-84a4-117cff8a1bcf service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:48:55.436535 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cbd1daeb-cf3d-4d56-9b61-fde7d6e6492e req-f2f5d91f-abe6-4dc9-84a4-117cff8a1bcf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:48:55.436988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-cbd1daeb-cf3d-4d56-9b61-fde7d6e6492e req-f2f5d91f-abe6-4dc9-84a4-117cff8a1bcf service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:48:55.448352 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-cbd1daeb-cf3d-4d56-9b61-fde7d6e6492e req-f2f5d91f-abe6-4dc9-84a4-117cff8a1bcf service nova] Creating event network-changed:a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2 for instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab on n-h2-858384-17 Oct 31 16:48:55.453761 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-cbd1daeb-cf3d-4d56-9b61-fde7d6e6492e req-f2f5d91f-abe6-4dc9-84a4-117cff8a1bcf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033503 Oct 31 16:48:55.454418 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3922/7707] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:50:52.716200 n-d-858384-17 devstack@n-api.service[120588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9df96b43-1b68-4fd4-bacb-dc8215b59e09] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:50:52.717118 n-d-858384-17 devstack@n-api.service[120588]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2e1ce3f5-eb69-4b90-aba6-c95a507838b2] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:50:52.717601 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:50:52.718584 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=34 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:50:52.724109 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-16e84718-6934-42be-b0ef-bc55d1135bfe tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1364943063"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:50:52.726784 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-16e84718-6934-42be-b0ef-bc55d1135bfe tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:50:52.734924 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16e84718-6934-42be-b0ef-bc55d1135bfe tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:50:52.735431 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16e84718-6934-42be-b0ef-bc55d1135bfe tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:50:52.735879 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16e84718-6934-42be-b0ef-bc55d1135bfe tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:50:52.736595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16e84718-6934-42be-b0ef-bc55d1135bfe tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:50:52.737066 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16e84718-6934-42be-b0ef-bc55d1135bfe tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:50:52.737541 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-16e84718-6934-42be-b0ef-bc55d1135bfe tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:50:52.939378 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-16e84718-6934-42be-b0ef-bc55d1135bfe tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "POST /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab/action" status: 202 len: 0 microversion: 2.1 time: 0.225080 Oct 31 16:50:52.940051 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3786/7708] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:50:52 2022] POST /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 16:50:58.624862 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:50:58.632140 n-d-858384-17 devstack@n-api.service[120587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 31 16:50:58.632935 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:50:58.634575 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=28 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:50:58.635950 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:50:58.636324 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:50:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 31 16:50:58.750507 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-40930117-3bb8-491c-a0d2-a7f8092ae1c3 req-ecc6fc8b-9c00-4f0d-ac66-7044aa0dfac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b7418c-aaea-4aaa-9bec-eeacd47e6cab", "name": "network-vif-plugged", "status": "completed", "tag": "a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:50:58.761271 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-40930117-3bb8-491c-a0d2-a7f8092ae1c3 req-ecc6fc8b-9c00-4f0d-ac66-7044aa0dfac6 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:50:58.762000 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-40930117-3bb8-491c-a0d2-a7f8092ae1c3 req-ecc6fc8b-9c00-4f0d-ac66-7044aa0dfac6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:50:58.762605 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-40930117-3bb8-491c-a0d2-a7f8092ae1c3 req-ecc6fc8b-9c00-4f0d-ac66-7044aa0dfac6 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:50:58.774580 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-40930117-3bb8-491c-a0d2-a7f8092ae1c3 req-ecc6fc8b-9c00-4f0d-ac66-7044aa0dfac6 service nova] Creating event network-vif-plugged:a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2 for instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab on n-h2-858384-17 Oct 31 16:50:58.779916 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-40930117-3bb8-491c-a0d2-a7f8092ae1c3 req-ecc6fc8b-9c00-4f0d-ac66-7044aa0dfac6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157249 Oct 31 16:50:58.780524 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3923/7709] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:51:06.491151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:06.492138 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:06.497038 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2004739284", "imageRef": "bf0248aa-694c-43b7-b0ff-33b826b56b9f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1066071693", "security_groups": [{"name": "tempest-secgroup-smoke-449006215"}], "networks": [{"uuid": "8b55f11c-4a21-4103-a289-971b0f6e8249"}]}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:06.524785 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] [2e1ce3f5-eb69-4b90-aba6-c95a507838b2] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57040. Oct 31 16:51:06.526115 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] [9df96b43-1b68-4fd4-bacb-dc8215b59e09] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57038. Oct 31 16:51:06.610770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.network.neutron [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] validate_networks() for [('8b55f11c-4a21-4103-a289-971b0f6e8249', None, None, None, None, None)] {{(pid=120588) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 31 16:51:06.980143 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Flavor limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 31 16:51:06.980578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Image limits 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 31 16:51:06.981071 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Flavor pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 31 16:51:06.981524 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Image pref 0:0:0 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 31 16:51:06.981945 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.virt.hardware [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120588) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 31 16:51:06.993900 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:06.994392 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:06.994836 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:06.995596 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:06.996060 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:06.996491 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:07.013562 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Getting quotas for project 34ca506854ba46c58e0ed62f668add58. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 31 16:51:07.018788 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.quota [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Getting quotas for user 306a9bd806764e3a859221651cec0ada and project 34ca506854ba46c58e0ed62f668add58. Resources: {'cores', 'instances', 'ram'} {{(pid=120588) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 31 16:51:07.031045 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Going to run 1 instances... {{(pid=120588) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 31 16:51:07.033553 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bf0248aa-694c-43b7-b0ff-33b826b56b9f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120588) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 31 16:51:07.082957 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-5ce43928-dab5-49bb-a363-dd7d87ada9f7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.593509 Oct 31 16:51:07.089952 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3787/7710] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Oct 31 16:51:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 31 16:51:07.095755 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-5b9d6932-c27d-4dec-9630-a3be57baabba tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:07.096639 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-5b9d6932-c27d-4dec-9630-a3be57baabba tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:07.111375 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [821232af-9c0f-4884-8fd1-368336909f98] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57054. Oct 31 16:51:07.119810 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] [ea9cb094-0d78-4a03-a1f1-632d8e14b14b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 57056. Oct 31 16:51:07.174621 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-5b9d6932-c27d-4dec-9630-a3be57baabba tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:07.184118 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-5b9d6932-c27d-4dec-9630-a3be57baabba tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1249 microversion: 2.1 time: 0.092618 Oct 31 16:51:07.184809 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3924/7711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:07 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:51:08.207075 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:08.208916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:08.216636 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:08.217160 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:08.217611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:08.218550 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:08.219031 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:08.219694 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:08.289599 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:08.297446 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-193d8a9d-db2a-4c7b-8d8c-2513282b4702 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1319 microversion: 2.1 time: 0.094208 Oct 31 16:51:08.298040 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3788/7712] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:08 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1319 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:09.320645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:09.321295 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:09.325255 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:09.330178 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:09.330670 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:09.331109 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:09.331816 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:09.332273 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:09.332699 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:09.482448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:09.492201 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c6957035-5e47-4fad-9760-65ebba5bc4b9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.175958 Oct 31 16:51:09.493587 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3925/7713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:09 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:10.518437 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:10.519074 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:10.527167 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:10.527919 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:10.528460 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:10.529274 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:10.529956 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:10.530510 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:10.683824 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3cf802d8-bcfc-46d3-9d36-73cfa3630959 req-ce87df24-543a-40c3-ae51-cddc9c9eb001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b7418c-aaea-4aaa-9bec-eeacd47e6cab", "name": "network-vif-unplugged", "status": "completed", "tag": "a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:10.707266 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3cf802d8-bcfc-46d3-9d36-73cfa3630959 req-ce87df24-543a-40c3-ae51-cddc9c9eb001 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:10.707746 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3cf802d8-bcfc-46d3-9d36-73cfa3630959 req-ce87df24-543a-40c3-ae51-cddc9c9eb001 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:10.713182 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3cf802d8-bcfc-46d3-9d36-73cfa3630959 req-ce87df24-543a-40c3-ae51-cddc9c9eb001 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:10.738385 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3cf802d8-bcfc-46d3-9d36-73cfa3630959 req-ce87df24-543a-40c3-ae51-cddc9c9eb001 service nova] Creating event network-vif-unplugged:a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2 for instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab on n-h2-858384-17 Oct 31 16:51:10.742932 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:10.752039 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-3af28351-49cb-4cfe-a8fb-064c919e5aab tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.238006 Oct 31 16:51:10.770833 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3cf802d8-bcfc-46d3-9d36-73cfa3630959 req-ce87df24-543a-40c3-ae51-cddc9c9eb001 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092397 Oct 31 16:51:10.772137 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3926/7714] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:51:10.772784 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3789/7715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:10 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:11.781025 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:11.781744 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:11.788970 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:11.789796 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:11.790256 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:11.791056 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:11.791514 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:11.791988 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:11.941981 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:11.951623 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-54755fa7-16de-40b8-916d-f5e15c80d242 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.175840 Oct 31 16:51:11.965427 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3927/7716] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:11 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:12.976991 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:12.978678 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:12.987186 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:12.987781 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:12.988358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:12.989969 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:12.991078 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:12.991527 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:13.141830 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:13.150725 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-080d440d-6dc2-459b-8951-180ede5e86cf tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.178629 Oct 31 16:51:13.151322 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3790/7717] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:12 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:14.174992 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:14.176511 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:14.185294 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:14.186313 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:14.187308 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:14.188340 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:14.188875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:14.189406 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:14.367513 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:14.376806 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-3132ccb9-24f3-4aae-8071-878deaf98236 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.205935 Oct 31 16:51:14.377660 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3928/7718] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:14 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:15.403056 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:15.403732 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:15.425532 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:15.426057 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:15.426507 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:15.427314 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:15.427797 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:15.428220 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:15.584199 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:15.592256 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-2371756c-5221-46c8-8182-8e19f42be09c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.193854 Oct 31 16:51:15.592854 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3791/7719] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:15 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:16.616224 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:16.616911 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:16.623756 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:16.624311 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:16.624813 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:16.625609 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:16.626157 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:16.626645 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:16.841047 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:16.849753 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e7902298-e162-4714-9062-5e8ca9d672d0 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.237928 Oct 31 16:51:16.850575 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3929/7720] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:16 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:17.192869 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:17.194546 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell0:SELECT=6 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:17.254168 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-3add73ab-c4a8-43f4-93e9-14038984dfd7 req-725436c2-d59b-4dac-be53-9e07f50b8b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd", "tag": "f8f8e4da-5266-47ce-a3c8-4b5c15db674e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:17.264841 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3add73ab-c4a8-43f4-93e9-14038984dfd7 req-725436c2-d59b-4dac-be53-9e07f50b8b0d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:17.266260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3add73ab-c4a8-43f4-93e9-14038984dfd7 req-725436c2-d59b-4dac-be53-9e07f50b8b0d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:17.266260 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-3add73ab-c4a8-43f4-93e9-14038984dfd7 req-725436c2-d59b-4dac-be53-9e07f50b8b0d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:17.277660 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-3add73ab-c4a8-43f4-93e9-14038984dfd7 req-725436c2-d59b-4dac-be53-9e07f50b8b0d service nova] Creating event network-changed:f8f8e4da-5266-47ce-a3c8-4b5c15db674e for instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd on n-h1-858384-17 Oct 31 16:51:17.283093 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-3add73ab-c4a8-43f4-93e9-14038984dfd7 req-725436c2-d59b-4dac-be53-9e07f50b8b0d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097643 Oct 31 16:51:17.283906 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3792/7721] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:51:17.874135 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:17.874748 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:17.876687 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell0:SELECT=2 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:51:17.882942 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:17.883429 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:17.883864 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:17.884588 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:17.885046 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:17.885506 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:18.028808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:18.036484 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0ce33b70-9ee3-4e87-ab4c-851c7fb0e03e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.166292 Oct 31 16:51:18.037058 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3930/7722] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:17 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:19.060783 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:19.061475 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:19.067583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:19.068386 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:19.068916 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:19.069662 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:19.070137 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:19.070595 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:19.207543 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:19.215870 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-edf3558c-d51e-4f90-a804-800e10c8febc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.160443 Oct 31 16:51:19.216466 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3793/7723] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:19 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:20.239880 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:20.240808 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:20.247785 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:20.248270 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:20.248705 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:20.249426 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:20.250158 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:20.250592 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:20.386038 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:20.394574 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-db20298c-2695-4fa5-956b-6ab73cffcf71 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.158999 Oct 31 16:51:20.395297 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3931/7724] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:20 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:21.418358 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:21.418947 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:21.425363 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:21.425859 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:21.426310 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:21.427303 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:21.427773 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:21.428212 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:21.650236 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:21.657996 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-386a5a2f-5131-40b3-a188-a028835f92d3 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.243605 Oct 31 16:51:21.658801 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3794/7725] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:21 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:51:22.682292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:22.682939 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:22.689956 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:22.690532 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:22.690977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:22.691675 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:22.692134 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:22.693263 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:22.797683 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [req-5405690e-ff51-4d0b-8851-caa081ffdc5d req-05f50517-a957-4407-997c-213d099762ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd", "name": "network-vif-plugged", "status": "completed", "tag": "f8f8e4da-5266-47ce-a3c8-4b5c15db674e"}]} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:22.808534 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5405690e-ff51-4d0b-8851-caa081ffdc5d req-05f50517-a957-4407-997c-213d099762ae service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:22.809021 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5405690e-ff51-4d0b-8851-caa081ffdc5d req-05f50517-a957-4407-997c-213d099762ae service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:22.809704 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [req-5405690e-ff51-4d0b-8851-caa081ffdc5d req-05f50517-a957-4407-997c-213d099762ae service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:22.822121 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.compute.server_external_events [req-5405690e-ff51-4d0b-8851-caa081ffdc5d req-05f50517-a957-4407-997c-213d099762ae service nova] Creating event network-vif-plugged:f8f8e4da-5266-47ce-a3c8-4b5c15db674e for instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd on n-h1-858384-17 Oct 31 16:51:22.827384 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [req-5405690e-ff51-4d0b-8851-caa081ffdc5d req-05f50517-a957-4407-997c-213d099762ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033419 Oct 31 16:51:22.828109 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3795/7726] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 31 16:51:22.837168 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:22.846416 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-e27d5870-dc96-43ed-9ea7-af6f59000c01 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.168176 Oct 31 16:51:22.847085 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3932/7727] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:22 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:23.872559 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:23.873239 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:23.879440 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:23.880592 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:23.881361 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:23.882080 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:23.882555 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:23.883036 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:24.023734 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:24.031499 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-e7a5a7ee-05cf-4c96-b911-3ac31dc6a1f9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1374 microversion: 2.1 time: 0.164169 Oct 31 16:51:24.032097 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3796/7728] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:23 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:25.054306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:25.054895 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:25.061917 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:25.062409 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:25.062875 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:25.063572 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:25.064030 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:25.064453 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:25.196348 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:25.204108 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-679f2cbb-c090-4da6-81a3-a955659e1d82 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1560 microversion: 2.1 time: 0.153785 Oct 31 16:51:25.204691 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3933/7729] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:25 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 31 16:51:25.227107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:51:25.227729 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:51:25.234464 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:25.235208 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:25.235650 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:25.236342 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:25.236805 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:25.237270 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:25.432804 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:51:25.440529 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-8ec1a1b5-31e4-4764-9ac4-62094bfcabe4 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1560 microversion: 2.1 time: 0.217278 Oct 31 16:51:25.441117 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3797/7730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:51:25 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:51:27.390059 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-3e965247-f2e8-4d98-b3b9-1eef466a11c0 req-8e99db35-d246-4f21-85f6-b2c289dc7cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd", "tag": "f8f8e4da-5266-47ce-a3c8-4b5c15db674e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:51:27.400764 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e965247-f2e8-4d98-b3b9-1eef466a11c0 req-8e99db35-d246-4f21-85f6-b2c289dc7cdb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:51:27.401395 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e965247-f2e8-4d98-b3b9-1eef466a11c0 req-8e99db35-d246-4f21-85f6-b2c289dc7cdb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:51:27.401697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-3e965247-f2e8-4d98-b3b9-1eef466a11c0 req-8e99db35-d246-4f21-85f6-b2c289dc7cdb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:51:27.413354 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-3e965247-f2e8-4d98-b3b9-1eef466a11c0 req-8e99db35-d246-4f21-85f6-b2c289dc7cdb service nova] Creating event network-changed:f8f8e4da-5266-47ce-a3c8-4b5c15db674e for instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd on n-h1-858384-17 Oct 31 16:51:27.418392 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-3e965247-f2e8-4d98-b3b9-1eef466a11c0 req-8e99db35-d246-4f21-85f6-b2c289dc7cdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031997 Oct 31 16:51:27.419445 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3934/7731] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:52:54.606898 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:52:54.607705 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=54 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:52:54.608898 n-d-858384-17 devstack@n-api.service[120588]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:52:54.609163 n-d-858384-17 devstack@n-api.service[120588]: Mon Oct 31 16:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd/action (ip 10.222.0.20) !!! Oct 31 16:52:54.621068 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-17a26e19-d20d-4503-bf5a-a38e187d7be9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-265449002"}} {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:52:54.623418 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-17a26e19-d20d-4503-bf5a-a38e187d7be9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:52:54.630992 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a26e19-d20d-4503-bf5a-a38e187d7be9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:52:54.631493 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a26e19-d20d-4503-bf5a-a38e187d7be9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:52:54.631942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a26e19-d20d-4503-bf5a-a38e187d7be9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:52:54.632647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a26e19-d20d-4503-bf5a-a38e187d7be9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:52:54.633144 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a26e19-d20d-4503-bf5a-a38e187d7be9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:52:54.633585 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-17a26e19-d20d-4503-bf5a-a38e187d7be9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:52:54.837955 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-17a26e19-d20d-4503-bf5a-a38e187d7be9 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "POST /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd/action" status: 202 len: 0 microversion: 2.1 time: 0.232931 Oct 31 16:52:54.838571 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3798/7732] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Oct 31 16:52:54 2022] POST /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 31 16:52:59.316520 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_api:SELECT=26 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:52:59.317587 n-d-858384-17 devstack@n-api.service[120587]: DEBUG dbcounter [-] [120587] Writing DB stats nova_cell1:SELECT=52 {{(pid=120587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:52:59.319004 n-d-858384-17 devstack@n-api.service[120587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 31 16:52:59.319411 n-d-858384-17 devstack@n-api.service[120587]: Mon Oct 31 16:52:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.20) !!! Oct 31 16:52:59.330610 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-89ded359-fc14-4cb5-889d-0af39ca03902 req-d79fa7d2-d66c-4248-aa86-6f36425809aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd", "name": "network-vif-plugged", "status": "completed", "tag": "f8f8e4da-5266-47ce-a3c8-4b5c15db674e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:52:59.344297 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-89ded359-fc14-4cb5-889d-0af39ca03902 req-d79fa7d2-d66c-4248-aa86-6f36425809aa service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:52:59.345074 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-89ded359-fc14-4cb5-889d-0af39ca03902 req-d79fa7d2-d66c-4248-aa86-6f36425809aa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:52:59.346022 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-89ded359-fc14-4cb5-889d-0af39ca03902 req-d79fa7d2-d66c-4248-aa86-6f36425809aa service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:52:59.363055 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-89ded359-fc14-4cb5-889d-0af39ca03902 req-d79fa7d2-d66c-4248-aa86-6f36425809aa service nova] Creating event network-vif-plugged:f8f8e4da-5266-47ce-a3c8-4b5c15db674e for instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd on n-h1-858384-17 Oct 31 16:52:59.368883 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-89ded359-fc14-4cb5-889d-0af39ca03902 req-d79fa7d2-d66c-4248-aa86-6f36425809aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056158 Oct 31 16:52:59.369909 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3935/7733] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:53:08.435690 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_api:SELECT=2 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:53:08.439197 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-88837340-788e-4451-a399-464dd61e4856 req-319d5e65-80bd-43f0-8e88-27dc6b316b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd", "tag": "f8f8e4da-5266-47ce-a3c8-4b5c15db674e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:53:08.439970 n-d-858384-17 devstack@n-api.service[120588]: DEBUG dbcounter [-] [120588] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120588) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 31 16:53:08.444549 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:08.456103 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88837340-788e-4451-a399-464dd61e4856 req-319d5e65-80bd-43f0-8e88-27dc6b316b0b service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:08.457147 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:08.464882 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:08.465995 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:08.466820 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88837340-788e-4451-a399-464dd61e4856 req-319d5e65-80bd-43f0-8e88-27dc6b316b0b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:08.467340 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:08.468136 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:08.468620 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-88837340-788e-4451-a399-464dd61e4856 req-319d5e65-80bd-43f0-8e88-27dc6b316b0b service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:08.473687 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:08.474221 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:08.495870 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-88837340-788e-4451-a399-464dd61e4856 req-319d5e65-80bd-43f0-8e88-27dc6b316b0b service nova] Creating event network-changed:f8f8e4da-5266-47ce-a3c8-4b5c15db674e for instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd on n-h1-858384-17 Oct 31 16:53:08.502700 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-88837340-788e-4451-a399-464dd61e4856 req-319d5e65-80bd-43f0-8e88-27dc6b316b0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070180 Oct 31 16:53:08.503916 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3936/7734] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:53:08.508821 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:53:08.607637 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-cb493a5b-e60c-42fe-85bb-b30cd64c7afc tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 204 len: 0 microversion: 2.1 time: 0.175835 Oct 31 16:53:08.607637 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3799/7735] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:53:08 2022] DELETE /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:53:08.616711 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:08.617814 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:08.625858 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:08.626448 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:08.626963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:08.627783 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:08.628326 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:08.628828 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:08.815977 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:08.823932 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-7f02746d-2664-461c-a200-790edcfb875e tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1685 microversion: 2.1 time: 0.211750 Oct 31 16:53:08.824663 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3937/7736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:08 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1685 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:09.849224 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:09.849942 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:09.856862 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:09.857396 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:09.857842 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:09.858548 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:09.859107 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:09.859638 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:09.997273 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:10.005163 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-503eb8a2-8f48-4ce6-a077-d612b4057b0a tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1685 microversion: 2.1 time: 0.160264 Oct 31 16:53:10.017306 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3800/7737] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:09 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:10.572137 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-5db7f146-ddfb-47c8-83fa-ea57ffc0fa00 req-8ba26af3-a9fb-437d-8327-bd6ddaea7550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd", "name": "network-vif-deleted", "tag": "f8f8e4da-5266-47ce-a3c8-4b5c15db674e"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:53:10.584015 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5db7f146-ddfb-47c8-83fa-ea57ffc0fa00 req-8ba26af3-a9fb-437d-8327-bd6ddaea7550 service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:10.584522 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5db7f146-ddfb-47c8-83fa-ea57ffc0fa00 req-8ba26af3-a9fb-437d-8327-bd6ddaea7550 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:10.584944 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-5db7f146-ddfb-47c8-83fa-ea57ffc0fa00 req-8ba26af3-a9fb-437d-8327-bd6ddaea7550 service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:10.598639 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-5db7f146-ddfb-47c8-83fa-ea57ffc0fa00 req-8ba26af3-a9fb-437d-8327-bd6ddaea7550 service nova] Creating event network-vif-deleted:f8f8e4da-5266-47ce-a3c8-4b5c15db674e for instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd on n-h1-858384-17 Oct 31 16:53:10.603626 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-5db7f146-ddfb-47c8-83fa-ea57ffc0fa00 req-8ba26af3-a9fb-437d-8327-bd6ddaea7550 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035131 Oct 31 16:53:10.604277 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3938/7738] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:53:11.030070 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:11.030707 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:11.037583 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:11.038097 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:11.038536 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:11.039244 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:11.039720 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:11.040254 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:11.074424 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:11.075037 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:11.075782 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:11.076252 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lazy-loading 'fault' on Instance uuid f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:53:11.117860 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:11.125857 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-540325de-2e91-4044-8ea3-0058a10df266 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 200 len: 1339 microversion: 2.1 time: 0.100119 Oct 31 16:53:11.126444 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3801/7739] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:11 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:12.150292 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:12.150985 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:12.157214 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:12.157697 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:12.158130 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:12.158809 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:12.159262 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:12.159681 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:12.173205 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] HTTP exception thrown: Instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd could not be found. Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Request method failure captured: Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd HTTP/1.1 Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_xky4EegeS-QcRFj_SmwhiQm2dXuM260EY4yUs6zRiYAHE3S8U-mcHeeSa0kqvGYc4mFxVECXZTftsMIJ4ptDAPXkbVHCwIlnqgMIesmj1cDYq7HckKLyjKtJq_y4pOTrEnjAbgAqJgmCbSdEICBYkVS_87itF2yku0_5B3Nftu-kM Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 34ca506854ba46c58e0ed62f668add58 Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestSnapshotPattern-556890373 Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34ca506854ba46c58e0ed62f668add58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34ca506854ba46c58e0ed62f668add58", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34ca506854ba46c58e0ed62f668add58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34ca506854ba46c58e0ed62f668add58"}]}] Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestSnapshotPattern-556890373 Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 34ca506854ba46c58e0ed62f668add58 Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestSnapshotPattern-556890373 Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestSnapshotPattern-556890373-project Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 306a9bd806764e3a859221651cec0ada Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestSnapshotPattern-556890373-project Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd could not be found. Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': 'f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd'} Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd could not be found. Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd could not be found. Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:53:12.175198 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd could not be found. Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Returning 404 to user: Instance f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-65acb443-1aa1-4553-ae82-ac690bde778c tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd" status: 404 len: 111 microversion: 2.1 time: 0.031425 Oct 31 16:53:12.181227 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3939/7740] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:12 2022] GET /compute/v2.1/servers/f16b9ca6-0dc3-416e-a426-6e10e2b9d3bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:53:13.516182 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:13.516689 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:13.519363 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-7b39d86f-870d-4484-a646-8193075b8f61 req-7fc6be47-7382-4aed-b817-ec0f6f743ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b7418c-aaea-4aaa-9bec-eeacd47e6cab", "tag": "a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:53:13.524039 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:13.524637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:13.525218 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:13.526338 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:13.526637 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:13.527151 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:13.531833 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7b39d86f-870d-4484-a646-8193075b8f61 req-7fc6be47-7382-4aed-b817-ec0f6f743ddb service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:13.532600 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7b39d86f-870d-4484-a646-8193075b8f61 req-7fc6be47-7382-4aed-b817-ec0f6f743ddb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:13.533249 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-7b39d86f-870d-4484-a646-8193075b8f61 req-7fc6be47-7382-4aed-b817-ec0f6f743ddb service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:13.544773 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-7b39d86f-870d-4484-a646-8193075b8f61 req-7fc6be47-7382-4aed-b817-ec0f6f743ddb service nova] Creating event network-changed:a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2 for instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab on n-h2-858384-17 Oct 31 16:53:13.550012 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-7b39d86f-870d-4484-a646-8193075b8f61 req-7fc6be47-7382-4aed-b817-ec0f6f743ddb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035416 Oct 31 16:53:13.550622 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3940/7741] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:53:13.561750 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Going to try to terminate instance {{(pid=120588) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 31 16:53:13.656362 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-a96431a8-f8a6-4c2d-ad40-5d93194c0dae tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 204 len: 0 microversion: 2.1 time: 0.144057 Oct 31 16:53:13.657399 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3802/7742] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Oct 31 16:53:13 2022] DELETE /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 31 16:53:13.667632 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:13.669805 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:13.676250 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:13.676962 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:13.677657 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:13.678541 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:13.679162 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:13.679868 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:13.825963 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.policy [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120587) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:13.833900 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-0c3b4d59-6190-41a3-973a-c8696805db68 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1684 microversion: 2.1 time: 0.171767 Oct 31 16:53:13.834479 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3941/7743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:13 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:14.858035 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:14.858770 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:14.865891 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:14.866385 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:14.866858 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:14.867563 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:14.868026 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:14.868455 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:15.001927 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:15.009634 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-122e4b3d-f626-4954-adcf-7814d4d350df tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1684 microversion: 2.1 time: 0.155908 Oct 31 16:53:15.010212 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3803/7744] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:14 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:15.879092 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [req-23879755-a68b-45e3-90d3-5c58fe52c989 req-968117c6-2ea7-4778-92d1-b740ccca732d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b7418c-aaea-4aaa-9bec-eeacd47e6cab", "name": "network-vif-deleted", "tag": "a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2"}]} {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 31 16:53:15.890064 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-23879755-a68b-45e3-90d3-5c58fe52c989 req-968117c6-2ea7-4778-92d1-b740ccca732d service nova] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:15.890555 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-23879755-a68b-45e3-90d3-5c58fe52c989 req-968117c6-2ea7-4778-92d1-b740ccca732d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:15.890983 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [req-23879755-a68b-45e3-90d3-5c58fe52c989 req-968117c6-2ea7-4778-92d1-b740ccca732d service nova] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:15.902699 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.compute.server_external_events [req-23879755-a68b-45e3-90d3-5c58fe52c989 req-968117c6-2ea7-4778-92d1-b740ccca732d service nova] Creating event network-vif-deleted:a7943aaa-b7a2-415e-be9c-a5b9c1fab6f2 for instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab on n-h2-858384-17 Oct 31 16:53:15.907564 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [req-23879755-a68b-45e3-90d3-5c58fe52c989 req-968117c6-2ea7-4778-92d1-b740ccca732d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032670 Oct 31 16:53:15.908189 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3942/7745] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Oct 31 16:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 31 16:53:16.033606 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:16.034324 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.compute.api [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120588) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:16.041110 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:16.041647 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:16.042101 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:16.042815 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:16.043291 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:16.043812 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:16.077611 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:16.078172 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:16.078578 n-d-858384-17 devstack@n-api.service[120588]: DEBUG oslo_concurrency.lockutils [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120588) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:16.079041 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.objects.instance [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lazy-loading 'fault' on Instance uuid 92b7418c-aaea-4aaa-9bec-eeacd47e6cab {{(pid=120588) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 31 16:53:16.120602 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.policy [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '306a9bd806764e3a859221651cec0ada', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ca506854ba46c58e0ed62f668add58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120588) authorize /opt/stack/nova/nova/policy.py:199}} Oct 31 16:53:16.128972 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-31d1d598-58d7-4b4b-8c6c-9cef3c3c1af7 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 200 len: 1339 microversion: 2.1 time: 0.099263 Oct 31 16:53:16.129591 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3804/7746] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:16 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 31 16:53:17.154848 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '>' {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:17.155551 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.compute.api [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] [instance: 92b7418c-aaea-4aaa-9bec-eeacd47e6cab] Fetching instance by UUID {{(pid=120587) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 31 16:53:17.161792 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:17.162306 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:17.162742 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:17.163436 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Acquiring lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 31 16:53:17.163896 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 31 16:53:17.164322 n-d-858384-17 devstack@n-api.service[120587]: DEBUG oslo_concurrency.lockutils [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Lock "0e0c29d5-7fdf-4375-a488-5ccb57653ff7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120587) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 31 16:53:17.178256 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.wsgi [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] HTTP exception thrown: Instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab could not be found. Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Request method failure captured: Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: request: GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab HTTP/1.1 Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: Accept: application/json Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: Accept-Encoding: identity Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: Connection: close Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: Content-Length: 0 Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: Content-Type: application/json Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: Host: 10.222.0.20 Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: Openstack-System-Scope: None Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: User-Agent: python-urllib3/1.26.12 Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Auth-Token: gAAAAABjX_xky4EegeS-QcRFj_SmwhiQm2dXuM260EY4yUs6zRiYAHE3S8U-mcHeeSa0kqvGYc4mFxVECXZTftsMIJ4ptDAPXkbVHCwIlnqgMIesmj1cDYq7HckKLyjKtJq_y4pOTrEnjAbgAqJgmCbSdEICBYkVS_87itF2yku0_5B3Nftu-kM Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Id: None Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Domain-Name: None Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Identity-Status: Confirmed Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Is-Admin-Project: True Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Id: default Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Domain-Name: Default Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Id: 34ca506854ba46c58e0ed62f668add58 Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Project-Name: tempest-TestSnapshotPattern-556890373 Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Role: reader,member Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Roles: reader,member Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34ca506854ba46c58e0ed62f668add58"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_34ca506854ba46c58e0ed62f668add58", "adminURL": "http://10.222.0.20:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/34ca506854ba46c58e0ed62f668add58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/34ca506854ba46c58e0ed62f668add58"}]}] Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant: tempest-TestSnapshotPattern-556890373 Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Id: 34ca506854ba46c58e0ed62f668add58 Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-Tenant-Name: tempest-TestSnapshotPattern-556890373 Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-User: tempest-TestSnapshotPattern-556890373-project Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Id: default Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-User-Domain-Name: Default Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-User-Id: 306a9bd806764e3a859221651cec0ada Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: X-User-Name: tempest-TestSnapshotPattern-556890373-project Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: method: > Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: exception: Instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab could not be found. Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: action_args: {'id': '92b7418c-aaea-4aaa-9bec-eeacd47e6cab'} Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: {{(pid=120587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab could not be found. Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab could not be found. Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 31 16:53:17.179907 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab could not be found. Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: ERROR nova.api.openstack.wsgi Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: DEBUG nova.api.openstack.wsgi [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Returning 404 to user: Instance 92b7418c-aaea-4aaa-9bec-eeacd47e6cab could not be found. {{(pid=120587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: INFO nova.api.openstack.requestlog [None req-c473576d-8110-430a-befb-9460bb294877 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab" status: 404 len: 111 microversion: 2.1 time: 0.031564 Oct 31 16:53:17.186003 n-d-858384-17 devstack@n-api.service[120587]: [pid: 120587|app: 0|req: 3943/7747] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Oct 31 16:53:17 2022] GET /compute/v2.1/servers/92b7418c-aaea-4aaa-9bec-eeacd47e6cab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 31 16:53:17.342941 n-d-858384-17 devstack@n-api.service[120588]: DEBUG nova.api.openstack.wsgi [None req-be39e27c-7af1-476b-8241-2921450d2787 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] Calling method '.version_select at 0x7f16d87f09d0>' {{(pid=120588) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 31 16:53:17.368303 n-d-858384-17 devstack@n-api.service[120588]: INFO nova.api.openstack.requestlog [None req-be39e27c-7af1-476b-8241-2921450d2787 tempest-TestSnapshotPattern-556890373 tempest-TestSnapshotPattern-556890373-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1066071693" status: 202 len: 0 microversion: 2.1 time: 0.029873 Oct 31 16:53:17.368947 n-d-858384-17 devstack@n-api.service[120588]: [pid: 120588|app: 0|req: 3805/7748] 10.222.0.20 () {58 vars in 1257 bytes} [Mon Oct 31 16:53:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1066071693 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)